Be an Early Applicant
A leading global provider of business decisioning data and analytics for almost 200 years.
The Role
The Senior Software Engineer will design and develop scalable data pipelines, manage cloud infrastructures, and optimize Big Data architectures.
Summary Generated by Built In
Why We Work at Dun & Bradstreet
Dun & Bradstreet unlocks the power of data through analytics, creating a better tomorrow. Each day, we are finding new ways to strengthen our award-winning culture and accelerate creativity, innovation and growth. Our 6,000+ global team members are passionate about what we do. We are dedicated to helping clients turn uncertainty into confidence, risk into opportunity and potential into prosperity. Bold and diverse thinkers are always welcome. Come join us! Learn more at dnb.com/careers.
About Us:
Our global community of colleagues bring a diverse range of experiences and perspectives to our work. You'll find us working from a corporate office or plugging in from a home desk, listening to our customers and collaborating on solutions. Our products and solutions are vital to businesses of every size, scope and industry. And at the heart of our work you’ll find our core values: to be data inspired, relentlessly curious and inherently generous. Our values are the constant touchstone of our community; they guide our behavior and anchor our decisions.
KEY RESPONSIBILITIES:
- Design and Develop Data Pipelines:
- Architect, build, and deploy scalable and efficient data pipelines within our Big Data ecosystem using Apache Spark and Apache Airflow.
- Document new and existing pipelines and datasets to ensure clarity and maintainability.
- Data Architecture and Management:
- Demonstrate familiarity with data pipelines, data lakes, and modern data warehousing practices, including virtual data warehouses and push-down analytics.
- Design and implement distributed data processing solutions using technologies like Apache Spark and Hadoop.
- Programming and Scripting:
- Exhibit expert-level programming skills in Python, with the ability to write clean, efficient, and maintainable code.
- Cloud Infrastructure:
- Utilize cloud-based infrastructures (AWS/GCP) and their various services, including compute resources, databases, and data warehouses.
- Manage and optimize cloud-based data infrastructure, ensuring efficient data storage and retrieval.
- Workflow Orchestration:
- Develop and manage workflows using Apache Airflow for scheduling and orchestrating data processing jobs.
- Create and maintain Apache Airflow DAGs for workflow orchestration.
- Big Data Architecture:
- Possess strong knowledge of Big Data architecture, including cluster installation, configuration, monitoring, security, resource management, maintenance, and performance tuning.
- Innovation and Optimization:
- Create detailed designs and proof-of-concepts (POCs) to enable new workloads and technical capabilities on the platform.
- Collaborate with platform and infrastructure engineers to implement these capabilities in production.
KEY REQUIREMENTS:
- Minimum of 8 years hands-on experience with Big Data technologies e.g. Hadoop, Spark, Hive.
- Minimum 3+ years of experience on Spark
- Hands on experience with dataproc is a HUGE plus.
- Minimum 6 years of experience in Cloud environments, preferably GCP
- Any experience with NoSQL and Graph databases
- Hands on experience with managing solutions deployed in the Cloud, preferably on AWS
- Experience working in a Global company, working in a DevOps model is a plus
All Dun & Bradstreet job postings can be found at https://www.dnb.com/about-us/careers-and-people/joblistings.html and https://jobs.lever.co/dnb. Official communication from Dun & Bradstreet will come from an email address ending in @dnb.com.
Notice to Applicants: Please be advised that this job posting page is hosted and powered by Lever. Your use of this page is subject to Lever's Privacy Notice and Cookie Policy, which governs the processing of visitor data on this platform.
Top Skills
Apache Airflow
Spark
AWS
GCP
Graph Databases
Hadoop
NoSQL
Python
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
For almost 200 years, Dun & Bradstreet has helped clients and partners grow and thrive through the power of data, analytics, and data-driven solutions. Our more than 6,000 employees around the world are dedicated to this unique purpose, and we are guided by important values that make us the established leader in business decisioning data and analytical insights. Our data & insights are valuable at all phases of a business lifecycle and whatever the economic environment.
Why Work With Us
We are at a transformational moment in our company journey, and we’re excited about it. Each day, we are taking steps to transform our culture into one that activates our people’s best work, exploring what needs to change to accelerate creativity and innovation, and challenging ourselves to think differently about how we interact.
Gallery
