Senior Data Engineer

For decades, DTN has been the silent force behind some of the world’s most critical industries—helping businesses navigate complexity, uncertainty, and risk with smarter, faster decisions. From agriculture to energy to weather intelligence, our proprietary Operational Decisioning Platform transforms raw data into decision-grade insights—enabling companies to optimize supply chains, ensure market stability, and safeguard infrastructure against disruption. We don’t follow trends—we set the standard for precision, trust, and operational impact. 

DTN is at an exciting inflection point. Building off a foundation of financial strength, profitability, and industry trust, we’re accelerating growth and expanding our global footprint. Our purpose-built solutions—powered by AI and honed by decades of vertical expertise—are helping some of the world’s most significant enterprises thrive amid operational constraints and uncover new opportunities in a fast-changing world.

Job Description:

We are seeking a Senior Data Engineer who possesses a strong drive for results. In this role, you will be responsible for ensuring the ingestion, quality, integrity, and reliability of our data engineering processes and outputs and helping lead key architecture change within DTN, while providing expert support to our customers and internal teams.

What You’ll Do: 

• Lead and architect the delivery of trusted data sets and services from complex data sources and environments for DTN partners and customers.

• Design and implement our modern data and analytic architecture, establishing best practices for data management, integration, and acquisition patterns and pipelines.

• Provide expert-level support to DTN partners and customers, solving complex technical issues with data infrastructure and environments.

• Drive continuous improvement initiatives for data management practices, patterns, and standards across the organization.

• Develop and maintain comprehensive documentation for data engineering practices and standards, promoting broader adoption and consistency across teams.

• Oversee and ensure DTN's data governance and security practices are implemented at the highest standards.

• Lead initiatives to identify and improve internal processes by designing innovative data management and infrastructure solutions that enhance capabilities, reduce costs and complexity, and drive automation.

• Architect and develop enterprise-wide reference documentation, patterns, SODs, and reference architectures that enable specific fit-for-purpose needs and set the overall direction in the Data and Analytics domain.

• Mentor junior data engineers and provide technical leadership to cross-functional teams.

What You Need:

• Minimum 7 years of data engineering experience, with a strong background in pipelines, ingest, and ETL/ELT processes, and expert-level knowledge of databases, including Oracle and Postgres

• Minimum 5 years and deep expertise in AWS cloud services and architecture

• Advanced competency and extensive work experience with the following technical skills:

  • Apache Airflow or other workflow tools

  • PySpark, Amazon Elastic Map Reduce (EMR)

  • Lakehouse architectures with AWS S3 Tables, LakeFormation, and Apache Iceberg

  • Docker, Kubernetes

  • Terraform, Liquibase, GitLab pipelines, source control and versioning using Git

  • Data quality with tools like Great Expectations

  • Python for data development (and ideally API & Web development)

• Advanced data preparation techniques using ETL / SQL processing

• Expert consuming both REST and GraphQL APIs

What Will Make You Stand Out:

• Geospatial processing with PostGIS and Apache Sedona

• Deep experience deploying with Data Engineering best practices and a track record of implementing these

• Deep experience processing and deploying large datasets efficiently

• Deep technical understanding of relational and non-relational databases

• A customer focus and understanding of who consumes the data downstream and the value it brings

• A leadership mindset, leading change, mentoring others, working effectively across groups

• Ability to work and thrive in a fast-paced environment, learn rapidly, and master diverse web technologies and techniques

• Able to communicate effectively to a wide range of audiences and levels

About DTN:

DTN is a global data and technology company helping operational leaders in energy, agriculture, and weather-driven industries make faster, smarter decisions. Our Operational Decisioning Platform turns complex data into decision-grade insights—empowering customers to expand their margins, accelerate growth, and outpace risk. With more than 1,200 employees globally, DTN serves the companies that feed, fuel, and protect the world. 

At DTN, we value clarity, trust, and action. We’re a team of problem-solvers, outcome-drivers, and industry nerds who believe that precision matters – and that mission is at the core of what we do.

• Trust Built: We earn it. We keep it. We protect it. Our neutrality, precision, and integrity are non-negotiable.

• Confidence-Driven: We help customers move with clarity and conviction. We bring the data and operational knowledge leaders need to act.

• Built for Industry: We speak operations because we come from operations. Our expertise is forged in fuel terminals, fields, flight paths, and forecasts.

• Future-Forward: We see what’s coming- and we’re ready. We help customers lead through change with smarter decisioning.

Recruitment Fraud Notice:

DTN is aware of incidents where external parties have impersonated our organization, issuing fraudulent communications and/or job offers. Please be advised that all legitimate communication from DTN will come from an official @dtn.com email address or through our Paradox AI automated scheduling platform (Talent IQ). Any offers are extended directly by our Talent Acquisition team following a formal interview process. 

If you receive a suspicious message or offer claiming to be from DTN, please do not engage. Contact our Talent Acquisition team at [email protected] to verify the legitimacy of any communication. Report any fraudulent messaging as phishing or spam.

DTN is an Equal Opportunity Employer. We welcome and encourage applicants of all backgrounds, including minorities, women, veterans, and individuals with disabilities.