Manager, Data Engineering

Reposted 21 Days Ago
Be an Early Applicant
Atlanta, GA, USA
In-Office
Senior level
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Reimagining what's possible for food and agriculture
The Role
Lead a team to design, build, and maintain scalable cloud and big-data systems. Oversee streaming and batch pipelines, data architectures, ingestion, transformation (Spark), modeling, deployment pipelines, and stakeholder collaboration to deliver robust data products and analytics-ready platforms.
Summary Generated by Built In
Cargill's size and scale allows us to make a positive impact in the world. Our purpose is to nourish the world in a safe, responsible and sustainable way. We are a family company providing food, ingredients, agricultural solutions and industrial products that are vital for living. We connect farmers with markets so they can prosper. We connect customers with ingredients so they can make meals people love. And we connect families with daily essentials - from eggs to edible oils, salt to skincare, feed to alternative fuel. Our 160,000 colleagues, operating in 70 countries, make essential products that touch billions of lives each day. Join us and reach your higher purpose at Cargill.
Job Purpose and Impact
The Manager, Data Engineering job sets goals and objectives for the achievement of operational results for the team responsible for designing, building and maintaining robust data systems that enable data analysis and reporting. This job leads implementing the end to end process to ensure that large sets of data are efficiently processed and made accessible for decision making.
Essential Functions
  • DATA & ANALYTICAL SOLUTIONS: Oversees the development of data products and solutions using big data and cloud based technologies, ensuring they are designed and built to be scalable, sustainable and robust.
  • DATA PIPELINES: Develops and monitors streaming and batch data pipelines that facilitate the seamless ingestion of data from various data sources, transform the data into information and move to data stores like data lake, data warehouse and others.
  • DATA SYSTEMS: Reviews existing data systems and architectures to lead identification of areas for improvement and optimization.
    DATA INFRASTRUCTURE: Oversees the preparation of data infrastructure to drive the efficient storage and retrieval of data.
  • DATA FORMATS: Reviews and resolves appropriate data formats to improve data usability and accessibility across the organization.
  • STAKEHOLDER MANAGEMENT: Partners collaboratively with multi-functional data and advanced analytic teams to capture requirements and ensure that data solutions meet the functional and non-functional needs of various partners.
  • DATA FRAMEWORKS: Builds complex prototypes to test new concepts and provides guidance to implement data engineering frameworks and architectures that improve data processing capabilities and support advanced analytics initiatives.
  • AUTOMATED DEPLOYMENT PIPELINES: Oversees the development of automated deployment pipelines improving efficiency of code deployments with fit for purpose governance.
  • DATA MODELING: Guides the team to perform data modeling in accordance to the datastore technology to ensure sustainable performance and accessibility.
  • TEAM MANAGEMENT: Manages team members to achieve the organization's goals, by ensuring productivity, communicating performance expectations, creating goal alignment, giving and seeking feedback, providing coaching, measuring progress and holding people accountable, supporting employee development, recognizing achievement and lessons learned, and developing enabling conditions for talent to thrive in an inclusive team culture.

Qualifications
Minimum requirement of 4 years of relevant work experience. Typically reflects 5 years or more of relevant experience.
Preferred Qualifications
  • DATA ENGINEERING: Experience with data engineering on corporate finance data is strongly preferred.
  • CLOUD ENVIRONMENTS: Familiarity with major cloud platforms (AWS, GCP, Azure).
  • DATA ARCHITECTURE: Experience with modern data architectures, including data lakes, data lakehouses, and data hubs, along with related capabilities such as ingestion, governance, modeling, and observability.
  • DATA INGESTION: Proficiency in data collection, ingestion tools (Kafka, AWS Glue), and storage formats (Iceberg, Parquet).
  • DATA STREAMING: Knowledge of streaming architectures and tools (Kafka, Flink).
    DATA MODELING: Strong background in data transformation and modeling using SQL-based frameworks and orchestration tools (dbt, AWS Glue, Airflow). Experience with modeling concepts like SCD and schema evolution.
  • DATA TRANSFORMATION: Familiarity with using Spark for data transformation, including streaming, performance tuning, and debugging with Spark UI.
  • PROGRAMMING: Proficient with programming in Python, Java, Scala, or similar languages. Expert-level proficiency in SQL for data manipulation and optimization.
  • DEVOPS: Demonstrated experience in DevOps practices, including code management, CI/CD, and deployment strategies.
  • DATA GOVERNANCE: Understanding of data governance principles, including data quality, privacy, and security considerations for data product development and consumption.

The business will not sponsor work visas for applicants for this position.
#HiPo
Equal Opportunity Employer, including Disability/Vet.
To apply using chat/text, please click Apply Now button OR use this link to create a login to apply.

Skills Required

  • Minimum of 4 years relevant work experience (typically reflects 5+ years)
  • Proficient programming in Python, Java, Scala or similar
  • Expert-level proficiency in SQL
  • Experience with data engineering on corporate finance data
  • Familiarity with major cloud platforms (AWS, GCP, Azure)
  • Experience with modern data architectures (data lakes, lakehouses, data hubs)
  • Experience with data ingestion tools (Kafka, AWS Glue) and storage formats (Iceberg, Parquet)
  • Knowledge of streaming architectures and tools (Kafka, Flink)
  • Data transformation using Spark, including streaming, tuning, and debugging
  • Data modeling and orchestration experience (SQL-based frameworks, dbt, AWS Glue, Airflow); SCD and schema evolution
  • DevOps practices experience including code management, CI/CD, and deployment strategies
  • Understanding of data governance, data quality, privacy, and security for data products

What the Team is Saying

Gaby
Landon
Navita
William Orgertrice
Kayode D.
Patricia
Heather W.
Kristen K.
Shrey B.
Madhuri P.
William Orgertrice
Navita S.
Heather W.

Cargill Compensation & Benefits Highlights

  • Retirement Support Two-layer retirement program combines a 401(k) match (100% on the first 3%, 50% on the next 2%) with an employer-funded Employee Retirement Account of roughly 2.5–7% based on age and service. Match is delivered quarterly in company stock and the ERA adds long-term value through additional employer contributions.
  • Leave & Time Off Breadth PTO starts at 15 days and scales to 30 days with tenure, governed by a clear June 1–May 31 cycle. This structured ladder provides predictable time away as service grows.
  • Parental & Family Support Paid family leave offers up to 6 weeks to bond with a new child and 4 weeks to care for a family member or qualifying military needs. Additional supports such as Bright Horizons childcare solutions and Milk Stork reinforce family care.

Cargill Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Wayzata, MN
155,000 Employees
Year Founded: 1865

What We Do

We are a family company providing food, ingredients, agricultural solutions and industrial products to nourish the world in a safe, responsible and sustainable way. We connect farmers with markets so they can prosper. We connect customers with ingredients so they can make meals people love. And we connect families with daily essentials— from eggs to edible oils, salt to skincare, feed to flooring. By providing customers with products that are vital for living, we help businesses grow, communities prosper and consumers live well in their daily lives.

Why Work With Us

The decision to join Cargill can open the door to a world of possibility. As part of our Digital, Technology & Data team, you’ll get to be part of a large and diverse group full of unique perspectives united by a common, higher purpose while building a rewarding career full of opportunity, growth and the satisfaction of knowing your work matters.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Cargill Teams

Team
Data Engineering
Team
Atlanta
Team
Bengaluru
About our Teams

Cargill Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Typical time on-site: Not Specified
Company Office Image
HQCargill Office Center
Company Office Image
Atlanta, GA
Company Office Image
Bengaluru, Karnataka
Learn more

Similar Jobs

Cargill Logo Cargill

Manager, Application Developement - Food

Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
In-Office
Atlanta, GA, USA
155000 Employees

Cargill Logo Cargill

Manager, Application Development - ERP

Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
In-Office
Atlanta, GA, USA
155000 Employees

Cargill Logo Cargill

Senior Software Engineer

Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
In-Office
Atlanta, GA, USA
155000 Employees

Cargill Logo Cargill

Senior Application Engineer

Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
In-Office
Atlanta, GA, USA
155000 Employees
95K-152K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account