Cargill Jobs

Senior Data Engineer

Cargill

Senior Data Engineer

Posted Yesterday

Be an Early Applicant

Bengaluru, Bengaluru Urban, Karnataka, IND

In-Office

Senior level

Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial

Reimagining what's possible for food and agriculture

The Role

Designs, builds, and operates scalable AWS-based batch and streaming data pipelines and platforms (Lakehouse and warehouse). Owns architecture, performance, security, and cost optimization; implements transformations (SQL/dbt, PySpark), Kafka ingestion, Airflow orchestration, and CI/CD/Terraform. Partners with product and platform teams, mentors engineers, and drives data modeling, schema evolution, and operational excellence.

Summary Generated by Built In

Job Purpose and Impact

The Senior Data Engineer designs, builds, and operates scalable, reliable data products and platforms that power analytics, reporting, and downstream applications. This role owns end‑to‑end delivery of batch and streaming data pipelines on a modern AWS‑based cloud data platform, applying strong engineering patterns to ensure performance, security, observability, and cost efficiency.
With minimal supervision, the role partners closely with product, analytics, and platform teams to translate business requirements into robust technical solutions across a Lakehouse (Iceberg) and approved warehousing platforms (e.g., Snowflake). The Senior Data Engineer also mentors other engineers, drives code quality, and raises the engineering bar across the organization.

Key Accountabilities

Data & Analytical Solutions
- Designs and delivers scalable data products using standard cloud and data engineering architectures.
- Owns technical decisions (batch vs. streaming, Lakehouse vs. warehouse) and ensures solutions meet reliability, security, governance, latency, and cost requirements.
- Reviews designs and contributes reusable components, templates, and standards.
Data Pipelines
- Builds and operates end‑to‑end batch and streaming pipelines.
- Implements transformations using SQL/dbt and PySpark as needed.
- Integrates real‑time or event‑driven ingestion using Kafka.
- Orchestrates workflows with Airflow; establishes SLAs/SLOs and CI/CD‑based deployments.
Data Systems & Architecture
- Optimizes data architectures for performance, scalability, and cost.
- Applies best practices for Iceberg table design, incremental processing, and query optimization across Hive, Impala, Snowflake, and RDBMS.
- Diagnoses systemic issues and drives remediation with platform teams.
Data Infrastructure (AWS)
- Leads technical readiness across dev/test/prod environments.
- Works hands‑on with AWS services including S3, Glue, Lambda, IAM, and SageMaker.
- Partners with governance and platform teams on access control, tagging, and operational support.
Data Modeling & Formats
- Leads modeling across RAW, CURATED, and SERVING layers.
- Applies dimensional or normalized models for correctness, performance, and usability.
- Implements efficient formats (Parquet + Iceberg) with clear schema evolution strategies.
DevOps & CI/CD
- Designs and improves Git‑based CI/CD pipelines and infrastructure‑as‑code using Terraform.
- Ensures quality gates, auditability, and compliance with governance requirements.
Stakeholder & Engineering Leadership
- Partners with product, analytics, and platform teams to align on requirements, data contracts, and SLAs.
- Communicates complex technical topics clearly and leads technical discussions.
- Coaches engineers and raises engineering standards through reviews and documentation.
AI‑First & Product Mindset
- Uses GenAI‑assisted development responsibly to accelerate delivery.
- Builds products, not just pipelines, focusing on usability, adoption, reliability, and lifecycle ownership.
- Designs systems end‑to‑end and continuously optimizes cost‑performance trade‑offs using metrics.

Qualifications

8+ years of total experience with 6+ years of Data Engineering experience.
Strong expertise in AWS‑based data engineering and scalable cloud architectures
Proven experience building end‑to‑end batch and streaming pipelines, including Kafka
Advanced proficiency in SQL, Hive, Impala, and PostgreSQL / RDBMS
Strong programming skills in Python and PySpark
Hands‑on experience with AWS Glue, Lambda, S3, IAM, and SageMaker
Experience with Snowflake and modern data warehousing
Expertise in CI/CD, Terraform, and DevOps practices
Proficiency in Airflow for workflow orchestration
Experience with Power BI for data visualization and reporting
Strong foundation in data modeling, performance optimization, and large‑scale data systems

Skills Required

8+ years of total experience with 6+ years of Data Engineering experience
Strong expertise in AWS-based data engineering and scalable cloud architectures
Proven experience building end-to-end batch and streaming pipelines, including Kafka
Advanced proficiency in SQL, Hive, Impala, and PostgreSQL / RDBMS
Strong programming skills in Python and PySpark
Hands-on experience with AWS Glue, Lambda, S3, IAM, and SageMaker
Experience with Snowflake and modern data warehousing
Expertise in CI/CD, Terraform, and DevOps practices
Proficiency in Airflow for workflow orchestration
Experience implementing transformations using SQL/dbt
Experience with Parquet and Iceberg table design and schema evolution
Strong foundation in data modeling, performance optimization, and large-scale data systems
Experience with Power BI for data visualization and reporting

What the Team is Saying

Cargill Compensation & Benefits Highlights

Retirement Support — Cargill offers immediate 401(k) eligibility with a defined employer match, alongside additional vehicles such as an ESOP and company-supported tools for savings. Feedback suggests these features make long-term retirement readiness a strong part of the total package.
Leave & Time Off Breadth — Paid time off scales meaningfully with tenure on a clear annual cycle, and paid family leave covers both bonding with a new child and caregiving needs. Feedback suggests the combined PTO and leave programs compare favorably with common large-employer offerings.
Parental & Family Support — Adoption and surrogacy reimbursement, Bright Horizons childcare solutions, and Milk Stork complement the paid family leave program. These resources indicate a family-forward design that supports key life events and caregiving logistics.

Learn more about Cargill's Compensation & Benefits →

Cargill Insights

What's It Like to Work at Cargill? Cargill Culture & Values Cargill Career Growth & Development What's the Work-Life Balance Like at Cargill? Cargill Leadership & Management Cargill Company Growth, Stability & Outlook

View all jobs at Cargill

View Cargill Profile

Report Job

Am I A Good Fit?

beta

Get Personalized Job Insights.

Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company

HQ: Wayzata, MN

155,000 Employees

Year Founded: 1865

What We Do

We are a family company providing food, ingredients, agricultural solutions and industrial products to nourish the world in a safe, responsible and sustainable way. We connect farmers with markets so they can prosper. We connect customers with ingredients so they can make meals people love. And we connect families with daily essentials— from eggs to edible oils, salt to skincare, feed to flooring. By providing customers with products that are vital for living, we help businesses grow, communities prosper and consumers live well in their daily lives.

Why Work With Us

The decision to join Cargill can open the door to a world of possibility. As part of our Digital, Technology & Data team, you’ll get to be part of a large and diverse group full of unique perspectives united by a common, higher purpose while building a rewarding career full of opportunity, growth and the satisfaction of knowing your work matters.