Senior Data Engineer — Recommendations & Data Platform

Posted 23 Days Ago
San Bruno, CA, USA
Hybrid
185K-210K Annually
Senior level
Hardware • Social Impact • Energy • Agriculture
Trash stinks. Together, we can do better. Mill has created a new system to help you outsmart waste at home.
The Role
Design, build, and maintain scalable data pipelines and a customer-facing recommendation engine (including LLM logic). Manage data warehouse, data quality monitoring, CI/CD for pipelines, and partner with product, analytics, engineering, and marketing to ensure consistent metrics and observability.
Summary Generated by Built In

Mill is a waste prevention technology company reimagining what it means to eliminate waste, starting with food. We build smart systems and infrastructure for homes, businesses, and municipalities that transform food scraps from landfill-bound waste into valuable resources, including chicken feed. Tens of thousands of Mill’s residential food recyclers are already helping households divert millions of pounds of food scraps every year, paving the way for our upcoming launch of Mill Commercial—the industry’s first end-to-end solution for managing, understanding, and preventing food waste in commercial environments (e.g. grocery, restaurants, food services). At Mill, we are passionate about building easy-to-use, beautifully designed technologies that keep food in the food system and out of landfills.

As a Data Engineer at Mill, you'll touch systems end-to-end — from raw ingestion to the recommendation a customer sees in the app to managing the data warehouse. You'll architect a warehouse model one week and tune recommendation logic the next. You'll partner closely with product, engineering, data analytics, and marketing teams.

What You'll Do
  • Build and operate the customer-facing recommendation engine that turns food waste data into actionable recommendations — purchasing suggestions, anomaly explanations, operational nudges — including LLM-based logic where useful
  • Aggregate and unify disparate data streams to guarantee the precision, reliability, and protection of our analytical assets.
  • Co-create and drive Mill's self-serve analytics strategy with analysts and data scientists — defining golden datasets, setting SLAs for freshness and reliability, and establishing the governance model that keeps self-serve trustworthy at scale
  • Own data quality monitoring against those SLAs — build alerting, validation frameworks, and observability tooling so golden dataset issues get caught before they become business problems
  • Collaborate with software engineers to instrument new product features and ensure event data flows cleanly into the warehouse, meeting the governance and quality bar required for it to become part of a golden dataset
  • Design, build, and maintain scalable data pipelines across Mill's product and operational systems
  • Define and maintain the metrics, table endorsements, and business logic that analysts and stakeholders rely on — so everyone across the company is working from the same numbers
What We're Looking For
  • Have designed, built, or operated a recommendation system in production — one that combines multiple data sources into a single customer-facing output — not just contributed data to someone else's model
  • Experience building recommendation or personalization logic using LLMs (prompt-based scoring, retrieval-augmented generation, agent-based reasoning) in a live product, not just a prototype
  • Have built and operated data pipelines in production using Python, SQL, and tools like dbt, Airflow, Fivetran, or similar against a cloud data warehouse (e.g., Snowflake, BigQuery, Redshift) — including handling failures, backfills, and schema changes after launch
  • Have brought CI/CD discipline to data pipelines or product logic (automated testing, staged rollout, rollback), with a track record of measuring whether a change actually improved outcomes, not just shipping it
  • 5 years of experience operating data engineering systems in production
  • A bias toward clarity and action
Nice to Have
  • Exposure to distributed systems concepts (partitioning, consistency, fault tolerance)
  • Hands-on experience with infrastructure as code (Terraform, Pulumi) in a cloud environment
  • Experience with Hex, Mixpanel, Tableau, or similar BI/analytics tools
  • Familiarity with data contract or data mesh patterns
  • Experience with event tracking or product analytics

The estimated base salary range for this position is $185k to $210k, which does not include the value of benefits or a potential equity grant. A wide range of factors are considered in making compensation decisions, including but not limited to skill sets, market conditions, experience and training, licensure and certifications, and business and organizational needs.

Skills Required

  • 5 years of experience operating data engineering systems in production
  • Built and operated data pipelines in production using Python and tools like dbt, Airflow, Fivetran, including handling failures, backfills, and schema changes
  • Strong SQL skills
  • Experience with a cloud data warehouse (Snowflake, BigQuery, Redshift)
  • Experience with recommendation systems or pipelines combining multiple data sources into production outputs, including recommendation logic built with LLMs
  • Set up CI/CD for data pipelines or product logic (automated testing, staged rollout, rollback) and measured the impact of changes
  • Bias toward clarity and action; comfort working collaboratively with product, engineering, data analytics, and marketing
  • Exposure to distributed systems concepts (partitioning, consistency, fault tolerance)
  • Hands-on experience with infrastructure as code (Terraform, Pulumi) in a cloud environment
  • Experience with Hex, Mixpanel, Tableau, or similar BI/analytics tools
  • Familiarity with data contract or data mesh patterns
  • Experience with event tracking or product analytics

Mill Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Mill and has not been reviewed or approved by Mill.

  • Fair & Transparent Compensation Pay is positioned as competitive for several senior technical and business roles, supported by multiple six‑figure base ranges in recent postings. Total compensation snapshots commonly cluster in the mid‑ to high‑$100Ks for individual‑contributor roles, reinforcing a generally market-competitive posture for the Bay Area.
  • Leave & Time Off Breadth Time-off coverage appears broad, including paid holidays, paid sick days, flexible time off, and an unlimited vacation policy, with some company-wide time off. The overall setup signals strong flexibility for managing personal time, though day-to-day use may depend on team norms.
  • Healthcare Strength Core health coverage is described as comprehensive, including medical, dental, and vision, alongside wellness programs and an FSA. The package breadth suggests a solid baseline consistent with tech-startup standards.

Mill Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Bruno, CA
110 Employees
Year Founded: 2020

What We Do

We’re on a mission to eliminate waste for good, starting with the food that ends up in landfills. Did you know that more than half of the food in landfills comes from home kitchens (ReFED)? And food in landfills turns into methane – which is 80x more potent than CO2 over a 20-year period (IPCC). At Mill, we’re working to turn kitchen scraps into food for chickens. This keeps food in our food system and out of landfills.

Why Work With Us

Food isn't trash. Mill keeps it from stinking up your kitchen – and the planet.

Gallery

Gallery

Similar Jobs

Windfall Logo Windfall

Senior Data Engineer

Artificial Intelligence • Big Data • Machine Learning • Software
Hybrid
2 Locations
81 Employees
170K-220K Annually

PERGOLUX Logo PERGOLUX

Data Engineer

eCommerce • Retail
In-Office or Remote
8 Locations
169 Employees
Remote or Hybrid
United States
300 Employees
100K-140K Annually

Chartmetric Logo Chartmetric

Senior Data Engineer

Music • Software • Analytics
In-Office
2 Locations
56 Employees
140K-160K Annually

Similar Companies Hiring

Playground (tryplayground.com) Thumbnail
Kids + Family • Payments • Social Impact • Software
New York City, New York
80 Employees
Fairly Even Thumbnail
Hardware • Robotics • Sales • Software • Hospitality
New York, NY
30 Employees
Amalgamated Sugar Thumbnail
Food • Greentech • Agriculture • Industrial • Manufacturing
Boise, Idaho
768 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account