Machine Learning Engineer - Quality Intelligence

Posted Yesterday
Be an Early Applicant
San Francisco, CA, USA
In-Office
Mid level
Artificial Intelligence • Big Data
The Role
Build production ML and data systems to measure and improve data quality. Develop expert-matching, quality prediction, anomaly detection, and evaluation infrastructure. Convert messy signals into models, metrics, and product improvements while partnering with engineers and domain experts and owning systems from design to deployment.
Summary Generated by Built In
About AfterQuery

AfterQuery is an applied research lab curating data solutions for foundation model development.

We serve every frontier AI lab with the mission of delivering the best data to power the best models. In doing so, we can make expertise that once took a lifetime to build available to anyone who needs it. Our customers are the ones building the foundation models themselves and our work sits directly in the loop of how those systems improve.

This is a rare opportunity to join a company at a defining moment in AI. Since raising our $30M Series A at a $300M valuation, AfterQuery has grown well over a $100M revenue run rate.

We're based in San Francisco and backed by leading investors including Altos Ventures, BoxGroup, and Y Combinator and angels from Google DeepMind, OpenAI, Anthropic, Meta Superintelligence Labs, and Microsoft AI.

Machine Learning Engineer, Quality Intelligence

Overview

AfterQuery builds the data and evaluation systems that power frontier AI models. Every leading AI lab uses our datasets and reinforcement learning environments to encode and scale real-world expertise.

We’re hiring a Founding Machine Learning Engineer, Quality Intelligence to build the ML systems behind how we measure, improve, and scale data quality. You’ll work on production systems at the intersection of machine learning, human expertise, and frontier model evaluation.

This role is for someone who wants to build practical ML systems that directly improve the quality, reliability, and scalability of expert human data.

Responsibilities
  • Build ML and data systems that help measure quality across complex human data workflows

  • Develop systems for expert matching, quality prediction, and anomaly detection

  • Build evaluation infrastructure for tasks, reviewers, projects, and data deliveries

  • Turn messy real-world signals into models, metrics, and product improvements

  • Partner with engineers, domain experts, and operators to improve how high-quality data is created and reviewed

  • Own high-impact systems from early design through production deployment

Required Qualifications
  • 3-6 YOE with relevant experiences

  • Strong software engineering background with experience shipping production systems

  • Experience with applied ML, ranking, recommendations, search quality, marketplace systems, trust/safety, fraud, or data quality systems

  • Strong data intuition and ability to work with messy, ambiguous real-world signals

  • Comfort working across backend systems, data pipelines, ML models, and internal tools

  • Ability to move quickly in a high-ownership, fast-changing environment

  • Deep care for quality, precision, and customer impact

Not a Fit If
  • You want to do pure research without owning production systems

  • You only want to train models and not build product infrastructure

  • You need clean datasets and perfectly scoped problems

  • You do not want to work closely with users, operators, and domain experts

Skills Required

  • 3-6 years of experience
  • Strong software engineering background with experience shipping production systems
  • Experience with applied ML, ranking, recommendations, search quality, marketplace systems, trust/safety, fraud, or data quality systems
  • Strong data intuition and ability to work with messy, ambiguous real-world signals
  • Comfort working across backend systems, data pipelines, ML models, and internal tools
  • Ability to move quickly in a high-ownership, fast-changing environment
  • Deep care for quality, precision, and customer impact
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
200 Employees

What We Do

AfterQuery is an applied research lab curating data solutions to accelerate foundation model development.

Similar Jobs

In-Office
San Diego, CA, USA
955 Employees
95K-161K Annually

Wipfli Logo Wipfli

Audit Senior Manager, Health Care Industry

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
Irvine, CA, USA
3000 Employees
142K-200K Annually

Wipfli Logo Wipfli

Consultant

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
Irvine, CA, USA
3000 Employees
88K-118K Annually

Wipfli Logo Wipfli

Audit Manager, Technology Industry

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
3000 Employees
97K-145K Annually

Similar Companies Hiring

Legora Thumbnail
Artificial Intelligence • Legal Tech • Software
Chicago, Illinois
700 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account