Research Engineer - Environments, Data and Post-Training

Reposted 20 Hours Ago
San Francisco, CA, USA
In-Office
Junior
Artificial Intelligence • Software
We use AI to understand human ability and match talent with the opportunities they're best suited for.
The Role
As a Research Engineer, you'll enhance AI models through post-training and evaluation pipelines, focusing on data quality and performance metrics.
Summary Generated by Built In
About Mercor

Mercor is defining the future of work. We partner with leading AI labs and enterprises to provide the human intelligence essential to AI development.

Our vast talent network trains frontier AI models in the same way teachers teach students: by sharing knowledge, experience, and context that can't be captured in code alone. Today, more than 30,000 experts in our network collectively earn over $2 million a day.

Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society.

Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices.

About the Role

As a Research Engineer at Mercor, you’ll work at the intersection of engineering and applied AI research. You’ll contribute directly to post-training and RLVR, synthetic data generation, and large-scale evaluation workflows that meaningfully impact frontier language models.

Your work will be used to train large language models to master tool use, agentic behavior, and real-world reasoning in real-world production environments. You’ll shape rewards, run post-training experiments, and build scalable systems that improve model performance. You’ll help design and evaluate datasets, create scalable data augmentation pipelines, and build rubrics and evaluators that push the boundaries of what LLMs can learn.

What You’ll Do
  • Work on post-training and RLVR pipelines to understand how datasets, rewards, and training strategies impact model performance.

  • Design and run reward-shaping experiments and algorithmic improvements (e.g., GRPO, DAPO) to improve LLM tool-use, agentic behavior, and real-world reasoning.

  • Quantify data usability, quality, and performance uplift on key benchmarks.

  • Build and maintain data generation and augmentation pipelines that scale with training needs.

  • Create and refine rubrics, evaluators, and scoring frameworks that guide training and evaluation decisions.

  • Build and operate LLM evaluation systems, benchmarks, and metrics at scale.

  • Collaborate closely with AI researchers, applied AI teams, and experts producing training data.

  • Operate in a fast-paced, experimental research environment with rapid iteration cycles and high ownership.

What We’re Looking For
  • Strong applied research background, with a focus on post-training and/or model evaluation.

  • Strong coding proficiency and hands-on experience working with machine learning models.

  • Strong understanding of data structures, algorithms, backend systems, and core engineering fundamentals.

  • Familiarity with APIs, SQL/NoSQL databases, and cloud platforms.

  • Ability to reason deeply about model behavior, experimental results, and data quality.

  • Excitement to work in person in San Francisco, five days a week (with optional remote Saturdays), and thrive in a high-intensity, high-ownership environment.

Nice To Have
  • Real-world post-training team experience in industry (highest priority).

  • Publications at top-tier conferences (NeurIPS, ICML, ACL).

  • Experience training models or evaluating model performance.

  • Experience in synthetic data generation, LLM evaluations, or RL-style workflows.

  • Work samples, artifacts, or code repositories demonstrating relevant skills.

Benefits
  • Generous equity grant vested over 4 years

  • A $10K housing bonus (if you live within 0.5 miles of our office)

  • A $1.5K monthly stipend for meals

  • Free Equinox membership

  • Health insurance

Top Skills

APIs
Cloud Platforms
Machine Learning
NoSQL
SQL
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
2,217 Employees
Year Founded: 2023

What We Do

We use AI to understand human ability and match talent with the opportunities they're best suited for.

Similar Jobs

Zscaler Logo Zscaler

Senior Director Product Marketing, SecOps

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
USA
8697 Employees
224K-320K Annually

Dandy Logo Dandy

Revenue Operations Manager

Computer Vision • Healthtech • Information Technology • Logistics • Machine Learning • Software • Manufacturing
Remote or Hybrid
USA
1800 Employees
126K-148K Annually

Edmunds Logo Edmunds

Editor

AdTech • Automotive • Big Data • Consumer Web
Remote or Hybrid
USA
500 Employees
58K-68K Annually

Edmunds Logo Edmunds

Data Engineer

AdTech • Automotive • Big Data • Consumer Web
Remote or Hybrid
USA
500 Employees
125K-159K Annually

Similar Companies Hiring

Fairly Even Thumbnail
Hardware • Other • Robotics • Sales • Software • Hospitality
New York, NY
30 Employees
Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account