Research Engineer, Mid-Training

Posted 13 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
Entry level
Artificial Intelligence • Software
The Role
Own late-stage LLM training decisions across data mixing, capability injection, synthetic data, annealing schedules, context extension, evaluation, and scaling. Develop methods that improve coding, mathematics, and long-horizon reasoning while translating research into production training systems. The role requires end-to-end understanding of the LLM pipeline, hands-on large-model training experience, strong optimization and machine learning fundamentals, and demonstrated original technical contributions.
Summary Generated by Built In
We are an applied AI lab building end-to-end software agents.

We're the makers of Devin, the first AI software engineer.

Our team is extremely talent-dense. Among our founding team, we have world-class competitive programmers, former founders, and leaders from companies at the cutting edge of AI including Scale AI, Palantir, Cursor, Waymo, Tesla, Lunchclub, Modal, Google DeepMind, and Nuro.

Building Devin is just the first step—our hardest challenges still lie ahead. If you’re excited to solve some of the world’s biggest problems and build AI that can reason on real-world tasks, apply to join us.

Role Mission

Mid-training sits at the seam between pre-training and post-training and is one of the highest-leverage points in the entire model pipeline. This is where raw base model capability is sharpened into something that can reason deeply, generalize reliably, and serve as the foundation that post-training builds on.

You will own the late-stage training decisions that determine what our models are fundamentally capable of: data mix and quality uplift, annealing schedules, context length extension, capability injection across coding, math, and reasoning, and the synthetic data strategies that make all of it scale. This role does cross-cutting work across what is classically considered both pre-training and post-training. We don't distinguish between research and engineering; we expect both.

What You'll Accomplish
  • Data Mix and Quality Uplift: Design and iterate on high-quality data mixtures for late-stage and annealing training runs. Develop principled methods for sourcing, filtering, and weighting data to sharpen model capabilities without degrading general performance.

  • Capability Injection: Drive targeted improvements in coding, mathematics, and long-horizon reasoning through curated data strategies and training interventions. Translate research insights into measurable capability gains on our agents.

  • Synthetic Data Research: Develop and evaluate synthetic data pipelines that generate training signal at scale. Understand the limits and failure modes of synthetic approaches and build methods that hold up in production training runs.

  • Annealing and Schedule Design: Research and optimize multi-stage learning rate schedules, warmup strategies, and compute allocation across training phases. Understand how schedule choices interact with data distribution and model behavior.

  • Context Length Extension: Research and implement methods for extending effective context length without degrading short-context performance. This includes positional encoding strategies, data construction, and targeted evaluation.

  • Evaluation and Iteration: Build evals that distinguish real capability improvements from benchmark overfitting. Close the loop between training decisions and what actually matters for Devin and our other systems in deployment.

  • Scaling and Methodology: Measure how mid-training interventions scale with compute and data. Develop new approaches when existing methods hit ceilings; we expect both rigorous empiricism and original thinking.

Exceptional Candidates Have Demonstrated
  • Deep familiarity with the LLM training pipeline end to end: pre-training data, optimization, architecture, and how mid-training and post-training interact

  • Hands-on experience with continual pre-training, annealing, or late-stage data mixing for large models

  • Strong intuition for data quality: what makes a dataset useful for training, how to filter and curate at scale, and how data mix choices compound across evals

  • Experience developing or evaluating synthetic data pipelines for capability improvement

  • Proficiency in Python and deep learning frameworks (PyTorch); comfortable debugging distributed training at scale

  • Strong fundamentals in optimization, statistics, and ML theory; able to distinguish real effects from noise, instability, and overfitting

  • A track record of original contributions: publications, open-source impact, or internal results that moved a capability frontier

  • Comfort operating in ambiguous, fast-moving environments where the problem definition is as important as the solution

  • We care more about demonstrated capability than credentials. A PhD is one signal among many.

Resources & Environment
  • Small, highly selective team where research and product move together; prototypes reach real deployment quickly

  • Compute is not a constraint: large allocations with training jobs routinely running across thousands of GPUs from day one

  • The environment rewards speed, autonomy, and technical depth with minimal process overhead; this is one of the most competitive and fast-moving problems in AI

Our Commitment

Equal Opportunity. Cognition is an equal opportunity employer. We do not discriminate on the basis of any protected characteristic under applicable law. We are committed to providing reasonable accommodations for candidates with disabilities throughout the hiring process - please let us know if you need any. Cognition also considers applicants with criminal histories consistent with the SF Fair Chance Ordinance and similar local laws.

Data Privacy and Arbitration: By submitting your application, you agree to our Global Applicant and Job Candidate Privacy Notice. For US applicants, by submitting your application, you agree to the Applicant Arbitration Agreement.

Skills Required

  • Deep familiarity with the end-to-end LLM training pipeline, including pre-training data, optimization, architecture, mid-training, and post-training
  • Hands-on experience with continual pre-training, annealing, or late-stage data mixing for large models
  • Strong intuition for data quality, dataset filtering, curation, and data mixture design at scale
  • Experience developing or evaluating synthetic data pipelines for capability improvement
  • Proficiency in Python and deep learning frameworks such as PyTorch
  • Experience debugging distributed training at scale
  • Strong fundamentals in optimization, statistics, and machine learning theory
  • Ability to distinguish real effects from noise, instability, and overfitting
  • Track record of original contributions through publications, open-source impact, or impactful internal results
  • Comfort operating in ambiguous, fast-moving environments
  • PhD or equivalent demonstrated capability
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
49 Employees

What We Do

Makers of Devin, the first AI software engineer. We are an applied AI lab building end-to-end software agents. We’re building collaborative AI teammates that enable engineers to focus on more interesting problems and empower engineering teams to strive for more ambitious goals.

Similar Jobs

Wipfli Logo Wipfli

Manager, Accounting Advisory Services - Nonprofit Industry Clients

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
2900 Employees
107K-160K Annually

Micron Technology Logo Micron Technology

New College Grad - NAND & SSD Applications Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
2 Locations
45000 Employees
82K-150K Annually

Micron Technology Logo Micron Technology

Design Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
2 Locations
45000 Employees
150K-308K Annually

Micron Technology Logo Micron Technology

DMTS, DRAM Systems

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
2 Locations
45000 Employees
216K-430K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account