Research Engineer

Posted 2 Hours Ago
Be an Early Applicant
San Francisco, CA, USA
Hybrid
200K-240K Annually
Mid level
Artificial Intelligence • Software
The worlds most powerful AI-powered customer experience platform.
The Role
Build and maintain reproducible research infrastructure for evaluating digital-twin and large language model systems. Responsibilities include automating experiments, implementing deterministic measurement pipelines, managing versioned datasets and human-participant data, maintaining research-production alignment, monitoring evaluation validity and compute costs, and supporting documented coding workflows. The role requires strong Python, data pipeline, cloud, concurrency, machine learning, and software engineering skills, with preferred experience in LLM systems, model fine-tuning, inference serving, experiment tracking, and generative agents.
Summary Generated by Built In

Outset invented a better way to do research: AI-powered user interviews.

Global brands like Hubspot, Microsoft, Uber and Nestle use Outset to achieve deeper, qualitative insights about their users at unprecedented speed and scale.

The research industry is massive (>$140B and growing) and ripe for disruption. Incumbents are outdated, slow, and burdened by high-cost services. That's our opportunity.


Outset is backed by top Silicon Valley investors and raised a $30M Series B in December 2025—less than six months after our Series A—led by Radical Ventures with participation from M12 (Microsoft’s venture arm), 8VC, Y Combinator, and Adverb Ventures.

The raise follows a breakout year, with our business growing 8x as enterprise customers across industries adopt our category, AI‑moderated research, as the new standard for understanding people.

We’re a tight-knit team serving some of the world’s largest enterprises.

Outset builds digital twins: AI systems that represent specific real people and respond to research questions the way those people would. The Digital Twins Team runs an ongoing research program to measure and improve how faithfully these systems reproduce human responses and behavior, across a range of cross-sectional levels of analysis.

The Research Engineer reports to the Head Scientist and builds and maintains the systems that let the team's scientists run their studies correctly, reproducibly, and at scale. The scientists design the studies and define the measurements; you make sure every experiment executes exactly as designed, that results can be reproduced from stored inputs, and that research code stays in step with the shipped product. The ideal candidate has supported scientists in an academic computational social science lab or a comparable research setting and has hands-on experience engineering systems built on large language models.

Responsibilities

  • Own the evaluation infrastructure that tests competing modeling approaches, so that new tests can be set up quickly, run concurrently and automatically, and be monitored.

  • Implement measurement pipelines exactly as specified by the scientists, with deterministic and traceable outputs.

  • Maintain versioned evaluation datasets with held-out sets that are never used for training.

  • Build and maintain data pipelines for human-participant data, external datasets, and model training data, including linkage of records belonging to the same participant across sources.

  • Keep research code in step with the production product so that validated improvements ship promptly.

  • Detect and prevent threats to the validity of evaluations.

  • Track compute and API spend across experiments and their implications for production-stage costs

  • Manage repositories, code review, documentation, and the reproducibility of the team's coding workflow.

  • Identify implementation choices that can be made more correct or more efficient, and propose changes.

Qualifications

  • Several years of software engineering experience, including experience supporting researchers in a lab or comparable setting.

  • Experience translating specific scientific requirements and experiment designs into code.

  • Experience building and operating large-scale data pipelines on human behavior data, and confirming that the pipelines matched the criteria and design the researchers specified.

  • Strong Python, including the ability to read and audit code produced by agentic coding tools.

  • Fundamentals of computing: file systems, software libraries, databases, SQL, tabular data, and Git-based workflows.

  • Experience with cloud infrastructure and with running many jobs concurrently.

  • Working understanding of machine learning, including how transformer-based language models behave, how model APIs are used, and what fine-tuning involves.

  • A habit of writing deterministic, reproducible, cost-aware, and well-documented code.

Preferred
  • Hands-on experience engineering large language model systems: prompt pipelines, evaluation harnesses, embedding computation, agentic systems, and/or fine-tuning infrastructure.

  • Experience fine-tuning open-weight language models on multi-GPU hardware.

  • Experience serving open-weight models with an inference framework such as vLLM or SGLang, including batched inference and prefix caching for many requests that share a common prompt.

  • Experience with experiment tracking and cost monitoring for machine learning workloads.

  • Experience with survey or panel data and data collection platforms.

  • Experience extracting and storing model activations for downstream analysis.

  • Experience with experiment tracking and cost monitoring for machine learning workloads, including GPU provisioning across cloud providers.

  • Prior work on generative agents, digital twins, or simulation of human respondents.

Skills Required

  • Several years of software engineering experience, including supporting researchers in a lab or comparable setting
  • Experience translating scientific requirements and experiment designs into code
  • Experience building and operating large-scale data pipelines on human behavior data
  • Strong Python, including the ability to read and audit code produced by agentic coding tools
  • Knowledge of file systems, software libraries, databases, SQL, tabular data, and Git-based workflows
  • Experience with cloud infrastructure and running many jobs concurrently
  • Working understanding of machine learning, transformer-based language models, model APIs, and fine-tuning
  • Ability to write deterministic, reproducible, cost-aware, and well-documented code
  • Experience engineering large language model systems, including prompt pipelines, evaluation harnesses, embedding computation, agentic systems, or fine-tuning infrastructure
  • Experience fine-tuning open-weight language models on multi-GPU hardware
  • Experience serving open-weight models with vLLM or SGLang, including batched inference and prefix caching
  • Experience with experiment tracking and cost monitoring for machine learning workloads
  • Experience with survey or panel data and data collection platforms
  • Experience extracting and storing model activations for downstream analysis
  • Experience with GPU provisioning across cloud providers
  • Prior work on generative agents, digital twins, or simulation of human respondents

What the Team is Saying

Jessica
Lily
Rob
Nicole
Amelia

Outset AI Compensation & Benefits Highlights

  • Retirement Support — A 401(k) plan with employer matching is prominently offered, which is notable for a small startup. Company and third-party listings consistently highlight retirement contributions as part of total rewards.
  • Healthcare Strength — Medical, dental, and vision coverage are described as comprehensive across sources. This breadth positions healthcare as a strong pillar of the package.
  • Wellbeing & Lifestyle Benefits — Daily catered meals, snacks, drinks, commuter benefits, and a well-appointed San Francisco office are repeatedly emphasized. Professional development allowances and productivity-tool budgets further strengthen day-to-day support.

Outset AI Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
30 Employees
Year Founded: 2022

What We Do

Outset invented a better way to do research: AI-powered user interviews. We created this new category of research technology and now it's growing wildly. Global brands like Hubspot, Microsoft, Uber and Nestle use Outset to achieve deeper, qualitative insights about their users at unprecedented speed and scale. The research industry is massive (>$140B and growing) and ripe for disruption. Incumbents are outdated, slow, and burdened by high-cost services. That's our opportunity.

Why Work With Us

Outset is backed by top Silicon Valley investors and raised a $30M Series B in December 2025—less than six months after our Series A, with our business growing 8x as enterprise customers across industries adopt our category, AI‑moderated research, as the new standard for understanding people. We’re a tight-knit team of 30.

Gallery

Gallery
Gallery
Gallery

Outset AI Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Onsite 4 days a week - one day remote

Typical time on-site: 4 days a week
HQSan Francisco, CA
Financial District

Similar Jobs

Outset AI Logo Outset AI

Scientist

Artificial Intelligence • Software
Hybrid
San Francisco, CA, USA
30 Employees
200K-240K Annually

Outset AI Logo Outset AI

Account Manager

Artificial Intelligence • Software
Remote or Hybrid
2 Locations
30 Employees

Outset AI Logo Outset AI

Account Executive

Artificial Intelligence • Software
Remote or Hybrid
2 Locations
30 Employees

Outset AI Logo Outset AI

Account Executive

Artificial Intelligence • Software
Remote or Hybrid
2 Locations
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account