Research Scientist

Posted 27 Days Ago
San Francisco, CA, USA
Hybrid
200K-240K Annually
Entry level
Artificial Intelligence • Software
The hub for your customer understanding, powered by context-aware AI-moderated interviews and simulated human data.
The Role
Conducts research evaluating AI-generated digital twins against human responses. Designs experiments, statistical measures, human rating studies, longitudinal data collection, and model evaluations. Analyzes large-scale behavioral data, assesses model calibration and simulation performance, specifies analyses for engineers, and co-authors academic or industry publications.
Summary Generated by Built In

Outset invented a better way to do research: AI-powered user interviews.

Global brands like Hubspot, Microsoft, Uber and Nestle use Outset to achieve deeper, qualitative insights about their users at unprecedented speed and scale.

The research industry is massive (>$140B and growing) and ripe for disruption. Incumbents are outdated, slow, and burdened by high-cost services. That's our opportunity.


Outset is backed by top Silicon Valley investors and raised a $30M Series B in December 2025—less than six months after our Series A—led by Radical Ventures with participation from M12 (Microsoft’s venture arm), 8VC, Y Combinator, and Adverb Ventures.

The raise follows a breakout year, with our business growing 8x as enterprise customers across industries adopt our category, AI‑moderated research, as the new standard for understanding people.

We’re a tight-knit team serving some of the world’s largest enterprises.

Outset builds digital twins: AI systems that represent specific real people and respond to research questions the way those people would. The Digital Twins Team runs an ongoing research program to measure and improve how faithfully these systems reproduce human responses and behavior, across a range of cross-sectional levels of analysis.

The Research Scientist works directly with and reports to the Head Scientist. Together you will choose what to study, design the studies, define how results are measured, interpret the findings, and write them up for internal decision-making and, where appropriate, for academic publication. You will bring current methodological training in computational social science, data science, survey-methodology, human-computation interaction, and experiment design.

Responsibilities

  • Co-design and run studies that compare system-generated responses with responses from humans, using both qualitative and quantitative measures.

  • Design, justify, and hone measures of performance.

  • Apply and adapt state-of-the-art statistical techniques common to survey methodology and large-scale social data analysis, to benchmark and improve sample- and population-level simulation performance.

  • Design evaluations and experiments with pre-specified analysis plans.

  • Design and oversee human rating studies, including rater training, coding rubrics, and inter-rater agreement measurement.

  • Design data collection from third-party data sources and directly from human participants, including longitudinal and repeated-measures studies.

  • Contribute to the research agenda for new modeling approaches, including evaluation of fine-tuned models and of model calibration.

  • Specify analyses precisely enough for an engineer to implement.

  • Co-author papers, preprints, and presentations.

Qualifications

  • A completed or nearly completed PhD in computational social science, communication, HCI, sociology, political science, psychology, statistics, or a related field.

  • Peer-reviewed publications on which you were a primary author.

  • Working command of graduate-level statistical methodology common to social science, including the assumptions behind each.

  • Experience analyzing large-scale telemetry and behavioral datasets, with attention to the validity of the resulting inference.

  • Familiarity with machine learning, spanning classical, nonparametric, and LLM-based approaches, including how transformer-based language models work, what fine-tuning does, and how the major model families differ.

  • Fundamentals of computing: file systems, software libraries, databases, SQL, and tabular data.

  • Ability to work in an environment where most code is produced through agentic coding tools, and to read and check that code.

Preferred Qualifications

  • Experience fine-tuning open-weight language models on survey, experimental, or behavioral data.

  • Experience building or evaluating calibrated confidence or error-prediction models, including deriving decision thresholds from human judgments.

  • Experience measuring similarity of open-ended text, for example with embedding-based methods.

  • Experience designing or running panel-based data collection with human participants.

  • Experience presenting research at academic and/or industry conferences.

  • Prior work on generative agents, digital twins, or simulation of human respondents.

  • Familiarity with the startup ecosystem

  • Familiarity with qualitative interviews and ethnographic methods

  • Familiarity with topics in computational linguistics

Skills Required

  • Completed or nearly completed PhD in computational social science, communication, HCI, sociology, political science, psychology, statistics, or a related field
  • Peer-reviewed publications as a primary author
  • Graduate-level statistical methodology in social science, including understanding methodological assumptions
  • Experience analyzing large-scale telemetry and behavioral datasets with attention to inference validity
  • Familiarity with classical, nonparametric, and LLM-based machine learning approaches
  • Understanding of transformer-based language models, fine-tuning, and major model families
  • Fundamentals of computing, including file systems, software libraries, databases, SQL, and tabular data
  • Ability to read and check code produced through agentic coding tools
  • Experience fine-tuning open-weight language models on survey, experimental, or behavioral data
  • Experience building or evaluating calibrated confidence or error-prediction models and deriving decision thresholds from human judgments
  • Experience measuring similarity of open-ended text using methods such as embeddings
  • Experience designing or running panel-based data collection with human participants
  • Experience presenting research at academic or industry conferences
  • Prior work on generative agents, digital twins, or simulation of human respondents
  • Familiarity with the startup ecosystem
  • Familiarity with qualitative interviews and ethnographic methods
  • Familiarity with computational linguistics

What the Team is Saying

Jessica
Lily
Rob
Nicole
Amelia

Outset Compensation & Benefits Highlights

  • Retirement Support — The company advertises a 401(k) with employer matching up to 6%, which is notable for a small San Francisco startup. Public materials consistently highlight this match as part of the core benefits.
  • Healthcare Strength — Medical, dental, and vision coverage are presented as comprehensive in the official benefits description. Third-party employer profiles also list these plans as part of the package.
  • Wellbeing & Lifestyle Benefits — Daily catered lunches, snacks, drinks, and commuter benefits are provided for those working from the San Francisco office. Additional offerings such as a professional-development allowance and a productivity-tools budget further support day-to-day experience.

Outset Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
120 Employees
Year Founded: 2022

What We Do

Outset invented a better way to do research: AI-powered user interviews. We created this new category of research technology and now it's growing wildly. Global brands like Hubspot, Microsoft, Uber and Nestle use Outset to achieve deeper, qualitative insights about their users at unprecedented speed and scale. The research industry is massive (>$140B and growing) and ripe for disruption. Incumbents are outdated, slow, and burdened by high-cost services. That's our opportunity.

Why Work With Us

Outset is backed by top Silicon Valley investors and raised a $30M Series B in December 2025—less than six months after our Series A, with our business growing 8x as enterprise customers across industries adopt our category, AI‑moderated research, as the new standard for understanding people. We’re a tight-knit team of 30.

Gallery

Gallery
Gallery
Gallery

Outset Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Onsite 4 days a week - one day remote

Typical time on-site: 4 days a week
HQSan Francisco Headquarters
Financial District

Similar Jobs

Outset AI Logo Outset AI

Operations Associate

Artificial Intelligence • Software
Hybrid
San Francisco, CA, USA
30 Employees
125K-150K Annually

Outset AI Logo Outset AI

GTM Sourcer

Artificial Intelligence • Software
Hybrid
San Francisco, CA, USA
30 Employees
140K-190K Annually

Outset AI Logo Outset AI

Product Designer

Artificial Intelligence • Software
Hybrid
San Francisco, CA, USA
30 Employees
180K-220K Annually

Outset AI Logo Outset AI

Data Analyst

Artificial Intelligence • Software
Hybrid
San Francisco, CA, USA
30 Employees
140K-170K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account