Research Scientist

Posted Yesterday
Be an Early Applicant
Hiring Remotely in United States
Remote
Entry level
Artificial Intelligence • Big Data • Machine Learning • Software
The Role
Research data strategies for large language model development, including designing data slices to identify model failure modes, modeling annotator behavior, and optimizing instruction clarity and reward-signal reliability. Develop metrics and evaluation frameworks to assess dataset quality, diversity, alignment impact, and downstream model performance. Collaborate with AI research teams and test data-centric methodologies in production environments.
Summary Generated by Built In
About Us

Our mission is to raise AGI with the richness of human intelligence — curious, witty, imaginative, and full of unexpected brilliance.

Surge was founded by engineers and researchers who dreamed of building the next generation AI. We're building a platform that powers the most powerful models in the world in partnership with companies like Anthropic, Google, Microsoft, and Meta.

At Surge, we believe the path to AGI isn't just about scaling compute—it's about embracing the unlimited ceiling of human intelligence and creativity in the data that shapes these systems. Our platform combines elite human expertise with cutting-edge tools for scalable oversight, from building rich RL environments to conducting rigorous evaluations that go beyond benchmarks. We've run a profitable business from day one without raising venture funding.

The Role

As a Research Scientist focused on data, you’ll work at the cutting edge of LLM development by designing the datasets that shape how frontier models behave. You’ll partner directly with AI research teams to experiment with new data collection strategies, evaluate dataset quality, and uncover insights that improve alignment, safety, and model performance.

This is a research-driven, impact-heavy role: you’ll have the opportunity to test ideas quickly in live production environments, shape data-centric methodologies for some of the world’s top AI labs, and help define how high-quality data fuels the next generation of AI systems.

What We’re Looking for
  • Deep Curiosity About Data – Obsession with understanding how the structure, quality, and selection of data influence LLM performance

  • Bias Toward Insight and Iteration – You think critically but move fast, designing lightweight experiments to generate actionable results

  • Desire to Shape AI Development – Drive to build the foundational data layer that defines how the next generation of AI systems behave

What You'll Do
  • Research data collection strategies and designing high-impact data slices that uncover model failure modes

  • Model annotator behavior and designing experiments to optimize instruction clarity and reward signal reliability

  • Develop metrics and frameworks for evaluating dataset quality, diversity, and impact on downstream model alignment

Skills Required

  • Deep curiosity about data and how data structure, quality, and selection influence LLM performance
  • Ability to think critically and rapidly design lightweight experiments that generate actionable insights
  • Desire to contribute to AI development and build foundational data methodologies
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
485 Employees
Year Founded: 2020

What We Do

Surge AI is an artificial intelligence company focused on providing high-skill data-labeling services and technology for AI development. It combines a data-labeling platform with a specialized workforce supporting natural-language processing, code generation, search evaluation, adversarial training, and related machine-learning applications. The company’s broader mission is to help raise artificial general intelligence with the richness, curiosity, and creativity of human intelligence.

Similar Jobs

Slingshot Aerospace Logo Slingshot Aerospace

Scientist

Aerospace • Artificial Intelligence • Analytics • Defense
Remote
United States
223 Employees
120K-170K Annually

Arvinas Logo Arvinas

Scientist

Biotech • Pharmaceutical
In-Office or Remote
New Haven, CT, USA
375 Employees

Raydar Logo Raydar

Scientist

Professional Services • Consulting
Remote
2 Locations
28 Employees
130K-200K Annually

Peraton Logo Peraton

Data Scientist

Aerospace • Information Technology • Security • Cybersecurity • Defense
Remote
United States
18000 Employees
66K-106K Annually

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account