Research Scientist, Benchmarks & Evals

Posted 2 Days Ago
Hiring Remotely in United States
Remote
250K-350K Annually
Mid level
Artificial Intelligence • Big Data • Consumer Web • Software
The Role
Design and launch public benchmarks, private test sets, and evaluation systems for image, video, and document models. Run data-value experiments, human studies, and automated metric development; publish trusted leaderboards and reports; identify model weaknesses and guide future data collection. Collaborate with founders and AI lab buyers to translate research results into data partnerships.
Summary Generated by Built In

ABOUT KLED

Kled is building the largest opt-in human data network in the world.

We are not a labeling firm. We are not a task marketplace.

We are a consumer application where people upload their real photos, videos, and documents and get paid continuously.

We then filter, standardize, and license that data to frontier AI labs and enterprises that need fresh, rights-aware training data.

Since launching our mobile app in 2026, we have:

• Reached #1 on the App Store (Finance) with 0 paid marketing
• Scaled to 600,000+ active data contributors
• Processed 5M uploads per day
• Raised $15M+ from investors behind SpaceX, Airbnb, Coinbase, xAI, OpenAI, Anthropic, Spotify, Lyft, Uber, and more

Our mission is to let anyone download the app and earn a real living wage from uploading their data.

ABOUT THE ROLE

Research Scientist - Benchmarks & Evals

AI labs buy data when a benchmark shows it works.

You’ll build the benchmarks that show what one of the largest human data networks in the world can do for frontier AI models.

You will:

- Design and ship public benchmarks for image, video and document models

- Build private test sets from real, opt-in data that no model has trained on

- Run data-value experiments: train models with and without Kled data, measure what changes

- Design human evaluation studies and the automatic metrics that track them

- Publish leaderboards and reports that researchers at frontier labs trust

- Find where models fall short and tell our team what data to collect next

- Work directly with the founders and lab buyers to turn results into data deals

WE’RE LOOKING FOR

- 5-7+ years ML research or research engineering experience

- A benchmark or evaluation you built that other people actually used

- Strong hands-on experience training and fine-tuning image or video models (PyTorch)

- Deep understanding of experimental design and statistics (controls, ablations, human studies)

- Experience running experiments end to end, from GPUs to final report

- Clear writing for both researchers and buyers

Bonus:

- Publications at NeurIPS, ICML, ICLR or CVPR (datasets and benchmarks especially)

- Experience on an evaluation or data team at an AI lab

- Experience selling or licensing data to AI labs

- Experience with data valuation or data attribution research

CURRENT STACK

Research

- Python / PyTorch

- Open-weight image and video models

- Cloud GPUs

Data

- Hundreds of millions of opt-in photos, videos and documents

- PostgreSQL (Supabase)

- S3 storage

COMPENSATION

- Base salary: $250,000 - $350,000

- $750,000 – $1,500,000 equity

We move fast and work hard.

If you're excited to build the benchmarks that decide what data trains frontier AI, let’s talk!

GROWTH OPPORTUNITY

You’ll join a team operating at the frontier of applied AI data infrastructure.

In this role, you’ll have the opportunity to:

• Own core systems that power one of the largest human data networks in the world
• Design infrastructure that directly influences what data trains next-generation AI models
• Build at real scale - millions of uploads per day, adversarial environments, global contributors
• Ship alongside a team that has built marketplaces, AI systems, and products used by millions

If you’re excited to move fast, build systems that matter, and help define how human data powers frontier AI, let’s talk.

Skills Required

  • 3+ years of machine learning research or research engineering experience
  • Built a benchmark or evaluation used by other people
  • Hands-on experience training and fine-tuning image or video models with PyTorch
  • Deep understanding of experimental design and statistics, including controls, ablations, and human studies
  • Experience running experiments end to end, from GPUs through final report
  • Clear writing for researchers and buyers
  • Publications at NeurIPS, ICML, ICLR, or CVPR
  • Experience on an evaluation or data team at an AI lab
  • Experience selling or licensing data to AI labs
  • Experience with data valuation or data attribution research
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
6 Employees
Year Founded: 2025

What We Do

Kled AI operates a human data marketplace where individuals can contribute their data, such as photos and videos, and get paid, while enterprises gain access to structured datasets for training AI models.

Similar Jobs

Fieldguide Logo Fieldguide

Product Support Representative

Artificial Intelligence • Software
Remote
USA
230 Employees

Fieldguide Logo Fieldguide

Product Support Representative

Artificial Intelligence • Software
Remote
USA
230 Employees
52K-75K Annually

Shield AI Logo Shield AI

Reliability Engineer

Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software • Defense Technology
Remote
USA
180K-270K Annually

Cloudflare Logo Cloudflare

Senior Customer Engineer, Named - Portland, OR

Cloud • Information Technology • Security • Software • Cybersecurity
Remote or Hybrid
Oregon, USA
4400 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account