About the Role
We’re looking for a sharp, experienced Lead Spreadsheet Quality Analyst to oversee the accuracy and consistency of our spreadsheet evaluation data for AI training.
You’ll act as the quality gatekeeper for Excel-based annotation tasks, reviewing the work of Level 1 annotators, providing feedback, and maintaining strict programmatic verification (PV) standards that ensure our models learn from clean, unambiguous data.
This role blends technical precision with people leadership. You’ll mentor reviewers, refine QC processes, and audit datasets that shape how AI agents reason through complex spreadsheet tasks.
Note: This is a contract role with hours aligning to 10am-5pm PST.
Responsibilities
Review, approve, or reject annotated spreadsheet tasks for programmatic verification (PV) compliance
Provide detailed, actionable feedback to Level 1 annotators and help them improve their accuracy and speed
Define, refine, and document quality control guidelines and edge-case examples
Audit datasets for internal consistency and escalate structural or tooling issues to the product and research teams
Maintain weekly throughput and quality targets while ensuring annotation teams meet benchmark standards
Qualifications
3+ years in QA, data operations, analytics, or data labeling
Expert Excel user with formula auditing and debugging experience
Familiar with quality frameworks or annotation pipelines
Comfortable writing clear feedback and coaching others
Bonus
Familiarity with evaluation datasets or ML training data
Experience working in a startup environment
The Details
Location: Remote!
Compensation: $50 per hour + bonuses based on high quality task completion. Total expected compensation of $75 per hour
Hours: 10am-5pm PST. Additional hours may be requested if needed
What makes us interesting
Small, elite team of ex-founders, researchers from top AI Labs, top CS grads, and engineers from top companies
True ownership You will not be blocked by bureaucracy, shipping meaningful work within weeks rather than months
Serious momentum We're well-funded by top investors, moving fast, and focused on execution
What we do
Ship consumer products powered by cutting-edge AI research, and
Build infrastructure that facilitates research and product, and
Innovate cutting-edge research that will open up new consumer product forms
Top Skills
What We Do
Fundamental Research Labs is building digital humans—machines with the capacity to learn, care, and grow alongside us.
We're an applied research company building autonomous, collaborative, and socially intelligent agents. Our small team includes computational neuroscientists, AI researchers, engineers, and builders from MIT EECS, Stanford NLP Group, Google X, Citadel, and beyond.
Our research prototypes began with multi-agent experiments in games like Minecraft and Roblox, where over a million people have interacted with our agents. Today, we're bringing those agents out of the sandbox and into the real world—starting with your computer.
