QA Reviewer, Data Annotation

Posted 6 Days Ago
Be an Early Applicant
Palo Alto, CA, USA
In-Office
Mid level
Artificial Intelligence • Robotics • Industrial • Manufacturing
The Role
Lead quality assurance for a data annotation pipeline by running calibration sessions, identifying labeling inconsistencies, conducting root-cause analysis, updating guidelines, monitoring quality metrics, coaching reviewers, and coordinating with technical, operations, vendor, and annotation teams on complex robotics and multi-sensor data.
Summary Generated by Built In
QA Reviewer, Data AnnotationAbout Mind:

Mind Robotics is building Physical AI for real-world industrial deployment, starting with the factory floor. We believe the hardest problems in AI are solved when researchers and engineers are hands-on with the physical world every day - and we're looking for people who are passionate about robotics, value ownership, and are excited to tackle difficult problems. Join us if you want to move beyond digital intelligence and put intelligence into motion.

About the team and the role:

We are looking for a QA Reviewer & Calibration Lead to ensure our data annotation pipeline operates at high throughput without sacrificing quality. In this role, you will be the backbone of quality control for our continuous data flywheel. You will lead regular alignment sessions, identify systematic labeling inconsistencies, and work hands-on with internal reviewers and partner teams to resolve ambiguous edge cases.

Responsibilities:

  • Run calibration sessions: Lead weekly alignment meetings with internal reviewers and vendor partners to ensure everyone grades and labels data with high consistency.

  • Track and fix quality issues: Spot common reviewer errors, conduct root-cause analysis on labeling discrepancies, and build feedback loops to eliminate systemic mistakes.

  • Update guidelines and documentation: Keep labeling instructions, edge-case taxonomies, and SOPs clear, crisp, and up-to-date as project requirements evolve.

  • Monitor quality metrics: Track quality scores, accuracy rates, and inter-annotator agreement metrics across dashboards to ensure production targets are met.

  • Provide feedback and guidance: Deliver direct feedback and targeted training to reviewers navigating complex guidelines or multi-sensor data edge cases.

  • Coordinate cross-functionally: Work closely with technical leads, operations, and annotation teams to resolve taxonomy questions quickly and keep the data flywheel moving smoothly.

Requirements:
  • 2–4 years of experience in quality assurance, data annotation QA, or data review in high-velocity tech or AI environments.

  • Meticulous attention to detail: A sharp eye for subtle edge cases and a practical, logical approach to resolving ambiguous data scenarios.

  • Clear communication: Strong written and verbal communication skills with the ability to explain complex labeling rules clearly and facilitate alignment discussions.

  • Data fluency: Comfortable navigating dashboards, spreadsheets, and basic reports to track accuracy metrics and spot trends.

  • Collaborative mindset: A proactive, team-oriented attitude focused on coaching reviewers and continually driving quality across the organization.

  • Experience with multi-camera/ego-exo video annotation, point cloud data, or robotics training data pipelines (is a plus).

  • Background working with third-party vendor teams (BPO/managed services) in a fast-paced hardware or AI deployment environment (is a plus).

Skills Required

  • 2–4 years of experience in quality assurance, data annotation QA, or data review in high-velocity technology or AI environments
  • Meticulous attention to detail and ability to resolve ambiguous data scenarios logically
  • Strong written and verbal communication skills
  • Ability to explain complex labeling rules and facilitate alignment discussions
  • Comfort navigating dashboards, spreadsheets, and basic reports to track accuracy metrics and identify trends
  • Collaborative, proactive, team-oriented approach focused on coaching reviewers and improving quality
  • Experience with multi-camera or ego-exo video annotation, point cloud data, or robotics training data pipelines
  • Experience working with third-party vendor teams in a fast-paced hardware or AI deployment environment
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
20 Employees
Year Founded: 2025

What We Do

Mind Robotics builds intelligent, AI-driven robotic systems for industrial deployment, focusing on creating collaborative platforms for manufacturing environments.

Similar Jobs

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Sales Associate II

eCommerce • Fashion • Retail • Sales • Wearables • Design
Hybrid
Valley Center, CA, USA
16000 Employees
15-24 Hourly

Motive Logo Motive

Security Engineer

Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Easy Apply
In-Office
5 Locations
4000 Employees
160K-205K Annually

Liberty Mutual Insurance Logo Liberty Mutual Insurance

Senior Underwriting Officer - Environmental Casualty Product Line Manager

Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Hybrid
6 Locations
40000 Employees
98K-298K Annually

Airwallex Logo Airwallex

Security Engineer

Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Hybrid
San Francisco, CA, USA
2700 Employees
220K-280K Annually

Similar Companies Hiring

Unusual Machines, Inc. Thumbnail
Hardware • Robotics
Orlando, FL
300 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account