Human Data Manager

Posted 5 Days Ago
Be an Early Applicant
2 Locations
Remote
Mid level
Artificial Intelligence • Edtech • Machine Learning • Professional Services
The Role
Manage end-to-end delivery of human data evaluation projects: scope, staff, run production and QC, track throughput, and ensure on-time, high-quality shipments across concurrent engagements.
Summary Generated by Built In

Reports to: Human Data Evals Lead

Owns: end-to-end project delivery, staffing, production, quality, and on-time shipping

Location: Remote / Latam / US

The role

You run our data projects from scoped brief to delivered package. Once an engagement is won, it’s yours: you assemble the right experts, drive production, enforce the quality bar on every artifact, and ship on time. You are the person who makes sure nothing leaves the building below frontier standard, and nothing comes back rejected without us already knowing why. On a small team running multiple concurrent projects, you are the delivery engine of the Human Data Division.

Responsibilities
  • Project execution. Take scoped engagements through staffing, production, QC, and delivery. Own timeline, throughput, and the delivered package across several concurrent projects at once.

  • Expert orchestration. Staff each project from the expert pool, brief and calibrate contributors, manage their output and utilization, and keep production moving without quality drift.

  • Quality control. Run the QC structure on every deliverable — calibration layers, severity-weighted rubrics, deterministic verifiers, evidence maps — so each package survives buyer-side scrutiny before it ships.

  • Throughput & instrumentation. Track output-per-contributor-week, flag bottlenecks early, and protect margin by managing expert hours against scope.

  • Handoff. Keep the Strategic Project Lead and the Human Data Evals Lead informed on status, risk, and what shipped; surface anything that needs escalation before it becomes a delivery miss.

Experience
  • Delivered technical or data projects end to end under deadline pressure, owning quality and throughput across multiple concurrent workstreams.

  • Managed distributed contributors or expert pools — briefing, calibrating, and holding output to a standard.

  • Built or run QC processes that caught defects before a client did.

Qualifications
  • 3+ years in program/delivery management, technical project management, or data operations, ideally in AI/ML data, evaluation, or annotation.

  • Comfortable with how frontier models are evaluated — rubrics, pass rates, what makes a task discriminate a model — enough to QC it, even if you don’t author it.

  • Proven ability to run several projects in parallel without dropping quality or timelines.

  • Fluent English. Spanish is a nice to have.

Skills Required

  • Delivered technical or data projects end-to-end under deadline pressure, owning quality and throughput across multiple concurrent workstreams.
  • Managed distributed contributors or expert pools — briefing, calibrating, and enforcing output standards.
  • Built or run QC processes that caught defects before client detection (calibrations, rubrics, verifiers, evidence maps).
  • 3+ years in program/delivery management, technical project management, or data operations.
  • Experience in AI/ML data, evaluation, or annotation.
  • Comfortable evaluating frontier models (rubrics, pass rates, task discrimination) sufficient to QC evaluations.
  • Proven ability to run several projects in parallel without dropping quality or timelines.
  • Fluent English.
  • Spanish proficiency.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
0 Employees
Year Founded: 2022

What We Do

Anyone AI is an edtech startup dedicated to bridging the AI talent gap by investing in software developers from Latin America. The company provides intensive, hands-on training programs in Machine Learning and Artificial Intelligence, led by industry experts. By combining technical skill development with employability support, Anyone AI prepares professionals for global career opportunities, helping them transition into high-impact roles within the rapidly evolving AI and technology sectors.

Similar Jobs

Mondelēz International Logo Mondelēz International

Analytics Manager

Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Remote or Hybrid
6 Locations
90000 Employees

Circle (circle.so) Logo Circle (circle.so)

Lead Product Designer

Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Easy Apply
Remote
31 Locations
250 Employees
140K-170K Annually

Luxury Presence Logo Luxury Presence

Staff Software Engineer

Marketing Tech • Real Estate • Software • PropTech • SEO
Easy Apply
Remote or Hybrid
12 Locations
500 Employees

Adyen Logo Adyen

Operations Manager

Fintech • Payments • Financial Services
Easy Apply
Remote or Hybrid
11 Locations
4771 Employees

Similar Companies Hiring

Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account