Product Operations Manager, Research Services

Posted 8 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
140K-210K Annually
Mid level
Artificial Intelligence • Software
We use AI to understand human ability and match talent with the opportunities they're best suited for.
The Role
Own benchmark and evaluation prioritization, coordinate training and inference partners, forecast capacity, manage budgets and SLAs, track customer delivery, and lead operational reviews. Translate recurring delivery issues into product requirements and partner with Engineering to automate workflows. The role requires technical fluency in LLM evaluation, post-training methods, inference economics, SQL, and Python, plus strong project management, vendor judgment, communication, and ownership.
Summary Generated by Built In
About Mercor

Mercor's mission is to organize human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier models. Millions of domain experts on the platform are paid over $4 million per day to train frontier AI models. Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this same infrastructure to Fortune 500 companies: helping companies capture how their best people actually work, translating that expertise directly back into agents.

 

Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices.

About the Role

As a Product Operations Manager, Research Services, you'll drive operational excellence to support Mercor's full-service research partnerships. You will prioritize and manage delivery across various strategic customer segments to support model evaluations, diagnose model capability gaps, and fulfill post-training demand to better support our most strategic customers. This is a highly technical, internally-facing role in the Product Operations job family at the intersection of Product, Engineering, Data Production, GTM, Finance, and Strategic Partnerships.

What You'll Do
  • Prioritize the Benchmark Portfolio: Own the intake and prioritization of new benchmarks and evaluations supported in our platform. Weigh customer demand, observed capability gaps, differentiation versus public benchmarks, and build cost to inform our priorities.

  • Support Dataset Demand Generation: Run and share leaderboard evals to drive Mercor’s research brand equity during new model releases.

  • Manage Training and Inference Partners & Budgets: Own the relationships with our inference providers, compute partners, and external training vendors. Forecast capacity against the delivery calendar, negotiate and track SLAs and rate cards, monitor cost per eval run and per rollout, and qualify new partners before we need them.

  • Track Customer Delivery: Maintain the operating picture across every active evals, loss analysis, and post-training engagements, highlighting scope, milestones, dependencies, and SLA status. Run the delivery review, escalate slipping commitments before the customer notices, and give research counterparts a straight answer on where things stand.

  • Shape the Product: Translate recurring delivery friction into product requirements for the eval platform and partner with Engineering to automate the workflows you'd otherwise be running by hand.

What We're Looking For
  • Experience: 3+ years in Product Operations, Product Management, Technical Program Management, Research Operations, Solutions Engineering, or a similar technical, customer-facing role. Experience operating in an ML research or AI infrastructure environment strongly preferred.

  • Technical Fluency: Fluent in how modern LLM evaluation works, including harness design, verification, agentic rollouts, and contamination and fairness pitfalls. Working understanding of post-training (SFT, preference ranking, RL) and of inference economics. Familiar with coding agents; comfortable in SQL and Python without agent assistance.

  • Vendor and Capacity Judgment: Can plan capacity against an uncertain demand curve, hold partners to an SLA, and weigh cost against reliability without needing to escalate every call.

  • Ownership: Thrive in ambiguous environments and take ownership from problem definition through execution. Comfortable being the person accountable for a date.

  • Communication: Can hold your own in a technical conversation with AI researchers and write a status update an executive can act on. Excellent written and verbal communication.

  • Systems Thinking: Strong project management and cross-functional coordination skills. Passion for fixing problems at the source and building repeatable systems rather than one-off solutions.

Benefits

  • Bi-annual performance bonus structure

  • Generous equity grant vested over 4 years

  • Up to $15k Relocation bonus

  • $10K housing bonus (if you live within 0.5 miles of our office)

  • $1.5K monthly stipend for meals

  • Free Equinox membership

  • $200 monthly laundry reimbursement

  • $200 monthly personal wellness reimbursement

  • Health, Dental, Vision insurance

Skills Required

  • 3+ years of experience in Product Operations, Product Management, Technical Program Management, Research Operations, Solutions Engineering, or a similar technical customer-facing role
  • Fluency in modern LLM evaluation, including harness design, verification, agentic rollouts, contamination, and fairness pitfalls
  • Working understanding of post-training methods including SFT, preference ranking, and reinforcement learning
  • Working understanding of inference economics
  • Familiarity with coding agents
  • Comfortable using SQL and Python without agent assistance
  • Ability to plan capacity against uncertain demand, manage partners against SLAs, and balance cost and reliability
  • Strong ownership in ambiguous environments, from problem definition through execution
  • Excellent written and verbal communication skills
  • Strong project management and cross-functional coordination skills
  • Experience operating in an ML research or AI infrastructure environment

Mercor Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Mercor and has not been reviewed or approved by Mercor.

  • Fair & Transparent Compensation Pay is considered competitive across many roles, with clear hourly ranges and an hourly/pay‑per‑task mix designed to align rates with expertise. The structure emphasizes transparent, appropriate pay levels and guarantees payment for legitimate logged time.
  • Strong & Reliable Incentives Payments are processed on a predictable weekly cadence via Stripe/Wise, and some tracks offer additional weekly bonus incentives for top performers. This combination of regular payouts and performance bonuses supports dependable earnings when projects are active.
  • Equity Value & Accessibility Select full‑time roles include generous equity grants alongside cash perks such as relocation and housing bonuses. These elements increase total compensation for those positions.

Mercor Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
2,217 Employees
Year Founded: 2023

What We Do

We use AI to understand human ability and match talent with the opportunities they're best suited for.

Similar Jobs

BlackRock Logo BlackRock

Product Manager

Fintech • Information Technology • Financial Services
In-Office
3 Locations
25000 Employees
112K-163K Annually

Mastercard Logo Mastercard

Consultant

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
San Francisco, CA, USA
38800 Employees
95K-95K Annually

Magna International Logo Magna International

Controller

Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Hybrid
Ontario, CA, USA
171000 Employees
125K-193K Annually

MongoDB Logo MongoDB

Senior Manager, HR Compliance - Americas

Big Data • Cloud • Software • Database
Easy Apply
Remote or Hybrid
United States
5550 Employees
81K-160K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account