Engineering Manager, AI Quality

Posted 6 Days Ago
Be an Early Applicant
2 Locations
In-Office
297K-390K Annually
Senior level
Artificial Intelligence • Legal Tech • Professional Services • Software
The Role
Lead AI quality efforts, establish evaluation processes, improve AI outputs, and work closely with product engineering to enhance quality in AI products.
Summary Generated by Built In
Why Harvey

At Harvey, we’re transforming how legal and professional services operate — not incrementally, but end-to-end. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come.

This is a rare chance to help build a generational company at a true inflection point. With 700+ customers in 58+ countries, strong product-market fit, and world-class investor support, we’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched.

Our team is sharp, motivated, and deeply committed to the mission. We move fast, operate with intensity, and take real ownership of the problems we tackle — from early thinking to long-term outcomes. We stay close to our customers — from leadership to engineers — and work together to solve real problems with urgency and care. If you thrive in ambiguity, push for excellence, and want to help shape the future of work alongside others who raise the bar, we invite you to build with us.

At Harvey, the future of professional services is being written today — and we’re just getting started.

Role Overview

The quality of Harvey’s AI & Search systems is of critical importance. Our customers expect us to produce accurate, specific, verifiable and personalized results across all of our product surfaces. They also expect the quality of our answers to continuously get benchmarked and improved.

In this role, you will drive overall AI & results quality across all of Harvey’s products (Assistant, Harvey Word, Vault, Workflows & Agents, and net new products). This includes establishing the right evaluation processes and tools, creating and evangelizing reusable AI building blocks, and working closely with all product teams to continuously improve the quality of Harvey’s AI outputs. You will be responsible for building out tools and processes and for establishing a strong culture of scientific experimentation, rigorous evaluation, and iterative improvements.

What You'll Do
  • Establish an AI & Results Quality Program at Harvey: Establish offline and online eval processes and tools, and a culture of continuous iteration and experimentation.

  • Build out core AI quality building blocks that can be reused across different teams and surface areas.

  • Own search & retrieval quality, both for AI applications as well as other use cases.

  • Work closely with product engineering to continuously improve the quality and capabilities of our AI & search products.

  • Work closely with platform engineering to scale our capabilities.

What You Have
  • Significant industry experience leading AI or other related quality efforts (search or ads ranking systems, recommender systems, etc) at industry-leading companies.

  • Excellent software engineering skills; experience working in teams that built and operated production systems

  • Excellent communication skills, both written and verbal.

  • Ability to roll up your sleeves and build team, processes, and technology from the ground up.

  • A strong academic or professional background in Machine Learning, Generative AI, Information Retrieval or other related fields.

Compensation Range

$297,000 - $390,000 USD

Please find our CA applicant privacy notice here.

#LI-ML1

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made by emailing [email protected]

Top Skills

Generative Ai
Information Retrieval
Machine Learning
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
373 Employees
Year Founded: 2022

What We Do

Harvey is a generative AI company backed by Sequoia and OpenAI's startup fund building the future of professional services.

Similar Jobs

Circle Logo Circle

Senior Site Reliability Engineer

Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3
In-Office
New York, NY, USA
980 Employees
148K-195K Annually

Optimum Logo Optimum

Account Executive

AdTech • Digital Media • Internet of Things • Marketing Tech • Mobile • Retail • Software
Hybrid
5 Locations
9000 Employees
59K-96K Annually

Wells Fargo Logo Wells Fargo

Economics Executive

Fintech • Financial Services
Hybrid
2 Locations
213000 Employees
290K-500K Annually

Wells Fargo Logo Wells Fargo

Principal Engineer

Fintech • Financial Services
Hybrid
2 Locations
213000 Employees
159K-305K Annually

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account