Engineering Manager, AI Quality

Reposted 21 Days Ago
Be an Early Applicant
New York, NY
In-Office
260K-330K Annually
Senior level
Artificial Intelligence • Legal Tech • Professional Services • Software
The Role
Drive AI and quality improvements at Harvey by establishing evaluation processes, building reusable AI building blocks, and collaborating with product teams.
Summary Generated by Built In
Why Harvey

At Harvey, we’re transforming how legal and professional services operate — not incrementally, but end-to-end. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come.

This is a rare chance to help build a generational company at a true inflection point. With 1000+ customers in 58+ countries, strong product-market fit, and world-class investor support, we’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched.

Our team is sharp, motivated, and deeply committed to the mission. We move fast, operate with intensity, and take real ownership of the problems we tackle — from early thinking to long-term outcomes. We stay close to our customers — from leadership to engineers — and work together to solve real problems with urgency and care. If you thrive in ambiguity, push for excellence, and want to help shape the future of work alongside others who raise the bar, we invite you to build with us.

At Harvey, the future of professional services is being written today — and we’re just getting started.

Role Overview

The quality of Harvey’s AI & Search systems is of critical importance. Our customers expect us to produce accurate, specific, verifiable and personalized results across all of our product surfaces. They also expect the quality of our answers to continuously get benchmarked and improved.

In this role, you will drive overall AI & results quality across all of Harvey’s products (Assistant, Harvey Word, Vault, Workflows & Agents, and net new products). This includes establishing the right evaluation processes and tools, creating and evangelizing reusable AI building blocks, and working closely with all product teams to continuously improve the quality of Harvey’s AI outputs. You will be responsible for building out tools and processes and for establishing a strong culture of scientific experimentation, rigorous evaluation, and iterative improvements.

What You'll Do
  • Establish an AI & Results Quality Program at Harvey: Establish offline and online eval processes and tools, and a culture of continuous iteration and experimentation.

  • Build out core AI quality building blocks that can be reused across different teams and surface areas.

  • Own search & retrieval quality, both for AI applications as well as other use cases.

  • Work closely with product engineering to continuously improve the quality and capabilities of our AI & search products.

  • Work closely with platform engineering to scale our capabilities.

What You Have
  • Significant industry experience leading AI or other related quality efforts (search or ads ranking systems, recommender systems, etc) at industry-leading companies.

  • Excellent software engineering skills; experience working in teams that built and operated production systems

  • Excellent communication skills, both written and verbal.

  • Ability to roll up your sleeves and build team, processes, and technology from the ground up.

  • A strong academic or professional background in Machine Learning, Generative AI, Information Retrieval or other related fields.

Compensation Range

$260,000 - $330,000 USD

#LI-ML1

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made by emailing [email protected]

Top Skills

Generative Ai
Information Retrieval
Machine Learning
Software Engineering
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
373 Employees
Year Founded: 2022

What We Do

Harvey is a generative AI company backed by Sequoia and OpenAI's startup fund building the future of professional services.

Similar Jobs

Bose Logo Bose

Electronics Test Technician

Automotive • eCommerce • Hardware • Music • Retail • Software • Wearables
Hybrid
Binghamton, NY, USA
2900 Employees
25-34 Hourly

Bose Logo Bose

Pack Line

Automotive • eCommerce • Hardware • Music • Retail • Software • Wearables
Hybrid
Binghamton, NY, USA
2900 Employees
16-19 Hourly

Snap Inc. Logo Snap Inc.

Software Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Remote or Hybrid
6 Locations
5000 Employees
133K-235K Annually

Snap Inc. Logo Snap Inc.

Senior Client Partner

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Remote or Hybrid
4 Locations
5000 Employees
121K-214K Annually

Similar Companies Hiring

Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account