Staff Product Manager, Data & Retrieval

Reposted 6 Days Ago
Be an Early Applicant
San Francisco, CA, USA
Hybrid
214K-278K Annually
Senior level
Artificial Intelligence • Legal Tech • Professional Services • Software
The Role
The Senior Product Manager will lead the strategy and architecture for Harvey's data platform, driving improvements in retrieval and scaling capabilities. Responsibilities include managing data ingestion and architecture, collaborating with engineering teams, and ensuring high-quality systems for AI-powered legal research.
Summary Generated by Built In
Why Harvey

At Harvey, we’re transforming how legal and professional services operate — not incrementally, but end-to-end. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come.

This is a rare chance to help build a generational company at a true inflection point. With 1000+ customers in 58+ countries, strong product-market fit, and world-class investor support, we’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched.

Our team is sharp, motivated, and deeply committed to the mission. We move fast, operate with intensity, and take real ownership of the problems we tackle — from early thinking to long-term outcomes. We stay close to our customers — from leadership to engineers — and work together to solve real problems with urgency and care. If you thrive in ambiguity, push for excellence, and want to help shape the future of work alongside others who raise the bar, we invite you to build with us.

At Harvey, the future of professional services is being written today — and we’re just getting started.

Role Overview

Harvey is building the AI platform for the world’s top legal and professional services teams. Our users rely on fast, accurate access to external legal data to perform research that underpins their most important work. As we scale, our Data & Knowledge organization sits at the center of this mission—turning raw, fragmented information into intelligent systems that power research and reasoning at global scale.

Our Data Team is responsible for ingesting, structuring, understanding, and retrieving millions of documents across jurisdictions, formats, and domains. Whether public or private, offline or online, our mission is to organize the world’s legal information and make it accessible, reliable, and useful.

We’re looking for a Product Manager with deep search, retrieval, and data platform expertise to lead the next generation of Harvey’s data engine as we 100× our capabilities. You will shape the strategy, roadmap, and architecture behind the systems that make advanced reasoning possible. The team owns end-to-end RAG (retrieval-augmented generation) pipelines across domains such as case law, legislation, tax code, and IP law across 50+ jurisdictions. As generation quality continues improving, retrieval quality has become the new frontier—and one of Harvey’s highest priorities.

If you’re passionate about large-scale data problems, complex information retrieval, and building the backbone of cutting-edge AI systems, we’d love to meet you.

What You'll Do
  • Drive the roadmap and strategy for Harvey’s “Data Factory”, ensuring we scale our data 100x through new platforms that build the ‘legal index’ of the world

  • Work with internal operations and external data providers to methodically expand coverage, accelerate execution, and improve dataset quality.

  • Own and evolve Harvey’s end-to-end data architecture—from ingestion and transformation to storage, indexing, and retrieval—ensuring performance, reliability, and scalability for LLM-powered products.

  • Partner with Applied AI engineers to build and optimize retrieval systems, embeddings, search models, and evaluation frameworks.

  • Architect and oversee large-scale ingestion pipelines that aggregate, normalize, and continuously update millions of heterogeneous legal documents across global jurisdictions.

  • Collaborate cross-functionally with Product Engineering, Applied AI, Research, and Platform teams to deliver high-quality production systems that support reasoning, summarization, and legal research workflows.

What You Have
  • 5+ years of experience building or managing search, retrieval, recommendation, or data platforms at scale.

  • Experience working with complex, heterogeneous, or domain-specific datasets with structured + unstructured data.

  • Understanding of modern retrieval methods, including hybrid search (lexical + vector), dense retrieval, re-ranking, embeddings, chunking strategies, and index optimization.

  • Hands-on experience with LLMs or RAG frameworks (evaluation, grounding, hybrid pipelines, query rewriting, LLM-as-a-judge, retrieval metrics).

  • Ability to partner with engineers on technical architecture, with enough depth to challenge assumptions, propose solutions, and influence design.

  • A product mindset for search—balancing user needs, domain complexity, and system constraints to propose high-leverage improvements.

Compensation Range

$214,000 – $278,000 USD

Please find our CA applicant privacy notice here.

#LI-ML1

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made by emailing [email protected]

Top Skills

AI
Data Platforms
Embeddings
Indexing
Llms
Retrieval Augmentation
Search Models
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
373 Employees
Year Founded: 2022

What We Do

Harvey is a generative AI company backed by Sequoia and OpenAI's startup fund building the future of professional services.

Similar Jobs

Anduril Logo Anduril

Recruiting Manager, Hardware

Aerospace • Artificial Intelligence • Hardware • Robotics • Security • Software • Defense
In-Office
Costa Mesa, CA, USA
6000 Employees
150K-190K Annually

Anduril Logo Anduril

Senior Maintenance Specialist

Aerospace • Artificial Intelligence • Hardware • Robotics • Security • Software • Defense
In-Office
Costa Mesa, CA, USA
6000 Employees
48-57 Annually

Verkada Inc Logo Verkada Inc

Technical Support

Cloud • Hardware • Security • Software
In-Office
San Mateo, CA, USA
2000 Employees
30-33 Annually

Zocdoc Logo Zocdoc

Specialist, Customer Experience (Indianapolis)

Healthtech • Information Technology • Software • Telehealth
Easy Apply
Remote or Hybrid
USA
900 Employees
21-26 Annually

Similar Companies Hiring

Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY
Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account