Software Engineer, Search Systems - Code Data

Posted 2 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
250K-500K Annually
Senior level
Artificial Intelligence • Software
We use AI to understand human ability and match talent with the opportunities they're best suited for.
The Role
Lead design and implementation of Mercor's code search and retrieval systems: hybrid dense-code embeddings plus lexical (BM25) retrieval, candidate generation, ranking/re-ranking, model routing, query translation from natural language, indexing pipelines, evaluation/A-B testing, and technical leadership to evolve embeddings and search quality safely at scale.
Summary Generated by Built In
About Mercor

Mercor's mission is to organize human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier models. Millions of domain experts on the platform are paid over $4 million per day to train frontier AI models. Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this same infrastructure to Fortune 500 companies: helping companies capture how their best people actually work, translating that expertise directly back into agents.

 

Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices.

About the Role

Some of the most valuable work on Mercor's platform is code—the tasks, problems, and solutions that train and evaluate the world's frontier coding models. As a Software Engineer for Code Search & Retrieval, you'll own the architecture and algorithms behind how we search across code tasks: finding similar tasks, routing them to the right models, and turning natural-language questions into precise retrieval.

Searching over code is a genuinely hard problem. Identifying similar code tasks—not just similar text—requires retrieval that understands structure, semantics, intent, and difficulty, far beyond what generic embeddings capture. You'll own that end to end: the vision is to search across code tasks at scale, identify and select the correct code-specific models for a given task, and translate NLP questions into search queries that return the right code and tasks.

This is a hands-on technical leadership role, not a management role. You'll design and build the retrieval systems that combine dense (code) embeddings and lexical (BM25) signals, and make the tradeoffs that let search stay fast and affordable at scale. Because Mercor operates at the frontier of data and models, you'll also own the hardest part of the problem: continuously evolving embeddings, models, and search quality as newer, state-of-the-art code models arrive—without regressing what already works.

As an engineer, your impact extends well beyond your own commits. You'll set the technical direction the rest of the org builds on, mentor and grow the engineers around you, and raise the bar for how we build.

What You'll Do
  • Own the architecture of Mercor's code search and retrieval systems end to end—hybrid retrieval combining dense code embeddings and BM25, candidate generation, ranking, and re-ranking over code tasks.

  • Solve the hard problem of identifying similar code tasks—retrieval that captures code structure, semantics, intent, and difficulty rather than surface text.

  • Build the system that identifies and selects the correct code-specific models for a given task, and routes tasks to the right model.

  • Design natural-language-to-query translation that turns NLP questions into precise search over code and tasks.

  • Design and operate the indexing pipeline so the task index stays fresh and consistent as new tasks, solutions, and results arrive continuously—balancing incremental updates, full rebuilds, and real-time ingestion.

  • Make the cost-and-speed tradeoffs that keep search fast and economical at scale: embedding dimensionality and quantization, ANN index choice and parameters, caching, sharding, and serving infrastructure.

  • Build the systems and evaluation harnesses that let us continuously evolve embeddings, models, and search quality—safely swapping in new code models, re-embedding corpora, and A/B testing relevance as SOTA advances.

  • Define and drive the long-term technical strategy for code retrieval across the organization, and lead the highest-stakes design reviews.

  • Establish evaluation metrics, offline/online testing, and quality guardrails so search improvements are measurable and regressions are caught before they ship.

  • Stay deeply hands-on: prototype critical systems, ship production code, and unblock teams on their hardest retrieval and infrastructure problems.

  • Mentor and grow engineers—junior and senior—through design reviews, pairing, and clear technical writing, raising the technical bar across the org.

  • Partner with product, researchers, and engineering leadership on build-vs-buy decisions, platform investments, and technical hiring.

What We're Looking For
  • 8+ years of professional software engineering experience, including 3+ years operating at a Senior level or above, with a Staff-level track record of org-wide technical impact.

  • Deep, hands-on expertise building search and retrieval systems: dense-embedding retrieval, lexical scoring (BM25/TF-IDF), hybrid ranking, and re-ranking.

  • Good to have but not required: Experience with code search or code understanding—retrieval over code, code embeddings, or working with code-specific models—and an appreciation for why matching similar code tasks is harder than matching text.

  • Strong understanding of the search algorithms and index internals—vector/ANN indices (e.g. HNSW, IVF, product quantization), inverted indices, and engines such as Elasticsearch/OpenSearch, Lucene, FAISS, or vector databases.

  • A track record of making the right cost-vs-speed tradeoffs: latency budgets, throughput, memory footprint, and infrastructure spend on high-QPS systems.

  • Familiarity translating natural-language questions into structured search queries (query understanding, semantic parsing, or LLM-assisted query generation).

  • Excellent systems fundamentals: distributed systems, data modeling, and API design at scale.

  • Demonstrated technical leadership and mentorship—you've helped junior and senior engineers grow and level up an engineering team.

  • Genuine excitement for agentic development and new technology, fluency with modern AI dev tools (e.g. Claude Code, Cursor, Copilot), and a deep passion for writing great code.

  • Excellent communication—able to make complex tradeoffs legible to both engineers and leadership. Strong opinions, loosely held. High ownership, pragmatism, and a bias toward shipping.

Nice to Have
  • Experience training or fine-tuning code embedding models or code-specific LLMs.

  • Experience with learning-to-rank, semantic search, or recommendation systems in production.

  • Familiarity with LLM-based retrieval, RAG patterns, and model routing/selection.

  • Background operating latency-critical services on modern cloud and orchestration infrastructure.

Why Mercor
  • Impact: Own the code search systems that decide how well Mercor finds, routes, and evaluates the code tasks training the world's frontier models, at a company scaling faster than almost any in its category.

  • Ownership: Org-wide technical scope with a direct line to engineering leadership and real authority over technical direction.

  • Learning: Work alongside world-class engineers, product leaders, and AI researchers building at the frontier of AI.

  • Growth: Shape the engineering organization itself—its standards, its architecture, and its next generation of technical leaders.

Benefits
  • Generous equity grant vested over 4 years

  • Up to $15K relocation bonus (if moving to the Bay Area)

  • A $10K housing bonus (if you live within 0.5 miles of our office)

  • A $1.5K monthly stipend for meals

  • Free Equinox membership

  • Health insurance

Mercor is an equal opportunity employer. We work in-person five days a week in our San Francisco office.

Skills Required

  • 8+ years of professional software engineering experience
  • 3+ years operating at a Senior level or above with Staff-level track record of org-wide technical impact
  • Hands-on expertise building search and retrieval systems: dense-embedding retrieval, lexical scoring (BM25/TF-IDF), hybrid ranking, and re-ranking
  • Deep understanding of search algorithms and index internals: vector/ANN indices (HNSW, IVF, product quantization), inverted indices, and engines such as Elasticsearch/OpenSearch, Lucene, FAISS, or vector databases
  • Proven track record making cost-vs-speed tradeoffs for high-QPS, latency-sensitive systems (embedding dimensionality, quantization, ANN parameters, caching, sharding)
  • Familiarity translating natural-language questions into structured search queries (query understanding, semantic parsing, or LLM-assisted query generation)
  • Strong systems fundamentals: distributed systems, data modeling, and API design at scale
  • Demonstrated technical leadership and mentorship experience
  • Genuine excitement and fluency with modern AI developer tools (ex: Claude Code, Cursor, Copilot)
  • Experience with code search or code understanding (retrieval over code, code embeddings, code-specific models)
  • Experience training or fine-tuning code embedding models or code-specific LLMs
  • Experience with learning-to-rank, semantic search, or recommendation systems in production
  • Familiarity with LLM-based retrieval, RAG patterns, and model routing/selection
  • Background operating latency-critical services on modern cloud and orchestration infrastructure

Mercor Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Mercor and has not been reviewed or approved by Mercor.

  • Fair & Transparent Compensation Pay is considered competitive across many roles, with clear hourly ranges and an hourly/pay‑per‑task mix designed to align rates with expertise. The structure emphasizes transparent, appropriate pay levels and guarantees payment for legitimate logged time.
  • Strong & Reliable Incentives Payments are processed on a predictable weekly cadence via Stripe/Wise, and some tracks offer additional weekly bonus incentives for top performers. This combination of regular payouts and performance bonuses supports dependable earnings when projects are active.
  • Equity Value & Accessibility Select full‑time roles include generous equity grants alongside cash perks such as relocation and housing bonuses. These elements increase total compensation for those positions.

Mercor Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
2,217 Employees
Year Founded: 2023

What We Do

We use AI to understand human ability and match talent with the opportunities they're best suited for.

Similar Jobs

Comcast Logo Comcast

Senior Account Executive

Digital Media • Information Technology • News + Entertainment
Hybrid
Menlo Park, CA, USA
115000 Employees
75K-125K Annually

Comcast Logo Comcast

Senior Account Executive

Digital Media • Information Technology • News + Entertainment
Hybrid
San Jose, CA, USA
115000 Employees
75K-125K Annually

Cox Enterprises Logo Cox Enterprises

Technical Customer Care Specialist I (Vin Solutions)

Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Remote or Hybrid
United States
50000 Employees
17-25 Hourly

BAE Systems, Inc. Logo BAE Systems, Inc.

Designer

Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Hybrid
San Diego, CA, USA
40000 Employees
66K-106K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account