Research Engineer, Index Intelligence

Posted 2 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
180K-350K Annually
Entry level
Artificial Intelligence • Software
Building embeddings-based search infrastructure
The Role
Own the machine-learning signals and decisions governing web crawling and indexing at massive scale. Develop classifiers, rankers, and calibrated models to assess page quality, credibility, freshness, parsing success, duplicate content, and indexing value. Define ground truth for ambiguous problems, validate measurable search improvements, and collaborate across crawling, indexing, and retrieval teams to improve the quality and coverage of search results.
Summary Generated by Built In

Exa is an applied AI lab building a search engine unlike the world has ever seen. We build massive-scale infra to crawl the entire web, train state-of-the-art embedding models to process it, and design super high performant vector databases to retrieve over it. We now power search for Cursor, Cognition, HubSpot, and over 400,000 developers and have raised $350m from Lightspeed, Benchmark, and a16z.

 

Our ultimate goal is to build perfect search over all the world's information, far beyond Google. If you want to build massive-scale ML systems that will define the way the new AI world consumes information, this is the place for you.

We crawl the web continuously and cannot keep all of it, refresh all of it, or spend a GPU on all of it. Something has to decide which pages are worth indexing, which links are worth following, which pages say the same thing as pages we already have, what has gone stale, and what we should never have picked up. These decisions are worth more than most ranking work. The cheapest way to improve search is to stop indexing pages nobody should ever retrieve, and to start indexing the ones we are missing. Today they run on a mix of learned signals and thresholds someone picked.

We are looking for a research engineer to own the signals behind those decisions, and the decisions themselves.

Desired Experience
  • You are comfortable owning a problem with no ground truth, where the first job is defining what the right answer means

  • Hands-on ML experience with classifiers, rankers and calibration, plus strong data instincts at web scale

  • You think in end-to-end impact. A signal only counts if a decision changes and search gets better

  • You like working across teams. Crawling, indexing and retrieval all consume what you build

  • You care about the problem of finding high quality knowledge and recognize how important this is for the world

Example Projects
  • Make parsing work on the pages where it currently does not, and prove the improvement rather than assert it

  • Teach a model to judge page quality, and get everyone to agree on what quality means well enough to supervise it

  • Work on credibility and misinformation as a modelling problem: what a page claims, whether it is a reliable source of it, and whether it was written for a reader or for a crawler

  • Decide whether two documents are semantically the same or genuinely different, so we can deduplicate the web without collapsing pages that a user would want to see separately

 

Exa is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, creed, color, religion, sex, sexual orientation, gender identity or expression, national origin, disability, age, veteran status, marital status, pregnancy or related conditions, criminal histories consistent with applicable law, or any other basis protected by applicable law.

Skills Required

  • Comfort owning problems without ground truth and defining what the right answer means
  • Hands-on machine learning experience with classifiers, rankers, and calibration
  • Strong data instincts at web scale
  • Ability to evaluate end-to-end impact and demonstrate that signals improve search decisions
  • Ability to collaborate across crawling, indexing, and retrieval teams
  • Interest in finding high-quality knowledge and understanding its importance
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Burlington, MA
86 Employees
Year Founded: 2021

What We Do

Exa was built with a simple goal — to organize all knowledge. After several years of heads-down research, we developed novel representation learning techniques and crawling infrastructure so that LLMs can intelligently find relevant information.

Similar Jobs

Boeing Logo Boeing

Mid-Level Industrial Security Specialist

Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
In-Office
El Segundo, CA, USA
170000 Employees
94K-128K Annually

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Sales Support Associate II-8

eCommerce • Fashion • Retail • Sales • Wearables • Design
Hybrid
Livermore, CA, USA
16000 Employees
15-22 Hourly

Boeing Logo Boeing

Systems Engineer

Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
In-Office
El Segundo, CA, USA
170000 Employees
79K-107K Annually

Boeing Logo Boeing

Senior Manager, Proprietary Programs Integrated Planning and Scheduling

Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
In-Office
Seal Beach, CA, USA
170000 Employees
146K-212K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
43 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account