Software Engineer, Infrastructure

Reposted 12 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
180K-350K Annually
Mid level
Artificial Intelligence • Software
Building embeddings-based search infrastructure
The Role
The Infra Engineer will design and operate large-scale infrastructure, focusing on reliability, observability, and optimization across GPU clusters and Kubernetes systems.
Summary Generated by Built In

We raised a $250M Series C to build the search engine for AIs. Led by a16z, with existing investors Benchmark, Lightspeed, and YC doubling down, the round brings Exa's valuation to $2.2 billion. Read more

Exa is building a search engine from scratch to serve every AI agent. We build massive-scale infrastructure to crawl the web, train state-of-the-art embedding models to process it, and design super high performant vector databases in rust to search over it. If you like compute, we also own a $5M H200 GPU cluster (and soon 5x'ing that) and regularly spin up batchjobs with tens of thousands of machines.

Our Infrastructure Team builds the underlying tooling and infrastructure that powers all Exa's systems. Basically, we need more infra engineers to build the machine that builds the machine so that we can move as fast as possible as an engineering org. That could mean building GPU cluster orchestration in Kubernetes, map-reduce batchjobs on Ray, or the best observability tooling in the world.

Who You Are

  • You have experience designing and operating large-scale infrastructure - GPU clusters or large Kubernetes clusters or cloud batchjob systems

  • You bring an obsessive mindset — always thinking about reliability, observability, and optimization across the entire stack.

What You'll Do

  • Build the Kubernetes orchestration on a $20m GPU cluster

  • Scale our AWS batchjob system to handle map reduce jobs over 10s of thousands of machines

  • Design GPU scheduling software so we max out our cluster utilization

  • Build observability into our production systems

This is an in-person opportunity in San Francisco. We are open to sponsoring international candidates (e.g., STEM OPT, OPT, H1B, O1, E3).

Skills Required

  • Experience designing and operating large-scale infrastructure
  • Skills in GPU clusters or large Kubernetes clusters or cloud batchjob systems
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
San Francisco, , California
86 Employees
Year Founded: 2021

What We Do

Exa was built with a simple goal — to organize all knowledge. After several years of heads-down research, we developed novel representation learning techniques and crawling infrastructure so that LLMs can intelligently find relevant information.

Similar Jobs

Palantir Technologies Logo Palantir Technologies

Software Engineer

Artificial Intelligence • Information Technology • Software
Hybrid
Palo Alto, CA, USA
4400 Employees
145K-200K Annually

CoreWeave Logo CoreWeave

Staff Software Engineer

Cloud • Information Technology • Machine Learning
In-Office or Remote
5 Locations
1450 Employees
188K-275K Annually

Notion Logo Notion

Software Engineer

Artificial Intelligence • Productivity • Software
Hybrid
2 Locations
1000 Employees
260K-330K Annually

Snap Inc. Logo Snap Inc.

Software Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
2 Locations
5000 Employees
133K-235K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
31 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account