Software Engineer, Infrastructure

Reposted 9 Days Ago
Be an Early Applicant
San Francisco, CA
In-Office
150K-300K Annually
Mid level
Artificial Intelligence • Software
Building embeddings-based search infrastructure
The Role
The Infra Engineer will design and operate large-scale infrastructure, focusing on reliability, observability, and optimization across GPU clusters and Kubernetes systems.
Summary Generated by Built In

Exa is building a search engine from scratch to serve every AI application. We build massive-scale infrastructure to crawl the web, train state-of-the-art embedding models to index it, and develop super high performant vector databases in rust to search over it. We also own a $5M H200 GPU cluster that regularly lights up tens of thousands of machines.

Our Infrastructure Team builds the underlying tooling and infrastructure that powers all Exa's systems. Basically, we need more infra engineers to build the machine that builds the machine so that we can move as fast as possible as an engineering org. That could mean building GPU cluster orchestration in Kubernetes, map-reduce batchjobs on Ray, or the best observability tooling in the world.

Desired Experience

  • You have experience designing and operating large-scale infrastructure - GPU clusters or large Kubernetes clusters or cloud batchjob systems

  • You bring an obsessive mindset — always thinking about reliability, observability, and optimization across the entire stack.

Example Projects

  • Build the Kubernetes orchestration on a $20m GPU cluster

  • Scale our AWS batchjob system to handle map reduce jobs over 10s of thousands of machines

  • Design GPU scheduling software so we max out our cluster utilization

  • Build observability into our production systems

This is an in-person opportunity in San Francisco. We are open to sponsoring international candidates (e.g., STEM OPT, OPT, H1B, O1, E3).

Top Skills

AWS
Gpu
Kubernetes
Ray
Rust
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
San Francisco, , California
86 Employees
Year Founded: 2021

What We Do

Exa was built with a simple goal — to organize all knowledge. After several years of heads-down research, we developed novel representation learning techniques and crawling infrastructure so that LLMs can intelligently find relevant information.

Similar Jobs

Block Logo Block

Principal Software Engineer

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
264K-395K Annually

Block Logo Block

Product Lead, Buy Now Pay Later

Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
In-Office or Remote
8 Locations
12000 Employees
168K-297K Annually

Cash App Logo Cash App

Product Lead, Buy Now Pay Later

Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Remote or Hybrid
8 Locations
3500 Employees
168K-297K Annually

Motorola Solutions Logo Motorola Solutions

LMR Technician

Artificial Intelligence • Hardware • Information Technology • Security • Software • Cybersecurity • Big Data Analytics
Remote or Hybrid
California, USA
23000 Employees
65K-75K Annually

Similar Companies Hiring

Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account