Infrastructure Engineer

Reposted 7 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
Junior
Artificial Intelligence • Machine Learning • Software • Generative AI
The Role
Design and operate systems for high-performance inference and training infrastructure, focusing on reliability, speed, and cost-efficiency. Collaborate with research and product teams.
Summary Generated by Built In

About Us

Relace is building the models and infrastructure that code agents reach for. We power the fastest model on OpenRouter (10,000 tok/s) and deliver optimized small language models designed for retrieval, application, and core code generation functions.

Our technology supports some of the world’s fastest-moving companies — including Lovable, Figma, and Vercel — as they deploy and scale code generation to hundreds of millions of users. We recently raised our Series A from a16z, and we’re growing quickly.

Our team is made up of mathematicians, physicists, and computer scientists who are deeply passionate about their craft. If you thrive on ambitious technical problems, care about elegant systems design, and want to build the foundation of how code gets written at scale, this is the place for you.

The Role

As an Infrastructure Engineer at Relace, you’ll design and operate the systems that power our high-performance inference and training infrastructure. You’ll work closely with our research and product teams to ensure our models run at scale with reliability, speed, and cost-efficiency. This is a hands-on engineering role where you’ll shape how we build and scale the backbone of modern code generation.

You’ll have the opportunity to:

- Architect and manage the infrastructure powering our ultra-fast inference and training stack.

- Build reliable, efficient systems for deploying and scaling ML workloads globally.

- Work on GPU scheduling, distributed systems, and high-performance cloud deployments.

- Optimize performance and cost across compute, networking, and storage layers.

- Collaborate with world-class engineers to push the limits of what small models can do.

Requirements

2+ years of experience writing high-quality production code

Strong experience with cloud infrastructure (AWS, GCP, Azure, or equivalent)

Experience with data science and systems optimization

Familiarity with ML infrastructure, GPU’s, etc. a plus

Work out of our SF office in FiDi

Skills Required

  • 2+ years of experience writing high-quality production code
  • Strong experience with cloud infrastructure (AWS, GCP, Azure, or equivalent)
  • Experience with data science and systems optimization
  • Familiarity with ML infrastructure, GPUs, etc.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
6 Employees
Year Founded: 2022

What We Do

Relace develops AI models and infrastructure for coding agents, offering an end-to-end fine-tuning and inference platform for large language models.

Similar Jobs

People Inc. Logo People Inc.

Infrastructure Engineer

AdTech • Consumer Web • Digital Media • eCommerce • Marketing Tech
Remote or Hybrid
US
3500 Employees
115K-130K Annually

CoreWeave Logo CoreWeave

Staff Software Engineer

Cloud • Information Technology • Machine Learning
In-Office or Remote
5 Locations
1450 Employees
188K-275K Annually

Notion Logo Notion

Software Engineer

Artificial Intelligence • Productivity • Software
Hybrid
2 Locations
1000 Employees
260K-330K Annually

Snap Inc. Logo Snap Inc.

Software Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
2 Locations
5000 Employees
133K-235K Annually

Similar Companies Hiring

Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
LTX Thumbnail
Conversational AI • Generative AI
Jerusalem, Israel
360 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account