Software Engineer, AI Infrastructure

Posted 8 Hours Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
220K-350K Annually
Entry level
Professional Services • Consulting
The Role
Design and build backend infrastructure for software-writing AI agents, including model routing, context management, evaluations, observability, and code versioning. Improve agent performance using logged runs, new tools, learned behaviors, and failure analysis. The role requires production backend and infrastructure experience, large-scale AI automation, and ownership of open-ended projects from design through delivery. The position is onsite in San Francisco with limited flexible remote work.
Summary Generated by Built In

About the company

Our client is a software company.

The role

Raydar is recruiting for this role on behalf of our client. Design and build the backend platform that runs software-writing agents, covering how work is matched to models, how agents receive context, how their behaviour is measured, and how engineers can see what happened. The role combines production engineering with applied research aimed at making these systems better over time. Candidates should be comfortable owning open-ended problems from design through to delivery.

What you'll do

- Decide which model handles each task, weighing cost, speed and quality, and measure whether those choices were right.

- Shape what information reaches each model by designing lookup, state handling and condensing techniques, keeping only what is pertinent.

- Design evaluations that show where to improve next and whether a change made agents better.

- Build observability tools that record what each agent did, why, and at what cost.

- Use logged runs to improve the system through new tools, cheaper learned behaviour and fixes for recurring failures.

- Design how code and its history are represented, stored and versioned when agents produce much of it.


Requirements

What we're looking for

- Founder, founding engineer or similar fast-paced 0 to 1 development experience, including early-stage startup work.

- Practical familiarity with some part of agent tooling, such as choosing models for tasks, supplying information to models, judging output quality, or tracing system behaviour.

- Track record shipping large-scale AI-driven automation to real users, whether in production or internal tooling.

- Production backend or infrastructure experience, including scaling services, autoscaling, isolation and observability.

- Ability to work on-site in San Francisco, California.

Bonus points

- Academic or side-project background in program correctness, language design or model fine-tuning.

- Developer infrastructure experience, such as version control or build systems.

- Experience at a coding-agent company or on an internal coding-agent platform.

- Top undergraduate STEM degree, especially valued for less experienced candidates.


Benefits

Compensation and benefits

- Salary: $220K to $350K

- Equity

- Health, dental and vision coverage

- Flexible time off

- Retirement plan

Location and work model

- San Francisco, California, United States

- On-site, with a flexible remote option in one week of every six

- Full-time

Skills Required

  • Founder, founding engineer, or equivalent fast-paced 0-to-1 development experience, including early-stage startup work
  • Practical familiarity with agent tooling, such as model selection, model context, output evaluation, or system tracing
  • Track record shipping large-scale AI-driven automation to real users in production or internal tooling
  • Production backend or infrastructure experience, including scaling services, autoscaling, isolation, and observability
  • Ability to work onsite in San Francisco, California
  • Academic or side-project background in program correctness, language design, or model fine-tuning
  • Developer infrastructure experience, such as version control or build systems
  • Experience at a coding-agent company or on an internal coding-agent platform
  • Top undergraduate STEM degree
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
28 Employees
Year Founded: 2021

What We Do

Raydar is a talent acquisition and business consulting firm that connects world-class and emerging talent with growing organizations. It supports companies through team development, strategic hiring, and customized growth solutions, helping clients recruit roles such as engineers, product managers, executives, legal counsel, and quantitative traders. Raydar focuses on understanding each organization’s needs, culture, and long-term goals to build high-impact teams.

Similar Jobs

NVIDIA Logo NVIDIA

Software Engineer

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office
Santa Clara, CA, USA
21960 Employees
224K-431K Annually

Microsoft Logo Microsoft

Principal Software Engineer

Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
In-Office
5 Locations
206870 Employees
143K-304K Annually
In-Office or Remote
7 Locations
49 Employees

Skydio Logo Skydio

Senior Software Engineer

Artificial Intelligence • Hardware • Robotics • Software
Hybrid
San Mateo, CA, USA
250 Employees
190K-250K Annually

Similar Companies Hiring

Cravath, Swaine & Moore LLP Thumbnail
Legal Tech • Other • Professional Services
New York, NY
1200 Employees
VCA Animal Hospitals Thumbnail
Pet • Professional Services
Los Angeles, CA
35000 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account