Machine Learning Infrastructure Engineer

Posted 9 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
200K-300K Annually
Entry level
Professional Services • Consulting
The Role
Build and optimize low-level software for large machine learning workloads across specialized, multi-vendor hardware. Tune model serving for speed, throughput, reliability, and cost; write GPU kernels; design and operate heterogeneous compute clusters; monitor production systems; and work directly with customers. The role requires deep computer architecture and operating systems knowledge, infrastructure or systems experience, strong communication, on-site availability in San Francisco, and a computer science degree. Exceptional results and GPU or ML serving experience are valued.
Summary Generated by Built In

About the company

Our client is a technology company.

The role

Raydar is recruiting for this role on behalf of our client. Build and tune low-level software that makes large machine learning workloads run faster and more efficiently on a range of specialized hardware. Own production systems end to end, balancing reliability, observability and operating cost. Work closely with customers and engineers to shape the direction of the work.

What you'll do

- Bring newly released open-source models into production with performance tuned for speed and throughput.

- Refine the software that delivers model predictions, improving response times and how much work each machine handles.

- Write low-level GPU kernel code for accelerators from several hardware vendors.

- Design, deploy and operate compute clusters that mix hardware from different vendors.

- Operate live systems spanning varied hardware, watching uptime, monitoring and operating expense.

- Talk with customers about their needs, a meaningful share of the role.


Requirements

What we're looking for

- Evidence of exceptional results, such as top competition placement, a system owned end to end, or fast career progression.

- Backend, infrastructure or systems experience at a leading technology company or an early-stage startup.

- A deep understanding of computer architecture, memory hierarchy and operating system internals, beyond application-level coding.

- Able to start immediately and work on site in San Francisco.

- Enthusiasm for using AI agents and coding tools to improve their own workflow.

- Clear, warm communication skills for working with customers.

- A computer science degree from a top undergraduate program, with undergraduate study weighted above graduate study.

Bonus points

- Background in making machine learning models run faster and cheaper to serve.

- Track record keeping large, multi-machine hardware installations dependable and efficient.

- Exposure to GPU programming, ideally with a common accelerator toolkit.

- Open to new graduates with strong internships.


Benefits

Compensation and benefits

- Base salary: $200K - $300K

- Equity

- Health, dental and vision coverage

- Flexible time off

- Parental leave

Location and work model

- San Francisco, California, United States

- On-site, 5 days in-office

- Full-time

Skills Required

  • Evidence of exceptional results, such as top competition placement, end-to-end system ownership, or rapid career progression
  • Backend, infrastructure, or systems experience at a leading technology company or early-stage startup
  • Deep understanding of computer architecture, memory hierarchy, and operating system internals beyond application-level coding
  • Able to start immediately
  • Able to work on site in San Francisco five days per week
  • Enthusiasm for using AI agents and coding tools to improve workflow
  • Clear and warm communication skills for working with customers
  • Computer science degree from a top undergraduate program, with undergraduate study weighted above graduate study
  • Experience making machine learning models run faster and cheaper to serve
  • Experience keeping large, multi-machine hardware installations dependable and efficient
  • Exposure to GPU programming, ideally with a common accelerator toolkit
  • Strong internships for new graduates
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
28 Employees
Year Founded: 2021

What We Do

Raydar is a talent acquisition and business consulting firm that connects world-class and emerging talent with growing organizations. It supports companies through team development, strategic hiring, and customized growth solutions, helping clients recruit roles such as engineers, product managers, executives, legal counsel, and quantitative traders. Raydar focuses on understanding each organization’s needs, culture, and long-term goals to build high-impact teams.

Similar Jobs

Philo Logo Philo

Software Engineer

Cloud • Digital Media • News + Entertainment • On-Demand
Remote or Hybrid
2 Locations
165 Employees
165K-250K Annually

Snap Inc. Logo Snap Inc.

Software Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
2 Locations
5000 Employees
133K-235K Annually

Snap Inc. Logo Snap Inc.

Software Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
3 Locations
5000 Employees
178K-313K Annually

Snap Inc. Logo Snap Inc.

Software Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
3 Locations
5000 Employees
133K-235K Annually

Similar Companies Hiring

Cravath, Swaine & Moore LLP Thumbnail
Legal Tech • Other • Professional Services
New York, NY
1200 Employees
VCA Animal Hospitals Thumbnail
Pet • Professional Services
Los Angeles, CA
35000 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account