Machine Learning Infrastructure Engineer

Posted 3 Days Ago
Be an Early Applicant
Redwood City, CA, USA
In-Office
220K-350K Annually
Senior level
Professional Services • Consulting
The Role
Architect and operate infrastructure for distributed large-model training and deployment across accelerator fleets. Build scheduling tools, high-volume multimodal data pipelines, model compression and compilation workflows, and observability systems. Optimize compute, storage, and memory performance while partnering closely with researchers to accelerate experimentation and production deployment. The role requires technical leadership, PyTorch expertise, distributed training experience, ML platform ownership, multimodal systems experience, and on-site work five days per week.
Summary Generated by Built In

About the company

Our client is a fast-growing technology company.

The role

Raydar is recruiting for this role on behalf of our client. Take ownership of the platform that lets research teams train and run large models efficiently. You will bridge researchers and compute, shaping distributed systems, raising hardware efficiency and delivering the data flows that power experiments. This is a senior, high-autonomy position.

What you'll do

- Architect and grow the systems that spread model training over many accelerators, with attention to memory efficiency.

- Create easy-to-use internal tools and workload scheduling so researchers can iterate quickly and recover gracefully from failures.

- Engineer fast data ingestion and transformation pipelines that handle very large volumes of varied sensor and media data.

- Prepare trained models for fast, responsive deployment in live settings using compression and compilation methods.

- Investigate performance in depth, tracing slowdowns in compute, storage and memory to get more from a growing hardware fleet.

- Work side by side with researchers to shorten the time from experiment to production.


Requirements

What we're looking for

- 7+ years in ML or data infrastructure, including technical leadership on HPC or ML infrastructure projects.

- A track record of running production ML or data platforms within a highly skilled engineering team.

- Deep hands-on knowledge of PyTorch.

- Strong command of accelerator performance tuning, serving efficiency and observability.

- Practical experience with distributed training libraries.

- Prior experience joining a young company as one of its first infrastructure engineers.

- Experience building systems for multimodal models such as video, audio or other media.

- Genuine enthusiasm for robotics.

- Willingness to work on-site five days a week.

Bonus points

- Robotics experience in a startup or enterprise setting.


Benefits

Compensation and benefits

- Base salary: USD 220,000 to 350,000 per year

- Equity

- Flexible time off

- Relocation support

Location and work model

- Redwood City, CA, United States

- On-site, 5 days per week in office

- Full-time

Skills Required

  • 7+ years of experience in machine learning or data infrastructure
  • Technical leadership on HPC or machine learning infrastructure projects
  • Experience running production machine learning or data platforms within a highly skilled engineering team
  • Deep hands-on knowledge of PyTorch
  • Strong knowledge of accelerator performance tuning, serving efficiency, and observability
  • Practical experience with distributed training libraries
  • Experience joining a young company as one of its first infrastructure engineers
  • Experience building systems for multimodal models, such as video, audio, or other media
  • Genuine enthusiasm for robotics
  • Willingness to work on-site five days per week
  • Robotics experience in a startup or enterprise setting
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
28 Employees
Year Founded: 2021

What We Do

Raydar is a talent acquisition and business consulting firm that connects world-class and emerging talent with growing organizations. It supports companies through team development, strategic hiring, and customized growth solutions, helping clients recruit roles such as engineers, product managers, executives, legal counsel, and quantitative traders. Raydar focuses on understanding each organization’s needs, culture, and long-term goals to build high-impact teams.

Similar Jobs

Snap Inc. Logo Snap Inc.

Software Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
3 Locations
5000 Employees
178K-313K Annually

Mach9 Logo Mach9

Infrastructure Engineer

Computer Vision • Machine Learning • Software
In-Office
San Francisco, CA, USA
24 Employees
160K-250K Annually
In-Office or Remote
2 Locations
245K-429K Annually

Snap Inc. Logo Snap Inc.

Software Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
Palo Alto, CA, USA
5000 Employees
133K-235K Annually

Similar Companies Hiring

Fora Thumbnail
Agency • On-Demand • Professional Services • Sales • Software • Travel • Hospitality
New York, NY
250 Employees
Energy CX Thumbnail
Greentech • Professional Services • Business Intelligence • Consulting • Energy • Financial Services • Utilities
Chicago, IL
150 Employees
Northslope Thumbnail
Artificial Intelligence • Information Technology • Software • Analytics • Consulting • Generative AI
London, GB
100 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account