Software Engineer, ML Infrastructure

Posted Yesterday
Be an Early Applicant
Mountain View, CA, USA
In-Office
160K-241K Annually
Mid level
Artificial Intelligence • Automotive • Information Technology • Robotics
The Role
Build and scale ML infrastructure: automated IaC for GPU/CPU fleets, high-performance workload scheduling, petabyte-scale ETL, feature caching/storage, and platform abstractions to accelerate model development from experiment to production.
Summary Generated by Built In

Who We Are 

Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the world around us, that’s why we’re building a universal autonomy platform: self-driving for all roads and all rides.
Founded in 2016, Nuro is a physical AI company developing Level 4 autonomous driving technology for a wide range of vehicles, use cases, and markets. Powered by the Nuro Driver™, our universal autonomy platform enables the global mobility ecosystem to deploy autonomy at scale, from robotaxis and logistics fleets to personal vehicles.
With years of real-world deployment experience and a flexible, partner-led business model, Nuro is working toward a future where millions of autonomous vehicles powered by our technology help make everyday life safer, easier, and more connected.
Nuro has raised over $2B in capital from Uber, NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors

About the Role

Nuro is seeking a Software Engineer with expertise in large-scale infrastructure, workload orchestration, and data processing to join our ML Infrastructure team. In this role, you will focus on building and evolving the core platform that provides researchers and engineers with seamless access to compute and data resources. You will be responsible for executing the technical strategy for automated resource provisioning, high-performance workload scheduling, and efficient feature management to accelerate the Nuro Driver™ development lifecycle.

About the Work

You will build the foundation that powers Nuro’s model development from experimentation to production. Key responsibilities include:

  • Resource Provisioning & IaC: Scaling automated infrastructure-as-code (IaC) pipelines to manage thousands of GPU/CPU nodes across diverse environments.
  • Intelligent Scheduling: Designing and optimizing workload orchestration to maximize hardware utilization, minimize job wait times, and handle massive-scale distributed training.
  • Data & ETL: Designing robust pipelines for the extraction and transformation of petabyte-scale sensor and telemetry data into ML-ready formats.
  • Feature Management: Implementing robust feature caching and storage solutions to reduce redundant computations and ensure low-latency access to pre-computed features.
  • Platform Abstraction: Contributing to a unified ML platform that abstracts complex cloud infrastructure for end-users.

About You

  • Experience: 3+ years of professional experience in ML Infrastructure, Backend Platform Engineering, or Distributed Systems.
  • Resource Provisioning: Deep familiarity with modern Infrastructure-as-Code and provisioning tools such as Terraform, Pulumi, or Crossplane.
  • Workload Scheduling: Hands-on experience building or managing large-scale orchestrators for compute-heavy workloads (e.g., Kubernetes, KubeRay, Ray, Slurm, or Volcano).
  • Distributed Data Processing: Proficiency in at least one distributed processing framework, such as Apache Spark or Apache Beam, for large-scale data extraction and transformation.
  • Feature Management: Experience implementing or maintaining feature stores and caching layers (e.g., Feast, Hopsworks, or Redis-based custom caching).
  • Systems Design: A strong understanding of distributed systems, networking, and storage bottlenecks in the context of high-performance computing.

Bonus Points

  • Active contributor to open-source projects in the MLOps or Cloud-Native ecosystem (e.g., CNCF, Ray, or Kubeflow communities).
  • Experience with high-performance storage systems (e.g., Lustre, Ceph, or specialized NVMe caching) for ML data loading.
  • Knowledge of cost-optimization strategies for large-scale GPU clusters in public clouds (AWS, GCP, or Azure).

At Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected base pay range is between $160,360 and $240,540 for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.

At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics.

Skills Required

  • 3+ years professional experience in ML Infrastructure, Backend Platform Engineering, or Distributed Systems.
  • Deep familiarity with Infrastructure-as-Code/provisioning tools (Terraform, Pulumi, Crossplane).
  • Hands-on experience building or managing large-scale workload orchestrators (Kubernetes, KubeRay, Ray, Slurm, Volcano).
  • Proficiency with distributed data processing frameworks (Apache Spark or Apache Beam).
  • Experience implementing or maintaining feature stores and caching layers (Feast, Hopsworks, Redis-based caching).
  • Strong understanding of distributed systems, networking, and storage bottlenecks for high-performance computing.
  • Active contribution to open-source MLOps or cloud-native projects (CNCF, Ray, Kubeflow)
  • Experience with high-performance storage systems (Lustre, Ceph, NVMe caching).
  • Knowledge of cost-optimization strategies for large-scale GPU clusters in public clouds (AWS, GCP, Azure).
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Mountain View, CA
908 Employees
Year Founded: 2016

What We Do

We're on a mission to better everyday life through robotics. Our custom electric autonomous vehicles are designed to bring the things you need—from produce to prescriptions—right to your home. Nuro’s autonomous delivery can give you valuable time back and more freedom to do what you love. This convenient, eco-friendly, safe alternative to driving can make streets safer and cities more livable. Nuro has brought autonomous delivery to local communities in Texas, Arizona, and California—for less driving and more thriving.

Similar Jobs

Snap Inc. Logo Snap Inc.

Software Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
2 Locations
5000 Employees
133K-235K Annually

Whatnot Logo Whatnot

Software Engineer

eCommerce • Mobile • Retail
In-Office
4 Locations
1200 Employees
190K-300K Annually

Nuro Logo Nuro

Senior Software Engineer

Artificial Intelligence • Automotive • Information Technology • Robotics
In-Office
Mountain View, CA, USA
908 Employees
194K-291K Annually

Nuro Logo Nuro

Software Engineer

Artificial Intelligence • Automotive • Information Technology • Robotics
In-Office
Mountain View, CA, USA
908 Employees
160K-241K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account