Senior Software Engineer, AI Data

Posted 8 Days Ago
4 Locations
In-Office
152K-288K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Role
Design and build NVIDIA’s AI data platform for multi-cloud GPU fleets. Responsibilities include high-throughput data paths, distributed caching, checkpoint management, Kubernetes-native storage integrations, quota and lifecycle systems, I/O telemetry, capacity forecasting, and production reliability. The role partners with AI researchers and supports workloads across Kubernetes and Slurm, requiring expertise in distributed storage, data infrastructure, I/O performance, and systems programming.
Summary Generated by Built In

NVIDIA is a pioneer in accelerated computing, known for inventing the GPU and driving breakthroughs in gaming, computer graphics, high-performance computing, and artificial intelligence. Our technology powers everything from generative AI to autonomous systems, and we continue to shape the future of computing through innovation and collaboration. Within this mission, our team, Managed AI Research Superclusters (MARS), builds and scales the infrastructure, platforms, and tools that enable researchers and engineers to develop the next generation of AI/ML systems. By joining us, you'll help build solutions that power some of the planet's most advanced computing workloads.


The MARS AI Data team owns how NVIDIA's AI research uses data: many petabytes of training data, checkpoints and datasets across multiple clouds and partners. We build the layer between storage and the workload. That covers data placement across file systems, object storage, and local NVMe. It also includes streaming loaders and caches that supply tens of thousands of GPU cores. Efficient checkpoint management. Quotas remain fair throughout numerous research groups. This is a builder's role on a team that is redefining what it does. You will help design MARS' data platform on Kubernetes from the ground up, working directly with the researchers training NVIDIA's own models. The work shows up as faster training steps, shorter restarts and fewer runs lost to complete storage volumes.

What you'll be doing
  • Design and build the AI data layer for a multi-cloud GPU fleet: how datasets, checkpoints and scratch data are placed, cached, tiered and moved between different storage backends.
  • Build high-throughput data paths for training and RL. That means streaming loaders from object storage, distributed caches, and checkpoint save and restore at thousands of GPUs, including peer-to-peer and local-first restore.
  • Make data a first-class part of the compute platform. Build Kubernetes-native APIs, operators and storage integrations so a job declares the data it needs, and the platform mounts, caches and accounts for it, on Slurm and on Kubernetes.
  • Own quotas, capacity and data lifecycle across hundreds of research teams: usage attribution, quota enforcement, retention, clean-up of stale data, and forecasting capacity before it runs out.
  • Measure how workloads use data. Build I/O telemetry and access analytics that show hot and cold data, metadata pressure and I/O stalls, and use them to drive placement and fixes.
  • Own reliability for what you build: on-call, incident analysis, and changes that stop whole classes of data incidents, such as full file systems, runaway metadata load and lost checkpoints.
What we need to see
  • BS or MS in Computer Science, Computer Engineering, Electrical Engineering or a related field, or equivalent experience.
  • 5+ years building production systems or data-infrastructure software.
  • Deep experience with at least one of the following: parallel or distributed file systems (Lustre, WEKA, VAST, GPFS, Ceph or similar), object storage at scale (S3 or compatible), or large-scale data pipelines and data lakes.
  • A clear grasp of I/O performance: throughput, latency, metadata cost, caching and how access patterns interact with each.
  • Strong programming in Go, Rust, C or C++, plus Python for tooling and analysis.
  • A track record of owning a service in production and making it measurably better.
  • Clear written and spoken communication with engineers and researchers.
Ways to stand out from the crowd
  • Experience feeding large-scale AI training: data loaders, streaming datasets, and storage behavior at thousands of GPUs.
  • Experience with checkpointing at scale: asynchronous or distributed checkpoints, tiered checkpoint storage, fast restart after failure.
  • Built or ran a distributed cache or AI-oriented storage system, or used node-local NVMe as a managed tier.
  • Built a quota, accounting or capacity system that many teams depended on.
  • Knowledge of RL and agentic workloads and what they need from storage: many small reads, environment snapshots, sandbox images and fast fan-out.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
152,000 USD – 241,500 USD for Level 3; and 184,000 USD – 287,500 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 13, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Skills Required

  • Bachelor’s or master’s degree in Computer Science, Computer Engineering, Electrical Engineering, a related field, or equivalent experience
  • 5+ years building production systems or data-infrastructure software
  • Deep experience with parallel or distributed file systems such as Lustre, WEKA, VAST, GPFS, Ceph, or similar; object storage at scale such as S3; or large-scale data pipelines and data lakes
  • Strong understanding of I/O performance, including throughput, latency, metadata cost, caching, and access patterns
  • Strong programming skills in Go, Rust, C, or C++, plus Python for tooling and analysis
  • Track record of owning a production service and measurably improving it
  • Clear written and spoken communication with engineers and researchers
  • Experience supporting large-scale AI training, including data loaders, streaming datasets, and storage behavior at thousands of GPUs
  • Experience with asynchronous or distributed checkpointing, tiered checkpoint storage, or fast restart after failure
  • Experience building or operating distributed caches, AI-oriented storage systems, or managed node-local NVMe tiers
  • Experience building quota, accounting, or capacity systems used by multiple teams
  • Knowledge of reinforcement learning and agentic workloads and their storage requirements

NVIDIA Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NVIDIA and has not been reviewed or approved by NVIDIA.

  • Equity Value & Accessibility — Feedback suggests equity grants, stock options/RSUs, and a discounted ESPP materially boost total compensation and can deliver significant wealth-building when the stock performs well.
  • Healthcare Strength — Feedback suggests medical, dental, and vision plans with in-network preventive care at 100%, telehealth, and concierge-style support are comprehensive and valued.
  • Parental & Family Support — Feedback suggests up to 22 weeks fully paid parental leave, fertility coverage, and adoption/surrogacy reimbursement provide strong family-focused benefits.

NVIDIA Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
21,960 Employees
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

John Deere Logo John Deere

Data Science Tech Lead

Artificial Intelligence • Cloud • Internet of Things • Machine Learning • Analytics • Industrial
Remote or Hybrid
2 Locations
69000 Employees
138K-207K Annually

Hilton Logo Hilton

Manager, Creative Operations & Activation

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office or Remote
3 Locations
500000 Employees
40K-110K Annually

Hilton Logo Hilton

Process Improvement Analyst

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office or Remote
2 Locations
500000 Employees
40K-75K Annually

Hilton Logo Hilton

Senior Analyst, Creative Operations & Activation

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office or Remote
3 Locations
500000 Employees
40K-100K Annually

Similar Companies Hiring

Unusual Machines, Inc. Thumbnail
Hardware • Robotics
Orlando, FL
300 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account