NVIDIA is seeking a Senior MLOps Engineer to help design and scale the infrastructure that powers our AI research and product development. In this role, you will partner closely with research scientists and product teams to accelerate their success on the latest GPU and accelerator platforms. By building robust ML pipelines and scalable systems, you will ensure that cutting-edge hardware innovations translate directly into faster experiments, more efficient training, and reproducible deployments at scale. This is an opportunity to shape how NVIDIA’s world-class research teams turn ideas into breakthroughs.
What you’ll be doing:
Identify infrastructure and software bottlenecks to improve ML job startup time, data load/write time, resiliency, and failure recovery.
Translate research workflows into automated, scalable, and reproducible systems that accelerate experimentation.
Build CI/CD workflows tailored for ML to support data preparation, model training, validation, deployment, and monitoring.
Develop observability frameworks to monitor performance, utilization, and health of large-scale training clusters.
Collaborate with hardware and platform teams to optimize models for emerging GPU architectures, interconnects, and storage technologies.
Develop guidelines for dataset versioning, experiment tracking, and model governance to ensure reliability and compliance.
Mentor and guide engineering and research partners on MLOps patterns, scaling NVIDIA’s impact from research to production.
Collaborate with NVIDIA Research teams and the DGX Cloud Customer Success team to enhance MLOps automation continuously.
What we need to see:
BS in Computer Science, Information Systems, Computer Engineering or equivalent experience
8+ years of experience in large-scale software or infrastructure systems, with 5+ years dedicated to ML platforms or MLOps.
Proven track record designing and operating ML infrastructure for production training workloads.
Expert knowledge of distributed training frameworks (PyTorch, TensorFlow, JAX) and orchestration systems (Kubernetes, Slurm, Kubeflow, Airflow, MLflow).
Strong programming experience in Python plus at least one systems language (Go, C++, Rust).
Deep understanding of GPU scheduling, container orchestration, and cloud-native environments.
Experience integrating observability stacks (Prometheus, Grafana, ELK) with ML workloads.
Familiarity with storage and data platforms that support large-scale training (object stores, feature stores, versioned datasets).
Strong communication abilities, collaborating effectively with research teams to transform requirements into scalable engineering solutions.
Ways to stand out from the crowd:
Practical experience supporting research teams in expanding models on the newest GPU or accelerator hardware.
Contributions to open-source MLOps or ML infrastructure projects.
Proficiency in optimizing multi-node training tasks throughout extensive GPU clusters and familiarity with extensive ETL and data pipeline software/infrastructure for both structured and unstructured data.
Knowledge of security, compliance, and governance requirements for ML in regulated environments.
Demonstrated capability in connecting research and production by directing scientists on guidelines while providing reliable infrastructure.
NVIDIA is at the forefront of pioneering advancements in Artificial Intelligence, High-Performance Computing, and Visualization. The GPU, our innovation, acts as the visual cortex of modern computers and forms the core of our offerings. Our efforts unlock new realms for exploration, facilitate outstanding creativity and discovery, and drive what were previously science-fiction innovations—from artificial intelligence to autonomous vehicles. We are seeking remarkable individuals like you to assist us in propelling the next AI wave!
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.You will also be eligible for equity and benefits.
Top Skills
What We Do
NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”
