Senior AI and HPC Observability Engineer

Posted Yesterday
Be an Early Applicant
2 Locations
In-Office
152K-288K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Role
Designs and scales observability and telemetry platforms for distributed AI and HPC environments. Builds high-performance backend services, OpenTelemetry components, metrics pipelines, and real-time or batch data systems. Improves reliability, performance, capacity, and cost efficiency while developing monitoring, alerting, and service reliability frameworks. Requires production distributed-systems expertise, programming skills, time-series data experience, Kubernetes knowledge, and operational debugging capabilities.
Summary Generated by Built In

NVIDIA is a pioneer in accelerated computing, known for inventing the GPU and driving breakthroughs in gaming, computer graphics, high-performance computing, and artificial intelligence. Our technology powers everything from generative AI to autonomous systems, and we continue to shape the future of computing through innovation and collaboration. Within this mission, our team, Managed AI Superclusters (MARS) builds and scales the infrastructure, platforms, and tools that enable researchers and engineers to develop the next generation of AI/ML systems. By joining us, you’ll help design solutions that power some of the world’s most advanced computing workloads.

Observability is at the heart of this transformation. We are looking for a strong AI & HPC Observability Engineer to build and scale next-generation Observability and Telemetry platforms. You will design and develop high-throughput, reliable telemetry pipelines and modern data infrastructure. This role requires solid distributed systems fundamentals, production-grade coding, and a passion for operational excellence.

What You Will Be Doing:

  • Design and scale observability platforms handling high-volume metrics, logs, and traces across distributed environments

  • Build high-performance backend services for telemetry ingestion, processing, and routing

  • Develop and extend OpenTelemetry collectors, processors, exporters, and instrumentation libraries

  • Build and optimize metrics pipelines using large-scale time-series storage systems

  • Design and operate real-time and batch telemetry pipelines using streaming and distributed data technologies

  • Improve platform reliability, performance, and cost efficiency through tuning, capacity planning, and system optimization

  • Develop monitoring, alerting, and service reliability frameworks to ensure platform health and performance

  • Collaborate with platform engineering, infrastructure, and site reliability teams to deliver production-grade observability solutions

What We Need to see:

  • Bachelor’s degree in Computer Science, Computer Engineering, or related field or equivalent experience

  • 5+ years of experience building backend or distributed systems in production environments

  • Strong programming skills in Python, Go, or Java, with experience developing production-quality software

  • Hands-on experience with modern observability architectures, including metrics, logs, and traces

  • Solid experience with PromQL and time-series data systems

  • Experience building or operating distributed data pipelines using technologies such as Kafka, Spark, or Flink

  • Experience working with Kubernetes and cloud-native infrastructure

  • Strong understanding of distributed systems, concurrency, and fault-tolerant system design. Strong debugging, performance tuning, and production operations skills

Ways To Stand Out from The Crowd:

  • Proven experience designing and scaling observability platforms for AI, GPU, or HPC environments

  • Hands-on expertise with OpenTelemetry, Prometheus, Kafka, and high-volume distributed telemetry pipelines

  • Strong background in data engineering, time-series data modeling, and real-time performance tuning

  • Experience integrating observability with AI/ML pipelines, GPU workload monitoring, or intelligent alerting

  • Demonstrated use of statistical or machine learning techniques for anomaly detection, correlation, or predictive insights

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
152,000 USD – 241,500 USD for Level 3; and 184,000 USD – 287,500 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 3, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Skills Required

  • Bachelor's degree in Computer Science, Computer Engineering, a related field, or equivalent experience
  • 5+ years of experience building backend or distributed systems in production environments
  • Strong programming skills in Python, Go, or Java
  • Experience developing production-quality software
  • Hands-on experience with observability architectures involving metrics, logs, and traces
  • Experience with PromQL and time-series data systems
  • Experience building or operating distributed data pipelines using Kafka, Spark, or Flink
  • Experience with Kubernetes and cloud-native infrastructure
  • Understanding of distributed systems, concurrency, and fault-tolerant system design
  • Strong debugging, performance tuning, and production operations skills
  • Experience designing and scaling observability platforms for AI, GPU, or HPC environments
  • Hands-on expertise with OpenTelemetry, Prometheus, Kafka, and high-volume distributed telemetry pipelines
  • Background in data engineering, time-series data modeling, and real-time performance tuning
  • Experience integrating observability with AI/ML pipelines, GPU workload monitoring, or intelligent alerting
  • Experience using statistical or machine learning techniques for anomaly detection, correlation, or predictive insights

NVIDIA Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NVIDIA and has not been reviewed or approved by NVIDIA.

  • Equity Value & Accessibility — Company stock and RSUs have driven exceptional total compensation, with a generous employee stock purchase plan and ongoing equity refreshers playing a central role. Feedback suggests historic share-price gains created significant financial upside for many.
  • Healthcare Strength — Multiple plan options (HSA, PPO, and in some locations Kaiser) with in-network preventive care covered at 100% and company HSA contributions indicate a robust offering. Mental-health sessions and broad dental, vision, and disability coverage further strengthen the package.
  • Parental & Family Support — Up to 22 weeks of fully paid parental leave, adoption and surrogacy reimbursement, and coverage for IVF and egg freezing are highlighted as standout features. Additional family-care resources and caregiving support broaden the appeal.

NVIDIA Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
21,960 Employees
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

Chewy Logo Chewy

AD, Executive Talent (Onboarding, Development & Coaching)

eCommerce • Healthtech • Pet • Retail • Pharmaceutical
Hybrid
Bellevue, WA, USA
17800 Employees
149K-245K Annually

Arm Logo Arm

Artificial Intelligence Engineer

Artificial Intelligence • Internet of Things • Semiconductor
Hybrid
Seattle, WA, USA
8314 Employees
171K-231K Annually

Arm Logo Arm

Principal Software Engineer

Artificial Intelligence • Internet of Things • Semiconductor
Hybrid
Seattle, WA, USA
8314 Employees
263K-355K Annually

Optum Logo Optum

RN ASC OR First Hill Surgery Center

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Seattle, WA, USA
160000 Employees
29-52 Hourly

Similar Companies Hiring

Unusual Machines, Inc. Thumbnail
Hardware • Robotics
Orlando, FL
300 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account