Senior Systems Software Engineer, LPU

Reposted 5 Days Ago
Be an Early Applicant
2 Locations
In-Office or Remote
135K-220K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Role
Develop and maintain hardware abstraction layers, core system libraries, drivers, and runtimes; improve reliability via automation and diagnostics; debug multi-component system issues; support hardware bring-up and NPI; collaborate with hardware, compiler, and operations teams; contribute to documentation and tooling.
Summary Generated by Built In

NVIDIA’s LPU System Software team builds foundational software that enables deterministic, high-performance computing platforms by shifting complexity from silicon into software. We design and maintain the hardware abstraction layers, core system libraries, and runtime components that allow compiler teams and data center operators to safely and efficiently execute workloads on novel architectures. In this role, you will develop and evolve the libraries, drivers, and runtime interfaces that serve as key entry points into the platform. You will also help improve reliability and operability through automation, diagnostics, and tight cross-org collaboration with hardware, compiler, and operations teams.

What you'll be doing:

  • Extend and maintain hardware abstraction layers and core system libraries used across the platform.

  • Design and implement drivers, runtimes, and data movement/aggregation pipelines supporting workload execution.

  • Build and maintain runtime interfaces for launching, monitoring, and managing workloads.

  • Improve platform reliability through automation, error reporting, diagnostics, and operational tooling.

  • Debug and resolve complex sequencing, initialization, and runtime issues across multi-component systems.

  • Partner cross-functionally with hardware engineering, compiler teams, and data center operations to bring features from prototype to production.

  • Support new platform bring-up and NPI (New Product Introduction) efforts for new boards and silicon.

  • Contribute to engineering excellence through documentation, tooling improvements, code reviews, and knowledge sharing.

What we need to see:

  • A Masters Degree in Computer Science, Computer Engineering, Electrical Engineering, related STEM field or equivalent experience.

  • 5+ years of relevant work experience

  • Strong proficiency in modern C++ (design, implementation, debugging, and performance considerations).

  • Experience designing, maintaining, and refactoring software libraries and APIs with long-term support in mind.

  • Comfort working in large, multi-repository or multi-component codebases with layered dependencies.

  • Demonstrated ability to lead or drive triage of difficult reliability issues and produce clear root-cause analysis.

  • Ability to clearly communicate software architecture and design tradeoffs, including using diagrams and written design docs.

  • Low-level platform software experience (e.g., firmware/boot flows, RTOS, BMCs/MCUs, RISC-V, or closely related system software).

  • Linux systems experience that includes driver or kernel-adjacent interfaces (e.g., VFIO or similar subsystems).

  • Hardware bring-up and/or system triage experience (fault analysis, system diagnostics, or validation support in lab environments).

Ways to stand out from the crowd:

  • Distributed systems experience (e.g., MPI, gRPC, RPC frameworks, coordination/telemetry patterns).

  • Experience with inference systems and token serving (e.g., vLLM or similar serving/runtime stacks).

  • Experience shipping and supporting customer-facing SDKs, including documentation and ABI compatibility practices.

  • Production readiness and delivery experience (e.g., CI/CD and release workflows, monitoring/alerting practices, Kubernetes and/or data center operational workflows).

The GPU started out as the engine for simulating human imagination, conjuring up the amazing virtual worlds of video games and Hollywood films. Now, NVIDIA’s GPU runs deep learning algorithms, simulating human intelligence, and acts as the brain of computers, robots and self-driving cars that can perceive and understand the world. Just as human imagination and intelligence are linked, computer graphics and artificial intelligence come together in our architecture. Today, NVIDIA GPUs are used broadly for deep learning, and NVIDIA is increasingly known as “the AI computing company.”

Widely considered to be one of the technology world’s most desirable employers, NVIDIA has some of the most forward-thinking and hardworking people in the world inventing the future with us. Are you a creative and collaborative software engineer seeking new challenges? If so, we want to hear from you! Come, join us and help build the real-time, cost-effective AI computing platform driving our success in this exciting and quickly growing field.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 135,000 CAD - 185,000 CAD for Level 3, and 170,000 CAD - 220,000 CAD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until March 22, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

Skills Required

  • Masters degree in Computer Science, Computer Engineering, Electrical Engineering or related STEM field, or equivalent experience
  • 5+ years of relevant work experience
  • Strong proficiency in modern C++ (design, implementation, debugging, performance)
  • Experience designing, maintaining, and refactoring software libraries and APIs for long-term support
  • Comfort working in large, multi-repository or multi-component codebases with layered dependencies
  • Demonstrated ability to lead triage of difficult reliability issues and produce clear root-cause analysis
  • Ability to clearly communicate software architecture and design tradeoffs, including diagrams and design docs
  • Low-level platform software experience (firmware/boot flows, RTOS, BMCs/MCUs, RISC-V, or related system software)
  • Linux systems experience including driver or kernel-adjacent interfaces (e.g., VFIO or similar)
  • Hardware bring-up and/or system triage experience (fault analysis, diagnostics, validation in lab environments)

NVIDIA Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NVIDIA and has not been reviewed or approved by NVIDIA.

  • Equity Value & Accessibility Equity awards and a discounted ESPP are highlighted as core parts of total compensation, enabling employees to share in the company’s success. Stock-based compensation and the two-year lookback ESPP are consistently described as especially valuable.
  • Healthcare Strength Health coverage is portrayed as robust, with comprehensive medical, dental, and vision options alongside mental health support and on-site care resources. Employer HSA contributions and wellness perks reinforce the depth of the offering.
  • Retirement Support Retirement programs are depicted as strong, featuring a meaningful 401(k) match with Roth options and support for Mega Backdoor Roth contributions. These elements position long-term savings as a notable advantage of the total rewards package.

NVIDIA Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
21,960 Employees
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

CrowdStrike Logo CrowdStrike

Field Tech Strategist (Remote, CAN)

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
6 Locations
10000 Employees
150K-265K Annually
Remote
26 Locations
393 Employees
179K-179K Annually

Samsara Logo Samsara

Global Operations Rotation Program

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
CA
4000 Employees
80K-121K Annually

Samsara Logo Samsara

Senior Security Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
Vancouver, BC, CAN
4000 Employees
133K-172K Annually

Similar Companies Hiring

Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees
Fairly Even Thumbnail
Hardware • Robotics • Sales • Software • Hospitality
New York, NY
30 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account