Senior Staff Software Engineer - Enterprise AI Platform

Posted 9 Hours Ago
Be an Early Applicant
Santa Clara, CA, USA
In-Office
200K-322K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Role
Design and build NVIDIA’s enterprise AI agent platform, including agent blueprints, runtime safety and policy enforcement, multi-agent orchestration, credential brokering, checkpointing, observability, evaluation, and self-improvement loops. Deploy reliable long-running services at scale, integrate enterprise systems, support secure execution, and participate in on-call operations. The role requires extensive distributed systems or infrastructure experience and hands-on agent development.
Summary Generated by Built In

We're building the platform that lets long-running autonomous agents operate safely inside NVIDIA's enterprise. These are not assistants on a developer's laptop. They are fleets of agents deployed in the cloud, running continuously at scale on shared accelerated compute. They take on real work across enterprise systems, so people get far more done than they could before. This role defines the constructs that agents are built from: the blueprints they start from, the tools, skills, and plugins that power them against enterprise data, the runtime safety harness that keeps them in bounds, and the connections into credential management, sandbox, memory, and observability. The team designs and ships these building blocks so that agent developers across the company can stand up a new agent, wire it in, and run it for days or weeks. Security and safe execution come out of the box, not something each team has to get right on its own.

Today an agent runs inside a single harness. Claude, Codex, and open-source agent harnesses each work differently underneath, with their own execution model, tool interface, and telemetry shape. The platform smooths over those differences, so a single skill, safety policy, or trace works the same no matter which harness is running. We want to enable agents that act on a person's behalf, governed and secure, continuously evaluated and self-improving. These agents coordinate and hand work off to each other, with identity and policy following every hop. They route and tune themselves across harnesses from live eval signals, and get better from their own production telemetry instead of waiting on a human to retrain them. Have you run agents on a harness like Claude or Codex and hit the walls that show up when they run for real, for days, against live systems — and wanted them to learn from it on their own? We're building the platform that solves those problems once, for every team.

What you'll be doing:

The day-to-day is designing and building the platform that agent builders across NVIDIA depend on, from engineering teams to functions like finance, legal, and HR:

  • Design agent blueprints with clean interfaces for authorization, sandbox, memory, observability, and skills, so a new agent inherits its enterprise integrations from the platform.

  • Build the runtime safety harness: a policy engine that checks every action before it runs, rate and budget caps, circuit breakers, approval gates, action allow-lists, and a kill switch that works even when an agent goes rogue.

  • Enable composing and orchestrating agents: skills as first-class units with declarative manifests, multi-agent orchestration for delegation and handoff, and support for headless, long-running, autonomous agents.

  • Broker credentials so multi-agent systems can authenticate and authorize without ever touching secrets, with least-privilege scoping on every token.

  • Provide checkpoint and recovery so an agent resumes cleanly after a crash or restart.

  • Instrument observability and evaluation that span harnesses: decision-level traces with correlation IDs, what the agent saw and chose and why, cost anomaly alerts that catch looping, and quality scoring across skills, whole agents and products. Then close the loop: turn those signals into insights that make the agents better.

Since teams across NVIDIA depend on this platform in production, the whole team shares in keeping it healthy and reliable, including taking part in an on-call rotation.

What we need to see:

  • BS or MS in Computer Science, Engineering, or related field (or equivalent experience)

  • 12+ years building distributed systems, infrastructure, or developer platforms at scale

  • Hands-on experience building agents on a harness, exposing them as APIs, and shipping them with CI/CD

  • Experience deploying and operating long-running services on container orchestration platforms

  • Experience with the building blocks of scalable systems: messaging, caching, and durable storage

  • Proficiency in Python, Go, Rust, or similar

Ways to stand out from the crowd:

  • Built a safety or policy engine that enforces rules on agent actions at runtime, with approval gates and kill switches

  • Designed evaluation and feedback loops for agent behavior, tied to versioned skills or blueprints. Built self-evolving loops where agents improve from their own eval and production signals, on the latest agent harnesses — the closed-loop, self-improving side you want to attract

  • Applied security fundamentals like threat modeling, authentication and authorization, least privilege, secrets management, and token exchange

  • Designed AI data platform components like ingestion pipelines, vector stores, and retrieval APIs

  • Shipped platform building blocks adopted by multiple engineering teams. Led complex technical projects like migrations or greenfield platform builds, aligning teams and writing clear design docs

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 200,000 USD - 322,000 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until September 13, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Skills Required

  • Bachelor’s or master’s degree in Computer Science, Engineering, or a related field, or equivalent experience
  • 12 or more years building distributed systems, infrastructure, or developer platforms at scale
  • Hands-on experience building agents on an agent harness, exposing them as APIs, and shipping them with CI/CD
  • Experience deploying and operating long-running services on container orchestration platforms
  • Experience with messaging, caching, and durable storage building blocks for scalable systems
  • Proficiency in Python, Go, Rust, or a similar programming language
  • Experience building runtime safety or policy engines with approval gates and kill switches
  • Experience designing evaluation and feedback loops for agent behavior, including self-improving systems
  • Experience applying threat modeling, authentication, authorization, least privilege, secrets management, and token exchange
  • Experience designing AI data platform components such as ingestion pipelines, vector stores, and retrieval APIs
  • Experience shipping platform building blocks adopted by multiple engineering teams
  • Experience leading complex technical projects such as migrations or greenfield platform builds

NVIDIA Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NVIDIA and has not been reviewed or approved by NVIDIA.

  • Equity Value & Accessibility Equity awards and a discounted ESPP are highlighted as core parts of total compensation, enabling employees to share in the company’s success. Stock-based compensation and the two-year lookback ESPP are consistently described as especially valuable.
  • Healthcare Strength Health coverage is portrayed as robust, with comprehensive medical, dental, and vision options alongside mental health support and on-site care resources. Employer HSA contributions and wellness perks reinforce the depth of the offering.
  • Retirement Support Retirement programs are depicted as strong, featuring a meaningful 401(k) match with Roth options and support for Mega Backdoor Roth contributions. These elements position long-term savings as a notable advantage of the total rewards package.

NVIDIA Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
21,960 Employees
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

Square Logo Square

Partner Development Lead

eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Remote or Hybrid
8 Locations
12000 Employees
164K-297K Annually

Square Logo Square

Sales Manager

eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Remote or Hybrid
8 Locations
12000 Employees
173K-312K Annually

Expedia Group Logo Expedia Group

Principal Product Manager

AdTech • eCommerce • Information Technology • Software • Travel • Generative AI
Hybrid
San Jose, CA, USA
16000 Employees
224K-387K Annually

Expedia Group Logo Expedia Group

Designer

AdTech • eCommerce • Information Technology • Software • Travel • Generative AI
Hybrid
Beverly Hills, CA, USA
16000 Employees
111K-177K Annually

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software • Productivity
US
15 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account