Senior Staff Software Engineer - AI Agent Platform

Posted Yesterday
Be an Early Applicant
Santa Clara, CA, USA
In-Office
200K-391K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Role
Design, build, and scale NVIDIA’s AI agent platform infrastructure. Responsibilities include Kubernetes-based multi-tenant execution environments, agent lifecycle services, CI/CD automation, framework-agnostic platform APIs, Kafka and Redis streaming, AI data ingestion and retrieval, session management, authentication, secrets management, and compliance controls. The role also leads complex platform initiatives and collaborates across engineering and security teams.
Summary Generated by Built In

We are looking for a Sr. Engineer to design, build, and scale the infrastructure powering NVIDIA’s AI agent ecosystem. You will work at the intersection of distributed systems, developer platforms, and agentic AI — building the foundational services that enable teams across the company to develop, deploy, orchestrate, and operate autonomous AI agents at production scale.


What you will be doing:

  • Build and develop platform services that manage the full agent lifecycle from registration through deployment, execution, and teardown
  • Architect multi-tenant Kubernetes execution environments with pod lifecycle management, per-tenant namespace isolation, persistent storage, admission policy enforcement, and identity propagation
  • Develop and maintain automated CI/CD pipelines using GitLab CI and ArgoCD, including reusable pipeline templates and deployment blueprints that standardize how agents are built across teams
  • Build framework-agnostic infrastructure supporting multiple agent SDKs and harnesses — lifecycle hooks, skills configuration, memory services, and OTEL instrumentation — so teams can onboard new agent frameworks without platform changes
  • Build and operate Kafka-based message pipelines and real-time event streaming using Redis PubSub and SSE
  • Develop data ingestion pipelines, access interfaces, and storage layers that power AI agent knowledge and context
  • Implement session management for state persistence, conversation history, and agent recovery across sessions
  • Develop multi-layer auth using OAuth 2.0, JWT validation, token exchange, and gateway integration, and manage secrets lifecycle with Vault (provisioning, rotation, container injection)
  • Partner with security teams on compliance, access controls, and approval workflows for agent operations

What we need to see:

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field (or equivalent experience), with 12+ years in software engineering — ideally in platform engineering, infrastructure, or developer tools
  • Experience building and scaling AI agents in production using frameworks like Claude Code, Codex, or LangGraph
  • Deep Kubernetes expertise including pod orchestration, persistent storage, RBAC, and multi-cluster management
  • Strong Python skills with production API experience using FastAPI, Flask, or similar async frameworks
  • Proven track record designing distributed systems with Kafka, Redis, and MongoDB or PostgreSQL
  • Expertise building and managing robust CI/CD pipelines using GitLab CI and ArgoCD for continuous delivery to Kubernetes
  • Experience designing AI data platform components (ingestion pipelines, vector stores, retrieval APIs, data preprocessing workflows) and building developer-facing platform APIs consumed by multiple engineering teams
  • Solid grasp of auth and identity: OAuth 2.0, JWT, token exchange, and secrets management with Vault
  • History of leading sophisticated technical projects such as migrations or greenfield platform builds, with strong interpersonal skills to drive alignment across teams and write clear design documents

Ways to stand out from the crowd:

  • Experience building or operating AI agent platforms or agentic workflow systems, with hands-on expertise in agent protocols and frameworks like MCP, A2A, LangChain, or LangGraph
  • Hands-on experience with RAG architectures, embedding pipelines, and vector databases (Milvus, Pinecone, or Weaviate)
  • Full-stack skills with React or Vue for building developer portals and dashboards
  • Contributions to open-source infrastructure or platform tooling

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
200,000 USD – 322,000 USD for Level 5; and 248,000 USD – 391,000 USD for Level 6.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 23, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Skills Required

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, or equivalent experience
  • 12+ years of software engineering experience, ideally in platform engineering, infrastructure, or developer tools
  • Production experience building and scaling AI agents using frameworks such as Claude Code, Codex, or LangGraph
  • Deep Kubernetes expertise, including pod orchestration, persistent storage, RBAC, and multi-cluster management
  • Strong Python skills and production API experience with FastAPI, Flask, or similar asynchronous frameworks
  • Experience designing distributed systems with Kafka, Redis, and MongoDB or PostgreSQL
  • Experience building and managing CI/CD pipelines with GitLab CI and ArgoCD for Kubernetes delivery
  • Experience designing AI data platform components, including ingestion pipelines, vector stores, retrieval APIs, and preprocessing workflows
  • Experience building developer-facing platform APIs used by multiple engineering teams
  • Knowledge of OAuth 2.0, JWT, token exchange, and secrets management with Vault
  • Experience leading complex technical projects such as migrations or greenfield platform builds
  • Strong interpersonal, alignment, and technical design documentation skills
  • Experience with AI agent platforms, agentic workflow systems, MCP, A2A, LangChain, or LangGraph
  • Hands-on experience with RAG architectures, embedding pipelines, and Milvus, Pinecone, or Weaviate
  • Full-stack experience with React or Vue for developer portals and dashboards
  • Contributions to open-source infrastructure or platform tooling

NVIDIA Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NVIDIA and has not been reviewed or approved by NVIDIA.

  • Equity Value & Accessibility — Feedback suggests equity grants, stock options/RSUs, and a discounted ESPP materially boost total compensation and can deliver significant wealth-building when the stock performs well.
  • Healthcare Strength — Feedback suggests medical, dental, and vision plans with in-network preventive care at 100%, telehealth, and concierge-style support are comprehensive and valued.
  • Parental & Family Support — Feedback suggests up to 22 weeks fully paid parental leave, fertility coverage, and adoption/surrogacy reimbursement provide strong family-focused benefits.

NVIDIA Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
21,960 Employees
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

Motive Logo Motive

Manager, Technical Program Management

Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Easy Apply
In-Office
San Francisco, CA, USA
4000 Employees
200K-270K Annually

Relativity Space Logo Relativity Space

Technical Recruiter

Aerospace • Hardware • Robotics • Software • Manufacturing
Easy Apply
In-Office
Long Beach, CA, USA
2200 Employees
103K-155K Annually

The Aerospace Corporation Logo The Aerospace Corporation

Contracts Lead

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
San Jose, CA, USA
4600 Employees
124K-155K Annually

The Aerospace Corporation Logo The Aerospace Corporation

Lead Internal Auditor

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
San Jose, CA, USA
4600 Employees
129K-160K Annually

Similar Companies Hiring

Unusual Machines, Inc. Thumbnail
Hardware • Robotics
Orlando, FL
300 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account