Senior Manager, Engineering - Enterprise AI and Automation

Posted 3 Days Ago
Be an Early Applicant
Santa Clara, CA, USA
In-Office
272K-431K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Role
Lead NVIDIA’s agentic developer platform strategy and execution. Build scalable platform capabilities from emerging agent patterns, including RAG, vector databases, evaluation systems, governance, safety tooling, and GPU-optimized workflows. Integrate the AI Data Platform with NVIDIA’s on-prem AI Factory, improve distributed inference performance, and establish controls for data lineage, compliance, and Responsible AI. Grow a high-performing engineering team and drive adoption of reusable APIs, SDKs, components, and reference implementations across the company.
Summary Generated by Built In

As a Senior Engineering Manager for Agentic Systems & Platform Architecture, you will lead the strategy and execution for NVIDIA’s agentic developer platform—deeply understanding how teams across the company build, evaluate, and improve autonomous agents, and turning those evolving patterns into scalable platform capabilities. You will identify gaps and friction, drive rapid proof-of-concepts on emerging agent constructs and ecosystem tools, and operationalize the best approaches into reusable building blocks, integrations, and governance mechanisms that accelerate developer productivity and agent quality. If you’re passionate about staying at the forefront of agent architectures and turning experimentation into real business impact, this role offers a chance to build a platform. This platform helps teams safely ship more autonomous systems at NVIDIA scale.

What you will be doing:

  • Track and deeply understand evolving agent development patterns across NVIDIA and the broader ecosystem

  • Identify gaps and friction in current agent architectures, and translate insights into a platform strategy that boosts developer velocity and agent quality—backed by evaluations, benchmarking, and feedback loops

  • Assess and integrate open source and third-party tools where they add leverage; drive clear build-vs-use decisions

  • Architect and integrate high-performance data pipelines, RAG systems, vector databases, and GPU-optimized training and inference workflows.

  • Lead integration of the AI Data Platform into NVIDIA’s on-prem AI Factory, optimizing GPU-to-storage throughput, data locality, and distributed inference performance.

  • Establish and enforce robust Agent Governance policies across the platform, covering model/tool usage, data lineage, and ensuring adherence to compliance and Responsible AI frameworks.

  • Design, implement, and maintain a centralized Agent Safety Toolkit, providing developers with pre-vetted components for input/output guardrails and prompt injection defenses

  • Lead and grow a high-performing team along with a multi-functional community to standardize procedures and scale adoption

What we need to see:

  • Bachelor’s degree in CS/Engineering or equivalent experience

  • 10+ overall years in software engineering, including 4+ years managing high-performing teams

  • Strong hands-on experience with evolving agent architectures and open-source libraries; deep expertise in LLM/agent architectures—leading POCs and integrating them into real business use cases with measurable adoption/impact

  • Ability to turn fast-moving, ambiguous problem spaces into clear platform strategy, roadmap, and outcomes

  • Proven track record building multi-team developer platforms (APIs/SDKs, reusable components, reference implementations)

  • Experience building evaluation/benchmarking systems for agent workflows (metrics, regression, feedback loops)

  • Strong judgment integrating OSS/3P tools; clear build-vs-use decision-making and integration strategy

  • Product approach for safety and governance: controls, audit ability, monitoring, and risk management

  • Strong leadership and executive communication (engineering, product, security, research)

Ways to stand out from the crowd:

  • Experience implementing enterprise-grade governance for agent systems (controls, audit-ability, monitoring, policy enforcement) in production autonomous workflows

  • Demonstrated wins taking new/open-source agent constructs from POC to production adoption, with clear business impact (cycle time, quality, cost, reliability)

  • Built and scaled an agent platform or agent developer experience used by multiple teams (SDKs, templates, reference apps, reusable building blocks)

  • Clear point of view and real examples on build-vs-use decisions—when to adopt OSS/3P vs build internal primitives—and how to operationalize the choice

  • Deep experience with agent evaluation at scale (long-horizon tasks, tool correctness, reliability testing, automated regressions, offline/online feedback loops)

We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you! Ready to take your career to the next level? Apply now and join the innovation!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 272,000 USD - 431,250 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until October 26, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Skills Required

  • Bachelor's degree in Computer Science, Engineering, or equivalent experience
  • 10+ years of overall software engineering experience
  • 4+ years managing high-performing engineering teams
  • Hands-on experience with evolving agent architectures and open-source libraries
  • Deep expertise in LLM and agent architectures, including proof-of-concept leadership and production integration
  • Ability to translate ambiguous problem spaces into platform strategy, roadmaps, and measurable outcomes
  • Track record building multi-team developer platforms with APIs, SDKs, reusable components, and reference implementations
  • Experience building evaluation and benchmarking systems for agent workflows
  • Strong judgment integrating open-source and third-party tools, including build-versus-use decisions
  • Experience developing safety and governance controls, auditability, monitoring, and risk management
  • Strong leadership and executive communication across engineering, product, security, and research
  • Experience implementing enterprise-grade governance for agent systems in production autonomous workflows
  • Demonstrated success moving open-source agent constructs from proof of concept to production adoption
  • Experience building and scaling an agent platform or agent developer experience used by multiple teams
  • Clear experience making and operationalizing open-source or third-party build-versus-use decisions
  • Deep experience with agent evaluation at scale, including long-horizon tasks, tool correctness, reliability testing, automated regressions, and feedback loops

NVIDIA Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NVIDIA and has not been reviewed or approved by NVIDIA.

  • Equity Value & Accessibility — Equity awards and a discounted ESPP are highlighted as core parts of total compensation, enabling employees to share in the company’s success. Stock-based compensation and the two-year lookback ESPP are consistently described as especially valuable.
  • Healthcare Strength — Health coverage is portrayed as robust, with comprehensive medical, dental, and vision options alongside mental health support and on-site care resources. Employer HSA contributions and wellness perks reinforce the depth of the offering.
  • Retirement Support — Retirement programs are depicted as strong, featuring a meaningful 401(k) match with Roth options and support for Mega Backdoor Roth contributions. These elements position long-term savings as a notable advantage of the total rewards package.

NVIDIA Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
21,960 Employees
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

Hilton Logo Hilton

Pastry Cook II (Full-Time), Bourbon Steak - Waldorf Astoria Monarch Beach Resort and Club

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office
Dana Point, CA, USA
500000 Employees

Hilton Logo Hilton

Pastry Cook I (Full-Time) - Waldorf Astoria Monarch Beach Resort

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office
Dana Point, CA, USA
500000 Employees

Hilton Logo Hilton

Host - Hilton Anaheim

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office
Anaheim, CA, USA
500000 Employees

Hilton Logo Hilton

Cook I (Full-Time), Sun Deck - Hotel del Coronado, A Curio Collection by Hilton

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office
Coronado, CA, USA
500000 Employees

Similar Companies Hiring

Unusual Machines, Inc. Thumbnail
Hardware • Robotics
Orlando, FL
300 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account