NVIDIA needs a Senior Product Manager to lead Switchyard, our adaptive inference runtime for systems of models. We build Switchyard to help agentic applications choose among models, providers, tools, reasoning strategies, and runtime configurations to improve task-level quality, cost, latency, and policy compliance without requiring teams to rewrite their agents. You will turn a fast-moving research agenda and a growing partner ecosystem into open source tools that impact model routing and adaptive inference across the industry.
What you’ll be doing:
- Drive Switchyard’s product strategy and roadmap. Set priorities, quality bars, and clear product outcomes together with Engineering.
- Work directly with agent harness builders, inference gateways, model serving systems, and other partners to make integrations successful and turn market feedback into stronger product capabilities.
- Define the developer experience and product interfaces for adaptive inference.
- Partner with Research to translate advances in areas like cost and quality prediction, constrained optimization, and budget allocation into usable products and features.
- Partner with Engineering to improve reliability, usability, documentation, SDK coverage, and the customization path for production deployments.
- Build the adoption motion with Product Marketing, Solution Architects, and GTM teams. Identify qualified workloads, guide partner pilots, and build repeatable deployment playbooks.
- Establish the messaging and narrative for how our teams talk about model routing and adaptive inference, working together with Product Marketing.
- Define and inspect the evidence for success. Own the outcomes.
- Coordinate across adjacent teams to build compelling joint product outcomes..
What we need to see:
- Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML, or a related field, or equivalent experience.
- 8+ years of product management or closely related experience building technical products for developers, infrastructure teams, or AI practitioners.
- A record of scaling developer or infrastructure products through a partnership motion and integrations, not only through a single first-party application.
- Technical proficiency in LLM inference, model routing, agent runtimes, and developer APIs. Able to reason clearly about quality/cost/latency tradeoffs.
- Ability to engage mature customers and partners independently, uncover real production constraints, and guide GTM teams through complex technical adoption.
- Positive relationships with Engineering and Research teams. Ask sharp questions, convert uncertainty into decisions, and support teams without prescribing implementation.
- An evidence-driven product approach grounded in benchmarks, evals, and explicit success criteria.
- Excellent written and verbal communication, good judgment, and the ability to align senior technical and business leaders across organizational boundaries.
- Enough technical depth to inspect APIs, traces, and benchmark results directly and earn the trust of senior researchers and engineers.
Ways to stand out from the crowd:
- Experience with LLM routers, AI gateways, model serving, distributed inference, or systems that dynamically allocate test-time compute.
- Experience taking research from prototype to a reliable, adopted developer product.
- A track record with open-source communities, SDKs, platform integrations, or developer ecosystems.
- Hands-on familiarity with relevant adjacent topics like agent building, eval systems, and inference optimization.
With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most hard-working and dedicated people on the planet working for us and, due to outstanding growth, our Product Management teams are growing fast. If you’re a creative technologist with a genuine passion for these topics, we want to hear from you!
Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 258,750 USD for Level 4, and 208,000 USD - 327,750 USD for Level 5.You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Skills Required
- Bachelor's or Master's degree in Computer Science, Engineering, AI/ML, a related field, or equivalent experience
- 8+ years of product management or closely related experience building technical products for developers, infrastructure teams, or AI practitioners
- Experience scaling developer or infrastructure products through partnerships and integrations
- Technical proficiency in LLM inference, model routing, agent runtimes, and developer APIs
- Ability to assess quality, cost, and latency tradeoffs
- Ability to independently engage mature customers and partners, identify production constraints, and support complex technical adoption
- Ability to collaborate effectively with Engineering and Research teams and convert uncertainty into decisions
- Evidence-driven product approach using benchmarks, evaluations, and explicit success criteria
- Excellent written and verbal communication, good judgment, and ability to align senior technical and business leaders
- Technical depth to inspect APIs, traces, and benchmark results
- Experience with LLM routers, AI gateways, model serving, distributed inference, or dynamic test-time compute allocation
- Experience taking research prototypes to reliable, adopted developer products
- Experience with open-source communities, SDKs, platform integrations, or developer ecosystems
- Hands-on familiarity with agent building, evaluation systems, and inference optimization
NVIDIA Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NVIDIA and has not been reviewed or approved by NVIDIA.
-
Equity Value & Accessibility — Equity awards and a discounted ESPP are highlighted as core parts of total compensation, enabling employees to share in the company’s success. Stock-based compensation and the two-year lookback ESPP are consistently described as especially valuable.
-
Healthcare Strength — Health coverage is portrayed as robust, with comprehensive medical, dental, and vision options alongside mental health support and on-site care resources. Employer HSA contributions and wellness perks reinforce the depth of the offering.
-
Retirement Support — Retirement programs are depicted as strong, featuring a meaningful 401(k) match with Roth options and support for Mega Backdoor Roth contributions. These elements position long-term savings as a notable advantage of the total rewards package.
NVIDIA Insights
What We Do
NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”
