Senior Product Architect, K8s-Based AI Infrastructure

Posted Yesterday
Be an Early Applicant
Hiring Remotely in Santa Clara, CA, USA
In-Office or Remote
184K-357K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Role
Design and oversee datacenter-scale AI infrastructure architectures across networking, compute, storage, and Kubernetes ecosystems. Lead prototyping, testing, performance optimization, and lifecycle refinement for scalable AI products. Collaborate with hardware, software, security teams, customers, and partners to develop proofs of concept and MVPs. Produce technical documentation, user guides, whitepapers, blogs, and curricula while translating complex systems concepts for diverse audiences.
Summary Generated by Built In

NVIDIA is the engine of modern Artificial Intelligence, Parallel Compute Infrastructure, and Agentic AI - the biggest technology breakthroughs of our time. We’re on a mission to redefine how data moves, connects, and accelerates workloads at scale, and we’re seeking a visionary Product Architect with strong expertise in systems architecture to join our cause. As a key member of our team, you’ll design and shape the architectures that connect the world’s most powerful AI clusters. As a Product Architect at NVIDIA, you'll be the linchpin in transforming ideas into well-defined, functional products, balancing technical feasibility with user needs and market demands. You'll be responsible for designing and overseeing the development of cutting-edge AI solutions from conception through their entire lifecycle. Working at NVIDIA is all about efficiency and multiplying efforts; being a Product Architect is at the nexus of this ethos!

What you’ll be doing:

  • Stay at the forefront of technology trends in AI Infrastructure & Agentic AI, proposing new product concepts

  • Define detailed product architectures, including performance, scalability, interoperability, and datacenter deployment requirements

  • Lead prototyping and testing processes to validate product design and functionality, with a focus on scale, diagnosing bottlenecks and driving innovations in performance

  • Iterate and refine designs based on feedback, testing results, and evolving requirements

  • Collaborate with internal hardware, software, security and systems teams to ensure flawless integration of networking, compute and storage ecosystems

  • Work closely with partners and customers to conceptualize ideal solutions, build proof-of-concepts (POCs) and minimum viable products (MVPs) that demonstrate your vision

  • Provide comprehensive documentation for product designs, including technical specifications and user guides

  • Develop targeted content such as whitepapers, blogs, and curriculum for customers, partners, and users

What we need to see:

  • 8+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent

  • Bachelors degree in computer science or related field (or equivalent experience).

  • Strong background in technologies that enable large scale infrastructure management of complex systems, networks, and storage

  • Extensive experience with DevOps solutions, including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments

  • Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large scale training & fine-tuning, and model evaluation

  • Exceptional communication skills, with the ability to translate complex technical details for diverse audiences

  • A passion for staying updated with the latest technological advancements in AI and related fields

Ways to stand out from the crowd:

  • Prior first-hand experience on having built large scale AI infrastructure

  • Advanced certifications or publications in AI, deep learning, or related fields

  • Experience leading high-impact projects or initiatives in cutting-edge tech domains

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 24, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Skills Required

  • 8+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent
  • Bachelor's degree in computer science or a related field, or equivalent experience
  • Strong background in large-scale infrastructure management involving complex systems, networks, and storage
  • Extensive experience with DevOps solutions, Python, Ansible, container runtimes, Kubernetes, and data center deployments
  • Familiarity with AI workloads, including agentic and RAG-based workflows, inference at scale, large-scale training and fine-tuning, and model evaluation
  • Exceptional communication skills and ability to translate complex technical details for diverse audiences
  • Advanced certifications or publications in AI, deep learning, or related fields
  • First-hand experience building large-scale AI infrastructure
  • Experience leading high-impact projects or initiatives in cutting-edge technology domains

NVIDIA Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NVIDIA and has not been reviewed or approved by NVIDIA.

  • Equity Value & Accessibility Equity awards and a discounted ESPP are highlighted as core parts of total compensation, enabling employees to share in the company’s success. Stock-based compensation and the two-year lookback ESPP are consistently described as especially valuable.
  • Healthcare Strength Health coverage is portrayed as robust, with comprehensive medical, dental, and vision options alongside mental health support and on-site care resources. Employer HSA contributions and wellness perks reinforce the depth of the offering.
  • Retirement Support Retirement programs are depicted as strong, featuring a meaningful 401(k) match with Roth options and support for Mega Backdoor Roth contributions. These elements position long-term savings as a notable advantage of the total rewards package.

NVIDIA Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
21,960 Employees
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

Dynatrace Logo Dynatrace

Strategic Marketing Operations Technology Manager

Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Remote or Hybrid
United States
5600 Employees
148K-185K Annually

MetLife Logo MetLife

Consultant

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Remote or Hybrid
United States
43000 Employees
78K-100K Annually
Remote
United States
40 Employees
75K-125K Annually

CodePath.org Logo CodePath.org

Director of Growth

Edtech • Social Impact
Easy Apply
Remote
United States
55 Employees
180K-230K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
LTX Thumbnail
Robotics • Conversational AI • Generative AI
Jerusalem, Israel
200 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account