Senior Product Architect, K8s-Based AI Infrastructure

Reposted Yesterday
Be an Early Applicant
Hiring Remotely in Santa Clara, CA, USA
In-Office or Remote
184K-357K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Role
Design and oversee datacenter-scale AI infrastructure architectures across networking, compute, storage, and Kubernetes ecosystems. Lead prototyping, testing, performance optimization, and lifecycle refinement for scalable AI products. Collaborate with hardware, software, security teams, customers, and partners to develop proofs of concept and MVPs. Produce technical documentation, user guides, whitepapers, blogs, and curricula while translating complex systems concepts for diverse audiences.
Summary Generated by Built In

NVIDIA is the engine of modern Artificial Intelligence, Parallel Compute Infrastructure, and Agentic AI - the biggest technology breakthroughs of our time. We’re on a mission to redefine how data moves, connects, and accelerates workloads at scale, and we’re seeking a visionary Product Architect with strong expertise in systems architecture to join our cause. As a key member of our team, you’ll design and shape the architectures that connect the world’s most powerful AI clusters. As a Product Architect at NVIDIA, you'll be the linchpin in transforming ideas into well-defined, functional products, balancing technical feasibility with user needs and market demands. You'll be responsible for designing and overseeing the development of cutting-edge AI solutions from conception through their entire lifecycle. Working at NVIDIA is all about efficiency and multiplying efforts; being a Product Architect is at the nexus of this ethos!

What you’ll be doing:

  • Stay at the forefront of technology trends in AI Infrastructure & Agentic AI, proposing new product concepts

  • Define detailed product architectures, including performance, scalability, interoperability, and datacenter deployment requirements

  • Lead prototyping and testing processes to validate product design and functionality, with a focus on scale, diagnosing bottlenecks and driving innovations in performance

  • Iterate and refine designs based on feedback, testing results, and evolving requirements

  • Collaborate with internal hardware, software, security and systems teams to ensure flawless integration of networking, compute and storage ecosystems

  • Work closely with partners and customers to conceptualize ideal solutions, build proof-of-concepts (POCs) and minimum viable products (MVPs) that demonstrate your vision

  • Provide comprehensive documentation for product designs, including technical specifications and user guides

  • Develop targeted content such as whitepapers, blogs, and curriculum for customers, partners, and users

What we need to see:

  • 8+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent

  • Bachelors degree in computer science or related field (or equivalent experience).

  • Strong background in technologies that enable large scale infrastructure management of complex systems, networks, and storage

  • Extensive experience with DevOps solutions, including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments

  • Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large scale training & fine-tuning, and model evaluation

  • Exceptional communication skills, with the ability to translate complex technical details for diverse audiences

  • A passion for staying updated with the latest technological advancements in AI and related fields

Ways to stand out from the crowd:

  • Prior first-hand experience on having built large scale AI infrastructure

  • Advanced certifications or publications in AI, deep learning, or related fields

  • Experience leading high-impact projects or initiatives in cutting-edge tech domains

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
184,000 USD – 287,500 USD for Level 4; and 224,000 USD – 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 3, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Skills Required

  • 8+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent
  • Bachelor's degree in computer science or a related field, or equivalent experience
  • Strong background in large-scale infrastructure management involving complex systems, networks, and storage
  • Extensive experience with DevOps solutions, Python, Ansible, container runtimes, Kubernetes, and data center deployments
  • Familiarity with AI workloads, including agentic and RAG-based workflows, inference at scale, large-scale training and fine-tuning, and model evaluation
  • Exceptional communication skills and ability to translate complex technical details for diverse audiences
  • Advanced certifications or publications in AI, deep learning, or related fields
  • First-hand experience building large-scale AI infrastructure
  • Experience leading high-impact projects or initiatives in cutting-edge technology domains

NVIDIA Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NVIDIA and has not been reviewed or approved by NVIDIA.

  • Equity Value & Accessibility — Company stock and RSUs have driven exceptional total compensation, with a generous employee stock purchase plan and ongoing equity refreshers playing a central role. Feedback suggests historic share-price gains created significant financial upside for many.
  • Healthcare Strength — Multiple plan options (HSA, PPO, and in some locations Kaiser) with in-network preventive care covered at 100% and company HSA contributions indicate a robust offering. Mental-health sessions and broad dental, vision, and disability coverage further strengthen the package.
  • Parental & Family Support — Up to 22 weeks of fully paid parental leave, adoption and surrogacy reimbursement, and coverage for IVF and egg freezing are highlighted as standout features. Additional family-care resources and caregiving support broaden the appeal.

NVIDIA Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
21,960 Employees
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

SharkNinja Logo SharkNinja

Director, Media - Shark Home

Beauty • Robotics • Design • Appliances • Manufacturing
Remote
United States
4000 Employees
175K-215K Annually

CDW Logo CDW

Data Engineer

Information Technology
Remote or Hybrid
US
15100 Employees
105K-150K Annually

CDW Logo CDW

Consultant

Information Technology
Remote or Hybrid
US
15100 Employees
91K-129K Annually

Pfizer Logo Pfizer

Director, QSEO AI Transformation Lead

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
8 Locations
121990 Employees
177K-294K Annually

Similar Companies Hiring

Unusual Machines, Inc. Thumbnail
Hardware • Robotics
Orlando, FL
300 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account