Senior Product Architect, HPC and AI

NVIDIA is the engine of modern Artificial Intelligence and Generative AI, the biggest technology breakthrough of our time. We're on a mission to make AI accessible to all, and we're seeking a visionary Product Architect to join our cause. As a key member of our team, you'll harness your infrastructure expertise to create reference designs for the world’s most powerful AI clusters.

As an AI/HPC Product Architect at NVIDIA, you'll be the linchpin in transforming ideas into well-defined, functional products, balancing technical feasibility with user needs and market demands. Responsibilities include designing and overseeing the development of cutting-edge AI products and solutions from conception through their entire lifecycle. Working at NVIDIA is all about efficiency and multiplying efforts; being a Product Architect is at the nexus of this ethos!

What you’ll be doing:

• Design the next-gen datacenter-scale AI infrastructure, leveraging the latest NVIDIA GPUs, compute servers, networking, and storage technologies

• Stay at the forefront of technology trends in AI infrastructure, workload orchestration, MLOps platforms, and GenAI applications, proposing new product concepts

• Architect detailed product designs, including specifications for functionality, performance, integrations, hardware, and datacenter requirements

• Lead prototyping and testing processes to validate product design and functionality with an emphasis on performance and scalability

• Iterate and refine designs based on feedback, testing results, and evolving requirements

• Coordinate with cross-functional teams to ensure seamless integration of various components and technologies, and work closely with partners and customers to conceptualize ideal solutions, build proof-of-concepts (POCs) and minimum viable products (MVPs) that demonstrate your vision

• Provide comprehensive documentation for product designs, including architectural diagrams, technical specifications and user guides

• Develop targeted content such as whitepapers, blogs, and curriculum for customers, partners, and users

What we need to see:

• 12+ years of experience designing datacenter scale HPC infrastructure as an Infrastructure Architect, Solutions Architect, Principal Engineer, or similarly technical role

• Bachelor's Degree in Computer Science or a related field, or equivalent experience.

• Strong background in technologies that enable large scale infrastructure, management of complex systems, networks, storage, and datacenter equipment

• Familiarity with job schedulers, workload orchestrators, high-performance storage, and complex network topologies

• Extensive experience with benchmarking systems and analyzing performance bottlenecks in large-scale AI/HPC infrastructure

• Exceptional communication skills, with the ability to translate complex technical details for diverse audiences

• A passion for staying updated with the latest technological advancements in AI, HPC and related fields with a focus on hardware and large scale infrastructure innovations

Ways to stand out from the crowd:

• Prior first-hand experience building large scale AI infrastructure

• Knowledge of end-to-end AI workloads including training, fine-tuning, inference at scale, agentic & RAG-based workflows, and model evaluation

• Advanced certifications or publications in AI, deep learning, or related fields, and experience leading high-impact projects or initiatives in innovative tech domains

• Proactive contributions to open-source projects or active involvement in tech communities

• Proven ability to mentor and uplift junior team members or peers, and unique problem-solving experience where unconventional thinking led to breakthrough solutions

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!

#LI-Hybrid 

The base salary range is 220,000 USD - 419,750 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.