Solutions Architect - Rack Scale AI Systems

Posted Yesterday
Be an Early Applicant
2 Locations
In-Office
208K-414K Annually
Expert/Leader
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Role
Design and deploy rack-scale AI infrastructure and cluster solutions for NVIDIA products. Collaborate with product teams and cross-functional engineering groups to onboard hardware/software stacks, optimize cluster deployments, and support multi-site datacenter and lab rollouts. Troubleshoot complex system failures, automate provisioning, and improve time-to-market for next-generation GPU/Tegra-based products.
Summary Generated by Built In

NVIDIA is looking for a Solutions Architect to work in IPP's (Infrastructure, Planning and Process) Cloud Infrastructure Team. IPP is a global organization within NVIDIA. This group works with various other groups within NVIDIA such as Graphics Processors, Mobile Processors, Deep Learning, Artificial Intelligence and Driverless Cars to cater to their infrastructure needs. These cloud services provide almost half a million automated jobs per day on thousands of servers helping with the productivity of thousands of NVIDIA's software engineers worldwide. The cloud hosts a heterogeneous mix of machines and devices with various operating systems (Windows/Linux/Android), a multitude of hardware platforms both NVIDIA GPUs and Tegra Processors. Are you passionate about distributed infrastructure and looking for sophisticated, critical issues, ready to build the next generation of cloud services, design creative solutions, mine through data to uncover real problems and fix them?

What you'll be doing:

  • Work with NVIDIA Product Teams to understand new product roadmaps and requirements primarily Rack Scale AI Products.

  • Finding Optimum Solutions to deploy these products in a Datacenter or a Lab environment using sophisticated design techniques, services and tools.

  • Assist in roll-out and deployment of new development features aimed at supporting the latest NVIDIA hardware and technologies.

  • Work closely with world-class engineers, architects, technical product managers and application developers setting the best strategies in place for a product launch.

  • Defining and implementing full scale solutions for product onboarding into our hosted and private cloud environments.

  • Solve sophisticated problems involving multi-site deployments of NVIDIA products and directly contribute to the overall quality of deployments and improve time to market next gen products.

  • Collaborate with multi-functional teams, including system engineering, software engineering, mechanical/thermal engineering, operations, data center teams, external vendors, and other partners to successfully deliver a reliable and robust platform from concept to prototype to deployments.

  • Integrate and Optimize Cluster Deployment methods and manage SW stack deployments, including provisioning these services into the cloud.

What we need to see:

  • Bachelor's or Master's Degree in Computer Science or Software Engineering, or equivalent experience.

  • 12+ years of relevant experience.

  • 6+ years of Linux and Scripting experience.

  • Solid background on OS Kernels and system engineering.

  • A track record of quickly understanding new technologies outside of your domain expertise and deploying systems in sophisticated configurations from hardware through multiple layers of software in a fast-paced environment.

  • Strong technical skills and understanding of embedded systems, orchestration & automation systems, data centers and cloud architecture, as well as excellent communication and planning skills.

  • Strong problem-solving ability and experience in product engineering/failure analysis and debug/ HW or test design.

  • Understanding of dense datacenter design including compute, Storage and networking.

Ways to stand out from the crowd:

  • Understanding of software engineering principles and enterprise system architecture.

  • Experience with gpu and compute clusters administration & automation.

  • Experience in large scale QA environments, for product bring ups.

  • Special skills in large-scale computing and cluster computing(MPI), data center design include high speed interconnect InfiniBand, Cluster Storage and Scheduling related design and/or management experience.

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens new universes to explore, enables outstanding creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars. NVIDIA is looking for phenomenal people like you to help us accelerate the next wave of artificial intelligence. Widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and passionate about new technologies we want you on our team!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 208,000 USD - 333,500 USD for Level 5, and 256,000 USD - 414,000 USD for Level 6.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until July 17, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Skills Required

  • Bachelor's or Master's Degree in Computer Science or Software Engineering, or equivalent experience.
  • 12+ years of relevant experience.
  • 6+ years of Linux and scripting experience.
  • Solid background in OS kernels and system engineering.
  • Experience deploying systems across hardware and multiple software layers in complex configurations.
  • Strong technical skills in embedded systems, orchestration and automation systems, data center and cloud architecture.
  • Experience in product engineering, failure analysis, hardware/test debug and test design.
  • Understanding of dense datacenter design including compute, storage and networking.
  • Experience with GPU and compute cluster administration and automation (ways to stand out).
  • Experience in large-scale QA environments and product bring-ups (ways to stand out).
  • Experience with cluster computing (MPI), high-speed interconnects (InfiniBand), cluster storage and scheduling design/management (ways to stand out).

NVIDIA Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NVIDIA and has not been reviewed or approved by NVIDIA.

  • Equity Value & Accessibility Equity awards and a discounted ESPP are highlighted as core parts of total compensation, enabling employees to share in the company’s success. Stock-based compensation and the two-year lookback ESPP are consistently described as especially valuable.
  • Healthcare Strength Health coverage is portrayed as robust, with comprehensive medical, dental, and vision options alongside mental health support and on-site care resources. Employer HSA contributions and wellness perks reinforce the depth of the offering.
  • Retirement Support Retirement programs are depicted as strong, featuring a meaningful 401(k) match with Roth options and support for Mega Backdoor Roth contributions. These elements position long-term savings as a notable advantage of the total rewards package.

NVIDIA Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
21,960 Employees
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

Comcast Logo Comcast

Tier 3 -Engineer 4, Excellence in Operations (Onsite)

Digital Media • Information Technology • News + Entertainment
Hybrid
Plano, TX, USA
115000 Employees
91K-143K Annually

Comcast Logo Comcast

Enterprise Account Executive

Digital Media • Information Technology • News + Entertainment
Remote or Hybrid
Texas, USA
115000 Employees

Shield AI Logo Shield AI

Technician III, Maintenance (R5311)

Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software
In-Office
Dallas, TX, USA

PwC Logo PwC

Identity and Access Management - Sr Associate

Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Hybrid
21 Locations
370000 Employees
77K-202K Annually

Similar Companies Hiring

Legora Thumbnail
Artificial Intelligence • Legal Tech • Software
Chicago, Illinois
700 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account