NVIDIA is looking for a Senior Cloud Infrastructure and DevOps Solutions Architect to join its NVIDIA Infrastructure Specialist Team. Academic and commercial organizations around the world are using NVIDIA products to redefine deep learning and data analytics, and to power next-generation data centers. Join the team building and advising on many of the largest and fastest AI/HPC systems in the world!
We are looking for someone who combines deep technical expertise with strong consulting and communication skills. This role will engage directly with customers, partners, and cross-functional teams to assess, architect, and guide the implementation of large-scale infrastructure projects. The scope spans system architecture, Kubernetes-based platforms, and automation—serving as both a trusted advisor and a hands-on technical leader.
What You’ll Be Doing:
Advise on and help maintain large-scale computational and AI infrastructure, including monitoring, logging, and workload orchestration (Kubernetes and Linux job schedulers).
Provide consultative guidance and perform hands-on troubleshooting across the full stack—from bare metal and operating system, through the software stack, container platform, networking, and storage.
Assess customer environments and recommend optimized, production-ready Kubernetes-based container platforms integrated with enterprise-grade networking and storage solutions.
Serve as a key technical resource: develop, refine, and document standard methodologies and operational guidelines to be shared with internal teams and customer stakeholders.
Support Development activities and engage in POCs/POVs to validate new features, architectures, and upgrade approaches.
Create and deliver high-quality documentation, including runbooks, onboarding materials, and best-practice guides for customers and internal teams.
Act as the technical leader for assigned customer accounts, providing strategic guidance on DevOps and platform architecture and influencing long-term infrastructure and operations decisions.
What We Need to See:
Education & Experience: BS/MS/PhD in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, or related fields, with 5+ years of professional experience in managing scalable cloud environments and automation engineering roles.
Cloud & HPC Expertise: Proven understanding of networking fundamentals, data center architectures, and hands-on experience managing HPC/AI clusters, including deployment, optimization and troubleshooting.
NVIDIA GPU Expertise: Demonstrated hands-on experience deploying, configuring, and optimizing NVIDIA GPU-accelerated infrastructure, including driver management, CUDA toolkit integration, and GPU workload profiling.
Kubernetes & AI/ML Workloads: Extensive experience with Kubernetes for container orchestration, resource scheduling, scaling, and integration with GPU-accelerated and HPC environments.
Hardware & Software Knowledge: Strong familiarity with HPC and AI technologies (CPUs, GPUs, high-speed interconnects) and supporting software stacks.
Linux & Storage Systems: Deep knowledge of Linux (RedHat, Ubuntu), OS-level security, and protocols.
Automation & Observability: Proficiency in Python and Bash scripting, configuration management, and Infrastructure-as-Code tools (e.g., Ansible, Terraform). Experience with observability stacks (Grafana, Loki, Prometheus) for monitoring, logging, and building fault-tolerant systems.
Solution Architecture & Customer Engagement: Strong background in crafting scalable solutions and providing consultative support to customers, including leading architectural reviews and presenting to executive stakeholders.
Ways to Stand Out from the Crowd:
Knowledge of CI/CD pipelines for software deployment and automation.
Solid hands-on knowledge of Kubernetes and its operators for GPU and Network management.
Practical experience with SLURM, MPI, enroot and job provisioning
Experience with SW change management of clusters across compute, network and storage.
Experience with NVIDIA Base Command Manager (BCM) for provisioning, managing, and monitoring GPU clusters at scale as well as background with RDMA-based fabrics (InfiniBand or RoCE) in HPC or AI environments.
Skills Required
- BS/MS/PhD in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, or related field with 5+ years professional experience
- Proven experience managing scalable cloud environments, HPC/AI clusters, deployment, optimization and troubleshooting
- Hands-on experience deploying, configuring, and optimizing NVIDIA GPU-accelerated infrastructure (driver management, CUDA integration, GPU workload profiling)
- Extensive experience with Kubernetes for orchestration, scheduling, scaling, and GPU/HPC integration
- Deep knowledge of Linux systems (RedHat, Ubuntu), OS-level security, and storage systems
- Proficiency in Python and Bash scripting and automation
- Experience with Infrastructure-as-Code and configuration management (Ansible, Terraform)
- Experience with observability and monitoring stacks (Grafana, Loki, Prometheus)
- Strong solution architecture and customer engagement skills, including presenting to stakeholders and leading architectural reviews
- Knowledge of networking fundamentals and data center architectures for HPC/AI environments
- Knowledge of CI/CD pipelines for software deployment and automation
- Hands-on knowledge of Kubernetes operators for GPU and network management
- Practical experience with SLURM, MPI, and enroot job provisioning
- Experience with software change management of clusters across compute, network, and storage
- Experience with NVIDIA Base Command Manager (BCM) for provisioning and monitoring GPU clusters at scale
- Background with RDMA-based fabrics (InfiniBand or RoCE) in HPC or AI environments
NVIDIA Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NVIDIA and has not been reviewed or approved by NVIDIA.
-
Equity Value & Accessibility — Equity awards and a discounted ESPP are highlighted as core parts of total compensation, enabling employees to share in the company’s success. Stock-based compensation and the two-year lookback ESPP are consistently described as especially valuable.
-
Healthcare Strength — Health coverage is portrayed as robust, with comprehensive medical, dental, and vision options alongside mental health support and on-site care resources. Employer HSA contributions and wellness perks reinforce the depth of the offering.
-
Retirement Support — Retirement programs are depicted as strong, featuring a meaningful 401(k) match with Roth options and support for Mega Backdoor Roth contributions. These elements position long-term savings as a notable advantage of the total rewards package.
NVIDIA Insights
What We Do
NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”
