NVIDIA is looking for a Senior Cloud Infrastructure and DevOps Solutions Architect to join its NVIDIA Infrastructure Specialist Team. Academic and commercial organizations around the world are using NVIDIA products to redefine deep learning and data analytics, and to power next-generation data centers. Join the team building and advising on many of the largest and fastest AI/HPC systems in the world!
We are looking for someone who combines deep technical expertise with strong consulting and communication skills. This role will engage directly with customers, partners, and cross-functional teams to assess, architect, and guide the implementation of large-scale infrastructure projects. The scope spans system architecture, Kubernetes-based platforms, and automation—serving as both a trusted advisor and a hands-on technical leader.
What You’ll Be Doing:
Advise on and help maintain large-scale computational and AI infrastructure, including monitoring, logging, and workload orchestration (Kubernetes and Linux job schedulers).
Provide consultative guidance and perform hands-on troubleshooting across the full stack—from bare metal and operating system, through the software stack, container platform, networking, and storage.
Assess customer environments and recommend optimized, production-ready Kubernetes-based container platforms integrated with enterprise-grade networking and storage solutions.
Serve as a key technical resource: develop, refine, and document standard methodologies and operational guidelines to be shared with internal teams and customer stakeholders.
Support Development activities and engage in POCs/POVs to validate new features, architectures, and upgrade approaches.
Create and deliver high-quality documentation, including runbooks, onboarding materials, and best-practice guides for customers and internal teams.
Act as the technical leader for assigned customer accounts, providing strategic guidance on DevOps and platform architecture and influencing long-term infrastructure and operations decisions.
What We Need to See:
Education & Experience: BS/MS/PhD in Computer Science, Electrical/Computer Engineering, Physics, Mathematics, or related fields, with 5+ years of professional experience in managing scalable cloud environments and automation engineering roles.
Cloud & HPC Expertise: Proven understanding of networking fundamentals, data center architectures, and hands-on experience managing HPC/AI clusters, including deployment, optimization and troubleshooting.
NVIDIA GPU Expertise: Demonstrated hands-on experience deploying, configuring, and optimizing NVIDIA GPU-accelerated infrastructure, including driver management, CUDA toolkit integration, and GPU workload profiling.
Kubernetes & AI/ML Workloads: Extensive experience with Kubernetes for container orchestration, resource scheduling, scaling, and integration with GPU-accelerated and HPC environments.
Hardware & Software Knowledge: Strong familiarity with HPC and AI technologies (CPUs, GPUs, high-speed interconnects) and supporting software stacks.
Linux & Storage Systems: Deep knowledge of Linux (RedHat, Ubuntu), OS-level security, and protocols.
Automation & Observability: Proficiency in Python and Bash scripting, configuration management, and Infrastructure-as-Code tools (e.g., Ansible, Terraform). Experience with observability stacks (Grafana, Loki, Prometheus) for monitoring, logging, and building fault-tolerant systems.
Solution Architecture & Customer Engagement: Strong background in crafting scalable solutions and providing consultative support to customers, including leading architectural reviews and presenting to executive stakeholders.
Ways to Stand Out from the Crowd:
Knowledge of CI/CD pipelines for software deployment and automation.
Solid hands-on knowledge of Kubernetes and its operators for GPU and Network management.
Practical experience with SLURM, MPI, enroot and job provisioning
Experience with SW change management of clusters across compute, network and storage.
Experience with NVIDIA Base Command Manager (BCM) for provisioning, managing, and monitoring GPU clusters at scale as well as background with RDMA-based fabrics (InfiniBand or RoCE) in HPC or AI environments.
Skills Required
- BS, MS, or PhD in Computer Science, Electrical or Computer Engineering, Physics, Mathematics, or a related field
- 5+ years of professional experience managing scalable cloud environments and performing automation engineering
- Experience with networking fundamentals and data center architectures
- Hands-on experience managing HPC or AI clusters, including deployment, optimization, and troubleshooting
- Hands-on experience deploying, configuring, and optimizing NVIDIA GPU-accelerated infrastructure
- Experience with NVIDIA driver management, CUDA Toolkit integration, and GPU workload profiling
- Extensive Kubernetes experience, including orchestration, scheduling, scaling, and GPU/HPC integration
- Knowledge of HPC and AI technologies, including CPUs, GPUs, high-speed interconnects, and supporting software stacks
- Deep knowledge of Linux, including Red Hat, Ubuntu, OS-level security, and protocols
- Proficiency in Python and Bash scripting
- Experience with configuration management and Infrastructure-as-Code tools such as Ansible and Terraform
- Experience with Grafana, Loki, Prometheus, monitoring, logging, and fault-tolerant systems
- Background in solution architecture, customer consulting, architectural reviews, and executive presentations
- Knowledge of CI/CD pipelines
- Hands-on knowledge of Kubernetes operators for GPU and network management
- Practical experience with SLURM, MPI, enroot, and job provisioning
- Experience with software change management across compute, network, and storage clusters
- Experience with NVIDIA Base Command Manager
- Experience with RDMA-based fabrics, including InfiniBand or RoCE, in HPC or AI environments
NVIDIA Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NVIDIA and has not been reviewed or approved by NVIDIA.
-
Equity Value & Accessibility — Equity awards and a discounted ESPP are highlighted as core parts of total compensation, enabling employees to share in the company’s success. Stock-based compensation and the two-year lookback ESPP are consistently described as especially valuable.
-
Healthcare Strength — Health coverage is portrayed as robust, with comprehensive medical, dental, and vision options alongside mental health support and on-site care resources. Employer HSA contributions and wellness perks reinforce the depth of the offering.
-
Retirement Support — Retirement programs are depicted as strong, featuring a meaningful 401(k) match with Roth options and support for Mega Backdoor Roth contributions. These elements position long-term savings as a notable advantage of the total rewards package.
NVIDIA Insights
What We Do
NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”
