Engineering Manager, Internal GPU and HPC Computing Clusters

Reposted Yesterday
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka
In-Office
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Role
Lead the design and operation of large-scale AI GPU compute clusters, optimizing resource usage and driving operational excellence through automation while managing a high-performance team.
Summary Generated by Built In

At NVIDIA, we constantly innovate to amplify human intelligence. Our invention of the GPU sparked revolutions in gaming, computer graphics, and parallel computing. Now, GPU deep learning is driving modern AI forward. Join our GPU AI/HPC Infrastructure team and lead the design of groundbreaking GPU compute clusters for demanding AI, HPC, and compute-intensive workloads.

In this role, you'll lead and operate substantial AI GPU Clusters at unprecedented scale. You'll build an extraordinary team to optimize datacenter resource usage, drive operational excellence through automation, and create a cost-effective global computing infrastructure. Help us solve strategic challenges and implement methodologies, tools, and metrics for effective resource utilization in a heterogeneous compute environment. Make the choice to join NVIDIA today and shape the future of AI computing!

What you'll be doing:

  • Building and improving our ecosystem around GPU-accelerated computing including developing large scale automation solutions.

  • Supporting our researchers to run their flows on our clusters including performance analysis and optimizations of deep learning workflows. Improving reliability and overall Researcher Productivity.

  • Architect and implement brand new strategies to optimize the utilization of our AI computing clusters, driving operational efficiency and resource maximization.

  • Pioneer innovative solutions to streamline support processes, enabling our team to manage an unprecedented scale of GPU resources (10,000+ GPUs per support personnel).

  • Lead the charge in building a future-proof AI computing infrastructure, ensuring seamless scalability and resilience to power groundbreaking AI models and applications.

  • Collaborate with multi-functional teams to identify bottlenecks and opportunities for optimization, continuously improving the performance and cost-effectiveness of our AI computing operations.

  • Empower your team with the tools, processes, and standard methodologies necessary to thrive in a dynamic, high-intensity environment, fostering a culture of operational excellence and continuous improvement

What we need to see:

  • Bachelor’s degree or equivalent experience in Computer Science, Electrical Engineering or related field or similar area.

  • Minimum 4 years of experience leading AI/ML and software development teams as a people manager with 10+ overall years of relevant experience.

  • Consistent track record of leading high-performance teams in delivering innovative solutions to complex computational challenges, with a demonstrated ability to drive operational excellence and continuous improvement.

  • Exceptional problem-solving skills, with the ability to analyze complex systems, identify bottlenecks, and implement scalable solutions that can accommodate the ever-increasing demands of AI computing.

  • Shown leadership capabilities, with the ability to inspire and motivate multi-functional teams, fostering a culture of collaboration, innovation, and steadfast pursuit of operational excellence.

  • Strong communication and collaborator management skills, enabling you to effectively articulate technical concepts to diverse audiences and align priorities across the organization.

  • A passion for pushing the boundaries of what's possible in AI computing, with an aim to continuously explore and implement emerging technologies and standard processes to maintain our competitive edge.

  • Strong people management and team-building skills. Can coach and grow talent, cultivate healthy engineering culture, and attract/retain talent. Ability to build a diverse, broad, and impactful team.

Ways to stand out from the crowd:

  • Experience with Machine Learning and Deep Learning concepts, algorithms and models

  • Familiarity with InfiniBand with IBOP and RDMA

  • Understanding of fast, distributed storage systems like Lustre and GPFS for AI/HPC workloads

  • Familiarity with deep learning frameworks like PyTorch and TensorFlow

#LI-Hyrbid

Top Skills

AI
Gpfs
Gpu
Hpc
Ibop
Infiniband
Lustre
PyTorch
Rdma
TensorFlow
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
21,960 Employees
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

Samsara Logo Samsara

Technical Support

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
2800 Employees

BlackLine Logo BlackLine

Accountant

Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Remote or Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
1810 Employees

BlackLine Logo BlackLine

Manager, Database Engineering

Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Remote or Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
1810 Employees

Motorola Solutions Logo Motorola Solutions

IAM Engineer I

Artificial Intelligence • Hardware • Information Technology • Security • Software • Cybersecurity • Big Data Analytics
Hybrid
Bangalore, Bengaluru, Karnataka, IND
21000 Employees

Similar Companies Hiring

Credal.ai Thumbnail
Software • Security • Productivity • Machine Learning • Artificial Intelligence
Brooklyn, NY
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account