HPC Infrastructure Engineer - GPU Clusters

Posted Yesterday
Hiring Remotely in United States
Remote
Entry level
Artificial Intelligence • Information Technology
The Role
Operate and improve large-scale NVIDIA GPU clusters across bare-metal and rented capacity. Build automation for provisioning, health checks, remediation, monitoring, scheduling, and capacity management. Own Linux images, drivers, CUDA, containers, networking, storage, and Slurm. Diagnose performance and hardware issues, evaluate GPU providers, support ML training workloads, and maintain secure infrastructure. The role also includes hardware installation, datacenter coordination, and vendor management.
Summary Generated by Built In
About ElevenLabs

ElevenLabs is an AI research and product company transforming how we interact with technology.

We launched in January 2023 with the first human-like AI voice model. Today, we serve millions of users and thousands of businesses - from fast-growing startups to large enterprises like Deutsche Telekom and Meta. Our investors are some of the world's most prominent, including Andreessen Horowitz, ICONIQ Growth and Sequoia. We've raised $781M in funding and our last valuation was $11B - multiples of 11, always.
We have expanded from voice into three main platforms:

  • ElevenAgents enables businesses to deliver seamless and intelligent customer experiences, with the integrations, testing, monitoring, and reliability necessary to deploy voice and chat agents at scale.

  • ElevenCreative empowers creators and marketers to generate and edit speech, music, image, and video across 70+ languages.

  • ElevenAPI gives developers access to our leading AI audio foundational models.

Everything we do is the result of the creativity and commitment of our team - builders doing the best work of their lives. We are researchers, engineers, and operators. IOI medalists and ex-founders. If you want to work hard and create lasting positive impact, we want to hear from you.

How we work
  • High-velocity: Rapid experimentation, lean autonomous teams, and minimal bureaucracy.

  • Impact not job titles: We don’t have job titles. Instead, it’s about the impact you have. No task is above or beneath you.

  • AI first: We use AI to move faster with higher-quality results. We do this across the whole company—from engineering to growth to operations.

  • Excellence everywhere: Everything we do should match the quality of our AI models.

  • Global team: We prioritize your talent, not your location.

What we offer
  • Innovative culture: You’ll be part of a generational opportunity to define the trajectory of AI, surrounded by a team pushing the boundaries of what’s possible.

  • Growth paths: Joining ElevenLabs means joining a dynamic team with countless opportunities to drive impact - beyond your immediate role and responsibilities.

  • Learning & development: ElevenLabs proactively supports professional development through an annual discretionary stipend.

  • Social travel: We also provide an annual discretionary stipend to meet up with colleagues each year, however you choose.

  • Annual company offsite: Each year, we bring the entire team together in a new location - past offsites have included Croatia and Italy.

  • Co-working: If you’re not located near one of our main hubs, we offer a monthly co-working stipend.

About the role

Every model we train runs on infrastructure this role owns. We operate NVIDIA GPU clusters across bare metal and rented capacity, and we're looking for an engineer to join our small research infrastructure team and make that compute fast, reliable, and boring - in the best sense. When the clusters just work, research moves faster. Your impact is measured directly in training throughput and researcher velocity.

This is a builder-operator role with real breadth: one week you're writing automation that eliminates a whole class of manual work, the next you're benchmarking a new provider's InfiniBand fabric or on-site bringing new hardware online. You'll have unusual scope and autonomy - we're a lean team where decisions are made by the people closest to the problem.

What you’ll be doing
  • Operate and improve our GPU fleet end to end: provisioning, scheduling, monitoring, upgrades, capacity planning

  • Build automation that keeps the fleet healthy without human intervention — node health checks, automated draining and remediation, burn-in pipelines for new capacity

  • Own the stack beneath the training code: OS images, NVIDIA drivers, CUDA, container runtimes, NCCL, high-speed networking (InfiniBand/RoCE)

  • Run and tune job scheduling (Slurm or similar) so researchers get compute fairly and fast

  • Build and maintain high-performance storage for datasets and checkpoints

  • Hunt down performance problems: stragglers, degraded links, thermal issues, flaky GPUs — and fix the class of problem, not just the instance

  • Evaluate rented GPU capacity: benchmark it, validate it, hold providers to their SLAs

  • Hands-on hardware work when it's needed: racking, cabling, diagnostics, coordinating with datacenter staff and vendors

  • Keep clusters secure by default: access control, network isolation, secrets

Requirements
  • Have run large-scale Linux server or GPU environments in production and enjoy both building and operating

  • Know the NVIDIA stack well — drivers, CUDA, NCCL, DCGM — or have deep systems experience and learn hardware stacks fast

  • Are comfortable with bare-metal environments, server hardware, and high-speed networking

  • Write solid automation in Python and/or Bash, with IaC tools like Ansible or Terraform

  • Are happy digging into noisy data (metrics, logs, PromQL) to find what's actually wrong

  • Like owning real scope end to end and being the person others rely on

  • Don't consider any task above or beneath you — datacenter trips included

Nice to have
  • Experience supporting ML training workloads from the infra side (distributed training failure modes, checkpointing patterns)

  • Experience evaluating and working with GPU cloud providers

  • Parallel filesystems (WEKA, VAST, etc) or large-scale object storage

  • BMC/IPMI/Redfish automation, PXE provisioning at scale

  • Power and cooling awareness for dense GPU deployments

Location

This role is remote and can be executed globally. If you prefer, you can work from our offices in London, New York, San Francisco, and Warsaw.

#LI-Remote

#HPC-Infrastructure-Engineer-GPU-Clusters

We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or other legally protected statuses.

Skills Required

  • Production experience running large-scale Linux server or GPU environments
  • Experience building and operating infrastructure environments
  • Knowledge of NVIDIA drivers, CUDA, NCCL, and DCGM, or deep systems experience with the ability to learn hardware stacks quickly
  • Comfort with bare-metal environments, server hardware, and high-speed networking
  • Ability to write automation in Python and/or Bash
  • Experience with infrastructure-as-code tools such as Ansible or Terraform
  • Ability to analyze metrics, logs, and PromQL data
  • Experience supporting machine-learning training workloads from the infrastructure side
  • Experience evaluating and working with GPU cloud providers
  • Experience with parallel filesystems such as WEKA or VAST, or large-scale object storage
  • Experience with BMC, IPMI, or Redfish automation and PXE provisioning at scale
  • Power and cooling awareness for dense GPU deployments
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, New York
193 Employees
Year Founded: 2023

What We Do

ElevenLabs is an AI Audio research and deployment company. Our research team develops AI Audio models that generate realistic, versatile and contextually-aware speech and sound effects. Our product team makes these models accessible for everyday users, prosumers, and businesses to create & localize content. Our technology is used to voice audiobooks and news articles, animate video game characters, help in film pre-production, automate localization processes in entertainment, create dynamic audio content for social media and advertising, and train medical professionals. It has also given back voices to those who have lost them and helped individuals with accessibility needs in their daily lives. For more information, visit www.elevenlabs.io

Similar Jobs

Zscaler Logo Zscaler

Account Executive

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
Michigan, USA
8697 Employees
140K-200K Annually

ServiceNow Logo ServiceNow

Senior Manager, Data Platform Engineering - Kubernetes - Distributed Systems

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
San Diego, CA, USA
29000 Employees
181K-317K Annually
Easy Apply
Remote
United States
900 Employees
112K-125K Annually

Bounteous Logo Bounteous

Associate Director - Workfront

Artificial Intelligence • Information Technology • Professional Services • Software • Analytics • Generative AI • Big Data Analytics
Remote
United States
5000 Employees
105K-130K Annually

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account