Senior GPU Infrastructure Engineer

Reposted 25 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
75-75 Annually
Senior level
Artificial Intelligence • Information Technology
The Role
Responsible for building and scaling the GPU Cloud Marketplace, transforming GPUs from suppliers into a programmable, orchestrated pool for AI developers and researchers.
Summary Generated by Built In
Who We Are

Hyperbolic Labs is on a mission to democratize AI by breaking down the barriers to computing power with our Open-Access AI Cloud. By aggregating computing resources across the globe, we offer an innovative GPU marketplace and AI inference service that promise affordability and accessibility for all. As pioneers at the intersection of AI and open-source technology, we believe in an open future where AI innovation is limited only by imagination, not by access to resources. We're looking for forward-thinking individuals who share our passion for making AI universally accessible, secure, and affordable. Join us in building a platform that empowers innovators everywhere to turn their visionary AI projects into reality.

As we prepare for growth after our Series A, our team — led by co-founders with PhDs in AI, Math, and Computer Science — is poised to redefine computing.

About the Role

We're seeking a Senior Infrastructure Engineer to help build and scale Hyperbolic's GPU Cloud Marketplace, by building a multi-tenancy provisioning and virtualization solution. This is a foundational role where you'll be responsible for transforming raw GPUs from diverse global suppliers into a programmable, orchestrated pool that serves thousands of AI developers and researchers. You'll work at the cutting edge of cloud infrastructure, building the core orchestration layer that enables our platform to deliver up to 75% cost savings compared to traditional cloud providers.

Who You Are
  • Deep understanding of bare-metal provisioning and lifecycle management, including IPMI/Redfish, BMC-based remote management, PXE boot, and automated OS deployment workflows

  • Deep understanding of GPU scheduling and orchestration, including GPU type awareness, memory management, topology considerations, placement strategies for multi-GPU jobs, and fragmentation minimization

  • Strong infrastructure and DevOps engineering skills with proficiency in Terraform or Pulumi, CI/CD for infrastructure, secrets management, configuration management, and observability stack implementation

  • Experience with storage and data infrastructure for AI/ML workloads, including object storage, high-IOPS block storage, and distributed file systems for training data and checkpoints

  • Proficiency with API design and cloud-init for automated provisioning and configuration

  • Solid understanding of GPU architecture, CUDA, and GPU compute optimization

  • Highly collaborative team player with excellent communication skills across technical and non-technical stakeholders

  • Proven ability to work effectively with hardware vendors and vendor engineering teams to troubleshoot issues and optimize integrations

  • Experience building and scaling cloud infrastructure or distributed systems in production environments

Preferred Qualifications
  • Familiarity with high-performance networking technologies such as InfiniBand and RoCE (RDMA over Converged Ethernet)

  • Experience with distributed storage systems such as Ceph, Weka, or VAST Data

Hyperbolic is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Skills Required

  • Deep understanding of bare-metal provisioning
  • Proficiency in Terraform or Pulumi
  • Strong infrastructure and DevOps engineering skills
  • Experience with storage and data infrastructure for AI/ML workloads
  • Solid understanding of GPU architecture
  • Experience building and scaling cloud infrastructure
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
30 Employees

What We Do

At Hyperbolic, we’re building the leading open-access AI cloud. Access inference and compute at a fraction of the cost, and build AI applications without relying on centralized infrastructures. We invite builders, compute providers, researchers, and individuals to join us on this journey.

Similar Jobs

NVIDIA Logo NVIDIA

Senior ASIC Design Verification Infrastructure and Tools Engineer – GPU

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office
Santa Clara, CA, USA
21960 Employees
136K-265K Annually

Sciforium Logo Sciforium

Infrastructure Engineer

Artificial Intelligence • Information Technology • Software
In-Office
San Francisco, CA, USA
7 Employees
150K-220K Annually

CoreWeave Logo CoreWeave

Software Engineer

Cloud • Information Technology • Machine Learning
In-Office
2 Locations
1450 Employees
139K-204K Annually

Similar Companies Hiring

Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees
Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account