Senior GPU Systems & Fabric Engineer

Reposted 16 Days Ago
Be an Early Applicant
San Jose, CA, USA
In-Office
180K-320K Annually
Senior level
Software
The Role
Architects and operates the hardware foundation for AI cloud infrastructure, integrating NVIDIA and AMD GPUs with Kubernetes. Configures high-performance networking using RDMA, SR-IOV, RoCEv2, and InfiniBand; automates GPU and NIC remediation; manages GPU slicing, kernel and driver tuning, bare-metal provisioning, and firmware updates. Investigates cross-layer performance issues, supports topology-aware scheduling and storage, establishes operational standards, and mentors engineers.
Summary Generated by Built In

Bitdeer is a world-leading technology company for AI and Bitcoin mining infrastructure.

Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers and building AI computational infrastructure to support the AI revolution. Bitdeer handles complex processes involved in computing such as equipment procurement, transport logistics, data center design and construction, equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial intelligence.

Headquartered in Singapore, Bitdeer has deployed data centers across multiple countries, including the United States, Norway, Bhutan, and Ethiopia.

To learn more, visit https://ir.bitdeer.com/

Position Overview

We are seeking a Senior GPU Systems & Fabric Engineer to serve as the critical bridge between our physical GPU/network infrastructure and the Kubernetes abstraction layer. You will be responsible for creating the high-performance 'hardware foundation' that makes AI-native cloud computing possible. This role requires deep expertise in Linux kernel internals, GPU architectures, and high-speed interconnects, as you will be tasked with transforming raw, bare-metal compute resources into scalable, resilient, and multi-tenant cloud primitives. You will drive the design of our fabric layer, ensuring that our AI workloads have the low-latency, high-bandwidth environment they require to perform at industry-leading speeds.

Key Responsibilities

  • Architect and maintain integrations for NVIDIA/AMD GPU device plugins and Kubernetes Operators to expose hardware capabilities to the control plane.
  • Configure and optimize high-performance host networking stacks, including RDMA, SR-IOV, RoCEv2, and InfiniBand, ensuring line-rate throughput for distributed AI training.
  • Build and manage automated hardware remediation pipelines using DCGM telemetry to proactively identify, isolate, and reset degraded GPU/NIC components before they impact production jobs.
  • Implement and manage sophisticated GPU slicing technologies (MIG, vGPU) to enable efficient multi-tenant inference workloads and maximize cluster utilization.
  • Profile and tune kernel-level parameters, device drivers, and runtime libraries (CUDA, NCCL) to resolve bottlenecks and optimize containerized AI workloads.
  • Collaborate with the Scheduling and Storage engineering teams to ensure topology-aware placement and efficient data movement across the fabric.
  • Define and enforce operational standards for bare-metal provisioning, BIOS/firmware updates, and OS hardening within the containerized environment.
  • Lead technical investigations into complex performance issues spanning hardware, fabric, and software, providing actionable architectural insights.
  • Mentor team members and drive documentation standards for our evolving AI hardware stack.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or related field.
  • 5+ years of systems engineering experience, with strong proficiency in Linux kernel internals, C, or Go.
  • Hands-on experience with GPU architectures (NVIDIA H100/A100), CUDA runtimes, and distributed networking (RDMA, InfiniBand).
  • Deep understanding of containerized environments and Kubernetes device plugin architecture.
  • Proven track record of operating, debugging, and scaling bare-metal systems in large-scale production or HPC environments.
  • Familiarity with infrastructure automation (e.g., Terraform, Ansible, CI/CD pipelines) for managing hardware lifecycles.
  • Strong problem-solving skills, with the ability to navigate ambiguous performance challenges at the intersection of hardware and software.
  • Excellent communication skills, with a collaborative approach to working across infrastructure, scheduling, and reliability teams.
  • Experience working in high-velocity, high-growth engineering environments is strongly preferred

--------------------------------------------------------------------

Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, color, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.

Skills Required

  • Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field
  • 5+ years of systems engineering experience
  • Strong proficiency in Linux kernel internals, C, or Go
  • Hands-on experience with NVIDIA H100/A100 or comparable GPU architectures
  • Experience with CUDA runtimes and distributed networking, including RDMA and InfiniBand
  • Deep understanding of containerized environments and Kubernetes device plugin architecture
  • Experience operating, debugging, and scaling bare-metal systems in large-scale production or HPC environments
  • Familiarity with infrastructure automation such as Terraform, Ansible, and CI/CD pipelines
  • Strong problem-solving skills for hardware and software performance challenges
  • Excellent communication and cross-functional collaboration skills
  • Experience in high-velocity, high-growth engineering environments
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Singapore
214 Employees

What We Do

Bitdeer Technologies Group (Nasdaq: BTDR) is a leader in the blockchain and high-performance computing industry. It is one of the world’s largest holders of proprietary hash rate and suppliers of hash rate. Bitdeer is committed to providing comprehensive computing solutions for its customers. The company was founded by Jihan Wu, an early advocate and pioneer in cryptocurrency who cofounded multiple leading companies serving the blockchain economy. Mr. Wu leads the company as Founder, Chairman, and CEO. Linghui Kong serves as Bitdeer’s CBO and provides leadership through deep industry knowledge and technology expertise. Headquartered in Singapore, Bitdeer has deployed mining datacenters in the United States, Norway, and Bhutan. It offers specialized mining infrastructure, high-quality hash rate sharing products, and reliable hosting services to global users. The company also offers advanced cloud capabilities for customers with high demands for artificial intelligence. Dedication, authenticity, and trustworthiness are foundational to our mission of becoming the world’s most reliable provider of full-spectrum blockchain and high-performance computing solutions. We welcome global talent to join us in shaping the future

Similar Jobs

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Barista II

eCommerce • Fashion • Retail • Sales • Wearables • Design
Hybrid
Cabazon, CA, USA
16000 Employees
15-18 Hourly

Capital One Logo Capital One

Artificial Intelligence Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Remote or Hybrid
5 Locations
55000 Employees
286K-392K Annually

Optum Logo Optum

LVN or LPN, Case Manager - Remote

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office or Remote
Cypress, CA, USA
160000 Employees
20-36 Hourly

Optum Logo Optum

Senior Rebate Audit Analyst

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Irvine, CA, USA
160000 Employees
60K-107K Annually

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account