Senior AI Storage Infrastructure Engineer

Reposted 5 Days Ago
Be an Early Applicant
San Jose, CA, USA
In-Office
180K-260K Annually
Senior level
Software
The Role
Architects and operates high-performance storage infrastructure for AI training and inference. Responsibilities include developing Kubernetes CSI drivers, integrating GPUDirect Storage, optimizing NVMe caching and I/O performance, supporting RDMA and high-speed networking, monitoring storage systems, managing quotas and multi-tenancy, and mentoring engineers.
Summary Generated by Built In

Bitdeer is a world-leading technology company for AI and Bitcoin mining infrastructure.

Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers and building AI computational infrastructure to support the AI revolution. Bitdeer handles complex processes involved in computing such as equipment procurement, transport logistics, data center design and construction, equipment management, and daily operations. Bitdeer also offers advanced cloud capabilities to customers with high demand for artificial intelligence.

Headquartered in Singapore, Bitdeer has deployed data centers across multiple countries, including the United States, Norway, Bhutan, and Ethiopia.

To learn more, visit https://ir.bitdeer.com/

Position Overview

We are seeking a Senior AI Storage Infrastructure Engineer to build the critical data-delivery fabric of our AI-native NeoCloud. AI model training and inference are profoundly I/O intensive; you will be responsible for architecting high-performance storage solutions that eliminate bottlenecks and ensure GPUs are constantly saturated with data. This role sits at the intersection of distributed storage, kernel-level I/O, and Kubernetes orchestration. You will design the pathways—from NVMe-backed local caching for massive LLM weights to parallel file system integration—that enable seamless, low-latency access for large-scale distributed training and inference workloads.

Key Responsibilities

  • Design, deploy, and maintain robust Container Storage Interface (CSI) drivers for high-performance parallel file systems (e.g., Weka, Lustre, DAOS, VAST).
  • Architect and implement GPUDirect Storage (GDS) integrations to enable direct memory access (DMA) between NVMe drives and GPU memory, bypassing CPU bottlenecks.
  • Develop and manage local NVMe caching strategies for rapid, low-latency loading of massive model weights and datasets during distributed training.
  • Optimize IOPS, throughput, and latency profiles across the entire containerized storage stack, from the storage array to the container runtime.
  • Collaborate with the GPU Systems & Fabric team to ensure the storage layer is fully optimized for RDMA and high-speed interconnects (InfiniBand, RoCE).
  • Implement automated monitoring and alerting for storage performance, detecting and mitigating I/O contention or hardware degradation before it impacts production jobs.
  • Define storage policies, quota management, and multi-tenancy isolation strategies within Kubernetes to ensure fair resource sharing for customer workloads.
  • Mentor junior engineers and drive architectural design reviews to maintain high standards of reliability and performance across the infrastructure team.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.
  • 5+ years of experience in distributed storage systems and high-performance file systems, with a deep understanding of POSIX compliance and file I/O semantics.
  • Deep expertise in the Kubernetes CSI paradigm, including building or extending volume plugins and storage operators.
  • Strong hands-on experience with block/file I/O at the Linux OS level and kernel-level performance tuning.
  • Familiarity with high-throughput networking protocols (RDMA, InfiniBand, RoCE) and how they interact with storage subsystems.
  • Proven track record of operating, debugging, and scaling large-scale storage environments in production or HPC settings.
  • Experience with infrastructure automation tools (e.g., Terraform, Ansible) and CI/CD pipelines.
  • Excellent technical communication skills, with the ability to influence cross-functional architectural decisions.
  • Experience working in high-velocity, high-growth engineering environments is strongly preferred.

--------------------------------------------------------------------

Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, color, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.

Skills Required

  • Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field
  • 5+ years of experience in distributed storage systems and high-performance file systems
  • Deep understanding of POSIX compliance and file I/O semantics
  • Expertise in the Kubernetes CSI paradigm, including building or extending volume plugins and storage operators
  • Hands-on experience with block and file I/O at the Linux OS level and kernel-level performance tuning
  • Familiarity with RDMA, InfiniBand, and RoCE and their interaction with storage subsystems
  • Track record of operating, debugging, and scaling large-scale storage environments in production or HPC settings
  • Experience with infrastructure automation tools such as Terraform and Ansible and CI/CD pipelines
  • Excellent technical communication skills and ability to influence cross-functional architectural decisions
  • Experience working in high-velocity, high-growth engineering environments
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Singapore
214 Employees

What We Do

Bitdeer Technologies Group (Nasdaq: BTDR) is a leader in the blockchain and high-performance computing industry. It is one of the world’s largest holders of proprietary hash rate and suppliers of hash rate. Bitdeer is committed to providing comprehensive computing solutions for its customers. The company was founded by Jihan Wu, an early advocate and pioneer in cryptocurrency who cofounded multiple leading companies serving the blockchain economy. Mr. Wu leads the company as Founder, Chairman, and CEO. Linghui Kong serves as Bitdeer’s CBO and provides leadership through deep industry knowledge and technology expertise. Headquartered in Singapore, Bitdeer has deployed mining datacenters in the United States, Norway, and Bhutan. It offers specialized mining infrastructure, high-quality hash rate sharing products, and reliable hosting services to global users. The company also offers advanced cloud capabilities for customers with high demands for artificial intelligence. Dedication, authenticity, and trustworthiness are foundational to our mission of becoming the world’s most reliable provider of full-spectrum blockchain and high-performance computing solutions. We welcome global talent to join us in shaping the future

Similar Jobs

Superhuman Logo Superhuman

Marketing Manager

Artificial Intelligence • Information Technology • Machine Learning • Natural Language Processing • Productivity • Software • Generative AI
Hybrid
San Francisco, CA, USA
1500 Employees
123K-195K Annually

SailPoint Logo SailPoint

Manager, Forward Deployed Engineering

Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Remote or Hybrid
United States
2461 Employees
98K-164K Annually

GoodRx Logo GoodRx

Marketing Manager

Consumer Web • Coupons • Healthtech • Social Impact • Pharmaceutical
Remote or Hybrid
3 Locations
800 Employees
127K-271K Annually

Navan Logo Navan

Analytics Manager

Fintech • Information Technology • Payments • Productivity • Software • Travel • Automation
Easy Apply
Hybrid
San Francisco, CA, USA
3300 Employees
105K-234K Annually

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account