We are seeking an Infrastructure Engineer with a focus on InfiniBand/NCCL to join our Infrastructure Engineering team. Our engineers design and build automation, tooling, and systems that bridge the gap between physical infrastructure and the platforms that power large-scale AI/ML and HPC workloads.
This role combines the breadth of a core infrastructure engineer with a specialty in high-performance networking and GPU communication. You’ll help ensure our InfiniBand fabric and NCCL stack are tuned, reliable, and efficient at scale — supporting some of the world’s largest GPU clusters.
This is a fully remote position, although candidates must be based in the continental United States. Unfortunately, we are unable to provide sponsorship for this role.
ResponsibilitiesDesign, build, and maintain automation, APIs, and frameworks to manage physical infrastructure at scale.
Develop and extend systems for server lifecycle management.
Implement and tune InfiniBand networking and NCCL configurations for multi-GPU communication.
Collaborate with Network, Platform, and Infrastructure Operations teams to support new infrastructure rollouts.
Diagnose and improve performance across GPU, NVSwitch, PCIe, and InfiniBand layers.
Write clear design documents and technical documentation to capture best practices.
8+ years of professional experience in infrastructure engineering, HPC, or related domains.
Strong experience with Linux in production environments.
Proficiency in Python or similar languages for automation.
Deep understanding of InfiniBand networking (CX7 HCAs, fabrics, partitioning, GPUDirect).
Familiarity with NCCL, CUDA, and GPU topology optimization.
Knowledge of containerization and orchestration concepts.
Strong written and verbal communication skills.
Experience with Dell PowerEdge XE9680 or other GPU-dense servers.
Prior work with NVIDIA H100s, NVSwitch, and large-scale NCCL testing.
Familiarity with Mellanox OFED, UCX, and Redfish/iDRAC for management.
Broader experience across infrastructure areas (storage, virtualization, networking).
Enjoy collaborating with a motivated, execution-focused team.
Comfortable operating with autonomy while aligning to company objectives.
Value precision, documentation, and knowledge-sharing.
Excited to grow as both a domain specialist (InfiniBand/NCCL) and a generalist infrastructure engineer.
Voltage Park is an equal opportunity employer and makes employment decisions on the basis of merit. All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other characteristic protected by law.
Voltage Park is an equal opportunity employer and makes employment decisions on the basis of merit. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other characteristic under federal, state, or local law. If you require an accommodation during the job application process, please notify your recruiter.
Compensation Range: $140K - $180K
#BI-Remote
Similar Jobs
What We Do
The market for cutting-edge ML compute is broken. Startups, researchers and even big AI labs are scrambling to buy or rent access to the latest chips for ML training. But demand far outstrips supply, and what’s available is only accessible to the well-resourced, placing an artificial damper on innovation.
To solve this challenge, we've launched Voltage Park, and we’re on a mission to make machine learning infrastructure accessible to all, from large enterprises and research universities, to seed-stage startups and nonprofits.
With around 24,000 NVIDIA H100 GPUs, the Voltage Park cloud is one of the most powerful collections of cutting-edge ML compute in the world. Our clusters consist of 80GB H100 SXM5 GPUs fully interconnected with 3.2T InfiniBand.
Why Work With Us
You’ll play a pivotal role as a member of the founding team that will change the face of machine learning infrastructure. As an early hire, you’ll have outsize influence in defining the company’s culture and ensuring mission success.
Gallery
