Senior HPC Platform Engineer (HPC / GPU Infrastructure) (m/f/d)

Posted 2 Days Ago
Be an Early Applicant
London, Greater London, England, GBR
In-Office
Senior level
Information Technology • Business Intelligence • Consulting
The Role
Build, operate, and harden large-scale Linux bare-metal and virtualized GPU platforms for HPC and AI workloads. Manage NVIDIA GPUs, BlueField DPUs, InfiniBand fabrics, Kubernetes, virtualization, storage networking, and datacenter infrastructure. Automate provisioning and lifecycle operations with Ansible, Bash, and Python; lead production incident response and root-cause analysis; and coordinate hardware and platform deployments across European datacenters.
Summary Generated by Built In
Job Description

We are hiring a Senior Platform Engineer to build, run and harden the bare-metal GPU platform behind our AI cloud. This is a hands-on Linux systems role at the intersection of HPC, GPU virtualisation and high-performance fabrics: you will own the servers, the OS, the GPUs, the DPUs and the InfiniBand fabric they run on.


We are a European Neocloud operating a large NVIDIA GPU estate (H100, H200 and B300) across multiple datacentres in Europe. Our customers run large-scale AI training and inference workloads, on both physical and virtualised GPU clusters, and they depend on our platform being fast, stable and predictable.

The platform you will own:


Compute: Linux bare-metal GPU servers with NVIDIA H100, H200 and B300 GPUs.

Virtualisation: KVM/QEMU via libvirt on selected hosts; KubeVirt for VM workloads on Kubernetes; GPU passthrough and SR-IOV Virtual Functions.

DPUs: NVIDIA BlueField-2 and BlueField-3, operated in DPU mode.

GPU Fabric: InfiniBand on ConnectX-7 and ConnectX-8 adapters, managed with OpenSM and NVIDIA UFM.

Ethernet & Storage: Multi-tier spine-leaf Ethernet carrying block and object (blob) storage traffic; IPv6-first addressing.

Storage: NVMe-oF, RoCE and NFS; VAST Data and Pure Storage platforms.

Operating Systems: Debian / Ubuntu; immutable Kubernetes distributions (Flatcar, Fedora CoreOS).

Orchestration: Kubernetes with Operators, CNIs and CSIs; Docker / containers.

Tooling: Ansible (IaC), Nautobot, OpenBao, Defguard, PXE / preseed / cloud-init, Redfish / IPMI.

This is a platform engineering role, not a network engineering role. Networking, fabric and storage knowledge matter because they are part of the server platform you operate end to end.


YOUR RESPONSIBILITIES


  • Build, tune and maintain Linux bare-metal GPU hosts for HPC and AI workloads, from BIOS/BMC through kernel, drivers and firmware.
  • Deploy, configure and operate BlueField-2/3 DPUs in DPU mode, including BFB images, DOCA services, OVS offload and network/storage offload on the Arm cores.
  • Operate and troubleshoot InfiniBand fabrics with OpenSM and UFM: subnet management, partitions (PKeys), routing, health monitoring, and performance analysis of NCCL and RDMA traffic.
  • Deliver GPU virtualisation: PCIe passthrough, SR-IOV Virtual Functions on GPUs and ConnectX adapters, and integration of GPU VMs into Kubernetes via KubeVirt or libvirt/QEMU hypervisors.
  • Build and support both physical and virtual GPU clusters interconnected over InfiniBand, down to NUMA, PCIe topology, GPUDirect RDMA and IOMMU level.
  • Run IPv6-first host networking and support storage networks carrying NVMe-oF, RoCE, NFS, block and object traffic across the spine-leaf fabric.
  • Automate provisioning and lifecycle with PXE, preseed, cloud-init, Redfish/IPMI and Ansible; review and extend our existing IaC code base.
  • Write production-quality Bash and Python tooling for deployment, validation, health checks and fleet operations.
  • Lead incident response for platform issues across multiple European datacentres, perform root-cause analysis, and drive permanent fixes.
  • Work with networking, storage, Kubernetes and customer-facing teams to plan hardware generations (e.g. B300, ConnectX-8, BlueField-3) into production.

YOUR ESSENTIAL SKILLS (in priority order)


- Linux in an HPC configuration:

  • Deep knowledge of the Linux OS and kernel: modules, drivers, sysctl/boot parameters, hugepages, NUMA, CPU pinning, IOMMU/VFIO, PCIe topology.
  • Debian/Ubuntu in production; comfortable debugging at kernel level (dmesg, perf, ftrace, crash analysis).
  • Complete understanding of NVIDIA GPUs and GPU concepts: drivers, CUDA, Fabric Manager, NVLink/NVSwitch, MIG, DCGM, GPUDirect RDMA.
  • GPU virtualisation: passthrough, SR-IOV Virtual Functions, vGPU concepts, and VM integration with KVM/QEMU/libvirt or Kubernetes with the KubeVirt operator.

- NVIDIA BlueField in DPU mode (must have):

  • Extensive hands-on experience with BlueField-2 and/or BlueField-3: provisioning, BFB images, firmware, DOCA, OVS/ASAP2 offload, and host-to-DPU networking.
  • ConnectX-7 / ConnectX-8 configuration, firmware management (mlxconfig, mlxfwmanager) and SR-IOV.

- InfiniBand with OpenSM and UFM (must have):

  • Operating IB fabrics with both OpenSM and UFM: subnet managers, partitions, routing engines, fabric diagnostics (ibdiagnet, perfquery, ibnetdiscover).
  • Low-level RDMA concepts (verbs, QPs, GIDs, LIDs) and validating physical and virtual GPU clusters over IB (perftest, NCCL tests).

- Networking, with an emphasis on IPv6:

  • Strong TCP/IP fundamentals for IPv6 and IPv4: addressing, SLAAC/DHCPv6, neighbour discovery, routing.
  • Working knowledge of DHCP, DNS, NTP and BGP as they apply to hosts in a spine-leaf datacentre fabric.

- Storage networks:

  • Block and object (blob) storage concepts over Ethernet: NVMe-oF (TCP/RDMA), RoCE, NFS, multipathing and performance tuning.
  • Understanding how storage traffic behaves across a multi-tier spine-leaf network (QoS, PFC/ECN for RoCE, MTU).

YOUR EXPERIENCE


  • Bash and Python: excellent Bash; excellent Python for automation and tooling (strong scripting and maintainable code, not necessarily software-developer level).
  • Automation: working knowledge of Ansible to review and enhance an existing IaC code base.
  • Server management and deployment: BMC, Redfish, IPMI; PXE, preseed, cloud-init.
  • Containers: Docker/containerd and Kubernetes, including Operators, CNIs and CSIs.
  • Incident handling: proven ability to lead incidents on production infrastructure, under pressure, through to root cause.

Desirable skills:

  • Hands-on experience with VAST Data and/or Pure Storage.
  • Immutable, Kubernetes-focused OS distributions such as Flatcar Container Linux or Fedora CoreOS.
  • Operational experience with Nautobot, OpenBao (or HashiCorp Vault) and Defguard.
  • General knowledge of HPC and AI concepts and tooling: Slurm, MPI, NCCL, distributed training and inference frameworks.
  • NVIDIA GPU Operator and Network Operator on Kubernetes.
  • Experience in a cloud provider, Neocloud or large HPC centre operating GPUs at scale across multiple sites.

About you:

  • Typically 7+ years in Linux systems or infrastructure engineering, with recent hands-on time on GPU or HPC platforms.
  • Calm and methodical during incidents; you dig to root cause rather than stopping at the workaround.
  • You automate by default and leave behind documentation and tooling others can use.
  • Clear communicator in English, comfortable working across teams and datacentres in different countries.
WHAT WE OFFER

With us, you will work towards the future of HPC: From new, sustainable building methods for data centers to cooling concepts to software solutions for accelerated compute. 

Your approaches count: In official exchange formats or spontaneously at the coffee machine. At Northern Data, it's the best idea that counts - not the hierarchy. We’re looking forward to getting your inputs!

You make the difference in the company: Unlike in established corporations, at Northern Data you will really help shape things. From implementing new departments, to optimizing processes and culture. 

Best-in-class partners: The best work with Northern Data. This means a knowledge and time advantage from which your career and our customers benefit equally.

Green by heart: Sustainability is at the core of Northern Data. With us, you actively work on the carbon neutrality of datacenters worldwide. Beginning with our infrastructure and continuing with the solutions for our clients, we work towards a green future.

Home Office facts: Work with our international and virtual team flexible from home. And of course, your hardware wishes will be fulfilled to make your ideas for next level HPC come true.

Your wellness matters: At Northern Data we have regular wellbeing initiatives that are designed to promote wellness, diversity, inclusion, and much more, ensuring a supportive and enriching environment for our global team.

Skills Required

  • Deep Linux and kernel expertise, including modules, drivers, sysctl, hugepages, NUMA, CPU pinning, IOMMU, VFIO, and PCIe topology
  • Production experience with Debian or Ubuntu and kernel-level debugging
  • Strong knowledge of NVIDIA GPUs, CUDA, Fabric Manager, NVLink, NVSwitch, MIG, DCGM, and GPUDirect RDMA
  • GPU virtualization experience with passthrough, SR-IOV, vGPU concepts, KVM, QEMU, libvirt, or KubeVirt
  • Extensive hands-on experience with NVIDIA BlueField-2 or BlueField-3 in DPU mode, including BFB, firmware, DOCA, OVS/ASAP2 offload, and host-to-DPU networking
  • ConnectX-7 or ConnectX-8 configuration, firmware management, and SR-IOV experience
  • Experience operating InfiniBand fabrics with OpenSM and NVIDIA UFM
  • Knowledge of RDMA concepts, fabric diagnostics, perftest, and NCCL testing
  • Strong IPv4 and IPv6 networking fundamentals, including addressing, SLAAC, DHCPv6, neighbor discovery, and routing
  • Working knowledge of DHCP, DNS, NTP, and BGP in datacenter fabrics
  • Knowledge of NVMe-oF, RoCE, NFS, multipathing, QoS, PFC/ECN, and MTU tuning
  • Excellent Bash and Python skills for automation and production tooling
  • Working knowledge of Ansible and infrastructure-as-code
  • Experience with BMC, Redfish, IPMI, PXE, preseed, and cloud-init
  • Experience with Docker or containerd and Kubernetes, including Operators, CNIs, and CSIs
  • Proven ability to lead production infrastructure incidents through root-cause resolution
  • Typically seven or more years of Linux systems or infrastructure engineering experience with recent GPU or HPC experience
  • Experience with VAST Data or Pure Storage
  • Experience with Flatcar Container Linux or Fedora CoreOS
  • Experience with Nautobot, OpenBao or HashiCorp Vault, and Defguard
  • Knowledge of Slurm, MPI, NCCL, distributed training, and inference frameworks
  • Experience with NVIDIA GPU Operator and Network Operator on Kubernetes
  • Experience operating GPUs at scale for a cloud provider, Neocloud, or large HPC center
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Frankfurt am Main
124 Employees

What We Do

At Northern Data Group, we believe unlimited High Performance Computing (HPC) will unlock unprecedented opportunities for research and development, business, and ultimately human progress. We power innovation through market-leading HPC infrastructure, operating across our three business divisions: Taiga Cloud, Ardent Data Centers and Peak Mining. Our global organization is rapidly becoming a world leader for GPU-based solutions by designing and operating ultra-efficient green HPC infrastructure. We uniquely combine intelligent and sustainable data centers, cutting-edge hardware and self-developed software for various HPC applications including Generative AI, Machine Learning and Bitcoin Mining. We operate from large-scale custom data centers and proprietary containerized data centers for ultimate site selection flexibility

Similar Jobs

The Aerospace Corporation Logo The Aerospace Corporation

Design Engineer

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Hybrid
2 Locations
4600 Employees

Hilton Logo Hilton

Casual Food and Beverage Assistant

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office
York, North Yorkshire, England, GBR
500000 Employees
13-13 Hourly

Hilton Logo Hilton

Casual Porter

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office
London, Greater London, England, GBR
500000 Employees
13-13 Hourly

Zscaler Logo Zscaler

Sales Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
UK
8697 Employees

Similar Companies Hiring

Quanta Thumbnail
Artificial Intelligence • Fintech • Software • Business Intelligence • Big Data Analytics
San Francisco, California
23 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account