Distributed Systems Engineer

Reposted One Month Ago
Be an Early Applicant
4 Locations
In-Office
208K-269K Annually
Senior level
Artificial Intelligence • Software
The Role
Design, build, and operate the observability and control-plane for a hyperscale GPU fleet. Own data pipelines, API surface, fleet state as source-of-truth, distributed command execution, and clean hardware/site onboarding (ZTP/DHCP/DNS). Ensure production reliability, run incidents, and drive automation to eliminate toil.
Summary Generated by Built In
About Fluidstack

We exist to make humanity more free. For most of human history, you farmed or you starved. Technology gave people more time for the things they wanted to do, instead of things they had to do. Powerful AI will be the biggest lever for human choice we've ever built - but only if models are aligned with what humanity actually wants. There are groups building AI who don't share these goals. Whoever deploys frontier compute infrastructure fastest will decide whether AI expands human freedom or shrinks it.

We're singularly focused on delivering 10 to 100s of GWs of compute faster than anyone else, rethinking every layer of the stack. We acquire power, design and build data centers, and operate them - with teams spanning hardware and software. Speed and scale are our key differentiators. Come be a part of building civilization-scale infrastructure for AI.


We hire people who care deeply about this problem space. If that is you, please apply!

How We Operate
  • Be a barrel. Full autonomy. Own things end to end, take on scope without being asked, no permission required to operate outside your core role.

  • Insane urgency. We drive everything forward as fast as possible.

  • Reason from first principles. Challenge every assumption. Zero analogy thinking, no egos, the best idea wins.

  • Love of the game. The frontier of AI is the most interesting problem of our time. We put in long hours at high intensity to push the frontier forward.

  • Build something that actually matters. If you're going to spend your time, spend it on something that matters to the world.

The Production Engineering Team

Examples of key exciting problems the team is working on

  • Make tens of thousands of GPUs legible in real time: build the observability platform that turns raw telemetry into signal, from site-level health down to individual device and link. At this scale, you cannot operate what you cannot see.

  • Build the control plane every team at Fluidstack depends on: replace one-off tooling with a stable, versioned API surface that covers unified machine management, actual state inspection, and distributed command execution. One interface for the whole company, not a hundred scripts.

  • Make the system's view of itself always match reality: integrate fleet state as a machine-readable source of truth across provisioning, operations, and customer-facing platforms, so every new site and GPU generation lands cleanly from day zero.

Role Scope
  • Own the observability platform. Build and operate the data pipelines, decoration and correlation engine, and healthcheck framework that make the fleet legible — from site down to device and link. No other team should need to scrape production directly to answer a question.

  • Define and build the API surface for infrastructure. Design the contracts between production infrastructure and every tool that touches it. All other teams at Fluidstack use your tooling to manage and operate our hyperscale fleet.

  • Build the production control plane. Unified machine management, actual state inspection, distributed command execution — and the Kubernetes-based infrastructure that underpins it all.

  • Own fleet state as source of truth. SLOs, site lifecycle state, and integration with internal infrastructure management and customer-facing operations platforms. What the system says about itself should match reality, and you're accountable when it doesn't.

  • Land new hardware into the platform cleanly. ZTP, DHCP, DNS, artifacts — every new XPU generation and site integration goes through IaaS before production.

     
What We're Looking For

The below is a starting point. We always make space for exceptional people, so if you don't fit this role exactly, tell us where you would.

  • You treat toil as a bug. If something requires a human to do it twice, you build the thing that makes it not require a human.

  • You design APIs that age well. You've felt the pain of a leaky abstraction at scale and you don't repeat it.

  • You move toward ambiguity, not away from it. You walk into the fog, build the map, and explain it to everyone else.

  • You learn at a steep slope. You reach real competence in an unfamiliar domain fast. We value this over existing expertise.

  • You carry a pager without flinching. You run the incident, write the postmortem, fix the systemic cause, and move on.

  • You're fluent with AI tooling. LLM APIs, MCP servers, and agentic frameworks, and you drive Claude Code, Cursor, or similar every day.

  • You've shipped production services that other teams depend on at scale, and you're comfortable in any language using AI coding tools.

  • Bonus: Distributed systems and data pipeline engineering. Time-series observability stacks (Prometheus, Thanos, VictoriaMetrics). API design and versioning at scale. Workflow and orchestration engines (Temporal, Cadence). BMC/Redfish or hardware telemetry. Go, Python, and Postgres.

 
Salary & Benefits
  • Competitive total compensation package (salary + equity).

  • Retirement or pension plan, in line with local norms.

  • Health, dental, and vision insurance.

  • Generous PTO policy, in line with local norms.

     

We are committed to pay equity and transparency.

Fluidstack is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law. Fluidstack will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.

You will receive a confirmation email once your application has successfully been accepted. If there is an error with your submission and you did not receive a confirmation email, please email [email protected] with your resume/CV, the role you've applied for, and the date you submitted your application-- someone from our recruiting team will be in touch.

Skills Required

  • Carry a pager and participate in on-call rotations
  • Shipped production services that other teams depend on at scale
  • Fluent with AI tooling including LLM APIs, MCP servers, and agentic frameworks (e.g., Claude Code, Cursor)
  • Comfortable coding in any language and using AI coding tools to deliver production services
  • Design APIs that age well and define stable infrastructure contracts
  • Move toward ambiguity, learn quickly, and own end-to-end operational responsibilities
  • Distributed systems and data pipeline engineering experience
  • Time-series observability stacks (Prometheus, Thanos, VictoriaMetrics)
  • Workflow and orchestration engines (Temporal, Cadence)
  • BMC/Redfish or hardware telemetry experience
  • Experience with Go, Python, and Postgres
  • Experience with Kubernetes-based infrastructure and machine management
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: London
30 Employees
Year Founded: 2017

What We Do

Instantly reserve dedicated clusters of NVIDIA H200s and GB200s for any scale to supercharge your training and inference workflows.

Similar Jobs

NVIDIA Logo NVIDIA

Senior Software Engineer

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office or Remote
5 Locations
21960 Employees
152K-288K Annually

Cloudflare Logo Cloudflare

Systems Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Hybrid
Austin, TX, USA
4400 Employees

NVIDIA Logo NVIDIA

Senior Software Engineer

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office or Remote
5 Locations
21960 Employees
224K-431K Annually

Cloudflare Logo Cloudflare

Principal Software Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Hybrid
4 Locations
4400 Employees
200K-288K Annually

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account