HPC Architect

Posted 2 Hours Ago
Be an Early Applicant
3 Locations
In-Office or Remote
Senior level
Artificial Intelligence • Cloud • Information Technology • Software
The Role
Own technical qualification of compute providers: define acceptance standards and benchmarks, validate clusters (fabric, GPUs, storage, orchestration), guide provider remediation, and maintain technical relationships to ensure reliable production performance.
Summary Generated by Built In
HPC ArchitectLocation: North America Remote/SF-Hybrid · Full-Time

About Andromeda

Andromeda Cluster was founded by Nat Friedman and Daniel Gross to give early-stage startups access to the kind of scaled AI infrastructure once reserved only for hyperscalers.

We began with a single managed cluster — but it filled almost instantly. Since then, we’ve been quietly building the systems, network, and orchestration layer that makes the world’s AI infrastructure more accessible.

Today, Andromeda works with leading AI labs, data centers, and cloud providers to deliver compute when and where it’s needed most. Our platform routes training and inference jobs across global supply, unlocking flexibility and efficiency in one of the fastest-growing markets on earth.

Our long-term vision is to build the liquidity layer for global AI compute. We are expanding to new frontiers to find the brightest that work in AI infrastructure, research and engineering.

The Role

This role owns our provider relationships on the technical side. You're the person who decides whether a provider's cluster is good enough to join the Andromeda network, and the person who helps them get there when it isn't. That means vetting prospective providers against our quality bar and then working alongside their engineers to bring their clusters onto the network cleanly.

You'll work closely with our compute procurement team to identify and qualify new providers, and you'll be the standing technical relationship with the providers we already have. When procurement finds a promising provider, you're the one who validates the claims. When a provider says their fabric is non-blocking and their nodes are burn-in tested, you're the one who verifies it by reviewing their evidence, and sometimes by running the tests yourself on their hardware.

The qualification bar you'll hold providers to mostly doesn't exist yet in written form. Some of it lives informally in how our SREs evaluate clusters today; much of it hasn't been defined at all. You'd be the first person in this role, so a large part of the job is building that bar: the acceptance test suite, the quality thresholds, and the technical standards a provider must meet. Then making them rigorous enough that we can trust them and clear enough that providers can build to them.

This role is the technical counterpart to our Provider Technical Program Manager, who owns delivery timelines, escalations, and incident command. You own the technical judgment: is this cluster ready, what's wrong with it, and what will it take to fix. During provider incidents, command and coordination sit with the program manager and technical response sits with our SREs. Your involvement is upstream, making sure clusters that would have caused those incidents never make it onto the network.

What You’ll Do

  • Vet prospective compute providers: assess cluster architecture, GPU hardware, network fabric, storage, and orchestration against Andromeda's quality metrics, and make the call on whether a cluster qualifies.

  • Define the qualification bar itself. Build the acceptance test suite, benchmark methodology, and quality thresholds from scratch, formalizing what currently exists only as SRE tribal knowledge. Own and evolve these standards as the fleet and the market change.

  • Run validation hands-on where it matters: burn-in testing, fabric validation (InfiniBand/RoCE), NCCL and application-level benchmarks, storage performance testing. For routine or repeat validation, define the methodology and review results rather than executing everything yourself.

  • Guide providers through technical onboarding: work directly with their data-center and platform engineers to remediate gaps, tune configurations, and bring clusters up to the bar on a predictable path.

  • Partner with compute procurement to identify and qualify new providers. Perform technical due diligence during sourcing, and a clear read on how much remediation a candidate cluster needs before procurement commits.

  • Build and maintain technical relationships with existing providers: you're the engineer their engineers call, and the one who spots architectural or quality drift before it becomes a customer problem.

  • Feed what you learn back into provider-facing standards and internal documentation, so each qualification is faster and more consistent than the last.

What We’re Looking For

  • Deep HPC experience: you've designed, built, or operated GPU clusters at meaningful scale and understand what makes them fast, stable, and debuggable.

  • Strong fabric knowledge, ideally both InfiniBand and RoCE. You can evaluate a topology, interpret fabric diagnostics, and identify why a fabric underperforms, not just that it does.

  • Experience with distributed orchestration and the HPC software stack: Slurm, Kubernetes, OpenMPI or equivalent, and the Linux systems engineering underneath all of it.

  • Data-center literacy: power, cooling, cabling, and physical-layer realities. You can walk a provider's facility and know what questions to ask.

  • Benchmarking judgment. You know which numbers matter for large-scale training workloads, how providers game them, and how to design tests that can't be gamed.

  • The ability to write standards others can build against: precise, testable, and usable by a provider's engineering team without you in the room.

  • Credibility in the room with external engineering teams, including the ability to deliver a failing grade to a provider who wants your business, and keep the relationship intact.

  • Comfort with ambiguity. The qualification framework you'll apply mostly doesn't exist yet; you'll write it.

Strong Candidates May Have

  • Experience inside a neocloud, hyperscaler, colocation, or data-center provider.

  • NVIDIA data-center GPU depth: DGX/HGX platforms, NVLink/NVSwitch, GPU health and RAS behavior at fleet scale.

  • Experience supporting AI research labs or other large-scale training customers, and familiarity with what their workloads punish: stragglers, fabric jitter, storage stalls.

  • Background in cluster acceptance testing or site bring-up. Ideally you've taken a cluster from delivery to production before.

What Success Looks Like

Within your first year, you'll have delivered:

  • A qualification bar that's written down and trusted. Andromeda's acceptance criteria, benchmark suite, and quality thresholds exist as documents and tooling — not tribal knowledge. SREs, procurement, and providers all work from the same bar, and a passing grade from you means the cluster performs in production.

  • Providers who build to our standards before we ever test them. Prospective providers get our technical requirements upfront and arrive closer to qualified, because the standards are clear enough to engineer against. Time-from-sourcing-to-qualified drops with each provider.

  • Onboarding that's technically boring. Clusters that join the network have been validated the same way every time, and the surprises that used to appear in a customer's training run get caught in acceptance instead.

  • A technical relationship providers value. Provider engineering teams treat you as the authority on what Andromeda needs and the first call when they're planning a build-out so that we hear about architecture decisions early enough to influence them.

  • A procurement partnership that changes what we buy. Procurement's provider pipeline reflects your technical due diligence, and deals are shaped by a realistic view of remediation cost.

Why You’ll Love It Here

  • High-growth environment: Get in early at a company at the center of the AI infrastructure boom

  • Ownership: First HPC Architect for the solutions engineering team, you’ll get to build this function from the ground up

  • Competitive compensation: + meaningful equity

  • Comprehensive benefits: for you and your dependents, including healthcare, dental, and vision coverage, 401(k), and unlimited PTO

Andromeda Cluster is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Skills Required

  • Designed, built, or operated GPU clusters at meaningful scale
  • Strong fabric knowledge (InfiniBand and/or RoCE) with ability to interpret diagnostics and topology
  • Experience with distributed orchestration and HPC software stack: Slurm, Kubernetes, OpenMPI (or equivalent), and Linux systems engineering
  • Data-center literacy: power, cooling, cabling, and physical-layer facility knowledge
  • Benchmarking and validation experience: burn-in testing, NCCL and application-level benchmarks, storage performance testing
  • Ability to write precise, testable technical standards and acceptance test suites
  • Credibility working directly with external provider engineering teams and delivering technical judgments
  • Comfort with ambiguity and building qualification frameworks from scratch
  • Experience inside a neocloud, hyperscaler, colocation, or data-center provider
  • NVIDIA data-center GPU experience (DGX/HGX platforms, NVLink/NVSwitch, GPU health and RAS behavior)
  • Experience supporting AI research labs or large-scale training customers
  • Background in cluster acceptance testing or site bring-up (delivery to production)
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, California
17 Employees

What We Do

Andromeda Cluster was founded by Nat Friedman and Daniel Gross to give early-stage startups access to the kind of scaled AI infrastructure once reserved only for hyperscalers. We began with a single managed cluster — but it filled almost instantly. Since then, we’ve been quietly building the systems, network, and orchestration layer that makes the world’s AI infrastructure more accessible. Today, Andromeda works with leading AI labs, data centers, and cloud providers to deliver compute when and where it’s needed most. Our platform routes training and inference jobs across global supply, unlocking flexibility and efficiency in one of the fastest-growing markets on earth. Our long-term vision is to build the liquidity layer for global AI compute. We are expanding to new frontiers to find the brightest that work in AI infrastructure, research and engineering.

Similar Jobs

Hewlett Packard Enterprise Logo Hewlett Packard Enterprise

Architect

Artificial Intelligence • Cloud • Information Technology • Consulting
In-Office or Remote
4 Locations
85422 Employees
161K-390K Annually

Affirm Logo Affirm

Staff Software Engineer

Big Data • Fintech • Mobile • Payments • Financial Services
Easy Apply
Remote
Canada
2200 Employees
181K-241K Annually

Samsara Logo Samsara

Analytics Manager

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
Toronto, ON, CAN
4000 Employees
139K-180K Annually

GitLab Logo GitLab

Support Engineer

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
Remote
2 Locations
2500 Employees

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account