Principal/Staff HPC Network Engineer

Reposted 2 Days Ago
Be an Early Applicant
San Francisco, CA, USA
In-Office
250K-325K Annually
Expert/Leader
Artificial Intelligence • Cloud • Information Technology • Infrastructure as a Service (IaaS)
The Role
The role involves architecting and managing GPU clusters, focusing on network management and automation, mentoring junior engineers, and maintaining documentation.
Summary Generated by Built In

We're building the company which will de-risk the largest infrastructure build-out in history.

When people finance GPU clusters, the datacenters housing them, and the infrastructure powering them, they need "offtake" - meaning someone has signed a contract to lease the cluster for a period of time before its even built.

Financing a GPU cluster is inherently risky, since margins are thin and volumes are huge. Lenders don't want to take on the risk that cluster developers can't repay their loan, and cluster developers really don't want to risk not selling their cluster. As a result, risk is offloaded to the customer using fixed-price long-term contracts.

If you don't mitigate this customer risk, there's a bubble. This isn't SaaS anymore - application layer companies sign multi-year contracts for computer and inference, but sell to customers on monthly subscriptions. If you mess up a purchase, it's game over: a minor shift in your revenue growth rate might mean the difference between profit or bankruptcy. But what if companies could exit their contract by selling it back to the market?

Otherwise, as AI scales, compute only becomes available to folks who can effectively take on that risk. A 2-person startup in a San Francisco Victorian can't realistically sign a 5-year take or pay contract on $100m supercomputers. But they may be able to buy the month of liquidity that someone else sold back.

So that's what we make: a liquid market for GPU offtake.

About the Role

GPU clusters are some of the most performant computers on the planet. Even smaller clusters by today’s standards would have ranked in the TOP500 five years ago. Our infrastructure team is responsible for architecting and deploying new clusters around the world and keeping them running smoothly. You’ll participate in on-call rotation, fix issues when they arise, and lean into automation to enable deployments at scale. We’re a small but ambitious team so you’ll be an early contributor helping to shape culture, mentor junior engineers, and learn from our customers.

About You
  • You will have 10+ years of experience with hands-on management or architecture with network for at least one GPU cluster in the past (ideally a cluster with >1k GPU’s but not required)

  • You deeply understand the fundamentals of Ethernet (RoCEv2) and/or InfiniBand networks in CLOS/fat-tree topologies

  • You have built HPC network architectures (eBGP, fat-tree, VXLAN, MCLAG, etc.)

  • The idea of implementing zero-touch provisioning for a large multi-layer network excites you (you embrace automation)

  • You appreciate, value and generate good documentation

  • You have the ability and willingness to mentor junior engineers

  • You’re open to coming in to our San Francisco office 3-4 days per week

Some Nice to Haves
  • You understand data center concepts including power, cooling and how to engage with colo providers

  • You have experience with Linux systems administration including managing kernel drivers and tuning the network stack

  • You have experience with Linux virtualization (KVM, QEMU, libvirt, etc.)

  • You’ve had exposure to containers and Kubernetes operators

BenefitsGenerous equity grant

Team members are offered a competitive salary along with equity in the company

Visa Sponsorships

Yes, we sponsor visas and work permits

Retirement matching

We match 401(k) plans up to 4%

Medical, dental & vision

We offer competitive medical, dental, vision insurance for employees and dependents and cover 100% of premiums

Time off

We offer unlimited paid time off as well as 10+ observed holidays

Parental leave

We offer biological, adoptive, and foster parents paid time off to spend quality time with family

Daily lunch

We cover lunch daily for employees

Unlimited office book budget

You can buy as many books for the office as you want

The San Francisco Compute Company is committed to maintaining a workplace free from discrimination and harassment.

We make employment decisions based on business needs, job requirements, and individual qualifications, without regard to race, color, religion, belief, national origin, social or ethical origin, age, physical, mental, or sensory disability, sexual orientation, gender identity or expression, marital status, civil union or domestic partnership status, past or present military service, HIV status, family medical history or genetic information, family or parental status including pregnancy, or any other status protected by law.

We welcome the opportunity to consider qualified applicants with prior arrest or conviction records. Our commitment to diversity includes hiring talented individuals regardless of their criminal history, in accordance with local, state, and federal laws, including San Francisco’s Fair Chance Ordinance and California’s ban-the-box laws.

If you require reasonable accommodation for any reason, please reach out to us at [email protected]

Skills Required

  • 10+ years of experience managing or architecting network for GPU clusters
  • Deep understanding of Ethernet (RoCEv2) and/or InfiniBand networks
  • Experience building HPC network architectures (eBGP, fat-tree, VXLAN, MCLAG, etc.)
  • Ability to implement zero-touch provisioning for multi-layer networks
  • Willingness to mentor junior engineers
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
30 Employees
Year Founded: 2023

What We Do

San Francisco Compute Company operates a marketplace for large-scale GPU clusters, enabling users to buy and sell compute contracts with flexible terms. They aim to make AI compute more accessible and affordable by creating a liquid market for GPU offtake.

Similar Jobs

Optum Logo Optum

Patient Care Coordinator

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Greenbrae, CA, USA
160000 Employees
18-32 Hourly

Optum Logo Optum

Senior Database Administrator

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office or Remote
San Francisco, CA, USA
160000 Employees
113K-193K Annually

Optum Logo Optum

National Coding Educator - Remote

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office or Remote
Irvine, CA, USA
160000 Employees
92K-164K Annually

Optum Logo Optum

Provider Relations Representative

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
San Diego, CA, USA
160000 Employees
60K-107K Annually

Similar Companies Hiring

Bellagent Thumbnail
Artificial Intelligence • Machine Learning • Business Intelligence • Generative AI
Chicago, IL
20 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account