Compute Strategy & Operations Lead

Reposted Yesterday
Be an Early Applicant
New York, NY, USA
In-Office
Mid level
Machine Learning • Generative AI
The Role
The role involves managing procurement of GPU and CPU capacity, building supplier relationships, evaluating options, negotiating contracts, and collaborating with engineering for specifications.
Summary Generated by Built In
About Us:

AI needs a new infrastructure layer. We're building it at Modal.

Every era of computing brought new workloads that previous infrastructure couldn't support: mainframes, databases, and the cloud. Each time, the company that rebuilt the layer underneath defined the decade. AI is no different, except it touches everything instead of one slice, and the window to build the layer underneath it is open right now.

Our customers include category-defining companies like Lovable, Ramp, Cognition, DoorDash, and Suno. They rely on Modal for instant GPU access, sub-second container starts, and native storage, so it's simple to serve low-latency inference, fine-tune models, and access production-ready sandboxes at scale.

We recently raised a $355M Series C at a $4.65B valuation, led by General Catalyst and Redpoint Ventures. We've crossed $300M+ ARR and grown fivefold since September.

Our team includes creators of popular open-source projects (e.g.,Seaborn,Luigi), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience.

The Role:

We're hiring a Compute Strategy and Operations lead to own how Modal plans for and acquires GPU and CPU capacity. You'll size our infrastructure needs ahead of demand, source supply across hyperscalers, neoclouds, and datacenter operators, and negotiate and close the contracts to secure it. The compute you secure directly determines what Modal can sell and build.

In this role, you will:

  • Own end-to-end procurement of GPU and CPU capacity across hyperscalers, neoclouds, and datacenter operators

  • Build and maintain a strong pipeline of supplier relationships

  • Evaluate supply options on price, availability, hardware specs, networking capabilities, and SLA terms

  • Negotiate and close contracts: reserved capacity agreements, spot arrangements, MSAs, DPAs, and order forms

  • Work closely with our engineering teams to translate technical requirements into procurement specs

  • Track market pricing, availability trends, and supplier dynamics, and serve as a trusted advisor to leadership on infrastructure procurement decisions

Requirements:
  • Fluency in the AI infrastructure landscape: hyperscalers, neoclouds, and the broader GPU supply market

  • Technical understanding of what you're buying: GPU architectures (NVIDIA H100/H200/B200, etc.), networking (InfiniBand vs. RoCE, fabric topology), and SLA structures

  • Strong commercial instincts. You know how to find leverage, structure a deal, and close it

  • Ability to work cross-functionally with finance and engineering teams on commercial terms and technical requirements

Skills Required

  • Fluency in the AI infrastructure landscape
  • Technical understanding of GPU architectures and networking
  • Strong commercial instincts and deal negotiation skills
  • Ability to work cross-functionally with finance and engineering teams
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York City, New York
50 Employees

What We Do

Deploy generative AI models, large-scale batch jobs, job queues, and more on Modal's platform. We help data science and machine learning teams accelerate development, reduce costs, and effortlessly scale workloads across thousands of CPUs and GPUs. Our pay-per-use model ensures you're billed only for actual compute time, down to the CPU cycle. No more wasted resources or idle costs—just efficient, scalable computing power when you need it.

Similar Jobs

NBCUniversal Logo NBCUniversal

Analyst, TechEx

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Hybrid
New York, NY, USA
68000 Employees
62K-80K Annually

NBCUniversal Logo NBCUniversal

VP, Technical Operations Finance

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Remote or Hybrid
New York, NY, USA
68000 Employees
200K-235K Annually

NBCUniversal Logo NBCUniversal

VP, Engineering Finance

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Remote or Hybrid
New York, NY, USA
68000 Employees
200K-235K Annually

General Motors Logo General Motors

Sales Manager

Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Remote or Hybrid
United States
165000 Employees

Similar Companies Hiring

ClickMint Thumbnail
AdTech • eCommerce • Marketing Tech • Generative AI
Malibu, CA
9 Employees
Credal.ai Thumbnail
Software • Security • Productivity • Machine Learning • Artificial Intelligence
Brooklyn, NY
LTX Thumbnail
Conversational AI • Generative AI
Jerusalem, Israel
360 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account