Technical Program Manager, Compute Infrastructure

Reposted Yesterday
Be an Early Applicant
San Francisco, CA, USA
Hybrid
207K-285K Annually
Senior level
Artificial Intelligence • Machine Learning • Generative AI
The Role
The Technical Program Manager will lead the delivery of large-scale GPU clusters, coordinating with engineers and managing cross-functional teams to ensure timely, reliable production capacity.
Summary Generated by Built In
About the Team

The Compute Infrastructure team runs the GPU fleet and large-scale compute clusters that serve the models backing ChatGPT and the API, while also supporting training workloads for our next generation of models. We provide a unified platform for OpenAI teams to run production Applied AI and Research training workloads.

Our work spans cloud providers, bare metal infrastructure, data centers, and the foundational services that make compute usable. We partner across Engineering, Research, Product, Capacity Planning, Finance, and Data Center Infrastructure to bring new capacity online and support OpenAI’s growing compute needs.

We seek to learn from deployment and distribute the benefits of AI, while ensuring that this powerful tool is used responsibly and safely. Safety is more important to us than unfettered growth.

About the Role

As a Technical Program Manager for Compute Infrastructure, you will own the supply signal for all GPUs entering our fleet: a reliable view of what capacity is arriving, where and when it will arrive, and when it is expected to become usable. You will own the roadmap, requirements, delivery, and adoption of the tools, data, and platform behind that signal, partnering with Engineering to build systems that support planning and execution across OpenAI.

You will also lead programs that turn incoming supply into usable compute. Working across cloud providers, Data Center Infrastructure, and compute engineering teams, you will connect physical site readiness with the CPU, storage, network, GPU, and foundational services required to bring new sites and clusters online.

You will be part of an engineer-first TPM team, managing a broad portfolio of infrastructure programs and making dependencies, risks, and decisions clear from working teams through leadership. Your work will help teams plan with confidence, respond to supply changes, and deliver capacity on time.

In this role, you will:
  • Own the GPU supply signal across the fleet. Maintain a trusted view of incoming capacity across providers, sites, and clusters, including quantities, delivery forecasts, acceptance and readiness milestones, and expected dates for production use. Make changes and their downstream effects visible.

  • Build and scale the tools, data, and platform behind that signal. Own the roadmap, requirements, delivery, and adoption, partnering with Engineering on data models, integrations, quality checks, and planning workflows. Serve Product TPMs, Capacity TPMs, and Compute TPMs, alongside Finance, Accounting, leadership, Engineering, and Research.

  • Connect supply with capacity planning. Partner with Capacity Planning on supply and demand management, allocation planning, and scenario analysis. Ensure plans reflect current supply forecasts, infrastructure constraints, and the effects of early or late deliveries.

  • Coordinate physical readiness for new capacity. Work closely with Data Center Infrastructure and cloud service providers to align ready-for-service dates, site construction, power and cooling readiness, supply-chain convergence, equipment delivery, and commissioning. Track dependencies and drive resolution of gaps that threaten deployment.

  • Lead logical readiness across infrastructure resources. Coordinate CPU, storage, network, GPU, Kubernetes, and dependent compute foundation services so new clusters can support their intended workloads. Make clear which missing services or resources could delay GPU use.

  • Drive deployment across cloud and bare metal environments. Lead integrated plans across AWS, GCP, Azure, OCI, and other infrastructure partners, accounting for provider-specific dependencies while establishing consistent readiness criteria and handoffs.

  • Establish Delivery Scorecards for cloud providers and internal infrastructure teams. Track delivery commitments, forecast changes, actual delivery, readiness milestones, and time to usable capacity. Use these scorecards to identify recurring gaps, clarify recovery actions, and improve delivery predictability.

  • Improve the reliability and repeatability of cluster bringup. Partner with Engineering to scale automation, runbooks, validation, and deployment processes. Reduce manual coordination and the time between capacity delivery and production use.

  • Manage the critical paths across concurrent programs. Establish clear milestones, owners, dependencies, and escalation paths. Resolve cross-team blockers and drive decisions that keep site and cluster deployments moving.

  • Communicate progress, risks, and tradeoffs clearly. Give technical and business stakeholders the information they need to understand capacity availability, assess changes to the plan, and make timely decisions.

You might thrive in this role if you:
  • Have 5+ years of experience leading major technical programs, including compute infrastructure, hyperscaler deployments, capital projects, or similarly complex infrastructure work.

  • Possess a degree in a hard science or engineering discipline, or have a demonstrated track record of equivalent engineering expertise.

  • Are familiar with Kubernetes deployments and have worked with at least one major cloud provider—such as AWS, GCP, Azure, or OCI—to scale compute infrastructure. Experience coordinating deployments across multiple providers is valuable.

  • Are familiar with bare metal GPU capacity and the provisioning, inventory, and planning systems used to bring it into service.

  • Have worked with Capacity Planning teams on supply and demand management, allocations, constraints, and supporting tools. You understand how changes in delivery or readiness affect downstream capacity plans.

  • Have experience defining requirements for operational data and internal platforms. You can work with engineers to establish useful data models, improve data quality, and build tools that teams adopt and rely on.

  • Understand how site readiness, power and cooling, equipment delivery, commissioning, and ready-for-service milestones affect cluster deployment. You can coordinate these dependencies without losing sight of when the intended workload can run.

  • Have a record of owning and delivering complex technical programs across internal teams and external partners, including cloud providers, equipment suppliers, or data center infrastructure teams.

  • Are technically adept and comfortable working with Engineering and Research to understand dependencies, evaluate tradeoffs, and turn complex problems into executable plans.

  • Build simple, scalable processes and communicate clearly with both technical teams and business stakeholders. You are resourceful in ambiguous environments and follow issues through to resolution.

  • Are interested in and thoughtful about the impacts of AGI.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. 

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.

Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Skills Required

  • 5+ years of experience in program management for major projects
  • Experience with hyperscaler infrastructure deployment
  • Degree in a hard science or demonstrated engineering expertise
  • Ability to manage cross-functional teams
  • Experience delivering high-profile technical projects
  • Experience interfacing with external vendors

OpenAI Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about OpenAI and has not been reviewed or approved by OpenAI.

  • Parental & Family Support — Policies include 24 weeks of paid leave for birth parents and 20 weeks for non‑birth parents, plus fertility and family‑planning coverage. Additional flexibility such as the option to work from home for several weeks after parental leave reinforces family support.
  • Healthcare Strength — Health coverage is positioned as competitive and tailored by location, with dedicated mental‑health support and services alongside life and AD&D insurance. Global business‑travel insurance for employees and dependents extends protection beyond core medical care.
  • Equity Value & Accessibility — Equity has delivered tangible value through multiple tender offers that have enabled employees to realize liquidity at strong valuations. A shift toward more conventional RSU‑style grants for newer offers makes the equity more familiar for many candidates.

OpenAI Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
4,500 Employees
Year Founded: 2015

What We Do

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. AI is an extremely powerful tool that must be created with safety and human needs at its core. OpenAI is dedicated to putting that alignment of interests first — ahead of profit. To achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. Our investment in diversity, equity, and inclusion is ongoing, executed through a wide range of initiatives, and championed and supported by leadership. At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Similar Jobs

NVIDIA Logo NVIDIA

Technical Program Manager

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Remote or Hybrid
2 Locations
21960 Employees

Luxury Presence Logo Luxury Presence

Finance Manager

Marketing Tech • Real Estate • Software • PropTech • SEO
Easy Apply
Remote or Hybrid
United States
500 Employees
160K-185K Annually

Samsara Logo Samsara

Consultant

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
89K-135K Annually

Samsara Logo Samsara

Account Manager

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
51K-69K Annually

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account