Product Manager, AI Infrastructure

Posted 22 Days Ago
Be an Early Applicant
San Jose, CA, USA
Hybrid
263K-355K Annually
Senior level
Artificial Intelligence • Internet of Things • Semiconductor
Build What the World Depends On
The Role
The Product Manager for AI Infrastructure will define and manage AI compute products, ensuring hardware and software integration for production platforms, while resolving system integration challenges and driving product decisions.
Summary Generated by Built In
Product Management, Datacenter AI / ML
The future isn't just about technology - it's about people and the limitless possibilities AI can unlock for us all. As AI transforms how we live, work, and connect, Arm is at its very foundation, powering the innovations that are shaping our world.
Arm's Cloud AI team is building next-generation platforms to power the AI workloads of tomorrow and we're growing our product management organization to help guide this journey. This is an opportunity to help shape the product direction of a major strategic investment while also helping build a new team and culture.
As a member of the team, you'll own the integration of hardware, software, and services into a production AI compute platform that supports critical customer workloads. You'll be responsible for defining the end-to-end product, identifying mismatches across system components, and driving decisions required to deliver a production system. We're looking for deeply technical, independent product leaders who thrive in ambiguity and can move seamlessly between product definition, system-level problem solving, technical analysis, and partner & customer engagement.
Responsibilities:
  • Define the AI compute product, including supported workloads, system capabilities, and constraints
  • Own system integration for AI compute platforms, ensuring hardware, software, and services combine into a production-ready system
  • Identify and resolve gaps across hardware, software, and deployment plans (e.g.: performance, system behavior, capacity)
  • Drive multi-functional decisions when system components or timelines don't align
  • Translate customer, system, and technical constraints into clear product tradeoffs and priorities for engineering teams

Required Skills and Experience:
  • Proven experience delivering complex, multi-component compute systems (including hardware & software)
  • Strong systems thinking - ability to reason across layer boundaries and understand end-to-end system behavior
  • Proven ability to drive ambiguous, multi-functional problems to resolution, including making product tradeoffs across competing constraints
  • Solid understanding of datacenter AI infrastructure (compute, memory, networking, software & services)
  • 6+ years of experience in product management, systems or solution engineering, or related product leadership role
  • Bachelor's degree or equivalent experience in Electrical or Computer Engineering

"Nice-to-Have" Skills and Experience:
  • Experience with data center compute deployment at scale, including service readiness, fleet rollout, or capacity planning for AI compute
  • Experience working with ML accelerators
  • Hands-on experience building or running GenAI workloads at scale
  • Experience with real-world hardware-software codesign (e.g., accelerators, distributed systems, or large-scale cloud services)
  • Masters or PhD degree in Electrical or Computer Engineering

In Return:
Help shape products that will define the future of AI compute and define what world-class product management looks like in AI infrastructure. You'll grow as a leader and technical voice - and help ensure Arm delivers the products our customers need today and the platforms that will power tomorrow.
Accommodations at Arm
At Arm, we want our people to Do Great Things. If you need support or an accommodation to Be Your Brilliant Self during the recruitment process, please email [email protected]. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.
Equal Opportunities at Arm
Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don't discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Hybrid Working at Arm
Arm's hybrid approach to working is centered around flexibility, where we split our time between the office and other locations to get our work done. Within that framework, we empower groups and teams to determine their own particular hybrid working pattern, depending on the work and the team's needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.
Salary Range:
$262,700-$355,400 per year
We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.
Accommodations at Arm
At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email [email protected] . To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.
Hybrid Working at Arm
Arm's approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team's needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.
Equal Opportunities at Arm
Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don't discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Skills Required

  • Proven experience delivering complex, multi-component compute systems (including hardware & software)
  • Strong systems thinking
  • Proven ability to drive ambiguous, multi-functional problems to resolution
  • Solid understanding of datacenter AI infrastructure
  • 6+ years of experience in product management or related role
  • Bachelor's degree in Electrical or Computer Engineering
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Cambridge, England
8,314 Employees
Year Founded: 1990

What We Do

We bring brilliant people together in a global ecosystem that is sparking the world’s potential. Arm technology enables specialized processing built on the economics, design freedom and accessibility of general-purpose compute that has, so far, led to more than 180 billion chips being shipped by our partners.

Why Work With Us

At Arm, we build the future of computing, powering everything from smartphones to AI. Our 10x mindset drives bold thinking and deep collaboration to solve complex problems together. With a people first culture, flexible work, and strong support for growth and wellbeing, your ideas can make a global impact while your career thrives.

Gallery

Gallery
Gallery
Gallery
Gallery

Arm Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Typical time on-site: Not Specified
HQCambridge, UK
Galway, Ireland
Budapest, Hungary
Sophia Antipolis, France
Ra'anana, Israel
Bengaluru, India
Noida, India
Yokohama, Japan
Seoul, South Korea
Hsinchu, Taiwan
Taipei, Taiwan
Munich, Germany
Austin, TX
Bristol, UK
Chandler, AZ
Raleigh, NC
Lund, Sweden
Manchester, England
Oslo, Norway
San Diego, CA
San Jose, CA
Sheffield, UK
Trondheim, Norway
Boston, MA
Learn more

Similar Jobs

Arm Logo Arm

Product Manager

Artificial Intelligence • Internet of Things • Semiconductor
Hybrid
San Jose, CA, USA
8314 Employees
212K-286K Annually

Arm Logo Arm

Principal Implementation Engineer

Artificial Intelligence • Internet of Things • Semiconductor
Hybrid
San Diego, CA, USA
8314 Employees
250K-338K Annually

Arm Logo Arm

Senior Implementation Engineer

Artificial Intelligence • Internet of Things • Semiconductor
Hybrid
San Diego, CA, USA
8314 Employees
162K-219K Annually

Arm Logo Arm

Architect

Artificial Intelligence • Internet of Things • Semiconductor
Hybrid
San Jose, CA, USA
8314 Employees
263K-355K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account