Product Manager, AI Infrastructure

Reposted 23 Days Ago
Be an Early Applicant
San Jose, CA, USA
Hybrid
212K-286K Annually
Senior level
Artificial Intelligence • Internet of Things • Semiconductor
Build What the World Depends On
The Role
The Product Manager for AI Infrastructure will lead performance analysis, inform product roadmaps, and drive alignment across teams for AI compute platforms.
Summary Generated by Built In
Product Management, Datacenter AI / ML
The future isn't just about technology - it's about people and the limitless possibilities AI can unlock for us all. As AI transforms how we live, work, and connect, Arm is at its very foundation, powering the innovations that are shaping our world.
Arm's Cloud AI team is building next-generation platforms to power the AI workloads of tomorrow, and we're growing our product management organization to help guide this journey. This is an opportunity to help shape the product direction of a major strategic investment while also helping build a new team and culture.
As a member of the team, you'll own competitive and performance insights that directly shape product and roadmap decisions for AI compute platforms. You'll be responsible for leading deep competitive and performance analysis across platforms and critical customer workloads and translating those into actionable insights for our engineering and executive partners. We're looking for deeply technical, independent product leaders who thrive in ambiguity and can move seamlessly between product definition, system-level problem solving, technical analysis, and partner & customer engagement.
Responsibilities:
  • Own competitive and performance analysis for AI compute platforms across hardware, software, and services
  • Identify key workload-driven performance gaps and translate them into product and engineering priorities
  • Inform product roadmap and tradeoffs through data-driven insights across system layers
  • Drive alignment across teams on where and how to improve system performance and competitiveness

Required Skills and Experience:
  • Strong understanding of datacenter AI workloads and hardware & software infrastructure
  • Experience analyzing and comparing performance of complex compute systems (hardware & software) and translating insights into product or engineering direction
  • Strong systems thinking - ability to reason across system layers and understand end-to-end system behavior
  • Proven ability to drive ambiguous, multi-functional problems to resolution, including making product tradeoffs
  • 6+ years of experience in product management, systems or solution engineering, or related product leadership role
  • Bachelor's degree or equivalent experience in Electrical or Computer Engineering

"Nice To Have" Skills and Experience:
  • Experience working with ML accelerators
  • Hands-on experience building or running GenAI workloads at scale
  • Experience with competitive analysis across AI compute platforms and customer workloads
  • Masters or PhD degree in Electrical or Computer Engineering

In Return:
Help shape products that will define the future of AI compute and define what world-class product management looks like in AI infrastructure. You'll grow as a leader and technical voice - and help ensure Arm delivers the products our customers need today and the platforms that will power tomorrow.
Accommodations at Arm
At Arm, we want our people to Do Great Things. If you need support or an accommodation to Be Your Brilliant Self during the recruitment process, please email [email protected]. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.
Equal Opportunities at Arm
Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don't discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Hybrid Working at Arm
Arm's hybrid approach to working is centered around flexibility, where we split our time between the office and other locations to get our work done. Within that framework, we empower groups and teams to determine their own particular hybrid working pattern, depending on the work and the team's needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.
Salary Range:
$211,600-$286,200 per year
We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.
Accommodations at Arm
At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email [email protected] . To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.
Hybrid Working at Arm
Arm's approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team's needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.
Equal Opportunities at Arm
Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don't discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Skills Required

  • Strong understanding of datacenter AI workloads and hardware & software infrastructure
  • Experience analyzing and comparing performance of complex compute systems
  • Strong systems thinking ability
  • Proven ability to drive ambiguous, multi-functional problems to resolution
  • 6+ years of experience in product management or related role
  • Bachelor's degree or equivalent experience in Electrical or Computer Engineering
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Cambridge, England
8,314 Employees
Year Founded: 1990

What We Do

We bring brilliant people together in a global ecosystem that is sparking the world’s potential. Arm technology enables specialized processing built on the economics, design freedom and accessibility of general-purpose compute that has, so far, led to more than 180 billion chips being shipped by our partners.

Why Work With Us

At Arm, we build the future of computing, powering everything from smartphones to AI. Our 10x mindset drives bold thinking and deep collaboration to solve complex problems together. With a people first culture, flexible work, and strong support for growth and wellbeing, your ideas can make a global impact while your career thrives.

Gallery

Gallery
Gallery
Gallery
Gallery

Arm Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Typical time on-site: Not Specified
HQCambridge, UK
Galway, Ireland
Budapest, Hungary
Sophia Antipolis, France
Ra'anana, Israel
Bengaluru, India
Noida, India
Yokohama, Japan
Seoul, South Korea
Hsinchu, Taiwan
Taipei, Taiwan
Munich, Germany
Austin, TX
Bristol, UK
Chandler, AZ
Raleigh, NC
Lund, Sweden
Manchester, England
Oslo, Norway
San Diego, CA
San Jose, CA
Sheffield, UK
Trondheim, Norway
Boston, MA
Learn more

Similar Jobs

Arm Logo Arm

Architect

Artificial Intelligence • Internet of Things • Semiconductor
Hybrid
San Jose, CA, USA
8314 Employees
263K-355K Annually

Arm Logo Arm

Architect

Artificial Intelligence • Internet of Things • Semiconductor
Hybrid
2 Locations
8314 Employees
198K-268K Annually

Arm Logo Arm

Counsel

Artificial Intelligence • Internet of Things • Semiconductor
Hybrid
San Jose, CA, USA
8314 Employees
281K-380K Annually

Arm Logo Arm

Architect

Artificial Intelligence • Internet of Things • Semiconductor
Hybrid
San Jose, CA, USA
8314 Employees
263K-355K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account