Staff AI Performance Engineer

Posted An Hour Ago
Be an Early Applicant
Milpitas, CA, USA
Hybrid
Expert/Leader
Artificial Intelligence • Semiconductor
Joining Graphcore gives you a seat at the top-table, shaping the future of Artificial Intelligence.
The Role
Leads performance optimization for large-scale AI training and inference workloads across distributed systems. Builds benchmarks, profiles workloads, identifies compute, memory, networking, and software bottlenecks, and develops C++ and Python tools. Coordinates complex performance improvements across hardware and software teams, validates results with reliable data, and guides engineering decisions that improve efficiency, scalability, and reliability at data center scale.
Summary Generated by Built In
About the Job

Lead performance work that turns large-scale AI workloads into faster, more efficient systems.

As a Staff AI Performance Engineer, you will analyze and optimize AI training and inference workloads across distributed systems. Your work will connect compute, memory, networking and software behavior.

You will lead complex performance workstreams across hardware and software. You will find bottlenecks, validate improvements and turn performance evidence into practical engineering decisions.

You will build benchmarks, profile demanding workloads and develop C++ and Python tools for analysis and optimization. Your recommendations will help teams improve efficiency, scalability and reliability.

This role gives you broad technical scope across AI infrastructure at data center scale. It is based in Milpitas, California.

The team and culture

The System Engineering Performance team architects, evaluates and optimizes high-performance infrastructure for large-scale data center deployments. The team works across the computing stack to understand real system behavior.

Work moves through evidence, ownership and clear technical judgment. You will lead investigations, coordinate across teams and validate impact with reliable performance data.

Decisions are shaped through benchmarks, models, simulations and practical engineering tradeoffs. The team values engineers who think big, act fast, take responsibility, speak up and lead beyond their own area.

What we’re looking for

· Strong experience profiling and optimizing AI, machine learning or high-performance computing workloads.
· Experience with distributed systems and communication libraries such as MPI, NCCL, UCX or libfabric.
· Strong C++ and Python skills, including reliable tools or performance-sensitive software.
· Deep understanding of compute, memory and communication behavior in large-scale systems.
· Ability to lead technically complex work and coordinate improvements across teams.
· Familiarity with MLPerf, accelerated architectures, ML frameworks or high-performance interconnects.

While we have outlined a set of requirements, we value transferable skills and diverse experiences. We also welcome engineers returning to the profession after a career break, including through returnship routes.

Benefits

Graphcore offers competitive compensation and benefits designed to support employees' health, financial well-being, work-life needs, and professional growth. Benefits and programs for eligible U.S. employees may include: 

• Medical, dental, and vision coverage, with options that may extend to eligible dependents.
• Mental health, wellness, and employee assistance resources.
• Retirement savings benefits and company contributions where applicable.
• Paid vacation, sick time, company holidays, and parental or family leave in accordance with applicable plans and policies.
• Life insurance and short-term or long-term disability coverage.
• Flexible working hours and hybrid working arrangements where compatible with the role and team requirements.
• Professional-development resources, learning programs, office amenities, and team-led activities. 

Benefits vary by work location, employment status, scheduled hours, and plan eligibility and are subject to the terms of the applicable plans and company policies. This overview is not a contract or guarantee of benefits. 

Graphcore is an equal opportunity employer. We consider qualified applicants without regard to race, color, religion, creed, sex, pregnancy, sexual orientation, gender identity or expression, national origin, ancestry, age, disability, genetic information, veteran status, or any other status protected by applicable law. 

Graphcore is committed to an inclusive and accessible hiring process. If you need a reasonable accommodation to participate in the application or interview process, please let the recruiting team know. 

Personal information submitted during the recruiting process will be handled in accordance with Graphcore's applicable candidate privacy notices.

Join the Team at Graphcore

Graphcore is one of the world’s leading innovators in Artificial Intelligence compute. It is developing hardware, software and systems infrastructure that will unlock the next generation of AI breakthroughs and power the widespread adoption of AI solutions across every industry.

As part of the SoftBank Group, Graphcore is a member of an elite family of companies responsible for some of the world’s most transformative technologies. Together, they share a bold vision: to enable Artificial Super Intelligence and ensure its benefits are accessible to everyone.

Graphcore’s teams are drawn from diverse backgrounds and bring a broad range of skills and perspectives. A melting pot of AI research specialists, silicon designers, software engineers and systems architects, Graphcore brings together deep expertise to solve complex problems and deliver meaningful progress in AI compute.

Ready to lead performance improvements across AI systems at data center scale? Apply now to join Graphcore in Milpitas.

Skills Required

  • Strong experience profiling and optimizing AI, machine learning, or high-performance computing workloads
  • Experience with distributed systems and communication libraries such as MPI, NCCL, UCX, or libfabric
  • Strong C++ and Python skills, including reliable tools or performance-sensitive software
  • Deep understanding of compute, memory, and communication behavior in large-scale systems
  • Ability to lead technically complex work and coordinate improvements across teams
  • Familiarity with MLPerf, accelerated architectures, ML frameworks, or high-performance interconnects

What the Team is Saying

Monika
Dionysia
Dave

Graphcore Compensation & Benefits Highlights

  • Healthcare Strength — Company materials list private medical insurance, dental coverage, health cash plans, mental‑health support, and day‑one U.S. medical options via Cigna/Kaiser. Feedback suggests these offerings are a meaningful strength, particularly in the UK.
  • Leave & Time Off Breadth — Benefits highlight flexible working hours, unlimited annual leave, generous parental leave, and paid U.S. holidays. Feedback suggests work‑life balance is often described positively alongside these policies.
  • Retirement Support — UK information cites pension matching up to 5%, while U.S. listings describe a 401(k) with a 100% company match up to 6%. Feedback suggests these structured contributions are viewed as competitive elements of the package.

Graphcore Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Bristol, Bristol
903 Employees
Year Founded: 2016

What We Do

At Graphcore, we’re building the future of AI compute. We’re a team of semiconductor, software and AI experts, with deep experience in creating the complete AI compute stack - from silicon and software to infrastructure at datacenter scale. As part of the SoftBank Group, backed by significant long-term investment, we are delivering key technology into the fast-growing SoftBank AI ecosystem. To meet the vast and exciting AI opportunity, Graphcore is expanding its teams around the world. We are bringing together the brightest minds to solve the toughest problems, in a place where everyone has the opportunity to make an impact on the company, our products and the future of artificial intelligence.

Why Work With Us

Our team is at the forefront of the machine intelligence revolution, enabling innovators from all industries to build AI-native products to expand human potential. What we do at Graphcore really makes a difference.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Graphcore Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

At Graphcore, we value wellbeing and flexibility to support a healthy work/life balance. Our hybrid approach encourages office-based colleagues to work onsite three days a week, with trusted flexibility built on trust and transparency for everyone.

Typical time on-site: 3 days a week
HQHeadquarters
Austin Office
Bengaluru Office
Cambridge Office
Gdańsk Office
Hsinchu Office
London Office
Learn more

Similar Jobs

Graphcore Logo Graphcore

Principal Datacenter Technologist

Artificial Intelligence • Semiconductor
Hybrid
Milpitas, CA, USA
903 Employees

Graphcore Logo Graphcore

Architect

Artificial Intelligence • Semiconductor
Hybrid
Milpitas, CA, USA
903 Employees

Graphcore Logo Graphcore

Architect

Artificial Intelligence • Semiconductor
Hybrid
2 Locations
903 Employees

Graphcore Logo Graphcore

Director, Sustaining Engineering

Artificial Intelligence • Semiconductor
Hybrid
Milpitas, CA, USA
903 Employees
50K-50K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account