AI Systems Performance Engineer

Reposted 15 Hours Ago
Be an Early Applicant
San Jose, CA, USA
In-Office
141K-226K Annually
Senior level
Software • Semiconductor • Manufacturing
The Role
As a Senior AI Systems Performance Engineer, you will benchmark AI workloads, optimize Ethernet fabric performance, and troubleshoot system bottlenecks, focusing on delivering actionable insights across teams.
Summary Generated by Built In

Please Note:

1. If you are a first time user, please create your candidate login account before you apply for a job. (Click Sign In > Create Account)

2. If you already have a Candidate Account, please Sign-In before you apply.

Job Description:

We are seeking a highly talented and experienced Senior AI Fabric Performance Engineer to take on a critical role within our Performance Lab. In this high-impact position, you will drive the performance benchmarking of AI inference, training and storage workloads with focus on our network infrastructure. You will be responsible to generate reports that aid the customers in deployment and marketing team to position the product.

While the AI workloads (inference and training) run on our servers, your primary focus will be optimizing the Ethernet fabric that connects them. You will be responsible for executing rigorous performance benchmarks, isolating complex system bottlenecks, and tuning parameters to achieve maximum throughput and minimum latency. If you possess a deep understanding of Ethernet fabric, machine learning system demands, and Linux environments, and you thrive on solving complex performance puzzles, we want you on our team.

Key Responsibilities
  • Benchmarking & Execution: Install, configure, and run industry-standard AI performance benchmarks, with a strong emphasis on MLPerf (Training and Inference) and NCCL tests.

  • Fabric Optimization: Tune and optimize network parameters, focusing heavily on Ethernet fabric performance, to ensure seamless data flow for distributed AI workloads running on server clusters.

  • Deep Debugging: Identify, isolate, and troubleshoot complex system performance bottlenecks spanning across the Linux OS, server hardware, and Ethernet switches.

  • Automation Development: Design, develop, and implement robust performance testing frameworks and automation tools to streamline continuous benchmarking.

  • Cross-Functional Collaboration: Document test methodologies, communicate performance findings, and provide actionable improvement recommendations to hardware, software, and networking stakeholders.

Required Qualifications
  • Education: Bachelor's / Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field plus 12+ years / 10+ years related industry experience.

  • OS Expertise: Deep familiarity and hands-on experience with Linux operating systems, including system-level performance tuning and troubleshooting.

  • Programming Skills: Strong proficiency in programming and scripting languages, specifically Python and C++.

  • AI/ML Knowledge: Familiarity with modern machine learning frameworks, particularly PyTorch, and a solid understanding of how AI models consume compute and network resources.

  • Networking & Fabric: Proven experience in performance testing and validating Ethernet switch systems.

  • Analytical Capabilities: Extensive experience with performance metrics, profiling, and benchmarking tools. Strong problem-solving skills with a proven ability to diagnose root causes in complex, distributed systems.

Preferred Qualifications (Optional but recommended for a critical role)
  • Experience with RDMA (Remote Direct Memory Access) and RoCEv2 (RDMA over Converged Ethernet).

  • Prior experience building CI/CD pipelines for automated hardware or software performance regression testing.

  • Familiarity with containerization and orchestration tools (Docker, Kubernetes) used in AI deployments.

Additional Job Description:

Compensation and Benefits

The annual base salary range for this position is $141,300 - $226,000. 

As a valued member of our team, you'll be eligible for a discretionary annual bonus and the opportunity to receive not only a competitive new hire equity grant, but also annual equity awards, connecting your success directly to the company's growth. All subject to relevant plan documents and award agreements.

Broadcom offers a competitive and comprehensive benefits package: Medical, dental and vision plans, 401(K) participation including company matching, Employee Stock Purchase Program (ESPP), Employee Assistance Program (EAP), company paid holidays, paid sick leave and vacation time. The company follows all applicable laws for Paid Family Leave and other leaves of absence.

Broadcom is proud to be an equal opportunity employer.  We will consider qualified applicants without regard to race, color, creed, religion, sex, sexual orientation, national origin, citizenship, disability status, medical condition, pregnancy, protected veteran status or any other characteristic protected by federal, state, or local law.  We will also consider qualified applicants with arrest and conviction records consistent with local law.

If you are located outside USA, please be sure to fill out a home address as this will be used for future correspondence.

Skills Required

  • Bachelor's / Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field
  • 12+ years / 10+ years related industry experience
  • Deep familiarity and hands-on experience with Linux operating systems
  • Strong proficiency in programming and scripting languages, specifically Python and C++
  • Familiarity with modern machine learning frameworks, particularly PyTorch
  • Proven experience in performance testing and validating Ethernet switch systems
  • Extensive experience with performance metrics, profiling, and benchmarking tools

Broadcom Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Broadcom and has not been reviewed or approved by Broadcom.

  • Equity Value & Accessibility Equity is used broadly through RSUs with quarterly or annual vesting, and an ESPP with a discount and look‑back that can add meaningful upside. Company disclosures show ongoing equity grants, including inducement RSUs tied to acquisitions, underscoring equity’s central role in total rewards.
  • Retirement Support A 401(k) plan with a competitive company match and immediate vesting is consistently highlighted, supporting long‑term savings. Tax‑advantaged accounts like HSA/FSA further strengthen the financial wellness toolkit.
  • Pay Growth & Progression Compensation ceilings in technical tracks are described as high, with wide ranges and very strong totals for experienced engineers. Sales compensation is also characterized as competitive, supporting attractive on‑target earnings.

Broadcom Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Jose, CA
38,985 Employees
Year Founded: 1991

What We Do

Broadcom Inc. (NASDAQ: AVGO) is a global technology leader that designs, develops and supplies semiconductor and infrastructure software solutions.

Similar Jobs

NVIDIA Logo NVIDIA

Systems Performance Engineer, Agentic AI Workloads – New College Grad 2026

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office
3 Locations
21960 Employees
124K-242K Annually

NVIDIA Logo NVIDIA

Software Engineer

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office or Remote
Santa Clara, CA, USA
21960 Employees
224K-357K Annually

SambaNova Systems Logo SambaNova Systems

Senior AI Systems Performance Engineer

Artificial Intelligence • Hardware • Machine Learning • Natural Language Processing • Software • Generative AI
In-Office
San Jose, CA, USA
500 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account