AI Systems Performance Engineer

Reposted 2 Months Ago
Be an Early Applicant
San Jose, CA, USA
In-Office
141K-226K Annually
Senior level
Software • Semiconductor • Manufacturing
The Role
As a Senior AI Systems Performance Engineer, you will benchmark AI workloads, optimize Ethernet fabric performance, and troubleshoot system bottlenecks, focusing on delivering actionable insights across teams.
Summary Generated by Built In

Please Note:

1. If you are a first time user, please create your candidate login account before you apply for a job. (Click Sign In > Create Account)

2. If you already have a Candidate Account, please Sign-In before you apply.

Job Description:

Senior AI Network Performance Engineer (NIC / Host Networking)

We are seeking an experienced Senior AI Network Performance Engineer to join the Performance Lab within our Architecture group. You will benchmark AI inference, training, and storage workloads on GPU clusters, with a focus on NIC and host networking performance. Your reports will guide customers in deployment and help our marketing team position the product.
Your primary focus will be the server side of the network: the NIC, its drivers, and the host stack that connects AI workloads to the fabric. You will run rigorous benchmarks, isolate bottlenecks, and tune for maximum throughput and minimum latency. If you have gone deep on NIC performance, built or operated AI clusters, or run inference serving at scale, we want to hear from you.

Key Responsibilities

Benchmarking: Install, configure, and run AI performance benchmarks, including MLPerf (Training and Inference) and NCCL collective communication tests.
NIC and host tuning: Optimize NIC, driver, and host network settings (RDMA/RoCEv2, congestion control, queue and interrupt configuration, NUMA placement) for distributed AI workloads.
Debugging: Isolate performance bottlenecks across the Linux OS, server hardware, NICs, and the network.
Automation: Build tools and frameworks that make benchmarking repeatable.
Communication: Document test methodologies and present findings and recommendations to hardware, software, and networking teams.

Required Qualifications

Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field. We typically look for 12+ years of related industry experience, but candidates with fewer years and an exceptional track record are encouraged to apply.
Strong hands-on Linux experience, including system-level performance tuning and troubleshooting.
Proficiency in Python or a similar scripting language.
Deep experience in at least one of the following:
NIC / host networking: performance tuning or validation of high-speed NICs, drivers, or RDMA/RoCEv2.
AI cluster building: bringing up and tuning multi-node GPU clusters, including collective communication libraries such as NCCL.
Proven ability to diagnose root causes of performance problems in distributed systems.

Preferred Qualifications

Experience in more than one of the three areas above.
Experience with MLPerf Training or Inference.
Familiarity with Ethernet switch and fabric behavior (PFC, ECN, load balancing).
Experience with Docker, Kubernetes, or Slurm in AI deployments.
Experience building CI/CD pipelines for performance regression testing.


Must have authorization to work in the US.


Compensation and Benefits


The annual base salary range for this position is USD 143,800.00 To USD 230,000.00

As a valued member of our team, you'll be eligible for a discretionary annual bonus and the opportunity to receive not only a competitive new hire equity grant, but also annual equity awards, connecting your success directly to the company's growth. All subject to relevant plan documents and award agreements.


Broadcom offers a competitive and comprehensive benefits package: Medical, dental and vision plans, 401(K) participation including company matching, Employee Stock Purchase Program (ESPP), Employee Assistance Program (EAP), company paid holidays, paid sick leave and vacation time. The company follows all applicable laws for Paid Family Leave and other leaves of absence.


Broadcom is proud to be an equal opportunity employer.  We will consider qualified applicants without regard to race, color, creed, religion, sex, sexual orientation, national origin, citizenship, disability status, medical condition, pregnancy, protected veteran status or any other characteristic protected by federal, state, or local law.  We will also consider qualified applicants with arrest and conviction records consistent with local law.


If you are located outside USA, please be sure to fill out a home address as this will be used for future correspondence.

Skills Required

  • Bachelor's / Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field
  • 12+ years / 10+ years related industry experience
  • Deep familiarity and hands-on experience with Linux operating systems
  • Strong proficiency in programming and scripting languages, specifically Python and C++
  • Familiarity with modern machine learning frameworks, particularly PyTorch
  • Proven experience in performance testing and validating Ethernet switch systems
  • Extensive experience with performance metrics, profiling, and benchmarking tools

Broadcom Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Broadcom and has not been reviewed or approved by Broadcom.

  • Equity Value & Accessibility — Equity is used broadly through RSUs with quarterly or annual vesting, and an ESPP with a discount and look‑back that can add meaningful upside. Company disclosures show ongoing equity grants, including inducement RSUs tied to acquisitions, underscoring equity’s central role in total rewards.
  • Retirement Support — A 401(k) plan with a competitive company match and immediate vesting is consistently highlighted, supporting long‑term savings. Tax‑advantaged accounts like HSA/FSA further strengthen the financial wellness toolkit.
  • Pay Growth & Progression — Compensation ceilings in technical tracks are described as high, with wide ranges and very strong totals for experienced engineers. Sales compensation is also characterized as competitive, supporting attractive on‑target earnings.

Broadcom Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Palo Alto, CA
38,985 Employees
Year Founded: 1991

What We Do

Broadcom Inc. (NASDAQ: AVGO) is a global technology leader that designs, develops and supplies semiconductor and infrastructure software solutions.

Similar Jobs

Boeing Logo Boeing

Experienced Data Product Lifecycle Management Analyst

Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
In-Office
Edwards Air Force Base, CA, USA
170000 Employees
96K-130K Annually

Boeing Logo Boeing

Systems Engineer

Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
In-Office
Seal Beach, CA, USA
170000 Employees
153K-207K Annually

Boeing Logo Boeing

Lead Wire Design & Install Engineer

Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
In-Office
El Segundo, CA, USA
170000 Employees
146K-198K Annually

Boeing Logo Boeing

Senior Wire Design and Install Engineer

Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
In-Office
El Segundo, CA, USA
170000 Employees
177K-239K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
55 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account