# AI/ML Silicon Accelerator Memory Architect

Posted Yesterday
Be an Early Applicant
San Jose, CA, USA
In-Office
200K-320K Annually
Expert/Leader
Software • Semiconductor • Manufacturing
The Role
Defines multi-generation memory and data-transport architecture for AI/ML accelerator silicon. Owns HBM, DDR-family, SRAM, controllers, caches, scratchpads, on-die interconnects, DMA engines, and workload-driven performance and power tradeoffs. Leads architecture across silicon generations, vendors, and internal teams, using analytical and simulation models to optimize bandwidth, latency, scalability, and energy per bit.
Summary Generated by Built In

Please Note:

1. If you are a first time user, please create your candidate login account before you apply for a job. (Click Sign In > Create Account)

2. If you already have a Candidate Account, please Sign-In before you apply.

Job Description:

### Memory Subsystems and Low-Power Data Transport

**Level:** Principal Architect/Distinguished Architect

**Function:** Silicon Architecture — AI/ML Accelerators

---

## The Role

You will define the end-to-end memory *and* data transport architecture for our

accelerators — from the memory technology we bet on, through the controller, on-die network,

and DMA engines, all the way into the scratchpads feeding the compute blocks. This is not a

"pick the DRAM generation" role. It is ownership of the whole data path across multiple

silicon generations, including the performance-versus-power analysis that decides major

trade-offs and the co-architecture with internal teams and external memory/IP vendors.

---

## What You'll Own

**Memory architecture and roadmap.** Multi-generation memory strategy across the portfolio —

HBM, LPDDR/GDDR/DDR, on-die SRAM hierarchies and scratchpads.

Capacity, bandwidth, and latency requirements derived from real AI workloads

(model size, KV-cache growth, prefill versus decode, MoE sparsity). Memory controller and

cache/scratchpad microarchitecture: scheduling, address mapping, QoS across compute, DMA,

and host traffic.

**Data transport and energy-efficient movement.** The complete path from memory to the MACs:

on-die interconnect (topology, flow control, deadlock avoidance, QoS under mixed traffic),

and the DMA, gather/scatter, layout-transform, and multicast engines that make it usable.

You own the pJ/bit budget as a first-class constraint.

**Modeling and silicon realization.** Analytical and simulation-based models that make

architectural calls with quantified confidence.

## Minimum Qualifications

- MSEE/MSCE or PhD in EE, CE, CS, or related field, or equivalent demonstrated

  architectural impact.

- 18+ years in ASIC/SoC architecture focused on memory systems and data movement for HPC or

  AI. Deep knowledge of memory subsystems: HBM, DDR/LPDDR/GDDR, controller architecture, cache

  coherency and memory consistency models, tiered and pooled memory.

- Demonstrated ownership of a data movement architecture — on-die interconnect, DMA/copy

  engines, buffer hierarchies, and the dataflow connecting them to compute — including what

  each protocol (NVLink, UALink, RDMA, ARM CHI, UCIe, PCIe) actually costs in latency, area, and power.

- Strong performance modeling and system-level simulation background; first-principles

  command of latency, throughput, utilization, and scalability.


Compensation and Benefits


The annual base salary range for this position is USD 200,000.00 To USD 320,000.00

As a valued member of our team, you'll be eligible for a discretionary annual bonus and the opportunity to receive not only a competitive new hire equity grant, but also annual equity awards, connecting your success directly to the company's growth. All subject to relevant plan documents and award agreements.


Broadcom offers a competitive and comprehensive benefits package: Medical, dental and vision plans, 401(K) participation including company matching, Employee Stock Purchase Program (ESPP), Employee Assistance Program (EAP), company paid holidays, paid sick leave and vacation time. The company follows all applicable laws for Paid Family Leave and other leaves of absence.


Broadcom is proud to be an equal opportunity employer.  We will consider qualified applicants without regard to race, color, creed, religion, sex, sexual orientation, national origin, citizenship, disability status, medical condition, pregnancy, protected veteran status or any other characteristic protected by federal, state, or local law.  We will also consider qualified applicants with arrest and conviction records consistent with local law.


If you are located outside USA, please be sure to fill out a home address as this will be used for future correspondence.

Skills Required

  • MSEE, MSCE, PhD in electrical engineering, computer engineering, computer science, or related field, or equivalent architectural impact
  • 18+ years of ASIC or SoC architecture experience focused on memory systems and data movement for HPC or AI
  • Deep knowledge of HBM, DDR, LPDDR, GDDR, memory controller architecture, cache coherency, memory consistency, tiered memory, and pooled memory
  • Demonstrated ownership of data movement architecture, including on-die interconnects, DMA or copy engines, buffer hierarchies, and compute dataflows
  • Knowledge of NVLink, UALink, RDMA, ARM CHI, UCIe, and PCIe, including latency, area, and power tradeoffs
  • Strong performance modeling and system-level simulation background
  • First-principles command of latency, throughput, utilization, and scalability

Broadcom Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Broadcom and has not been reviewed or approved by Broadcom.

  • Equity Value & Accessibility — Equity awards such as RSUs and an ESPP can substantially increase total compensation, particularly in technical and senior roles. Stock-based pay is often a major component of earnings and can make offers especially attractive when shares perform well.
  • Retirement Support — A 401(k) match reportedly up to 6% with immediate vesting strengthens long-term savings. This feature provides clear value for employees prioritizing retirement contributions.
  • Healthcare Strength — Offerings include medical, dental, vision, mental-health coverage and HSA/FSA options, alongside fertility, adoption, childcare benefits, and caregiver leave. This breadth signals a comprehensive set of health and family supports.

Broadcom Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Palo Alto, CA
38,985 Employees
Year Founded: 1991

What We Do

Broadcom Inc. (NASDAQ: AVGO) is a global technology leader that designs, develops and supplies semiconductor and infrastructure software solutions.

Similar Jobs

Motive Logo Motive

Technical Program Manager

Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Easy Apply
In-Office
San Francisco, CA, USA
4000 Employees
140K-200K Annually

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Temporary Associate

eCommerce • Fashion • Retail • Sales • Wearables • Design
Hybrid
San Diego, CA, USA
16000 Employees
15-20 Hourly

General Motors Logo General Motors

Engineering Manager

Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Remote or Hybrid
Sunnyvale, CA, USA
165000 Employees
219K-335K Annually

General Motors Logo General Motors

Senior Engineering Manager

Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Hybrid
Sunnyvale, CA, USA
165000 Employees
296K-454K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
Glendale, Kentucky
55 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account