AI SOC Architect

Posted 3 Hours Ago
Be an Early Applicant
Los Altos, CA, USA
In-Office
Expert/Leader
Software
The Role
Lead architecture and integration of RISC-V-based AI compute clusters and vector engines. Define ISA extensions, memory subsystems, interconnects, task-mapping and scheduling, and performance/debug features. Collaborate with compiler, ML runtime, RTL, verification, and firmware teams to optimize performance-per-watt and scalability across silicon generations.
Summary Generated by Built In
Description

Role Description

We are seeking an experienced SoC Architect – AI Acceleration (RISC-V and Compute Cluster Development) to lead the architecture and integration of Majestic’s compute subsystem.

In this role, you will define and optimize the RISC-V–based compute clusters, vector engines, and shared memory structures that power high-performance AI workloads.

You’ll collaborate closely with design, verification, compiler, and ML software teams to define architectures that maximize performance per watt while ensuring scalability across multiple generations of silicon.

This is a hands-on technical leadership role for an architect who thrives at the intersection of hardware design, parallel compute, and AI acceleration.

What You’ll Do

  • Architect and define RISC-V compute clusters, including multi-core integration, interconnects, and memory subsystems.
  • Design matrix multiplication and vector processing engines optimized for neural network and ML kernels.
  • Define the ISA extensions, microarchitecture, and system-level interfaces supporting AI acceleration.
  • Develop strategies for compute task mapping, thread scheduling, and shared cache (L3) utilization.
  • Collaborate with compiler and ML runtime teams to ensure software–hardware co-optimization.
  • Evaluate performance and power trade-offs across workloads using simulation and modeling.
  • Define debug, trace, and performance-monitoring features at the compute-subsystem level.
  • Work with SoC, memory, and I/O architects to ensure cohesive dataflow and system efficiency.
  • Provide specifications and technical guidance for RTL, verification, and firmware implementation teams.
Requirements

What We’re Looking For

  • Bachelor’s or Master’s in Electrical Engineering, Computer Engineering, or related field.
  • 10+ years of experience in SoC or compute architecture, with a focus on AI acceleration or high-performance compute.
  • Deep understanding of RISC-V architecture, vector extensions, and parallel compute design.
  • Experience with multi-core cluster integration, shared memory hierarchies, and cache coherency protocols.
  • Familiarity with matrix multiplication engines, SIMD/vector processors, and AI kernel optimization.
  • Strong background in embedded systems architecture, system-level performance modeling, and debug methodologies.
  • Excellent analytical, problem-solving, and communication skills

Ways to Stand Out from the Crowd

  • Experience designing custom RISC-V ISA extensions or AI-specific compute units.
  • Hands-on work in neural network mapping, tiling, and kernel scheduling.
  • Familiarity with AXI, UALINK, HBM, or chiplet-based architectures for scalable AI compute.
  • Contributions to open-source RISC-V or AI compute frameworks.
  • Proven success in first-silicon AI or HPC SoC programs.
  • Understanding of compiler design and low-level ML operator optimization.

Skills Required

  • Bachelor's or Master's in Electrical Engineering, Computer Engineering, or related field
  • 10+ years experience in SoC or compute architecture focused on AI acceleration or high-performance compute
  • Deep understanding of RISC-V architecture and vector extensions
  • Experience with multi-core cluster integration, shared memory hierarchies, and cache coherency protocols
  • Familiarity with matrix multiplication engines, SIMD/vector processors, and AI kernel optimization
  • Strong background in embedded systems architecture, system-level performance modeling, and debug methodologies
  • Experience specifying RTL, verification, and firmware requirements for compute subsystems
  • Collaboration experience with compiler and ML runtime teams for software-hardware co-optimization
  • Experience designing custom RISC-V ISA extensions or AI-specific compute units
  • Hands-on experience in neural network mapping, tiling, and kernel scheduling
  • Familiarity with AXI, UALINK, HBM, or chiplet-based architectures for scalable AI compute
  • Proven success in first-silicon AI or HPC SoC programs
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
55 Employees
Year Founded: 2023

What We Do

Majestic Labs is reimagining AI infrastructure for the world’s most demanding workloads. Today, organizations are forced to overprovision expensive compute just to access the required memory their models need. We took a fundamentally different approach by pairing a massive amount of compute with 1000x the memory to create game changing improvements in performance, power and deployment efficiency. Our customers can literally replace racks of traditional AI infrastructure with a single Majestic server.

Similar Jobs

NVIDIA Logo NVIDIA

Architect

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office
Santa Clara, CA, USA
21960 Employees
272K-431K Annually

Headway Logo Headway

Senior Product Designer

Consumer Web • Healthtech • Professional Services • Social Impact • Software
Easy Apply
In-Office or Remote
3 Locations
819 Employees
180K-225K Annually

Xero Logo Xero

Senior Director Product & Technology Finance

Cloud • Fintech • Information Technology • Machine Learning • Software
Hybrid
San Mateo, CA, USA
4500 Employees
225K-285K Annually

Snap Inc. Logo Snap Inc.

Operations Associate

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
2 Locations
5000 Employees
91K-161K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
31 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account