AI SoC Architect Networking

Posted One Month Ago
Be an Early Applicant
Los Altos, CA, USA
In-Office
Senior level
Software
The Role
Lead the architectural design of SoC networking, SmartNIC/NIC and switch interface IPs for AI accelerators. Define scale-up/scale-out topologies, hardware offloads for collective operations, optimize transport protocols and congestion control, run performance modeling and simulations, and produce architecture specifications while collaborating across silicon, firmware, and software teams.
Summary Generated by Built In
Description

About Majestic Labs

We’re a fast-moving, US-Israeli AI startup building next-generation infrastructure for the world’s most demanding AI workloads. Our mission is to accelerate the future of intelligence and make it ubiquitously accessible by delivering full stack custom AI servers optimized for large-scale inference and training.

Backed by top-tier investors and led by industry veterans, we’re scaling rapidly. We seek forward-thinking engineers and operators who thrive in a collaborative environment and excel at solving complex challenges from first principles. If you want to build infrastructure that fundamentally changes what the world can accomplish with AI, come join us!

About the position

This is a highly technical and cross-functional role requiring deep expertise in SoC networking, high-speed interconnects, and protocol acceleration for AI. As a SOC System Network Architect for AI, you will lead the definition and architectural design of network engines and interconnect fabrics powering our custom AI servers. You will collaborate closely with silicon architecture, hardware design, firmware, and software teams to shape scale-up and scale-out networking topologies optimized for distributed AI workloads.

Responsibilities

• Architect end-to-end SoC networking engines, SmartNIC/NIC architectures, and switch interface IPs for AI accelerators

• Define scale-up (intra-node) and scale-out (inter-node) network topologies 

• Design hardware acceleration and offload engines for AI collective operations (e.g., AllReduce, AllGather, AllToAll) directly on the network fabric

• Optimize transport protocols (RoCEv2, custom RDMA engines, TCP/UDP offloads) and adaptive routing/congestion control algorithms (e.g., DCQCN) for synchronized AI traffic flows

• Drive performance modeling, cycle-accurate simulations, and traffic pattern analysis to evaluate architectural trade-offs across network fabrics

• Collaborate with ASIC design, silicon architecture, and AI software teams to define hardware/software interfaces, register abstractions, and programming models

• Produce high-quality network architecture specifications, interface documents, and lead cross-functional architecture reviews

Requirements

• 7+ years of hands-on network architecture, SoC interconnect design, or silicon engineering experience, with at least 3 years in an architecture or technical lead capacity

• B.Sc. or M.Sc. in Electrical Engineering, Computer Engineering, or Computer Science

• Proven track record of owning and delivering complex network ASICs, NIC engines, or switch architectures from initial concept through silicon bring-up

Core Technical Skills

• Deep expertise in SmartNIC/NIC architecture, RDMA technologies (RoCEv2, InfiniBand), and hardware transport protocol engines

• Strong understanding of scale-up and scale-out topologies, high-speed packet processing, and switch architecture trade-offs

• In-depth knowledge of AI communication patterns and hardware acceleration for network collective operations

• Solid foundation in lower-level network protocols (TCP/UDP, Ethernet, IP) and advanced network congestion control mechanisms

• Proficiency in network performance modeling, hardware simulation tools, and architectural trade-off analysis

Preferred Qualifications

• Experience with high-speed proprietary interconnects (e.g., NVLink, NVSwitch, UALink, CXL) or custom switch silicon

• Hands-on experience with network simulation and modeling frameworks (e.g., ns-3, OMNeT++, SystemC/TLM)

• Familiarity with distributed AI communication libraries (e.g., NCCL, RCCL) and frameworks (PyTorch, DeepSpeed)

We seek smart, curious, self-driven individuals who enjoy creative problem-solving and continuous learning. Even if you don't meet all requirements, we'd love to hear from you if you have the mindset to tackle complex challenges.

Majestic Labs is an equal opportunity employer deeply committed to diversity of background and thought. If you are ready to dare greatly, learn from mistakes, engage in vigorous debates, and help create a step-function shift in human technical capability, we want to meet you!

Skills Required

  • 7+ years of hands-on network architecture, SoC interconnect design, or silicon engineering experience
  • At least 3 years in an architecture or technical lead capacity
  • B.Sc. or M.Sc. in Electrical Engineering, Computer Engineering, or Computer Science
  • Proven track record of owning and delivering complex network ASICs, NIC engines, or switch architectures from concept through silicon bring-up
  • Deep expertise in SmartNIC/NIC architecture and RDMA technologies (RoCEv2, InfiniBand)
  • Strong understanding of scale-up and scale-out topologies, high-speed packet processing, and switch architecture trade-offs
  • Design hardware acceleration and offload engines for AI collective operations (AllReduce, AllGather, AllToAll)
  • Solid foundation in lower-level network protocols (TCP/UDP, Ethernet, IP) and advanced congestion control mechanisms (e.g., DCQCN)
  • Proficiency in network performance modeling, cycle-accurate simulations, and hardware simulation tools
  • Experience with high-speed proprietary interconnects (NVLink, NVSwitch, UALink, CXL)
  • Hands-on experience with network simulation and modeling frameworks (ns-3, OMNeT++, SystemC/TLM)
  • Familiarity with distributed AI communication libraries and frameworks (NCCL, RCCL, PyTorch, DeepSpeed)
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
55 Employees
Year Founded: 2023

What We Do

Majestic Labs is reimagining AI infrastructure for the world’s most demanding workloads. Today, organizations are forced to overprovision expensive compute just to access the required memory their models need. We took a fundamentally different approach by pairing a massive amount of compute with 1000x the memory to create game changing improvements in performance, power and deployment efficiency. Our customers can literally replace racks of traditional AI infrastructure with a single Majestic server.

Similar Jobs

SOPHiA GENETICS Logo SOPHiA GENETICS

Associate Director / Sr Manager, BioPharma Business Development (West / Central)

Artificial Intelligence • Big Data • Healthtech • Software • Biotech
Remote or Hybrid
4 Locations
450 Employees

PNC Bank Logo PNC Bank

Technology Solution Center Analyst Lead

Machine Learning • Payments • Security • Software • Financial Services
Remote or Hybrid
USA
55000 Employees
41K-83K Annually

PNC Bank Logo PNC Bank

Software Engineer

Machine Learning • Payments • Security • Software • Financial Services
Remote or Hybrid
USA
55000 Employees

Shield AI Logo Shield AI

Business Systems Analyst

Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software
In-Office
San Mateo, CA, USA
140K-210K Annually

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account