Head of Platform Software

Posted 5 Days Ago
Be an Early Applicant
Santa Clara, CA, USA
Hybrid
220K-330K Annually
Expert/Leader
Artificial Intelligence • Machine Learning • Software
The Role
Leads the platform software organization responsible for rack-scale AI accelerator bring-up, device and link discovery, health monitoring, fault handling, firmware and BMC integration, telemetry, diagnostics, and fleet tooling. Defines interfaces with fabric managers, runtimes, and schedulers; drives platform readiness through production handoff; and hires and develops the engineering team. Requires extensive systems infrastructure experience, platform delivery leadership, and expertise in BMC, firmware, and out-of-band management.
Summary Generated by Built In

Join d-Matrix and help build the future of AI inference. We’ve pioneered a memory-centric architecture that brings compute directly into memory, making AI faster, more energy efficient, and accessible on a global scale. From chips and software to rack-scale systems, our team is tackling some of AI infrastructure’s hardest challenges — and shipping breakthrough technology today. If you want to create what comes next and help make infinite inference possible, we’d love to hear from you.

Our culture is built on respect, collaboration, and direct communication. We value humility, we believe our different perspectives lead to better solutions, and we’re looking for people who are driven by execution and energized by hard problems.

Role Overview

The platform software layer sits between hardware bring-up and the workload stack. It determines whether a rack-scale AI accelerator system powers on, joins its fabric, passes validation, and stays healthy in the field. As the senior leader of platform software, you will own the physical platform layer: device and link discovery, health, fault detection, readiness gating, firmware and BMC integration, and bring-up and fleet tooling. You will build the team that delivers it and publish a clean, versioned interface to the fabric manager, runtime, and schedulers above it. You will partner closely with hardware, runtime, diagnostics, validation, deployment, operations, and product teams.

What you will do

  • Own node, rack, and cluster bring-up software, including discovery, provisioning, configuration, and readiness gating before any workload traffic, in partnership with the fabric software team.

  • Define and maintain a versioned interface between the platform layer and the workload stack (fabric manager, runtime, and schedulers), with explicit state transitions and events pushed to consumers rather than inferred.

  • Own device and link discovery and health, and publish normalized state and events for devices and links across their lifecycle.

  • Drive fault detection and classification, including severity-based handling, escalation paths, and hand-offs to recovery owners and data center operations.

  • Own firmware, BMC, and low-level platform software integration, packaging, and update flows.

  • Deliver health telemetry, diagnostics integration, and fleet monitoring for deployed clusters, and integrate with orchestration so the platform layer owns device and fabric readiness.

  • Build tooling and recipes to turn up, stabilize, and hand off initial clusters to production operations at a defined readiness threshold, with feedback loops to hardware, diagnostics, manufacturing, and field teams.

  • Hire and lead the platform software team, owning technical direction, milestones, quality, and on-call, and turn architecture into owned, dated deliverables.

What you will bring

  • Bachelor’s degree in Computer Science, Electrical or Computer Engineering, or a related field, or equivalent practical experience.

  • 12+ years in systems software, including substantial experience with rack-scale, cluster-scale, or large server infrastructure.

  • Track record of taking a platform or infrastructure program from design to shipped software with milestones.

  • Depth in several of the following: hardware bring-up, device and firmware interfaces, BMC and out-of-band management, fleet management, and fault handling.

  • Hands-on experience with BMC and out-of-band management standards (Redfish, OpenBMC, PLDM) and firmware update frameworks.

  • Experience building and leading engineering teams, including hiring, growing leaders, and managing cross-functional dependencies.

  • Strong judgment in interface and contract design between systems layers.

Preferred Qualifications

  • Master’s degree in a related field.

  • Experience with accelerator or GPU infrastructure, including taking a new hardware platform from early silicon through first customer deployments.

  • Experience with high-speed interconnect and fabric software such as PCIe, NVLink-class, CXL, RDMA, InfiniBand, or Ethernet-based fabrics

  • Experience with Kubernetes, device plugins, and cluster lifecycle tooling.

Equal Opportunity Employment Policy

d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication, and a willingness to embrace challenges and learn together every day.

d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individuals interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of all applicants. Thank you for your understanding and cooperation.

Skills Required

  • Bachelor's degree in Computer Science, Electrical Engineering, Computer Engineering, or a related field, or equivalent practical experience
  • 12+ years of experience in systems software, including substantial rack-scale, cluster-scale, or large server infrastructure experience
  • Track record of taking a platform or infrastructure program from design through shipped software with milestones
  • Depth in hardware bring-up, device and firmware interfaces, BMC and out-of-band management, fleet management, and fault handling
  • Hands-on experience with Redfish, OpenBMC, PLDM, and firmware update frameworks
  • Experience building and leading engineering teams, including hiring, developing leaders, and managing cross-functional dependencies
  • Strong judgment in interface and contract design between systems layers
  • Master's degree in a related field
  • Experience with accelerator or GPU infrastructure, from early silicon through first customer deployments
  • Experience with PCIe, NVLink-class, CXL, RDMA, InfiniBand, or Ethernet-based fabrics
  • Experience with Kubernetes, device plugins, and cluster lifecycle tooling
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
102 Employees

What We Do

d-Matrix is building a new way of doing datacenter AI inferencing using in-memory computing (IMC) techniques with chiplet level scale-out interconnects. Founded in 2019, d-Matrix has attacked the physics of memory-compute integration using innovative circuit techniques, ML tools, software and algorithms; solving the memory-compute integration problem, which is the final frontier in AI compute efficiency.

Similar Jobs

Pfizer Logo Pfizer

Director, Solution Engineer, Data Storage and Registration

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
13 Locations
121990 Employees
147K-272K Annually

Pfizer Logo Pfizer

Senior Computational Chemist

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Hybrid
La Jolla, CA, USA
121990 Employees
106K-177K Annually

Pfizer Logo Pfizer

Sr. Manager, Solution Engineer, Visualization, Analytics & Collaboration

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
13 Locations
121990 Employees
112K-207K Annually

Capital One Logo Capital One

Machine Learning Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
4 Locations
55000 Employees
269K-335K Annually

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account