Staff ML Engineer - Infrastructure

Posted 16 Days Ago
San Jose, CA
In-Office
Senior level
Semiconductor
The Role
Join ChipStack as an ML Infrastructure Engineer, building core ML infrastructure for training and deploying LLMs, collaborating with chip designers and ML scientists.
Summary Generated by Built In

About Us

Chips are at the center of today's tech-driven world. But how we design them has not changed in decades, while their complexity and specialization have skyrocketed due to increasing performance demands from applications like AI. We want to change that.

Our team is small, technical, and fast-moving. We’ve built and shipped at the intersection of AI, EDA, and systems software, with deep roots at companies like Qualcomm, Nvidia, Google, Meta, and the Allen Institute for AI. We’re backed by top investors including Khosla Ventures, Cerberus, and Clear Ventures, and already deployed with 10+ innovative customers—from Fortune 100s to cutting-edge AI silicon startups.

About This Role

This role offers a unique opportunity to be part of the founding team at ChipStack, where we are reinventing how modern silicon chips are designed. You will work alongside highly experienced chip designers who have built complex chips, ML scientists who have trained LLMs at scale, and top-notch infrastructure and software engineers. You will get to leverage your experience building ML and data infrastructure and apply it to some of the hardest problems in chip design.

About You

You want to be at a startup because you love to be at the center of all the dynamism that a startup offers.
You are willing to put in the hours and go the extra mile to ensure every customer has an exceptional experience.
You are self-motivated with a sense of urgency and can operate independently without much guidance.
You are not afraid of difficult problems and enjoy venturing into areas you have not explored before.

This Role

We’re looking for a strong, experienced ML Infrastructure Engineer to join our founding team. We are seeking someone with experience designing and scaling ML infrastructure and training systems. You’ll be responsible for building the core infrastructure that enables training, fine-tuning, evaluation, and deployment of LLMs across cloud and on-premise environments. Your work will directly impact product capabilities and speed of iteration.

What's needed

  • 5+ years of experience in ML infrastructure or adjacent roles

  • Deep expertise in Python and experience with training frameworks like PyTorch or TensorFlow

  • Strong systems engineering skills and experience with distributed training, data pipelines, and performance optimization

  • Experience deploying ML models to production (REST APIs, batch jobs, streaming pipelines)

  • Proficiency with cloud platforms (e.g., GCP, AWS) and containerized systems (Docker, Kubernetes)

  • Experience managing GPU/TPU workloads efficiently

  • Good communication skills and the ability to work directly with engineers and customers

What's good to have

  • Prior experience training or fine-tuning LLMs

  • Experience setting up observability, monitoring, and evaluation pipelines for ML models

  • Exposure to chip design fundamentals (via coursework or elsewhere)

  • Experience at an early-stage startup

Our Culture

Challenge status quo: We are innovators who can challenge the status quo and push forward our vision of the world.
Strong opinions, loosely held: We are low on ego, but high on collaboration. We are okay to be wrong and are always open to learning.
Ship fast, ship quality: We ruthlessly prioritize what matters. We build a few things, but at lightning speed with high quality.
Proud of our craft: Attention to detail is in our DNA. We take pride in what we build and ensure they exceed the high standards of the semiconductor industry.

Top Skills

AWS
Docker
GCP
Kubernetes
Python
PyTorch
TensorFlow
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Campbell, CA
15 Employees

Similar Jobs

Voxel Logo Voxel

Staff Software Engineer

Artificial Intelligence • Security • Software
Hybrid
San Francisco, CA, USA
200K-250K Annually

Snap Inc. Logo Snap Inc.

Staff Software Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
4 Locations
195K-343K Annually

Nuro Logo Nuro

Staff Software Engineer

Artificial Intelligence • Automotive • Information Technology • Robotics
In-Office
Mountain View, CA, USA
167K-303K

Nuro Logo Nuro

Staff Software Engineer

Artificial Intelligence • Automotive • Information Technology • Robotics
In-Office
Mountain View, CA, USA
167K-303K

Similar Companies Hiring

HRL Laboratories Thumbnail
Software • Semiconductor • Machine Learning • Hardware • Computer Vision
Malibu, CA
1050 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account