Compiler Engineer (PyTorch / Triton / LLVM / MLIR)

Posted Yesterday
Be an Early Applicant
Los Altos, CA, USA
In-Office
Senior level
Software
The Role
Design, implement, and optimize compiler components for AI workloads using PyTorch, Triton, LLVM, and MLIR. Build IRs, codegen passes, and performance-tuned kernels for CPUs, GPUs, and custom accelerators. Contribute upstream to open-source projects and collaborate cross-functionally to enable scalable, high-performance deployment across diverse hardware.
Summary Generated by Built In
Description

Role Description:

We are looking for an experienced, highly skilled and motivated Senior Compiler Engineer to join our compiler team. In this role, you will be responsible for designing, developing, and maintaining critical components of our AI-driven compilation stack. You will work on PyTorch, Triton, LLVM, and MLIR to build robust, scalable, and high-performance solutions for diverse

hardware backends. This is a hands-on technical position where you will solve complex problems, optimize for performance, and contribute to the next generation of our technology.

What You’ll Do:

  • Design, Implement, and Optimize Compiler Components: Architect and develop critical compiler modules to efficiently translate and optimize AI models for deployment across a variety of hardware platforms, including CPUs, GPUs, and emerging custom accelerators
  • Enhance and unify PyTorch Inductor, Triton, LLVM, and MLIR toolchains to support cutting-edge architectures, facilitate seamless interoperability, and enable rapid experimentation with new compiler features
  • Create and maintain custom IRs, code generation passes, and optimization strategies tailored for AI workloads, focusing on both general and domain-specific improvements
  • Profile and tune computational kernels—such as linear algebra operations, matrix multiplications, and elementwise computations—to achieve optimal performance, scalability, and resource efficiency on diverse hardware
  • Open-Source Engagement: Actively contribute to the LLVM, MLIR, Triton, and PyTorch open-source projects, sharing improvements, collaborating with the developer community, and driving the evolution of the AI compiler ecosystem
Requirements

What We’re Looking For:

  • Bachelor’s or Master’s in Computer Science, Computer Engineering, or a related field from a recognized university
  • 7+ years experience in compiler engineering or closely related fields
  • Deep knowledge of LLVM and MLIR internals, including IR transformations, code generation, and backend optimization techniques
  • Experience with PyTorch (Inductor/Dynamo) and Triton, including their compiler subsystems
  • Proven experience and expertise in C/C++ programming
  • Demonstrated expertise in performance optimization, including vectorization, parallelization, and hardware-specific tuning
  • Advanced debugging, analytical, and system-level thinking skills
  • Excellent communication skills with a strong track record of cross-functional collaboration

Ways to Stand Out from the Crowd:

  • Strong understanding of AI models — both training and inference pipelines
  • Experience developing compiler support for custom hardware accelerators, including ASICs, FPGAs, or novel AI chips
  • Active contributions to open-source compiler frameworks, demonstrating leadership and community involvement
  • Familiarity with distributed training strategies, graph compilers, and advanced memory models

Skills Required

  • Bachelor's or Master's in Computer Science, Computer Engineering, or related field
  • 7+ years experience in compiler engineering or closely related fields
  • Deep knowledge of LLVM and MLIR internals, including IR transformations, code generation, and backend optimization techniques
  • Experience with PyTorch (Inductor/Dynamo) and Triton, including their compiler subsystems
  • Proven experience and expertise in C/C++ programming
  • Demonstrated expertise in performance optimization, including vectorization, parallelization, and hardware-specific tuning
  • Advanced debugging, analytical, and system-level thinking skills
  • Excellent communication skills and cross-functional collaboration experience
  • Strong understanding of AI models (training and inference pipelines)
  • Experience developing compiler support for custom hardware accelerators (ASICs, FPGAs, novel AI chips)
  • Active contributions to open-source compiler frameworks (LLVM, MLIR, Triton, PyTorch)
  • Familiarity with distributed training strategies, graph compilers, and advanced memory models
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
55 Employees
Year Founded: 2023

What We Do

Majestic Labs is reimagining AI infrastructure for the world’s most demanding workloads. Today, organizations are forced to overprovision expensive compute just to access the required memory their models need. We took a fundamentally different approach by pairing a massive amount of compute with 1000x the memory to create game changing improvements in performance, power and deployment efficiency. Our customers can literally replace racks of traditional AI infrastructure with a single Majestic server.

Similar Jobs

Hybrid
San Francisco, CA, USA
897 Employees
240K-325K Annually

Vercel Logo Vercel

Head of Workplace Strategy & Operations

Artificial Intelligence • Cloud • Software
Easy Apply
Hybrid
San Francisco, CA, USA
220K-265K Annually

Datadog Logo Datadog

Senior Engineer

Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
3 Locations
6500 Employees
194K-237K Annually

CrowdStrike Logo CrowdStrike

VP, Americas Alliances & Channels (Remote)

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
5 Locations
10000 Employees
200K-340K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
31 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account