Compiler Engineer (PyTorch / Triton / LLVM / MLIR)

Reposted 25 Days Ago
Be an Early Applicant
Raanana, ISR
In-Office
Senior level
Software
The Role
Design, implement, and optimize compiler components for AI models targeting CPUs, GPUs, and custom accelerators. Enhance PyTorch Inductor/Dynamo, Triton, LLVM, and MLIR toolchains; create IRs, codegen passes, and performance optimizations; profile and tune kernels; and contribute to open-source projects.
Summary Generated by Built In
Description

About Majestic Labs

We’re a fast-moving, US-Israeli AI startup building next-generation infrastructure for the world’s most demanding AI workloads. Our mission is to accelerate the future of intelligence and make it ubiquitously accessible by delivering full stack custom AI servers optimized for large-scale inference and training.

Backed by top-tier investors and led by industry veterans, we’re scaling rapidly. We seek forward-thinking engineers and operators who thrive in a collaborative environment and excel at solving complex challenges from first principles. If you want to build infrastructure that fundamentally changes what the world can accomplish with AI, come join us!

About the position

We are looking for an experienced, highly skilled and motivated Senior Compiler Engineer to join our compiler team. In this role, you will be responsible for designing, developing, and maintaining critical components of our AI-driven compilation stack. You will work on PyTorch, Triton, LLVM, and MLIR to build robust, scalable, and high-performance solutions for diverse

hardware backends. This is a hands-on technical position where you will solve complex problems, optimize for performance, and contribute to the next generation of our technology.

Responsibilities

  • Design, Implement, and Optimize Compiler Components: Architect and develop critical compiler modules to efficiently translate and optimize AI models for deployment across a variety of hardware platforms, including CPUs, GPUs, and emerging custom accelerators
  • Enhance and unify PyTorch Inductor, Triton, LLVM, and MLIR toolchains to support cutting-edge architectures, facilitate seamless interoperability, and enable rapid experimentation with new compiler features
  • Create and maintain custom IRs, code generation passes, and optimization strategies tailored for AI workloads, focusing on both general and domain-specific improvements
  • Profile and tune computational kernels—such as linear algebra operations, matrix multiplications, and elementwise computations—to achieve optimal performance, scalability, and resource efficiency on diverse hardware
  • Open-Source Engagement: Actively contribute to the LLVM, MLIR, Triton, and PyTorch open-source projects, sharing improvements, collaborating with the developer community, and driving the evolution of the AI compiler ecosystem
Requirements

Requirements

  • Bachelor’s or Master’s in Computer Science, Computer Engineering, or a related field from a recognized university
  • 7+ years experience in compiler engineering or closely related fields
  • Deep knowledge of LLVM and MLIR internals, including IR transformations, code generation, and backend optimization techniques
  • Experience with PyTorch (Inductor/Dynamo) and Triton, including their compiler subsystems
  • Proven experience and expertise in C/C++ programming
  • Demonstrated expertise in performance optimization, including vectorization, parallelization, and hardware-specific tuning
  • Advanced debugging, analytical, and system-level thinking skills
  • Excellent communication skills with a strong track record of cross-functional collaboration

Preferred Qualifications

  • Strong understanding of AI models — both training and inference pipelines
  • Experience developing compiler support for custom hardware accelerators, including ASICs, FPGAs, or novel AI chips
  • Active contributions to open-source compiler frameworks, demonstrating leadership and community involvement
  • Familiarity with distributed training strategies, graph compilers, and advanced memory models

We seek smart, curious, self-driven individuals who enjoy creative problem-solving and continuous learning. Even if you don't meet all requirements, we'd love to hear from you if you have the mindset to tackle complex challenges.

Majestic Labs is an equal opportunity employer deeply committed to diversity of background and thought. If you are ready to dare greatly, learn from mistakes, engage in vigorous debates, and help create a step-function shift in human technical capability, we want to meet you!

Skills Required

  • Bachelor's or Master's in Computer Science, Computer Engineering, or related field
  • 7+ years experience in compiler engineering or closely related fields
  • Deep knowledge of LLVM and MLIR internals, including IR transformations and code generation
  • Experience with PyTorch (Inductor/Dynamo) and Triton compiler subsystems
  • Proven experience and expertise in C/C++ programming
  • Demonstrated expertise in performance optimization (vectorization, parallelization, hardware-specific tuning)
  • Advanced debugging, analytical, and system-level thinking skills
  • Excellent communication skills and cross-functional collaboration
  • Strong understanding of AI models (training and inference pipelines)
  • Experience developing compiler support for custom hardware accelerators (ASICs, FPGAs)
  • Active contributions to open-source compiler frameworks
  • Familiarity with distributed training strategies, graph compilers, and advanced memory models
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
55 Employees
Year Founded: 2023

What We Do

Majestic Labs is reimagining AI infrastructure for the world’s most demanding workloads. Today, organizations are forced to overprovision expensive compute just to access the required memory their models need. We took a fundamentally different approach by pairing a massive amount of compute with 1000x the memory to create game changing improvements in performance, power and deployment efficiency. Our customers can literally replace racks of traditional AI infrastructure with a single Majestic server.

Similar Jobs

ServiceNow Logo ServiceNow

Senior Manager - Product Red Team

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Petah Tikva, ISR
29000 Employees

HiBob Logo HiBob

Marketing Manager

HR Tech • Information Technology • Professional Services • Sales • Software
Remote or Hybrid
Israel
1350 Employees

Milestone Systems Logo Milestone Systems

Infrastructure Engineer

Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Remote or Hybrid
2 Locations
1500 Employees

ServiceNow Logo ServiceNow

Staff Software Engineer

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Hybrid
Petah Tikva, ISR
29000 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account