Software Engineer - Compiler

Sorry, this job was removed at 06:08 p.m. (CST) on Wednesday, Aug 06, 2025
10 Locations
Remote or Hybrid
Machine Learning • Software
The Role
About Us
We believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.

Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at companies like Amazon, Google, Microsoft Research, Nvidia, Intel, Qualcomm, and IBM. Our co-founder and CEO, Gennady Pekhimenko, is a world-renowned expert in ML systems who holds multiple academic and industry research awards from Google, Amazon, Facebook, and VMware.

Overview:
We are seeking highly motivated and skilled compiler engineers to join our team in developing a state-of-the-art compiler for machine learning systems. Are you interested in pushing the frontier of AI programmability and performance? Do you like building kernels and tools that make programs run with the speed of light? As a compiler engineer, you will play a critical role in developing high-performance GPU kernels using the Hidet compiler, extending the compiler with new capabilities, and deploying it in collaboration with peer teams to accelerate LLM inference and training.

Join our team, and help us in our mission to democratize AI for the world!

Responsibilities:

  • Write modular, high-quality code for the Hidet compiler in Python/C++.
  • Implement new and classical compiler optimizations to accelerate the performance of AI workloads on GPU and CPU.
  • Build highly efficient GPU kernels using Hidet Python-based DSL.
  • Write tests and benchmarks to validate and evaluate our solutions.
  • Collaborate with peer teams to deploy the compiler in inference and training systems. 

Who you are:

  • Bachelor’s or higher degree in Computer Science or related technical field.
  • Strong coding skills in Python, C++, CUDA, or OpenCL.
  • Excellent communication skills and the ability to work in a team.
  • 2+ industry or academic experience in compiler development, GPGPU programming or performance engineering. 
  • Experience or interest in accelerating AI workloads.
  • Solid fundamentals in other computer science and computer engineering topics: algorithms and data structures, operating systems, computer architecture, etc.

You will stand out from the crowd if you have:

  • Experience with ML systems, such as PyTorch, JAX, or TensorFlow.
  • Experience with ML compilers, such as TVM, IREE, XLA, pytorch.compile, etc.
  • Experience developing high-performance kernels for NVIDIA or AMD GPUs.
  • Experience with AI accelerator hardware.
  • Experience with MLIR or LLVM.
  • Contributions to open-source projects.
  • Strong publication record in ML, HPC, compiler or computer system conferences.

Benefits & Perks
- An open and inclusive work environment
- Employee stock options
- Best-in-class medical and dental benefits
- Parental Leave top-up
- Professional development budget
- Flexible vacation time to promote a healthy work-life blend

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation. 

CentML strives to respect the dignity and ‎‎independence of people with disabilities and is committed to giving them the same ‎‎opportunity to succeed as all other employees. 

Inclusiveness is core to our culture at CentML, and we strive to ensure you get the most from your interview experience. CentML makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to the Talent team.

Similar Jobs

Motive Logo Motive

Solutions Engineer

Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Easy Apply
Remote
Canada
4000 Employees
110K-160K Annually

Motive Logo Motive

Marketing Operations Lead

Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Easy Apply
Remote
Canada
4000 Employees
137K-205K Annually

Square Logo Square

Account Executive

eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Remote or Hybrid
8 Locations
12000 Employees
130K-234K Annually

Square Logo Square

Product Manager

eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Remote or Hybrid
8 Locations
12000 Employees
139K-245K Annually
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Toronto, Ontario
50 Employees
Year Founded: 2022

What We Do

We pioneer novel technology to enhance computing efficiency, making AI accessible for innovation and to benefit the global community.

We believe honesty builds integrity, honing craftsmanship delivers excellence, and collaboration fosters community.

Why Work With Us

Our journey began in the esteemed Efficient Computing Systems lab at the University of Toronto, under the leadership of our CEO, Gennady Pekhimenko. Today, the EcoSystems lab stands proudly as one of the world’s foremost authorities in Machine Learning Systems.

Our founding team is made up of experts in AI, ML compilers and ML hardware and has led

Gallery

Gallery

Similar Companies Hiring

PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account