Machine Learning Compiler Engineer

Posted Yesterday
Be an Early Applicant
New York, NY, USA
In-Office
Entry level
Financial Services
The Role
Develop and improve Jane Street’s ML compiler stack for high-throughput training and low-latency inference. Responsibilities may span compiler optimization, graph compilation, GPU kernel programming, frontend design, ML training and inference systems, debugging, formal methods, and programming-language or DSL development. The role involves evaluating existing technologies and building custom solutions to improve hardware utilization and accelerate model development and deployment.
Summary Generated by Built In
About the position

We’re looking for compiler engineers to join a new ML Compilers Team at Jane Street. 

Machine learning is a critical pillar of our global business. Our ever-evolving trading environment serves as a unique, rapid-feedback platform for ML experimentation, allowing us to incorporate new ideas with relatively little friction. Our ML team is full of people with a shared love for the craft of software engineering, and for designing APIs and systems that are delightful to use.

ML compilers let us quickly turn research ideas and novel architectures into high-throughput training jobs and low-latency inference. To get the most out of our hardware resources and enable rapid model development and deployment, we are working to understand and improve the current ML compiler technologies and explore where it makes sense to build our own solutions. In this role, you would shape the development of our compiler stack.

If you’ve never thought about a career in finance, you’re in good company. Many of us were in the same position before working here. If you have a curious mind and a passion for solving interesting problems, we have a feeling you’ll fit right in.

About you

The ideal candidate has worked on an ML compiler in the past, but non-ML compiler experience is also valuable. Experience with any part of the stack is fine, be it high-level ML frameworks (PyTorch, Jax, TensorFlow), graph compilers (Inductor, XLA, TVM), or kernel DSLs (Triton, Helion, cuTile). You should understand how all those pieces fit together even if you are unfamiliar with specific parts. 

Some other things you might be excited about are:

  • Optimizations in ML compilers: algebraic rewriting, materialize vs recompute tradeoffs and fusion, equality saturation, scheduling languages, loop-level optimization, autotuning
  • ML compiler frontends: graph capture, symbolic and dynamic shapes, control flow, automatic differentiation
  • GPU kernel programming and architecture: Triton, cuTile, CuTeDSL, CUDA, compute and memory hierarchies, programming with tensor cores
  • Compiler concepts: static analysis, intermediate representations like SSA and CFGs, instruction selection
  • ML inference: CUDA Graphs, KV caching, batching
  • ML training: Tensor/Sequence/Expert/Pipeline Parallelism, FSDP, NCCL, activation checkpointing
  • GPU debugging and optimization: CUDA-GDB, Nsight Systems, Nsight Compute
  • Formal methods: proof assistants, automated theorem provers, agentic proof systems
  • Programming languages and DSL design: embedded DSLs, staging and metaprogramming, type systems, functional programming

If you're a recruiting agency and want to partner with us, please reach out to [email protected]

Skills Required

  • Understanding of how ML compiler stack components fit together
  • Experience working on an ML compiler
  • Experience with non-ML compiler development
  • Experience with high-level ML frameworks, graph compilers, or kernel DSLs

Jane Street Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Jane Street and has not been reviewed or approved by Jane Street.

  • Healthcare Strength — Medical, dental, and vision coverage are offered at no cost for employees and dependents, with robust onsite care including primary care, physical therapy, and mental‑health therapy. Private onsite gyms and counseling resources further reinforce the health focus.
  • Parental & Family Support — Fully paid parental leave for all parents, with additional time for birth parents, is highlighted alongside expanded fertility benefits and well‑equipped nursing suites. These offerings position family support as a core element of the package.
  • Wellbeing & Lifestyle Benefits — Daily free meals and snacks, private onsite gyms, recreation spaces, and rich learning programs (including tuition reimbursement and company classes) elevate day‑to‑day quality of life. Onsite medical suites and speaker series add to the lifestyle and development mix.

Jane Street Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
1,390 Employees
Year Founded: 2000

What We Do

Jane Street works differently. As a liquidity provider and market maker, we trade on more than 200 trading venues across 45 countries and help form the backbone of global markets. Our approach is rooted in technology and rigorous quantitative analysis, but our success is driven by our people. Our bright, beautiful offices in the heart of New York, London, Hong Kong, and Amsterdam are open and buzzing with conversation. We come from many backgrounds and encourage travel between offices to share perspectives. Some of our best ideas come from bumping into a visiting colleague at the office coffee bar. Markets move fast. Staying competitive as we’ve grown has required constant invention—of new trading strategies, technology, and processes. We’ve found this is easier when you hire humble, kind people. They tend to help each other, and prioritize teamwork over titles. We invest heavily in teaching and training. There’s a library and a classroom in every office, because deepening your understanding of something is considered real work. Guest lectures, classes, and conferences round out the intellectual exchanges that happen every day. People grow into long careers at Jane Street because there are always new and interesting problems to solve, systems to build, and theories to test. More than twenty years after our founding, it still feels like we’re just getting started.

Similar Jobs

In-Office
2 Locations
2359 Employees
213K-263K Annually

Wipfli Logo Wipfli

Senior Accountant

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
2900 Employees
66K-109K Annually

Wipfli Logo Wipfli

Analyst II, Workday ERP

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
2900 Employees
88K-118K Annually

Wipfli Logo Wipfli

Senior Project Manager

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
2900 Employees
117K-158K Annually

Similar Companies Hiring

Granted Thumbnail
Artificial Intelligence • Healthtech • Insurance • Mobile • Financial Services
New York, New York
23 Employees
Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account