Runtime Engineer

Posted Yesterday
Be an Early Applicant
Hiring Remotely in Cañada De Pala, CA, USA
In-Office or Remote
Mid level
Artificial Intelligence • Machine Learning • Software
The Role
Design, build, and maintain a multi-target runtime for an AI compiler stack. Implement low-level parallelization, kernel scheduling, and performance analysis; prototype runtime ideas; benchmark compiler outputs on target hardware; build tooling to collect and analyze performance bottlenecks; collaborate with compiler and product teams to improve runtime architecture for diverse hardware and large-scale execution.
Summary Generated by Built In
About Us

At Lemurian Labs, we're reimagining the foundations of computing to make AI accessible to everyone. Our mission is to remove the limits of scale, hardware, and cost that hold back innovation, so the people solving humanity's hardest problems can move faster.

We're building a new kind of software stack: a hardware-agnostic platform that makes every system — from a laptop to a supercomputer — feel like one seamless engine. Developers can write once, run anywhere, and get state-of-the-art performance across any chip, any cloud, at any scale. It's a complete rethink of how software and hardware interact — designed for the era beyond Moore's Law.

We're not looking for the comfortable or the conventional; we're looking for the bold. The engineers who crave frontier problems, who want to bend the limits of what's possible, who see infrastructure not as a constraint but as a canvas. If you want to build the foundation for the next era of AI and change what humanity can achieve in the process, join us.

About the Role

We're looking for a Runtime Engineer to design and build the multi-target runtime that sits at the heart of our AI compiler stack. This is a systems-level role where you'll take the output of our optimizing compiler and make it execute — efficiently, correctly, and at scale — across a diverse landscape of hardware targets.

You'll work on low-level parallelization, kernel scheduling, and performance analysis, and collaborate closely with our compiler and product teams to push the boundaries of what's possible on modern AI hardware.

What You'll Do
  • Design, develop, maintain, and improve our multi-target runtime.
  • Apply the latest techniques in parallelization and partitioning to automate kernel generation and exploit highly optimized execution paths.
  • Rapidly prototype and data-drive exploration of new runtime ideas.
  • Benchmark and analyze the outputs produced by our optimizing compiler on target hardware.
  • Build tools to collect and analyze performance bottlenecks.
  • Work closely with our product team to understand the evolving needs of ML engineers and drive improvements in runtime architecture.
RequirementsEssential Skills and Experience
  • BS degree in Computer Science, Computer Engineering, or equivalent practical experience.
  • 4+ years of experience working with compilers or runtime systems.
  • Deep understanding of asynchronous and concurrent programming.
  • 4+ years of experience with C/C++ (C++14 or newer).
  • Understanding of hardware architecture: vector vs. scalar registers and instructions, memory hierarchies.
  • Knowledge of operating system kernel development or hypervisor development.
Preferred Skills and Experience
  • Master's or PhD in Computer Science, Computer Engineering, or equivalent.
  • Experience developing or maintaining GPU compute libraries such as CUDA or ROCm.
  • Experience with GPU programming and optimization.
  • Background in high-performance computing (HPC).
  • Knowledge of deep learning frameworks such as PyTorch, JAX, or Triton.
  • Experience programming large compute clusters.
Why Join Lemurian Labs
  • Build the runtime that makes next-generation AI infrastructure actually go fast.
  • Work across the full stack — from hardware intrinsics to compiler output to distributed execution.
  • Join a team that approaches infrastructure as a canvas, not a constraint.
  • Competitive compensation including equity, medical/dental/vision, retirement savings, and wellness benefits.

Lemurian Labs is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees, regardless of gender identity, race, ethnicity, sexual orientation, disability status, age, or background.

Compensation depends on experience and geographic location and will be narrowed during the interview process. Additional benefits include equity, company bonus opportunities, medical, dental, and vision coverage, a retirement savings plan, and supplemental wellness benefits.

Skills Required

  • BS degree in Computer Science, Computer Engineering, or equivalent practical experience.
  • 4+ years of experience working with compilers or runtime systems.
  • Deep understanding of asynchronous and concurrent programming.
  • 4+ years of experience with C/C++ (C++14 or newer).
  • Understanding of hardware architecture: vector vs. scalar registers and instructions, memory hierarchies.
  • Knowledge of operating system kernel development or hypervisor development.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Toronto
33 Employees
Year Founded: 2018

What We Do

At Lemurian Labs our focus is on unleashing the capabilities of AI for the benefit of humanity. To fulfill this purpose we are developing a full stack solution consisting of software and hardware that is capable of orders of magnitude better performance and efficiency than legacy solutions, while being designed for scalability. There are massive shifts underway moving us from Software 1.0 to Software 2.0 to Software 3.0 and onwards, but to realize its true benefits we need fundamentally new hardware and systems that can keep up with the changing compute demands and simultaneously bringing down costs. We are developing software and hardware designed from first principles to deliver unprecedented realizable performance/watt and enable the next generation of AI workloads. Our diverse team of technologists have decades of experience at the frontiers of high performance computing, digital arithmetic, cryptography, artificial intelligence, robotics, and networking. There is a lot of talk about what the technology of tomorrow will look like and there are a number of companies developing it. At Lemurian, we believe tomorrow is so yesterday. We are developing the technology for the day after tomorrow. We are Lemurian Labs. Welcome to the future of artificial intelligence and computing.

Similar Jobs

Anthropic Logo Anthropic

Software Engineer

Artificial Intelligence • Natural Language Processing • Generative AI
In-Office or Remote
3 Locations
2500 Employees
405K-485K Annually
Remote
3 Locations
44 Employees
170K-190K Annually

Salvo Software Logo Salvo Software

OTX Runtime Engineer

Blockchain • Software • Automation
Remote
United States
16 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account