Base Compute is an AI inference lab. Our mission is to bring AGI on device. We believe in a world where everyone has access to intelligence: fast, private and always available on your device.
We’re building the infrastructure for the next generation of on-device AI, from silicon-level optimizations to distributed inference systems.
We’re working on hard problems at the intersection of inference efficiency, model intelligence and autonomous research.
The RoleWe’re looking for a Founding ML Researcher to work at the frontier of on-device AI. This role is for someone who identifies problems and potentials, designs and executes experiments and derives insights that translate into real-world performance.
You’ll have significant ownership over our research agenda and direct influence on the technical bets the company makes.
What You’ll Work OnInference research: Identifying and validating new approaches to on-device efficiency, including speculative decoding variants, novel quantization schemes and entirely new techniques yet to be discovered
Model routing research: Building the intelligence that decides how requests are served between on-device vs. frontier API models
Autoresearch pipelines: Designing systems that can autonomously explore, hypothesize and evaluate research ideas that accelerate our R&D loop
Evaluations and benchmarks: Developing rigorous evals that measure performance in the real world, outside of clean academic settings
PhD in ML or equivalent industry research experience
Deep understanding of LLM architectures and the principles of AI inference
Expertise in a relevant topic, such as speculative decoding, quantization theory, model distillation, reinforcement learning
A track record of producing results that people build on: research papers, open-source projects or blog posts that prove out novel ideas
Good communication: the ability to explain complex ideas simply, give honest feedback and document findings in a reproducible way
Nice-to-haves:
Familiarity with GPU and accelerator architectures and kernel optimization (CUDA, ROCm, Metal, Triton, etc.)
Experience deploying models under on-device constraints (memory bandwidth, latency budgets, and thermal and power ceilings)
Founding team equity and strong base salary
Direct influence on technical direction: your ideas will shape the roadmap
Work on genuinely hard problems that haven't been solved yet
Small team, fast iteration, low bureaucracy
The team is based in Melbourne and Berlin and works in-person from the office most days. We require strong written and spoken English, since the team collaborates across time zones.
Skills Required
- PhD in machine learning or equivalent industry research experience
- Deep understanding of LLM architectures and AI inference principles
- Expertise in a relevant area such as speculative decoding, quantization theory, model distillation, or reinforcement learning
- Track record of producing research papers, open-source projects, or blog posts demonstrating novel ideas
- Ability to explain complex ideas clearly, provide honest feedback, and document findings reproducibly
- Strong written and spoken English
- Familiarity with GPU and accelerator architectures and kernel optimization, including CUDA, ROCm, Metal, or Triton
- Experience deploying models under on-device memory, latency, thermal, and power constraints
What We Do
Base Compute is an AI inference lab building inference engines and infrastructure that make powerful AI run on-device. Its mission is to run AGI on-device. The company is a small senior team in Melbourne and Berlin working at the runtime and silicon levels, focusing on the difficult technical problems involved in efficient, local artificial-intelligence execution of advanced AI systems.
.jpg)
