Inference

Posted 21 Days Ago
Be an Early Applicant
7 Locations
In-Office or Remote
Senior level
Artificial Intelligence • Machine Learning • Robotics
The Role
Build and optimize low-latency on-device and distributed GPU inference pipelines. Implement and tune low-level CUDA/Triton kernels, optimize for throughput and latency, and develop monitoring/debugging tools to ensure reliable, deterministic inference in robotics and cluster environments.
Summary Generated by Built In
What You’ll Do
  • Build low-latency inference pipelines for on-device deployment, enabling real-time next-token and diffusion-based control loops in robotics

  • Design and optimize distributed inference systems on GPU clusters, pushing throughput with large-batch serving and efficient resource utilization

  • Implement efficient low-level code (CUDA, Triton, custom kernels) and integrate it seamlessly into high-level frameworks

  • Optimize workloads for both throughput (batching, scheduling, quantization) and latency (caching, memory management, graph compilation)

  • Develop monitoring and debugging tools to guarantee reliability, determinism, and rapid diagnosis of regressions across both stacks

What You’ll Bring
  • Deep experience in distributed systems, ML infrastructure, or high-performance serving (8+ years)

  • Production-grade expertise in Python, with strong background in systems languages (C++/Rust/Go)

  • Low-level performance mastery: CUDA, Triton, kernel optimization, quantization, memory and compute scheduling

  • Proven track record scaling inference workloads in both throughput-oriented cluster environments and latency-critical on-device deployments

  • System-level mindset with a history of tuning hardware–software interactions for maximum efficiency, throughput, and responsiveness

Skills Required

  • 8+ years experience in distributed systems, ML infrastructure, or high-performance serving
  • Production-grade expertise in Python
  • Strong background in systems languages (C++, Rust, Go)
  • Low-level performance mastery: CUDA, Triton, kernel optimization, quantization, memory and compute scheduling
  • Proven experience scaling inference workloads across GPU clusters and latency-critical on-device deployments
  • System-level mindset tuning hardware-software interactions for efficiency and responsiveness
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
86 Employees
Year Founded: 2025

What We Do

Genesis AI is a global full-stack robotics company developing general-purpose robots with human-level intelligence and capabilities. It aims to build foundational AI models that automate repetitive tasks across applications such as lab work and housekeeping. The company uses a proprietary physics engine to generate synthetic physical-world data, helping train robotics models for diverse real-world environments, and operates across Paris and Silicon Valley.

Similar Jobs

In-Office or Remote
7 Locations
14000 Employees

OneSix Logo OneSix

Lead Data Scientist

Artificial Intelligence • Big Data • Machine Learning • Analytics • Business Intelligence • Consulting • Generative AI
Remote or Hybrid
2 Locations
50 Employees
180K-200K Annually

Anthropic Logo Anthropic

Senior Software Engineer

Artificial Intelligence • Natural Language Processing • Generative AI
Remote
Ontario, ON, CAN
2500 Employees

WEKA Logo WEKA

Global Director, Partnerships & Alliances

Artificial Intelligence • Big Data • Machine Learning
In-Office or Remote
7 Locations
273 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
LTX Thumbnail
Robotics • Conversational AI • Generative AI
Jerusalem, Israel
200 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account