Lead AI Infrastructure Engineer

Reposted 6 Days Ago
Be an Early Applicant
Austin, TX, USA
In-Office
Senior level
Information Technology • Robotics
Let us do the driving
The Role
Lead ML infrastructure engineer owning GPU inference performance for onboard real-time and high-throughput offboard systems. Improve and maintain C++ inference framework, optimize GPU execution, collaborate with applied ML teams, and expand ownership across ML pipelines and distributed infrastructure.
Summary Generated by Built In
About the Team

Our team is at the core of Avride's self-driving stack. We build the base infrastructure layer that powers all autopilot code. It includes a C++ framework for implementing autonomy components, execution graph building and optimization systems, as well as runtimes that execute those graphs, both onboard and in simulation.

The vast part of the execution graph is implemented as a chain of neural network operations. The onboard mode relies on stable latencies of the inference of those networks, while in simulation we also optimize throughput at scale.

About the role

We’re looking for a software engineer with a leadership mindset and deep ML infrastructure experience. You will decide and influence the ML infrastructure layer across the company. The biggest challenge we’re facing at the moment is the effectiveness of GPU inference - both for onboard applications with near real-time guarantees and for offboard cases that target high throughput and deterministic execution. It is the first priority within this role.

What you'll do
  • At first, you will take on the GPU inference framework, focusing on performance
  • Later, the role assumes responsibility and ownership for broader ML infrastructure scattered across ML pipelines
  • Close collaboration with the applied ML team responsible for defining the neural model's architecture
What you'll need
  • Experience with PyTorch
  • Understanding of how GPUs work
  • Experience in diagnosing and resolving performance issues
  • Strong record of building infrastructure including distributed systems
  • 5+ years of experience with C++
  • Programming experience in multi-threaded environments - multiple processes, threads, timers, and interrupts

#LI-MS1

Candidates are required to be authorized to work in the U.S. The employer is not offering relocation, sponsorship, and remote work options are not available.

Avride is an equal opportunity employer and committed to providing reasonable accommodations to qualified applicants and employees with disabilities to ensure they have equal access to employment opportunities. Avride complies with the Americans with Disabilities Act (ADA), if you need a reasonable accommodation to assist with the application or hiring process, or to perform the essential functions of a job, please email [email protected].

Skills Required

  • Experience with PyTorch
  • Understanding of how GPUs work
  • Experience in diagnosing and resolving performance issues
  • Strong record of building infrastructure including distributed systems
  • 5+ years of experience with C++
  • Programming experience in multi-threaded environments (multiple processes, threads, timers, interrupts)
  • Authorized to work in the U.S.; no relocation sponsorship; remote work not available
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Austin, TX
236 Employees
Year Founded: 2020

What We Do

Avride is a leading developer in the autonomous vehicle and delivery robot industry. Our dynamic team, composed of a few hundred engineers develops and operates autonomous cars and delivery robots across the globe, shaping the future of mobility and logistics. At Avride, we are committed to making the roads safer and more accessible for everyone. At the core of our philosophy is the belief in the transformative power of technology. Every product we develop, every test we conduct, and every service we launch is anchored in our vision of creating a safer and more sustainable world with help of cutting-edge technologies and breakthrough solutions

Similar Jobs

EXL Logo EXL

Artificial Intelligence Engineer

Information Technology • Database • Consulting
Remote or Hybrid
United States
30246 Employees
150K-170K Annually

Capital One Logo Capital One

Artificial Intelligence Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
6 Locations
55000 Employees
209K-286K Annually

Comcast Logo Comcast

Manager 2, Business Operations & Analytics

Digital Media • Information Technology • News + Entertainment
Hybrid
Houston, TX, USA
115000 Employees

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Sales Support Associate III

eCommerce • Fashion • Retail • Sales • Wearables • Design
Hybrid
Brook Meadows, Friendswood, TX, USA
16000 Employees
15-20 Hourly

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
LTX Thumbnail
Robotics • Conversational AI • Generative AI
Jerusalem, Israel
200 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account