AI Inference Engineer

Reposted 9 Days Ago
San Francisco, CA, USA
In-Office
175K-225K Annually
Mid level
Information Technology • Security • Automation
The Role
The AI Inference Engineer will optimize and productionize AI models for real-time applications on edge devices, enhancing robotic systems' performance.
Summary Generated by Built In
Who We Are
Sauron protects your family and home, bringing the innovations of autonomous robots and self-driving cars to residential security. Our team is led by veteran operators and engineers, alumni of Sonos, Paypal, Tesla, Apple, and Google. Sauron has raised an $27M seed round led by A* and Atomic with participation from other leading venture capital firms. 

The Role 
We’re looking for an AI Inference Engineer who lives at the boundary of high-performance software and physical hardware. In this role, you won't just be managing pipelines; you’ll be squeezing every drop of performance out of silicon to ensure our perception systems can see, think, and act in real-time.
You will own productionizing of AI - taking sophisticated models and transforming them into lightning-fast, production-ready engines running on edge devices in homes across the country. If you are obsessed with CUDA kernels, TensorRT optimizations, and the challenge of deploying robust vision systems on real robots, we want to talk to you.

What You’ll Do
  • Lead the development and optimization of low-latency inference engines using TensorRT and ONNX, including authoring custom plugins to support cutting-edge architectures.
  • Design and maintain multithreaded video processing and streaming pipelines (RTSP, RTP, HLS) using GStreamer and DeepStream.
  • Collaborate closely with embedded engineers to integrate perception software with Yocto platforms, ensuring seamless hardware-software synergy.
  • Work with raw data from cameras and LiDAR to enable real-time data capture, obstacle detection, and avoidance.
  • Write and optimize custom CUDA kernels and perform low-level GPU tuning to maximize throughput and minimize power consumption.
  • Productionize proven prototypes from Jetpack into Yocto
  • Apply advanced optimization techniques—including quantization (INT8/FP16), pruning, and distillation - to bring research-grade models to production-grade efficiency.

What You Bring
  • Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, Robotics, or a related field.
  • 3+ years of experience developing and deploying computer vision or machine learning applications on real-world robotic systems (not just in simulation).
  • High proficiency in C, C++, and Python, with a focus on real-time and embedded systems.
  • Expert-level knowledge of the NVIDIA Jetson ecosystem (JetPack SDK, DeepStream, TensorRT) and a deep understanding of CUDA/GPU architecture.
  • Hands-on experience with video streaming tools like ffmpeg and protocols such as RTSP, RTP and HLS.
  • Proven track record of deploying AI systems that operate in the field, handling the unpredictability of real-world sensor data.

Nice to Have
  • Familiarity with NVIDIA’s broader robotics stack
  • Experience with ML compilers or compiler-level optimizations for GPU inference.
  • Specific background in sensor fusion and AI-driven obstacle avoidance for autonomous navigation.
  • Exposure to remote logging, log ingestion, and distributed telemetry aggregation.
  • Previous experience in early-stage startups or fast-paced hardware/software integration environments.

We Value
1. The Power of "We": “Align, then Accelerate”
  • We celebrate as a team and troubleshoot as a team.
  • The goal is the mission, not the credit.
2. High Challenge, Low Ego: "Respect the person, debate the idea."
  • Be ruthless with problems, but kind to people.
  • Raise the bar, lower the shield
3. Speak up: "Silence is a setback."  
  • Your perspective is a requirement, not a suggestion.
  • Speak the hard truths early so we can fix them fast.
4. Integrity in Motion: "Own the outcome, not just the task."
  • Do what you say you’ll do.
  • If it breaks, fix it. If it works, make it better.
5. Humanity at the Core: "Relationships over transactions."
  • Earn trust through empathy and consistency.
  • Anticipate needs before they become requests.

The compensation range for this position is $175-225k base + equity + benefits.

Why Sauron
You’ll be joining a deeply technical team obsessed with building real-world systems that make a tangible difference in people’s lives. We move quickly, iterate relentlessly, and ship with urgency - all while holding a deep respect for software craftsmanship and system reliability. If you're looking to solve challenging problems and own major parts of the deployment stack for a category-defining product, we want to talk.

We are focused on building a diverse and inclusive workforce. If you’re excited about this role, but do not meet 100% of the qualifications listed above, we encourage you to apply.
-----
Sauron is an Equal Opportunity Employer and considers applicants for employment without regard to race, color, religion, sex, orientation, national origin, age, disability, genetics or any other basis forbidden under federal, state, or local law.
Please review our CCPA policies here.
Compensation
The base pay range for this role is $175,000 – $225,000 per year.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
41 Employees
Year Founded: 2024

What We Do

Meet your home operating system. Home security should reinforce your peace of mind. You deserve a sanctuary, one that gives you the freedom to live your life with the people that matter most. That’s why we created something entirely new. Sauron is an autonomous platform for the perimeter of your home. It works discreetly in the background to reliably identify potential threats in all environmental conditions and it instantly recognizes who’s part of your inner circle. We provide a bespoke white-glove service, ensuring that each client’s security platform is installed with precision and care, swiftly and without disrupting the comfort or aesthetics of their home. To complement the technology, Sauron leverages its Intelligent Response and Intrusion Suppression (IRIS) Command Center, staffed 24/7 by exceptionally trained agents with diverse backgrounds in law enforcement, military service, executive protection, and other critical security fields. The team builds relationships with local police departments to ensure a rapid police response to verified security incidents.

Similar Jobs

Capital One Logo Capital One

Artificial Intelligence Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
4 Locations
55000 Employees
230K-286K Annually

Modular Logo Modular

Platform Engineer

Artificial Intelligence • Software
In-Office
Los Altos, CA, USA
187 Employees
198K-286K Annually
Hybrid
2 Locations
59 Employees
165K-330K Annually
Hybrid
2 Locations
59 Employees
165K-330K Annually

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Milestone Systems Thumbnail
Artificial Intelligence • Other • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account