Senior Perception AI Engineer - Autonomous Vehicles

Posted 9 Days Ago
Be an Early Applicant
Santa Clara, CA, USA
In-Office
184K-357K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Role
Develops learned and geometric online mapping systems for autonomous vehicles. Designs and trains PyTorch models using camera, LiDAR, and radar data; builds production C++ geometry, fusion, tracking, and topology algorithms; deploys real-time systems on NVIDIA DRIVE Orin and Thor. Owns datasets, ground truth, metrics, evaluation tooling, and failure analysis while collaborating across perception, localization, planning, and infrastructure teams for L2++ through L4 systems.
Summary Generated by Built In

Self-driving cars need to understand the road ahead in real time, even without a prior map. Our team builds the online mapping system that turns raw data from multiple sensors into an accurate, continuously updated 3D model of the driving environment. This model captures lanes, road boundaries, crosswalks, intersection layouts, and traffic control information to support decisions across the autonomous driving system. You’ll write the models, write the C++, and ship both into vehicles on the road, running on NVIDIA DRIVE Orin and Thor. The tasks you perform will be tested at scale, on real cars, with real safety requirements. NVIDIA’s autonomous driving stack spans the full range of automation, and online mapping is a core component across it, so your work will reach L2++, L3, and L4 systems. The role spans two subject areas, and we want someone who enjoys both:

  • Learned mapping involves training DNNs to predict map elements directly from visual sensors, laser scanning, and radar. This includes owning the GT story and collaborating with partners to provide the vital data.
  • Geometry and C++ engineering: building the post-processing that turns network outputs into stable, consistent, production-ready map elements.

What you’ll be doing:

  • Design, train, and improve PyTorch models that predict online map elements (lanes, road boundaries, crosswalks, road markings, topology) from camera, LiDAR, and/or radar, using BEV and vectorized-map representations.
  • Solve the hardest scenes: model intersection topology (connectivity between incoming and outgoing lanes, turn paths, merges and splits) and traffic light understanding (detection, state, and association of each light to the lanes it controls).
  • Write production C++ for geometry-based post-processing: curve and surface fitting, association, multi-frame fusion and tracking, topology reasoning, and consistency checks on DNN outputs.
  • Apply multi-view geometry, calibration, coordinate transforms, and sensor fusion to produce 3D maps that stay accurate and stable over time.
  • Optimize and deploy models alongside algorithms on NVIDIA DRIVE Orin and Thor under real-time and safety constraints, and get them running in vehicles.
  • Lead the narrative around GT and the data loop by planning datasets and defining GT and labeling requirements. Work with labeling, data, and tooling partners to produce high-quality GT. Mine data, choose metrics, and analyze failure cases to drive improvements.
  • Define critical metrics and build evaluation tooling to measure quality gains against large-scale real-world data.
  • Partner with perception, localization, planning, and infrastructure teams to integrate online mapping into the full AV stack, across L2++, L3, and L4 programs.
  • Contribute to technical direction and architecture decisions across the learned and geometric components of the mapping system.

What we need to see:

  • MS or PhD or equivalent experience in Computer Science, Electrical Engineering, Robotics, or a related field, or equivalent experience
  • 5+ years of industry or research experience in autonomous driving, robotics, or computer vision.
  • Strong foundation in 3D geometry: camera models, projective geometry, coordinate transforms, optimization, and curve/surface fitting.
  • Strong C++ skills, with a track record of designing and shipping production-quality algorithm code that is fast, reliable, and maintainable.
  • Hands-on experience training deep neural networks in PyTorch, including model design, training pipelines, debugging, and performance analysis.
  • Experience with data-driven development: building datasets, defining labels and GT, choosing metrics, and improving models by analyzing failures.
  • Excellent problem-solving and communication skills, and the ability to drive technical direction across teams.

Ways to stand out from the crowd:

  • Direct experience with DNN-based online or HD map generation, or BEV perception (e.g., vectorized map prediction, lane topology learning), or equivalent experience to BEV perception.
  • Experience with intersection understanding, such as lane connectivity and topology reasoning in sophisticated junctions, or traffic light detection and lane association.
  • Experience combining learned models with geometric post-processing in a production AV system and publications or open-source contributions in 3D vision, mapping, or autonomous driving.
  • Background in sensor fusion, multi-object tracking, or temporal fusion for map elements.
  • Experience deploying DNNs and algorithms on embedded GPUs (CUDA, TensorRT), ideally on DRIVE Orin or Thor, under real-time constraints.

#AutonomousVehicles

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:
184,000 USD – 287,500 USD for Level 4; and 224,000 USD – 356,500 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 13, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Skills Required

  • MS, PhD, or equivalent experience in Computer Science, Electrical Engineering, Robotics, or a related field
  • 5+ years of industry or research experience in autonomous driving, robotics, or computer vision
  • Strong foundation in 3D geometry, including camera models, projective geometry, coordinate transforms, optimization, and curve or surface fitting
  • Strong C++ skills and experience designing and shipping production-quality algorithm code
  • Hands-on experience training deep neural networks in PyTorch, including model design, training pipelines, debugging, and performance analysis
  • Experience building datasets, defining labels and ground truth, choosing metrics, and improving models through failure analysis
  • Excellent problem-solving and communication skills, with ability to drive technical direction across teams
  • Experience with DNN-based online or HD map generation, BEV perception, vectorized map prediction, lane topology learning, or equivalent
  • Experience with intersection understanding, lane connectivity, topology reasoning, traffic light detection, or lane association
  • Experience combining learned models with geometric post-processing in a production autonomous vehicle system
  • Publications or open-source contributions in 3D vision, mapping, or autonomous driving
  • Background in sensor fusion, multi-object tracking, or temporal fusion for map elements
  • Experience deploying deep neural networks and algorithms on embedded GPUs using CUDA or TensorRT, ideally on DRIVE Orin or Thor

NVIDIA Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about NVIDIA and has not been reviewed or approved by NVIDIA.

  • Equity Value & Accessibility — Feedback suggests equity grants, stock options/RSUs, and a discounted ESPP materially boost total compensation and can deliver significant wealth-building when the stock performs well.
  • Healthcare Strength — Feedback suggests medical, dental, and vision plans with in-network preventive care at 100%, telehealth, and concierge-style support are comprehensive and valued.
  • Parental & Family Support — Feedback suggests up to 22 weeks fully paid parental leave, fertility coverage, and adoption/surrogacy reimbursement provide strong family-focused benefits.

NVIDIA Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Santa Clara, CA
21,960 Employees
Year Founded: 1993

What We Do

NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, NVIDIA is increasingly known as “the AI computing company.”

Similar Jobs

Hilton Logo Hilton

Cook I - San Laurel - Conrad Los Angeles

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office
Los Angeles, CA, USA
500000 Employees
29-29 Hourly

Hilton Logo Hilton

Manager Global Deployment & Change Management Implementation Connected Room

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office or Remote
2 Locations
500000 Employees
40K-110K Annually

Snap Inc. Logo Snap Inc.

Scientist

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
5 Locations
5000 Employees
195K-343K Annually

BAE Systems, Inc. Logo BAE Systems, Inc.

Systems Engineer

Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Hybrid
Boulder, CA, USA
40000 Employees
65K-110K Annually

Similar Companies Hiring

Unusual Machines, Inc. Thumbnail
Hardware • Robotics
Orlando, FL
300 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account