Autonomy Engineering Specialist - Perception

Posted Yesterday
Be an Early Applicant
Irving, TX, USA
Hybrid
128K-209K Annually
Senior level
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Cat Digital delivers digital and technology solutions that power Caterpillar's world-famous yellow iron.
The Role
Develop autonomous and operator-assisted driving perception systems for off-road machines. Lead perception software development involving sensor fusion, computer vision, machine learning, object detection, tracking, classification, and mapping. Collaborate on architecture, integration, verification, validation, safety, and iterative model training while troubleshooting sensor and machine data. The role requires production-quality C++ and Python development, technical leadership, and up to 10% travel to support a full-time onsite position in Irving, Texas.
Summary Generated by Built In
Career Area:
Technology, Digital and Data
Job Description:
Your Work Shapes the World at Caterpillar Inc.
When you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.
As the Autonomy Engineering Specialist - Perception, you will be responsible for developing cutting-edge autonomous and operator-assisted driving systems. You will design, implement, and test modules for sensor fusion, object detection, tracking and classification and be a technical leader on the Perception team. You will also collaborate with other tech leads to integrate your solutions into our software stack and hardware platform.
What You Will Do:
  • Solve challenging perception problems for mobile off-road machines.
  • Lead other developers in the design and development of high-quality perception software to solve our customer needs.
  • Document architecture specifications, software design, verification plans, test cases, operating procedures, and safety procedures.
  • Work with application teams to collect and analyze data on customer experience with robotic and manned platforms. Participate in the iterative ML training cycles to meet perception requirements.
  • Use appropriate tools to debug, test and maintain perception software and assist in the verification and validation process.

What You Will Have:
Problem Solving:
  • Experience with modular perception ML and sensor fusion for autonomous vehicles and robotics. Familiarity with off-road autonomy applications is a plus.
  • Hands-on experience working with camera images, lidar and 4D radar point clouds, IMU, GNSS, and machine state data in real perception systems.
  • Solid understanding of object detection, drivable area understanding, ground plane segmentation, object tracking and fusion, and 3D mapping.

Software Development Life Cycle:
  • Participate in Agile software development from requirements and architecture through validation and deployment.
  • Develop software design documentation, verification plans, and test procedures.
  • Collaborate with engineering teams to deliver safe, production-quality autonomy solutions

Programming:
  • Excellence in C++
  • Fluency in Python
  • Experience developing computer vision, machine learning, sensor fusion, object detection, and tracking modules.
  • Strong software engineering, debugging, and code quality practices

Technical Troubleshooting:
  • Knowledge of debugging and validation tools to analyze and resolve perception software issues.
  • Ability to analyze code, logs, sensor data, and machine performance data to troubleshoot complex problems.
  • Experience with verification and validation activities for autonomous machine systems.

Considerations For Top Candidates:
  • Experience developing perception and calibration for autonomous vehicles, robotics, or advanced operator assist systems using lidar, radar, and cameras (typically 7+ years)
  • Strong background in computer vision, machine learning, deep learning, sensor fusion, object detection, classification, and tracking.
  • Demonstrated ability to lead other developers
  • Experience developing production-quality software in C++ and Python.
  • Experience with ROS/AIS, OpenCV, TensorFlow, PyTorch, and modern software development tools including Git, CMake, Docker, and GoogleTest.
  • Experience developing, integrating, or validating complex autonomous systems with a focus on machine safety and productivity.
  • Experience working in Agile environments using Azure DevOps or Jira and leveraging AWS cloud technologies (EC2, S3, Batch) for data processing and model development.

Additional Information:
  • This position requires the candidate to work full-time at the Irving, TX office.
  • Domestic relocation assistance is available for this position.
  • Visa sponsorship is NOT available with this position.
  • This position will require up to 10% travel

Summary Pay Range:
$128,470.00 - $208,770.00
Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.
Benefits:
Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.
  • Medical, dental, and vision benefits*
  • Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
  • 401(k) savings plans*
  • Health Savings Account (HSA)*
  • Flexible Spending Accounts (FSAs)*
  • Health Lifestyle Programs*
  • Employee Assistance Program*
  • Voluntary Benefits and Employee Discounts*
  • Career Development*
  • Incentive bonus*
  • Disability benefits
  • Life Insurance
  • Parental leave
  • Adoption benefits
  • Tuition Reimbursement

* These benefits also apply to part-time employees
Posting Dates:
Any offer of employment is conditioned upon the successful completion of a drug screen.
Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.
Not ready to apply? Join our Talent Community.

Skills Required

  • Experience with modular perception machine learning and sensor fusion for autonomous vehicles and robotics
  • Hands-on experience with camera images, lidar, 4D radar point clouds, IMU, GNSS, and machine state data in real perception systems
  • Understanding of object detection, drivable area understanding, ground plane segmentation, object tracking and fusion, and 3D mapping
  • Experience participating in Agile software development from requirements and architecture through validation and deployment
  • Experience developing software design documentation, verification plans, and test procedures
  • Experience collaborating with engineering teams to deliver safe, production-quality autonomy solutions
  • Excellence in C++
  • Fluency in Python
  • Experience developing computer vision, machine learning, sensor fusion, object detection, and tracking modules
  • Strong software engineering, debugging, and code quality practices
  • Knowledge of debugging and validation tools for perception software
  • Ability to analyze code, logs, sensor data, and machine performance data
  • Experience with verification and validation activities for autonomous machine systems
  • Typically 7 or more years developing perception and calibration for autonomous vehicles, robotics, or advanced operator-assist systems
  • Experience with ROS/AIS, OpenCV, TensorFlow, PyTorch, Git, CMake, Docker, and GoogleTest
  • Experience developing, integrating, or validating complex autonomous systems focused on machine safety and productivity
  • Experience leading other developers
  • Experience using Azure DevOps or Jira in Agile environments
  • Experience using AWS EC2, S3, and Batch for data processing and model development
  • Ability to work full-time at the Irving, Texas office

What the Team is Saying

Pradeep
Christina
Chad
Madison
Rakshan
MacGregor
Stan

Caterpillar Compensation & Benefits Highlights

  • Retirement Support — Retirement plans are highlighted as a standout element, with a strong company match and an additional company contribution noted for certain groups. Feedback suggests this is a notable strength of the package, with specifics dependent on plan and eligibility.
  • Healthcare Strength — Health coverage is described as comprehensive, spanning medical, dental, vision, HSAs/FSAs, wellness resources, and mental-health support through the EAP. Feedback suggests these offerings are competitive and broadly well regarded.
  • Parental & Family Support — Paid parental leave and adoption assistance are explicitly included, with adoption reimbursement and supportive leave policies emphasized. Feedback suggests family support is generous and a meaningful part of total rewards.

Caterpillar Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Irving, TX
100,000 Employees
Year Founded: 1925

What We Do

Cat Digital is the digital and technology arm of Caterpillar Inc., responsible for bringing digital capabilities to our world-famous yellow iron. With over 1.5M connected assets worldwide, our teams use data, technology, advanced analytics and AI capabilities to help solve our customers' toughest challenges.

Why Work With Us

At Cat Digital, we're accelerating Caterpillar's digital transformation to help customers solve their toughest challenges. Our teams use enterprise-wide data, emerging technologies, and customer insights to deliver solutions that drive real-world impact. Join us as we create innovative experiences that help customers succeed and power the world aro

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Caterpillar Teams

Team
Caterpillar
Team
Career Growth
About our Teams

Caterpillar Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Typical time on-site: Flexible
HQIrving, TX
India
Broomfield, CO
Chennai, IN
Chicago, IL
Geneva, CH
Košice, SK
Peoria, IL
Learn more

Similar Jobs

Caterpillar Logo Caterpillar

Infrastructure Engineer

Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Hybrid
Irving, TX, USA
100000 Employees
113K-183K Annually

Caterpillar Logo Caterpillar

Senior Autonomy Engineer - Positioning

Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Hybrid
Irving, TX, USA
100000 Employees
113K-183K Annually

Caterpillar Logo Caterpillar

Platform Engineer

Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Hybrid
Irving, TX, USA
100000 Employees
113K-183K Annually

Caterpillar Logo Caterpillar

Automation Engineer

Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Hybrid
Irving, TX, USA
100000 Employees
98K-158K Annually

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account