Senior Perception Engineer

Posted 3 Days Ago
Be an Early Applicant
Hiring Remotely in Seattle, WA, USA
Remote or Hybrid
Senior level
Professional Services
The Role
Design, develop, and deploy robust perception systems for earthmoving autonomy: sensor fusion, scene understanding, obstacle detection, depth and terrain estimation, SLAM/localization, and optimized real-time inference on edge hardware. Build production ML pipelines, integrate perception with autonomy stacks, validate with field data, and collaborate across robotics, controls, and systems teams.
Summary Generated by Built In
About AIM Intelligent Machines

Curious if you want to terraform earth?


Everything humanity depends on is mined, dug, or grown. At AIM, we are building the autonomous linchpin of civilization. We transform heavy machinery—bulldozers, loaders, excavators—into AI-powered fleets that operate continuously, safely, and at peak performance in the world’s harshest environments.
AIM runs production mines, large scale infrastructure builds, and defense operations as a TRL9 hardened system, not a science experiment. We have been automating this massive space with embodied AI and emerged as the market choice for ground engagement autonomy.
Built by engineers from mining, construction, Waymo, SpaceX, Google and Tesla, AIM enables scalable earthmoving, turbocharging the global economy’s physical foundation. AIM is backed by some of the most sophisticated capital in the world, including General Catalyst, Khosla Ventures, Elad Gil, Human Capital, Ironspring Ventures, Mantis, DCVC. Learn more about AIM here.

About you

You’re an engineer who loves solving difficult perception problems where machine learning meets the physical world.

You have experience building production machine learning systems that operate on real hardware, not just in research environments. You understand how perception algorithms behave under real-world constraints such as sensor noise, environmental variability, limited compute, and incomplete data.

You enjoy working across the full perception stack - from sensor data ingestion and calibration, through model development and training, to deployment on edge compute and real-time inference pipelines.

You take ownership of outcomes, not just models. You debug deeply, validate rigorously, and iterate quickly using field data to continuously improve system performance.

You’re motivated by building perception systems that enable safe, reliable autonomy in environments where failure is not acceptable.
As a Senior Perception Machine Learning Engineer, you will design, develop, and deploy the perception systems that allow AIM’s autonomous machines to understand and interact with their environment.

Design & Advance Perception Systems

  • Architect and develop perception algorithms for scene understanding, obstacle detection, terrain modeling, and machine awareness.

  • Advance AIM’s perception stack including sensor fusion, environment modeling, and machine-centric perception pipelines.

  • Develop algorithms that operate reliably in complex, dynamic earthmoving environments.

Build Production Machine Learning Systems

  • Develop and deploy machine learning models for perception tasks including object detection, segmentation, depth estimation, and terrain understanding.

  • Optimize models for real-time inference on edge compute platforms.

  • Build scalable data pipelines for training, evaluation, and model iteration.

Integrate Perception with the Autonomy Stack

  • Collaborate with robotics, controls, systems, and software teams to integrate perception outputs into planning and control systems.

  • Ensure perception systems interact correctly with localization, SLAM, mapping, and safety systems.

  • Design perception interfaces that are robust, testable, and observableResponsibilities

  • Advance AIM’s perception stack and sensor fusion algorithms

  • This involves breaking new ground as earth moving machines don’t merely navigate on existing mapped roads – they modify and build the environment as they work which poses interesting novel challenges

  • Research and development of state-of-the-art machine learning methods

  • Comfortable with hands-on applications on machines deployed in the field

  • Apply real-world experience with localization and SLAM state-of-the-art methods

Qualifications

Core ML Fundamentals

  • Experience designing, training, and evaluating machine learning models

  • Strong understanding of the mathematics behind training (optimization, gradients, regularization, bias–variance tradeoff)

  • Familiarity with training dynamics (overfitting, underfitting, convergence issues, data imbalance)

  • Excellent grasp of machine perception methods in 2D and 3D (depth sensing)

  • Experience with perception sensor calibration techniques (camera, lidar, radar, etc.)

Computer Vision Fundamentals

  • Experience working on real-world computer vision problems (classification, detection, segmentation, tracking, etc.)

  • Understanding of image representations, augmentations, and data preprocessing strategies

  • Awareness of common architectures and when to use them (CNNs, transformers, hybrid approaches)

  • Ability to reason about evaluation metrics and tradeoffs (precision/recall, mAP, IoU, etc.)Proven track record of deployed ML-based perception systems, ideally on autonomous vehicles

Overall Engineering Skillset

  • Experience shipping production models

  • Excellent software development skills in python

  • Proficiency in Tensorflow, PyTorch, Python, C++

  • Creativity and curiosity for solving complex problems

Why AIM?Joining AIM, You Will
  • Solve a massive set of real-world problems that require scalable earth moving

  • Accomplish that via deploying and expanding cutting edge tech

  • Run your workstreams with the largest degree of autonomy

  • Have an opportunity for rapid growth and a large voice on the direction of the company

  • Receive company funded medical, dental, vision, 401k, life insurance, gourmet food & perks

  • Experience a strong onsite collaboration (AIM offices, labs and proving grounds on the east side of the Greater Seattle area)

  • Have an opportunity to travel to unique sites around the world (Americas, Australia, Africa & more)

Skills Required

  • Designing, training, and evaluating machine learning models for perception
  • Strong understanding of optimization, gradients, regularization, and training math
  • Familiarity with training dynamics (overfitting, underfitting, convergence, data imbalance)
  • Excellent grasp of machine perception methods in 2D and 3D including depth sensing
  • Experience with perception sensor calibration techniques (camera, lidar, radar)
  • Real-world computer vision experience (classification, detection, segmentation, tracking)
  • Experience with localization and SLAM state-of-the-art methods
  • Proven track record of deployed ML-based perception systems, ideally on autonomous vehicles
  • Experience shipping production models and deploying/optimizing for real-time edge inference
  • Build scalable data pipelines for training, evaluation, and model iteration
  • Excellent software development skills in Python
  • Proficiency in TensorFlow, PyTorch, and C++
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
238 Employees
Year Founded: 2006

What We Do

Associated Industries of Massachusetts (AIM) is the state's largest business association, serving more than 3,500 businesses across 150 different industries and representing more than 650,000 people. They operate as passionate thought-leaders, trusted advisors, and advocates working to improve the Massachusetts economy through fair pro-growth legislation and the provision of top-rate employer services to their vibrant community of members.

Similar Jobs

NVIDIA Logo NVIDIA

Senior Machine Learning Engineer

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office or Remote
3 Locations
21960 Employees
184K-357K Annually

ISEE Logo ISEE

Senior Perception Engineer

Artificial Intelligence • Automotive • Transportation
Remote
US
85 Employees

Zscaler Logo Zscaler

Program Manager

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
USA
8697 Employees
127K-182K Annually

Zscaler Logo Zscaler

Principal Peering Coordinator

Cloud • Information Technology • Security • Software • Cybersecurity
Easy Apply
Remote or Hybrid
USA
8697 Employees
196K-245K Annually

Similar Companies Hiring

ABN AMRO Clearing USA LLC Thumbnail
Information Technology • Professional Services • Financial Services
Chicago, IL
215 Employees
Fora Thumbnail
Agency • On-Demand • Professional Services • Sales • Software • Travel • Hospitality
New York, NY
200 Employees
Energy CX Thumbnail
Greentech • Professional Services • Business Intelligence • Consulting • Energy • Financial Services • Utilities
Chicago, IL
108 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account