Machine Learning Engineer: Perception

Reposted 4 Days Ago
San Francisco, CA, USA
Hybrid
Mid level
Robotics
The Role
As a Machine Learning Engineer, you will design and train perception models for robotics, focusing on 3D perception systems. You will tackle complex physical challenges, optimize models for embedded hardware, and collaborate with cross-functional teams.
Summary Generated by Built In

Join the team bringing advanced autonomy to the built world

At Bedrock, we’re moving AI out of the lab and into the real world. Our team is composed of industry veterans who helped launch Waymo, scaled Segment to a $3.2B acquisition, and grew Uber Freight to $5B in revenue. Today, we’re deploying autonomous systems on heavy construction machinery across the country, accelerating project schedules of billion-dollar infrastructure projects and improving safety on job sites. Backed by $350M in funding, we’re working quickly to close the gap between America's surging demand for housing, data centers, manufacturing hubs, and the construction industry's growing labor shortage.

This is where algorithms meet steel-toed boots. You’ll collaborate with construction veterans and world-class engineers to solve physical-world problems that simulations can’t touch. If you're ready to apply cutting-edge technology to solve meaningful problems alongside a talented team—we'd love to have you join us.

Machine Learning Engineer: Perception

 

Bedrock is bringing autonomy to the construction industry! We’re a group of veterans from the autonomous vehicle industry who are passionate about bringing the benefits of automation to areas in the construction industry currently underserved by the market.

We are looking for engineers with expertise in shipping production 3D perception systems at scale. Successful candidates have architected systems, trained models from scratch, understand the full stack (clustering, detection, classification, and tracking), and have shipped at scale. We use both computer vision and LIDAR-based approaches, so knowledge of either or both is key. Models are just part of the system: you understand data and have good intuition about why models fail. You know how to evaluate corner cases, manage or build data pipelines, use autolabels (or not), and have a strong understanding of statistical properties of these systems.

 

What You’ll Do:

  • Design Early Fusion Architectures: Develop and train state-of-the-art models (e.g., BEV-based transformers) that fuse raw Lidar and Camera data to solve for object detection and semantic segmentation.

  • Tackle "Messy" Physics: Build perception systems robust enough to handle dynamic occlusion (seeing the robot’s own arm/bucket), particulates (dust, snow, rain), and high-vibration conditions.

  • Deploy to the Edge: Optimize models for inference on embedded hardware. You will debug system-level issues, such as sensor calibration drift and latency bottlenecks.

  • Collaborating with other teams to create state-of-the-art representations for downstream use cases.

What we're looking for:

  • Production ML Experience: 3+ years of experience taking deep learning models from research to real-world production using PyTorch, Tensorflow, or JAX.

  • 3D Geometry & Calibration: You have a deep understanding of SE(3) transformations, homogeneous coordinates, and intrinsic/extrinsic sensor calibration. You understand the math required to project a 3D Lidar point onto a 2D image pixel accurately.

  • Early Fusion Expertise: Practical experience with architectures that fuse modalities at the feature level (e.g., BEVFusion, TransFuser, PointPainting) rather than just fusing final bounding boxes.

  • SOTA Object Detection experience with modern transformer-based architectures (DETR, PETR, etc…) including similar temporal models (PETRv2, StreamPETR, …)

  • Systems Fluency: You are an expert in Python, but you are also comfortable reading and writing systems code in C++ or Rust. You understand memory management and real-time constraints.

  • Data Intuition: You understand that in robotics, better data alignment often beats a bigger model. You are willing to dig into the data infrastructure to ensure ground truth quality.

Ways to stand out:

  • Bonus: Voxel/Occupancy Experience: Experience working with occupancy grids, NeRFs, or voxel-based representations for terrain mapping.

  • Bonus: Top-Tier Research: Published work in conferences such as ICRA, IROS, CVPR, ECCV, ICCV, CoRL, or RSS

Our roles are often flexible. If you don't fit all the criteria, or are in another location (especially one where we have an office like SF or NY) please apply anyway! We'd love to consider you.

Skills Required

  • 3+ years of experience in Production Machine Learning
  • Deep understanding of SE(3) transformations and intrinsic/extrinsic sensor calibration
  • Practical experience with early fusion architectures
  • Experience with state-of-the-art object detection using transformer architectures
  • Expertise in Python; comfortable with systems coding in C++ or Rust
  • Strong intuition about data in robotics
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
56 Employees
Year Founded: 2024

What We Do

Bedrock Robotics brings advanced autonomy to the built world, helping the construction industry build at the pace today's society demands. Our technology upgrades existing heavy equipment, enabling truly autonomous operation with expert level quality and superhuman safety. At a time when we need to build faster than ever—from housing to data centers to factories and energy infrastructure—autonomous construction isn't just an innovation, it's an economic necessity.

Similar Jobs

In-Office
2 Locations
2359 Employees
204K-259K Annually

Gritt Robotics Logo Gritt Robotics

Machine Learning Engineer

Artificial Intelligence • Robotics • Software • Energy • Renewable Energy
In-Office
Belmont, CA, USA
14 Employees

Aurelius Systems Logo Aurelius Systems

Senior Machine Learning Engineer

Hardware • Energy • Defense • Automation
In-Office
San Francisco, CA, USA
18 Employees
190K-222K Annually

Zoox Logo Zoox

Senior Machine Learning Engineer

Artificial Intelligence • Machine Learning • Robotics • Software • Transportation • Design • Manufacturing
Hybrid
Foster City, CA, USA
2900 Employees
242K-290K Annually

Similar Companies Hiring

Apptronik Thumbnail
Computer Vision • Hardware • Machine Learning • Robotics • Software
Austin, TX
355 Employees
Doodle Labs Thumbnail
Wearables • Robotics • Internet of Things • Hardware • Automation • App development • Aerospace
SG
50 Employees
Fairly Even Thumbnail
Hardware • Robotics • Sales • Software • Hospitality
New York, NY
30 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account