Software Engineer - Data Platform

Reposted 12 Days Ago
Easy Apply
Austin, TX
In-Office
Mid level
Information Technology • Robotics
Let us do the driving
The Role
Design and maintain data pipelines and infrastructure for processing large datasets from autonomous vehicles, optimizing for performance and usability.
Summary Generated by Built In
About the Team

Our team is responsible for the collection, storage, and processing of large-scale datasets generated by autonomous vehicles and delivery robots. This includes sensor data from cameras, lidars, radars, and other onboard systems. Scaling reliable storage and providing efficient compute tools is essential for supporting downstream teams—such as machine learning, simulation, and algorithm development. Our data processing stack incorporates specialized algorithms similar to those deployed directly on autonomous systems in the field.

About the Role

As a Software Engineer, Data Platform at Avride, you will be responsible for designing, building, and maintaining the core data and machine learning infrastructure with a strong focus on software design and code quality. You will design systems to ingest, process, and organize petabytes of telemetry and sensor data into a globally distributed data lake, enabling high-throughput, low-latency access to data for both model training and online inference. Your work will help ML engineers and data scientists iterate faster and deliver better-performing systems.

‍What You'll Do
  • Build and maintain robust data pipelines and core datasets to support simulation, analytics, and machine learning workflows, as well as business use cases
  • Design and implement scalable database architectures to manage massive and complex datasets, optimizing for performance, cost, and usability
  • Collaborate closely with internal teams such as Simulation, Perception, Prediction, and Planning to understand their data requirements and workflows
  • Evaluate, integrate, and extend open-source tools (e.g., Apache Spark, Ray, Apache Beam, Argo Workflows) as well as internal systems
What You'll Need
  • Strong proficiency in Python (required); experience with C++ is highly desirable
  • Proven ability to write high-quality, maintainable code and design scalable, robust systems
  • Experience with Kubernetes for deploying and managing distributed systems
  • Hands-on experience with large-scale open-source data infrastructure (e.g., Kafka, Flink, Cassandra, Redis)
  • Deep understanding of distributed systems and big data platforms, with experience managing petabyte-scale datasets
Nice to Have
  • Experience building and operating large-scale ML systems
  • Understanding of ML/AI workflows and experience with machine learning pipelines
  • Experience optimizing resource usage and performance in distributed environments
  • Familiarity with data visualization and dashboarding tools (e.g., Grafana, Apache Superset)
  • Experience with cloud-based infrastructure (e.g., AWS, GCP, Microsoft Azure)

Candidates are required to be authorized to work in the U.S. The employer is not offering relocation sponsorship, and remote work options are not available.

Top Skills

Apache Beam
Spark
Argo Workflows
AWS
C++
Cassandra
Flink
GCP
Kafka
Kubernetes
Azure
Python
Ray
Redis
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Austin, TX
236 Employees
Year Founded: 2020

What We Do

Avride is a leading developer in the autonomous vehicle and delivery robot industry.

Our dynamic team, composed of a few hundred engineers develops and operates autonomous cars and delivery robots across the globe, shaping the future of mobility and logistics.

At Avride, we are committed to making the roads safer and more accessible for everyone. At the core of our philosophy is the belief in the transformative power of technology. Every product we develop, every test we conduct, and every service we launch is anchored in our vision of creating a safer and more sustainable world with help of cutting-edge technologies and breakthrough solutions

Similar Jobs

Luxury Presence Logo Luxury Presence

Staff Software Engineer

Marketing Tech • Real Estate • Software • PropTech • SEO
Easy Apply
Remote or Hybrid
United States
500 Employees
200K-230K Annually

CrowdStrike Logo CrowdStrike

Senior Software Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
7 Locations
10000 Employees
140K-215K Annually

Samsara Logo Samsara

Senior Software Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
150K-290K Annually

eBay Logo eBay

Software Engineer

eCommerce • Retail
In-Office
2 Locations
26035 Employees
115K-200K Annually

Similar Companies Hiring

Scrunch AI Thumbnail
Software • SEO • Marketing Tech • Information Technology • Artificial Intelligence
Salt Lake City, Utah
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
15 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account