Software Engineer - Data Platform

Reposted 11 Days Ago
Austin, TX
In-Office
Mid level
Information Technology • Robotics
Let us do the driving
The Role
Design and maintain data pipelines and infrastructure for processing large datasets from autonomous vehicles, optimizing for performance and usability.
Summary Generated by Built In
About the Team

Our team is responsible for the collection, storage, and processing of large-scale datasets generated by autonomous vehicles and delivery robots. This includes sensor data from cameras, lidars, radars, and other onboard systems. Scaling reliable storage and providing efficient compute tools is essential for supporting downstream teams—such as machine learning, simulation, and algorithm development. Our data processing stack incorporates specialized algorithms similar to those deployed directly on autonomous systems in the field.

About the Role

As a Software Engineer, Data Platform at Avride, you will be responsible for designing, building, and maintaining the core data and machine learning infrastructure with a strong focus on software design and code quality. You will design systems to ingest, process, and organize petabytes of telemetry and sensor data into a globally distributed data lake, enabling high-throughput, low-latency access to data for both model training and online inference. Your work will help ML engineers and data scientists iterate faster and deliver better-performing systems.

‍What You'll Do
  • Build and maintain robust data pipelines and core datasets to support simulation, analytics, and machine learning workflows, as well as business use cases
  • Design and implement scalable database architectures to manage massive and complex datasets, optimizing for performance, cost, and usability
  • Collaborate closely with internal teams such as Simulation, Perception, Prediction, and Planning to understand their data requirements and workflows
  • Evaluate, integrate, and extend open-source tools (e.g., Apache Spark, Ray, Apache Beam, Argo Workflows) as well as internal systems
What You'll Need
  • Strong proficiency in Python (required); experience with C++ is highly desirable
  • Proven ability to write high-quality, maintainable code and design scalable, robust systems
  • Experience with Kubernetes for deploying and managing distributed systems
  • Hands-on experience with large-scale open-source data infrastructure (e.g., Kafka, Flink, Cassandra, Redis)
  • Deep understanding of distributed systems and big data platforms, with experience managing petabyte-scale datasets
Nice to Have
  • Experience building and operating large-scale ML systems
  • Understanding of ML/AI workflows and experience with machine learning pipelines
  • Experience optimizing resource usage and performance in distributed environments
  • Familiarity with data visualization and dashboarding tools (e.g., Grafana, Apache Superset)
  • Experience with cloud-based infrastructure (e.g., AWS, GCP, Microsoft Azure)

Candidates are required to be authorized to work in the U.S. The employer is not offering relocation sponsorship, and remote work options are not available.

Top Skills

Apache Beam
Spark
Argo Workflows
AWS
C++
Cassandra
Flink
GCP
Kafka
Kubernetes
Azure
Python
Ray
Redis
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Austin, TX
236 Employees
Year Founded: 2020

What We Do

Avride is a leading developer in the autonomous vehicle and delivery robot industry.

Our dynamic team, composed of a few hundred engineers develops and operates autonomous cars and delivery robots across the globe, shaping the future of mobility and logistics.

At Avride, we are committed to making the roads safer and more accessible for everyone. At the core of our philosophy is the belief in the transformative power of technology. Every product we develop, every test we conduct, and every service we launch is anchored in our vision of creating a safer and more sustainable world with help of cutting-edge technologies and breakthrough solutions

Similar Jobs

In-Office
4 Locations
3107 Employees

eBay Logo eBay

Software Engineer

eCommerce • Retail
In-Office
2 Locations
26035 Employees
132K-222K Annually

eBay Logo eBay

Software Engineer

eCommerce • Retail
In-Office
2 Locations
26035 Employees
115K-200K Annually

Roku Logo Roku

Senior Software Engineer

News + Entertainment
In-Office
Austin, TX, USA
2724 Employees

Similar Companies Hiring

Axle Health Thumbnail
Logistics • Information Technology • Healthtech • Artificial Intelligence
Santa Monica, CA
17 Employees
Scrunch AI Thumbnail
Software • SEO • Marketing Tech • Information Technology • Artificial Intelligence
Salt Lake City, Utah
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account