Software Engineer - X Data Engineering

Reposted One Month Ago
Palo Alto, CA, USA
In-Office
125K-400K Annually
Mid level
Information Technology
The Role
Design, build, and operate production-grade realtime and batch data pipelines and internal data products. Ensure data correctness, tooling for backfills and reports, and partner with product/business teams to prioritize data acquisition and improvements. Work across query engines and streaming frameworks to support analytics, monitoring, and debugging for product and business stakeholders.
Summary Generated by Built In

SpaceXAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

ABOUT THE ROLE:

As a Data Engineer in X product engineering team, you will play a key role in providing comprehensive data solutions that own or serve a wide range of stakeholders, including our end-users and internal teams such as Product engineering, Algorithm, Legal, Finance and Sales. Our work utilizes AI, distributed computing and hybrid storage technologies, but extends beyond purely data-centric solutions, encompassing non-data-related challenges, ultimately maximizing the potential of data for the benefit of our diverse user base.

RESPONSIBILITIES:

You'll help build and operate a distributed data platform that powers hundreds of realtime and batch pipelines processing billions of events per day. The team runs like an internal startup — we own problems end to end, from raw event streams to the datasets, tooling, and metrics that product, growth, safety, and business teams depend on daily. In this role you will:

  • Design, build, and operate production-grade realtime and batch pipelines that ingest, process, validate, and deliver data powering user-behavior insights and product decisions.
  • Create shared datasets, fact tables, and internal data products that let other teams analyze, debug, and improve product performance.
  • Prototype and build tooling that automates and accelerates internal data workflows — backfills, dashboards, report generation, and self-serve access to data.
  • Own data correctness end to end: validate with output invariants, denominator reconciliation, and independent recomputation, and lead root-cause investigations when key metrics move unexpectedly.
  • Move fluidly across query engines and frameworks (e.g., BigQuery, Trino, Clickhouse for analytics; Flink, Kafka, Spark/Scalding for streaming and batch), choosing the right tool and adapting quickly to new infrastructure and environments.
  • Partner across product and business teams to surface where data gaps exist and prioritize the highest-impact opportunities for new data acquisition and improvement.
  • Iterate quickly on feedback, shipping the smallest useful increment with a strong bias toward efficient, accurate, and reliable solutions.
BASIC QUALIFICATIONS:

We are looking for an engineer with 3+ years of professional software engineering experience, ideally in data engineering or distributed systems.

  • Hands-on expertise in Python, Rust, Scala, Go or Java, and data pipeline toolings and distributed systems. 
  • Knowledge of realtime and batch data processing tools such as Spark/Kafka/Flink/SQL and various storage systems in RMDBs/NoSQL
  • Experience solving large scale problems and comfortable doing incremental quality work while building brand new systems to enable future quality improvements. 
  • Proven records of interpreting product requirements into engineering implementation plans, and effectively communicating with different groups (AI, product, marketing/sales and engineering). 
COMPENSATION AND BENEFITS:

$125,000 - $400,000 USD

Base salary is just one part of our total rewards package at SpaceXAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

SpaceXAI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.

Skills Required

  • 3+ years of professional software engineering experience
  • Experience in data engineering or distributed systems (ideal)
  • Hands-on expertise in Python, Rust, Scala, Go or Java
  • Knowledge of realtime and batch data processing tools such as Spark, Kafka, Flink, Scalding, and SQL
  • Experience with analytics query engines and storage systems such as BigQuery, Trino, Clickhouse, RDBMS and NoSQL
  • Proven ability to translate product requirements into engineering plans and communicate across teams
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Palo Alto, CA
96 Employees

What We Do

Understand the Universe

Similar Jobs

CoreWeave Logo CoreWeave

Senior Technology Design Manager - Data Hall Fit Out

Cloud • Information Technology • Machine Learning
In-Office
5 Locations
1450 Employees
157K-210K Annually

CoreWeave Logo CoreWeave

Senior Electrical Engineer

Cloud • Information Technology • Machine Learning
In-Office
5 Locations
1450 Employees
157K-210K Annually

Artera Logo Artera

Accounting Manager

Healthtech • Sales • Software • Analytics • Conversational AI
Easy Apply
In-Office
3 Locations
250 Employees
109K-143K Annually

Digible Logo Digible

Account Manager

AdTech • Agency • Artificial Intelligence • Digital Media • Marketing Tech • Social Media • PropTech
Remote or Hybrid
United States
145 Employees
87K-100K Annually

Similar Companies Hiring

Axle Health Thumbnail
Artificial Intelligence • Healthtech • Information Technology • Logistics
Santa Monica, CA
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account