Senior Data Engineer

Posted 2 Days Ago
San Diego, CA
In-Office
136K-172K Annually
Senior level
Information Technology
The Role
Design, build, and operate high-scale streaming and batch data pipelines using Kafka, Flink, and Airflow. Optimize Redshift and Iceberg/Athena performance and cost. Ensure data quality, observability, SLAs, and serve reliable datasets/APIs. Mentor engineers and collaborate cross-functionally to deliver low-latency, production-grade telemetry and analytics data assets.
Summary Generated by Built In

At Lytx, we make roadways safer by transforming real‑time video and telematics into actionable safety intelligence. The Data Platform is the backbone of that mission - ingesting and processing massive event streams, shaping trusted datasets, and serving low‑latency insights that power products and analytics across the company. As a Senior Data Engineer, you’ll design, build, and operate high‑scale streaming and batch pipelines, optimize our Redshift data lake, and raise the bar on data quality, reliability, and cost efficiency.

What You’ll Do

  • Build and operate streaming pipelines with Kafka and streaming technologies (i.e. Flink) for real‑time telemetry and event processing.
  • Design robust ETL with Airflow into Redshift and S3, supporting analytics, product use cases, and downstream services.
  • Model data (event/telemetry and serving schemas); own data contracts, schema evolution, and table partitioning/compaction strategies.
  • Optimize performance & cost across Redshift, Iceberg/Athena, and streaming jobs
  • Harden quality, reliability, and observability: SLAs/SLOs, lineage, testing, validation, alerting, and incident response for data pipelines and datasets.
  • Serve data to applications via APIs/GraphQL and scalable query services (Athena/Redshift), ensuring predictable latency and well‑documented contracts.
  • Collaborate cross‑functionally with application teams to translate business needs into durable, scalable data assets.
  • Mentor engineers and contribute to standards, patterns, and best practices; be a continuous learner who uplifts team capabilities.

What You’ll Bring

  • 6+ years of data engineering experience designing and operating production‑grade streaming + batch data systems at scale.
  • Deep hands‑on experience with Kafka and stream processing technology
  • Strong SQL and performance tuning in Redshift; practical experience with Postgres.
  • Production experience with Airflow (DAG design, SLAs, retries, idempotency) and Flink (job optimization).
  • Experience with open table formats - Apache Iceberg (preferred) including partition evolution, schema evolution; comfort with Athena query performance.
  • Solid data modeling for telemetry/events and analytics; understanding of data contracts, schema registry, and CDC patterns.
  • Proficiency in object-oriented programming languages such as C# / Java / Python; strong software engineering fundamentals (testing, CI/CD, code review).
  • AWS experience (S3, Redshift, Athena, IAM; EKS is a plus).
  • Clear communicator who owns outcomes, balances speed with rigor, and thrives in a collaborative, high‑impact environment.

Nice to Have

  • Experience with IoT/telematics data.
  • Knowledge of dbt / Great Expectations (or other data testing frameworks).
  • Terraform/IaC, Kubernetes, and cost‑aware architecture.

What Success Looks Like

  • Reliable, observable pipelines with clear SLAs; lower latency, fewer incidents, and better data quality.
  • Faster queries and lower cost in Redshift and Athena.
  • High‑adoption, well‑documented datasets and data APIs that product/analytics teams trust.
  • Measurable improvements to insights through timely, accurate, and accessible data.

 

___________ 

 

Lytx is powered by cutting-edge technology and Happy People. You want to use your powers for good, and that’s exactly what we do at Lytx. Our team is made up of people who are making a difference every day with technology that helps save lives each year.  

Benefits:

  • Medical, dental and vision insurance 
  • Health Savings Account
  • Flexible Spending Accounts
  • Telehealth
  • 401(k) and 401(k) match
  • Life and AD&D insurance
  • Short-Term and Long-Term Disability
  • FTO or PTO
  • Employee Well-Being program
  • 11 paid holidays plus 1 inclusive holiday per year
  • Volunteer Time Off
  • Employee Referral program
  • Education Reimbursement Program
  • Employee Recognition and Appreciation program
  • Additional perk and voluntary benefit programs

Salary is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.  This position is also eligible for an incentive compensation plan.  The expected hiring salary for this position is:

$136,000.00 - $172,000.00

Innovation Lives Here

You go all in no matter what you do, and so do we. At Lytx, we’re powered by cutting-edge technology and Happy People. You want your work to make a positive impact in the world, and that’s what we do. Join our diverse team of hungry, humble and capable people united to make a difference.

Together, we help save lives on our roadways!

Lytx, Inc. is proud to be an equal opportunity employer. We’re committed to building a diverse and inclusive workforce and do not discriminate based on race, color, religion, sex, sexual orientation, gender identity or expression, gender, genetic information, uniformed service, national origin, age, veteran status, disability, pregnancy, or any other status protected by federal or state law. We are committed to providing reasonable accommodation for candidates with disabilities who need assistance during the hiring process. To request a reasonable accommodation, please email [email protected].  Lytx conducts background checks on applicants who receive a conditional offer of employment in accordance with applicable local, state, federal and regional laws. Qualified applicants with arrest or conviction records will be considered. Background check results may potentially result in the withdrawal of a conditional offer of employment and will be made in accordance with all applicable local, state, federal and regional laws. 

Top Skills

Airflow
Apache Iceberg
Athena
C#
Dbt
Eks
Flink
GraphQL
Great Expectations
Iam
Java
Kafka
Kubernetes
Postgres
Python
Redshift
S3
SQL
Terraform
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Framingham, MA
790 Employees
Year Founded: 1998

What We Do

Learn how Lytx video telematics can help you improve safety, efficiency, and DOT compliance in your fleet. Start improving your fleet operations today.

Similar Jobs

Zeta Global Logo Zeta Global

Senior Data Engineer

AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Easy Apply
Hybrid
San Francisco, CA, USA
2429 Employees
165K-175K Annually

Zeta Global Logo Zeta Global

Senior Data Engineer

AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Easy Apply
Remote or Hybrid
United States
2429 Employees
165K-175K Annually

General Motors Logo General Motors

Senior Data Engineer

Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Hybrid
3 Locations
165000 Employees
153K-269K Annually

Bestow Logo Bestow

Senior Data Engineer

Big Data • Fintech • Information Technology • Insurance • Software
Remote or Hybrid
US
160 Employees
135K-159K Annually

Similar Companies Hiring

Axle Health Thumbnail
Logistics • Information Technology • Healthtech • Artificial Intelligence
Santa Monica, CA
19 Employees
Scrunch AI Thumbnail
Software • SEO • Marketing Tech • Information Technology • Artificial Intelligence
Salt Lake City, Utah
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
15 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account