Top Senior Data Engineer Jobs in Richmond, VA

Design, build, and maintain production-scale data systems and web-scale datasets (Spark/Flink) to support personalization ML. Drive dataset/schema design, collaborate with algorithm teams, and improve distributed big-data processing for member experience.

Technical leader for Data Engineering responsible for designing, operating, and optimizing Snowflake-based data platforms, self-hosted orchestration (Prefect), dbt practices, AWS infrastructure, and data pipelines. Drive architecture, mentor engineers, partner cross-functionally, ensure observability and production-grade practices, and enable model-ready datasets and AI/LLM workflows.

Design, build, operate, and optimize large-scale production data pipelines and foundational Healthcare Map data products using Python, SQL, Airflow, Spark, and AWS. Ensure data quality, observability, and performance; debug complex workflows; contribute to architecture, CI/CD, testing, documentation, and cross-functional delivery to enable analytics and AI/ML use cases.

Design, build, and scale reliable batch and real-time data pipelines and warehouses. Partner with engineering, data science, and business teams to define data models, improve observability, optimize storage and querying, and evangelize data engineering best practices across the company.

Design, build, and maintain scalable Databricks-based data pipelines and ELT workflows; develop and document dbt models; define data modeling methodology; ensure data quality, reliability, and scalability; collaborate with clients and cross-functional teams; provide technical guidance and deliver improvements to clients' data infrastructure and analytics capabilities.

Design, build, and optimize scalable batch and streaming data pipelines. Model and process structured and unstructured data, ensure production reliability and observability, apply ML techniques for insight extraction, and drive data strategy while adopting modern tooling and IaC practices.

Build and own data platform infrastructure and scalable pipelines (ingestion, orchestration, transformation, delivery). Define governance, observability, and AI-first architecture. Optimize performance, ensure data quality, mentor engineers, and integrate AI-assisted tooling.

Own and evolve the data platform: architect, build, and maintain data models, pipelines, and access layers. Ensure data quality, governance, and reliability; monitor and optimize infrastructure; provide technical leadership, code reviews, and collaborate with cross-functional teams to deliver scalable data solutions for operations and analytics.

Lead technical design and hands-on development of Pantheon’s data platform, extending ingestion, curation, retention services and ML/LLM infrastructure. Mentor engineers, drive architecture and engineering standards, operate in a DevOps model, partner cross-functionally, and participate in on-call support to ensure reliable, compliant data access and analytics.

The Senior Data Engineer will design and build scalable data platforms, handle automation for data operations, and ensure reliability and performance of data pipelines while collaborating with various teams.

Lead a team to design, build, and maintain cloud data engineering solutions using Microsoft Fabric and Azure Synapse. Responsibilities include architecture, data pipelines, lakehouse and warehousing implementation, governance, performance optimization, mentoring engineers, cross-functional collaboration, support/on-call, documentation, and ensuring reliability and compliance.

Lead the vision and execution for scalable data governance and quality across Airbnb. Architect future-proof data ecosystems, define best practices and tooling, drive cross-functional policy implementation (privacy, legal, infosec), mentor senior engineers, and influence executive strategy to embed stewardship into the data product lifecycle.

Build end-to-end data and analytics features: ingest and model data, build transformations and pipelines, create client-facing dashboards and interfaces, and develop LLM-powered workflows to accelerate analysis and app development. Partner with stakeholders, perform exploratory analyses, and ensure data quality, observability, and maintainability while influencing data engineering strategy.

Lead architecture, implementation, and optimization of scalable data platforms, ETL/ELT pipelines, and data governance. Ensure security and compliance, mentor junior engineers, drive CI/CD and IaC for data workflows, and collaborate with stakeholders to deliver actionable analytics and reporting.

Design, build, and maintain scalable distributed data pipelines and a secure data lakehouse for streaming and batch processing to support real-time analytics, ML, and experimentation. Automate, test, and harden workflows, architect logical and physical data models, build ML model features, and collaborate with product, analytics, and data science teams to turn data into value.

Build and operate ingestion and transformation pipelines, model and test core warehouse data, enable analytics and reporting, and maintain ML data infrastructure feeding matching and recommendation models. Partner with Engineering, Product, and Data Science to ensure reliable, documented, and trusted data at scale.