Top Senior Data Engineer Jobs

Designs and maintains scalable data pipelines and platforms, develops ETL/ELT processes, and migrates heterogeneous external data into standardized enterprise models. The role includes data ingestion, transformation, quality validation, reconciliation, and billing-data standardization across systems. It collaborates with engineering, product, DevOps, and DBA teams, contributes to technical decisions, mentors engineers, and applies AI-assisted development tools. The position is based in Richmond, Virginia, with four days in office and one day remote.

Own Doctronic’s end-to-end data platform, including CDC pipelines from production databases into S3, Iceberg, and Snowflake; dbt transformations; orchestration; warehouse architecture; monitoring; and governed access to PHI. Establish trusted, documented data layers for analytics, finance, dashboards, and AI model training. Implement HIPAA-compliant access controls, anonymization, and deletion workflows while partnering autonomously with product, finance, marketing, partnerships, and AI teams.

Designs, builds, and maintains scalable AWS data pipelines, integrations, lakehouse infrastructure, and Airflow workflows. Processes commercial pharmaceutical data, supports pharma KPIs and analytics, and develops pipelines for AI, machine learning, generative AI, LLM, embeddings, and RAG applications. The role also includes legacy-system migration, pipeline monitoring and optimization, data quality assurance, and translating pharmaceutical business needs into reliable data solutions.

Design and implement end-to-end AI features, scalable data pipelines, ETL/ELT workflows, Generative AI and agentic systems, ML and BI solutions, and MLOps/LLMOps practices across AWS, Azure, and GCP. Apply RAG, embeddings, vector databases, security governance, evaluation, reliability, and guardrails. Own technical workstreams, mentor junior engineers, and promote software engineering best practices in consulting environments.

Design and scale Zip’s enterprise data and AI platform across batch, streaming, structured, and unstructured workloads. Build reliable pipelines, AI-ready data products, semantic models, vector and hybrid search, and RAG capabilities. Establish standards for modeling, testing, governance, security, observability, and automation. Partner with engineering, data science, product, and business teams while mentoring engineers and influencing platform architecture.

Own and scale automated patient-data ingestion and transformation pipelines from EMR systems into clinical-trial matching workflows. Design reliable asynchronous, queue-based, containerized architectures; manage schemas, validation, data quality, monitoring, and production issues. Partner with AI and product engineering teams on healthcare data foundations, APIs, scalability, and trustworthy clinician-facing workflows. Operate autonomously in a startup environment while applying strong systems thinking and pragmatic technical judgment.

Designs and leads scalable real-time and batch data pipelines, data platforms, architectures, data products, and intelligent APIs. Ensures data quality, supports BI and AI/ML initiatives, and develops ingestion, processing, migration, and analytical solutions for big data, NoSQL, and data warehouse environments. Provides technical leadership, mentorship, code reviews, testing, CI/CD implementation, system monitoring, troubleshooting, and cross-functional translation of business requirements into reliable cloud-based solutions.

Design and build modern GCP lakehouse architectures, including Python and Spark pipelines, BigQuery ingestion, Kafka CDC, Delta Lake and Iceberg UniForm integrations, Delta Sharing endpoints, Snowflake and Databricks connectivity, data lineage, governed access controls, and semantic-layer alignment. Collaborate cross-functionally, troubleshoot full-stack issues, and deliver reusable data-sharing adapters and end-to-end data features.

Support SAP BRIM data analysis, migration, and development across SOM, Convergent Charging, Convergent Invoicing, and FI-CA. Design SAP BODS ETL workflows, configure EMIGALL migration objects, develop mappings and reconciliation reports, validate migrated data, troubleshoot issues, and support testing, cutover, production stabilization, documentation, governance, and stakeholder collaboration.

Build and maintain scalable data infrastructure, pipelines, warehouses, and models on cloud platforms, primarily GCP. Develop batch and real-time ETL/ELT workflows using Python, SQL, and Airflow-based tools; implement data quality, governance, metadata, lineage, CI/CD, and automation. Support production machine learning environments, optimize pipeline performance, collaborate with architects and analytics teams, lead solution delivery, and mentor data engineers.

Designs, builds, optimizes, and tests Snowflake lakehouse architecture and ETL/ELT pipelines integrating Salesforce, marketing, and business data. Develops Bronze, Silver, and Gold data models, semantic layers, and datasets for Power BI, analytics, and AI initiatives. Implements data quality and governance procedures, maintains Git repositories, documents architecture, leads solution design, reviews code, mentors engineers, and communicates technical solutions to stakeholders.

As a Senior Data Engineer at Auger, you will build data systems to transform customer data into a unified ontology for analytics and AI workflows, ensuring data quality and managing the data lifecycle.

Designs, builds, and maintains enterprise lakehouse data pipelines, transformation layers, and data models. Develops scalable batch and streaming solutions using Spark, Kafka, and Flink; implements medallion architecture, data quality monitoring, and infrastructure as code. Troubleshoots performance and data incidents, participates in code reviews, collaborates on data modeling, and mentors junior and mid-level engineers.

Leads enterprise data engineering initiatives by designing and optimizing data pipelines, data lakes, warehouses, and analytics infrastructure. Uses Snowflake, Informatica, SQL, and related technologies to integrate diverse data sources, improve data quality, secure PII, and support analytics and data science teams. Establishes governance, monitoring, scalability, performance, and cost-efficiency practices while mentoring teammates and partnering with stakeholders on complex technical solutions.

Architect, build, and evolve AWS-based data platforms and pipelines handling large, complex datasets. Optimize data solutions for scalability, reliability, performance, and cost efficiency. Collaborate with engineering and product teams, make architectural decisions, establish best practices, provide technical mentorship, and support modernization toward intelligent data architectures. The role involves Python, SQL, Databricks, Kubernetes, automation, DevOps, and agentic AI technologies.

Designs and oversees secure cloud data platforms, dimensional models, lakehouses, scalable ETL pipelines, Spark workflows, and data governance frameworks. Builds sitewide tracking architecture and KPI dashboards, integrates disparate data sources, optimizes query performance, and applies machine learning and AI-assisted development practices. Collaborates with engineering, product, DevOps, and security teams to deliver data solutions. Mentors engineers and analysts and manages projects through completion.

Leads data and analytics engineering for Zero Trust maturity assessment and implementation measurement. Designs common data models, integrates and validates enterprise data, develops maturity and risk metrics, supports prioritization and gap analysis, and establishes data quality, lineage, traceability, and documentation practices. Partners with dashboard and automation specialists to streamline reporting and data refresh workflows.

The Senior Data Engineer will design and develop scalable data architectures, manage ETL processes, optimize databases, and implement MLOps pipelines, promoting data-driven decision-making across the organization.

Own and scale streaming Kafka pipelines and large-scale Spark batch jobs processing billions of rows. Drive pipeline reliability, observability, data modeling, and cost/latency optimizations. Partner with data scientists and platform engineers, define SLOs, improve efficiency, contribute to shared infrastructure (Airflow, libraries, data catalog), and mentor junior engineers.

Own and operate the Snowflake warehouse and Sigma semantic layer; manage ingestion (Fivetran), dbt model scoping and review, reverse-ETL, data quality SLAs, dashboards, month-end financial analytics, vendor management, and automation to support AdOps, Sales, Finance, and executive reporting.

Design, build, and maintain scalable ETL/ELT data pipelines and data platform architecture. Build programmatic pipelines (primarily Python), optimize analytical data models (SQL), integrate sources into Snowflake, use orchestration/transformation tools (dbt, Airflow, Dagster), improve data quality/observability, and partner with product, engineering, and analytics to deliver reliable data for decision-making.

Designs and operates scalable serverless AWS data pipelines, data models, ETL/ELT workflows, feature stores, and analytics-ready data assets. Partners with AI, Analytics, Product, and Underwriting teams to support reproducible ML training and scoring, MLOps, data quality, monitoring, governance, and production troubleshooting. The role handles sensitive healthcare and financial data, optimizes serverless workloads, supports batch and near-real-time processing, and applies infrastructure-as-code, CI/CD, documentation, and responsible data-use practices.

Own and operate Priority Waste’s enterprise data platform, building Azure and Microsoft Fabric pipelines, warehouse models, Power BI semantic models and dashboards. Integrate operational, payroll, fleet, telematics, API and file-based data sources. Manage monitoring, alerting, data quality and governance while expanding AI-driven reporting and reconciliation automations. This hands-on, on-site role requires independently scoping, building, deploying and operating production data systems as the company’s primary data engineer.

Designs, builds, and optimizes batch and real-time data pipelines, warehouses, streaming solutions, analytical data models, and containerized data services. The role integrates diverse data sources, automates workflows, deploys secure multi-cloud services, embeds security scanning and encryption into CI/CD pipelines, and collaborates in Agile teams while mentoring junior engineers. Required expertise includes Spark, Kafka, Airflow, cloud data platforms, Python or related languages, databases, data modeling, Docker, and Kubernetes.

Lead the design, development, and optimization of scalable batch and real-time data pipelines and platforms. Build cloud-based data solutions using distributed processing, streaming technologies, and modern data warehouses. Define data models, improve performance and reliability, establish engineering best practices, and provide technical guidance to data engineers while collaborating with architects, product teams, developers, and stakeholders.