Top Senior Data Engineer Jobs

Designs, builds, and operates scalable enterprise data platforms supporting ingestion, processing, storage, governance, analytics, and AI/ML. Responsibilities include developing batch and real-time pipelines, lakehouse and warehouse architectures, orchestration, infrastructure automation, CI/CD, monitoring, security, cost optimization, and observability. The role partners with data, ML, DevOps, security, and application teams, troubleshoots complex platform issues, establishes reusable engineering standards, contributes to architecture strategy, and mentors engineers.

Design and operate scalable data pipelines, transformation workflows, layered data models, and production data infrastructure supporting analytics, experimentation, and AI/ML. Implement monitoring, data quality, observability, and incident response processes; modernize legacy systems; collaborate with product, analytics, and engineering teams; and mentor engineers through reviews and architectural discussions.

Designs and delivers scalable, low-latency streaming data pipelines using Apache Flink, Confluent Kafka, and Apache Iceberg. Modernizes batch and RDBMS workflows into event-driven architectures, builds lakehouse data structures, ensures data quality, optimizes streaming performance, and integrates ITSM and enterprise systems. The role also leads testing, documentation, delivery lifecycle activities, stakeholder collaboration, CI/CD, operational monitoring, and mentoring of data engineers.

Design, build, and maintain scalable data pipelines, client integrations, and data models to support reporting, analytics, and AI/ML. Ensure data quality, monitoring, and reliable ingestion of healthcare (FHIR/HL7, EHR) and claims data. Collaborate with product, engineering, and AI teams to enable downstream products and analytics.

Design, build, and optimize end-to-end data pipelines and dataflows, integrate with AWS, maintain schemas/data dictionaries, provide Tier 3 support, collaborate with stakeholders and product teams, document architectures, and support off-hours deployments. Ensure data governance, scalability, and production readiness while working primarily on-site in a cleared defense environment.

Design, develop, and manage scalable database systems, data pipelines, structures, and load routines primarily in AWS RDS for PostgreSQL and SQL environments. Support application teams through APIs, database optimization, data processing, and reporting tools such as Power BI. Collaborate with technical and non-technical stakeholders in an Agile setting. The role requires U.S. citizenship and an active TS/SCI with Polygraph clearance.

Build and scale data infrastructure supporting utility billing reports, analytics, AI-ready retrieval, dimensional models, and customer-facing data products. Responsibilities include developing ingestion and transformation pipelines, creating facts and dimensions, implementing testing and observability, monitoring freshness and lineage, and partnering with engineering, product, compliance, and analytics teams.

Design, develop, and optimize scalable batch and real-time data pipelines on GCP. Implement Medallion Architecture, build Python and PySpark transformations, optimize BigQuery and SQL workloads, deploy Dataflow pipelines, and orchestrate workflows with Cloud Composer and Airflow. Manage GCS storage, CI/CD, version control, IAM, data governance, security, reliability, scalability, and cost efficiency across enterprise data platforms.

Provides technical leadership for enterprise data platform engineering. Designs and implements ETL, ELT, streaming ingestion, data models, cloud data lakes and warehouses, monitoring, data quality, governance, testing, version control, and CI/CD practices. Leads AWS, Snowflake, and dbt implementations while integrating disparate data sources for analysts and data scientists. Partners with business stakeholders to align data products with organizational strategy and enables self-service analytics and automation.

The Staff Data Engineer will lead the architecture and scalability of H1's healthcare data processing systems, ensuring efficient entity resolution and big data operations. Responsibilities include design and optimization of distributed Spark pipelines, team leadership, and collaboration with AI/ML teams to enhance data processing capabilities.

The Senior Research Engineer will curate large datasets, automate data pipelines, optimize queries, and support data-driven research impacting business outcomes.

Design, build, and optimize scalable ELT pipelines into BigQuery, create dbt models and data models, implement data quality, observability, CI/CD, and IaC practices, and partner with stakeholders to deliver trusted enterprise data products.

Lead the design, development, scaling, and operation of enterprise data platforms, services, and pipelines. Own mission-critical systems, deliver complex multi-team projects, build analytics solutions, and improve data delivery processes. Partner with architects, engineers, analysts, data scientists, and business stakeholders to create reliable, observable, secure, and governed platforms. Provide technical leadership, evaluate technologies, establish engineering best practices, mentor engineers, and guide technical decisions across teams.

Design and build data warehouse, lakehouse, and analytics solutions on Microsoft Fabric and Azure SQL. Implement Medallion Architecture, develop reliable ELT/ETL pipelines, model data for analytics, ensure data quality and monitoring, consult with clients on requirements and governance, and provide technical leadership and mentoring.

Lead design and delivery of scalable data pipelines and APIs for Digital Risk Protection. Mentor engineers, align and ingest multiple data streams (including graph data), productize analytics and LLM outputs, and drive DRP technical projects with stakeholders to enable data-driven intelligence.

Design, build, and own core data models, pipelines, and infrastructure for the Eclipse Platform and Data Marketplace. Implement data quality monitoring, collaborate on governance, build dashboards, support leadership reporting, and deliver analytics and ML/NLP solutions.

Designs and oversees scalable data platforms, warehouses, lakehouses, pipelines, ETL processes, dimensional models, and Spark workloads. Integrates AI/ML capabilities, data governance, lineage, testing, monitoring, and performance optimization. Collaborates with engineering, product, DevOps, and security teams to support tracking, analytics, and business insights. The role also mentors engineers and analysts and manages software delivery using AWS DevOps, CI/CD, and Terraform practices.

Build and scale a client-facing analytics platform using Microsoft Fabric, scalable pipelines, Lakehouse architectures, dimensional models, and Power BI semantic models. Establish ingestion, observability, testing, CI/CD, and SDLC standards while optimizing performance, refresh strategies, costs, and SLAs. Lead architecture decisions, communicate technical concepts to business stakeholders, mentor engineers, and proactively manage platform risks in a client-facing analytics environment.

Own end-to-end data platform architecture across ingestion, transformation, modeling, and serving. Improve warehouse efficiency, access control, reliability, observability, orchestration, CI/CD, and developer experience. Lead cross-functional technical initiatives, build monitoring and alerting, mentor engineers, guide architectural decisions, and develop AI-powered data tooling. The role requires strong SQL and Python skills, production experience with Airflow, BigQuery, and containerized infrastructure, plus architectural ownership and stakeholder communication.

The role involves architecting and improving data systems, defining governance standards, optimizing performance, and mentoring engineers in data engineering.

Belvedere Trading seeks a Senior Data Engineer to enhance trading performance through data availability and reliability, designing ETL pipelines and data architectures in a fast-paced environment.

Design, build, and maintain scalable ETL/ELT pipelines and data warehouse architecture. Partner with cross-functional teams to define KPIs, ensure data quality and governance, own billing data infrastructure, and deliver dashboards and analytics for leadership while mentoring peers.

Design, build, and optimize modern Azure and Databricks data platforms for clients. Develop batch and streaming ingestion pipelines, lakehouse and medallion architectures, dimensional models, and transformation workflows. Lead discovery sessions, requirements workshops, architecture discussions, and solution reviews. Recommend practices for governance, lineage, monitoring, DevOps, security, and data modeling while translating business needs into scalable technical solutions and communicating with technical and executive stakeholders.

Designs, builds, and optimizes modern Azure and Databricks data platforms for clients. Responsibilities include client discovery, requirements workshops, architecture discussions, batch and streaming ingestion, lakehouse and dimensional modeling, data transformation, governance, monitoring, DevOps, security, and solution reviews. The role also communicates recommendations to technical stakeholders and leadership while delivering scalable analytics and reporting solutions.

Designs and maintains scalable data pipelines, architectures, ETL processes, data models, and governance frameworks for secure DoD analytics and AI initiatives. Integrates complex data sources, ensures data quality and compliance, and supports deployment and sustainment of data platforms. Collaborates with data scientists, product managers, and mission stakeholders to deliver operational decision-support solutions.