Top Senior Data Engineer Jobs

Leads data engineering and data science teams, setting strategy and delivering scalable pipelines, data architecture, models, analytics infrastructure, and data governance. Partners with product, analytics, and business stakeholders to prioritize initiatives, assess upstream changes, maintain data quality, and support Snowflake-based warehousing. This hands-on leadership role includes mentoring staff, contributing to technical codebases, and advancing data science and engineering solutions.

Build and maintain data pipelines to ingest, normalize, and deliver messy healthcare data (FHIR, HL7, CCDAs, PDFs) into structured models for AI and clinical use. Implement ETL, real-time webhooks, document extraction, PII sanitization, storage on AWS, and monitor data quality while ensuring compliance with healthcare interoperability standards.

Design, build, and maintain scalable batch and streaming data pipelines using Python, SQL, Kafka, and GCP. Develop REST and GraphQL data services, CI/CD automation, observability, and data-quality frameworks. Integrate ML and NLP models into production workflows, including continuous retraining and real-time inference. Support structured and unstructured healthcare datasets, distributed systems, microservices, and reliable data infrastructure while collaborating with data science and MLOps teams.

Build and configure a government Databricks workspace, develop ingestion and integration pipelines from enterprise and legacy systems, and prepare data for reporting. Implement Unity Catalog governance, metadata management, auditing, and lineage; configure MLflow workflows; assess security controls for sensitive data; and create architecture documentation, data dictionaries, and SOPs to support long-term sustainment.

Lead the design and optimization of healthcare data pipelines integrating EHR, payer, HIE, and vendor data. Build AWS-based ETL/ELT infrastructure, reusable integration tooling, data quality monitoring, and ML enablement foundations. Ensure HIPAA-compliant handling of clinical data, including security controls, audit logging, encryption, and de-identification. Provide technical leadership, mentor engineers, influence platform architecture, and lead complex partner integrations involving FHIR, HL7v2, CCDA, and healthcare terminology standards.

Designs, develops, and optimizes Databricks and Spark data pipelines integrating Oracle EBS and ERP Cloud data. Builds ETL/ELT jobs, data models, validation processes, and reporting solutions across financial, purchasing, project, inventory, and HR modules. Ensures data quality, lineage, reconciliation, security, governance, and compliance while partnering with Oracle SMEs and documenting solutions for federal review and audits.

Develops and supports secure data integrations, applications, and workflows using Microsoft Dynamics CRM and Power Platform. Responsibilities include requirements gathering, solution design, implementation, ALM, systems integration, monitoring, troubleshooting, reporting, plug-in administration, documentation, vendor coordination, and data reconciliation. The role also creates reusable technical solutions, supports customer-facing applications, and collaborates with business analysts to improve customer insights and revenue-generating services.

Designs, builds, and optimizes SAP HANA-native data models and analytical objects for S/4HANA, BW/4HANA, and standalone HANA platforms. Translates business requirements into performant calculation views, CDS views, AMDPs, and SQLScript solutions; diagnoses and resolves performance issues; applies HANA tuning methodologies; supports replication, security, analytics modeling, migrations, and upgrades. Requires strong SAP HANA architecture, SQL, troubleshooting, communication, and documentation skills.

Build and operate scalable financial market data pipelines for Binance stock products and AI applications. Responsibilities include sourcing, ingesting, modeling, processing, storing, and serving real-time and historical data; designing multi-market data frameworks; optimizing Flink pipelines; and establishing quality, reconciliation, monitoring, lineage, and recovery systems. The role also evaluates vendors and data sources, defines data contracts, and collaborates with trading, product, AI, legal, and compliance teams.

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

Lead data engineering initiatives supporting analytics, machine learning, and business intelligence teams. Design complex data warehouse and data lake models, manage large-scale SQL and Python ETL/ELT pipelines, maintain data quality and lifecycle standards, and translate strategic priorities into actionable projects. Provide technical leadership, mentorship, architectural guidance, project planning, and cross-functional collaboration with product, infrastructure, and architecture teams.

Leads the design, development, governance, and operational support of enterprise data engineering solutions for Fresh Meats analytics. Builds cloud-based data lakes, pipelines, models, integrations, and reporting-ready datasets; implements security, data quality, lineage, observability, and governance controls; supports production incidents and releases; and partners with business, platform, and governance teams. Mentors engineers and analysts while ensuring scalable, documented, secure, and reliable data products.

Hands-on principal data engineer defining enterprise-scale data architecture, building and optimizing data pipelines/integrations for analytics and ML, deploying production code, mentoring engineers, and partnering with product and ML teams to transform and analyze data for actionable insights.

Design, develop, test, deploy, and optimize high-throughput streaming, event-driven, and batch data pipelines using Databricks, Scala/PySpark, and cloud infrastructure. Build data lakehouse solutions, troubleshoot DevOps and Azure issues, perform root-cause and impact analysis, and support the full software development lifecycle. Collaborate with distributed stakeholders, drive technical improvements through proofs of concept, and maintain scalable data integration and curation solutions.

Designs and maintains operational data infrastructure for smart manufacturing, including pipelines, data warehouses, ETL/ELT processes, time-series data systems, integrations, governance, and trusted datasets. Uses SQL and Python to support reporting, analytics, automation, dashboards, and operational decision-making. Partners across manufacturing and enterprise systems, investigates complex data challenges, evaluates emerging technologies, and supports advanced analytics and digital transformation initiatives.

Develop, maintain, and optimize scalable data solutions, enterprise ETL processes, and operational data workflows. Design, build, test, automate, and maintain data management systems; develop algorithms, predictive models, and proof-of-concepts; and collaborate with architects, modelers, and IT teams. The role also includes managing projects through delivery, supporting business initiatives, evaluating data solutions, and contributing to internal consulting and digital transformation activities.

Design and lead scalable, secure, highly available database infrastructure for multi-terabyte SQL Server environments. Set technical direction for data architecture, performance, real-time pipelines, security, and growth. Troubleshoot complex production issues, optimize queries and indexes, guide cross-functional projects, mentor engineers, review changes, reduce technical debt, and evaluate emerging technologies. Monitor database health using Splunk, Datadog, and Grafana while influencing engineering and Site Reliability strategy.

Leads large-scale migration from legacy systems to cloud platforms, including data mapping, transformation, validation, cleansing, and reconciliation. Builds MuleSoft APIs and DataWeave transformations for real-time and batch integrations. Supports Salesforce Data 360, document AI, identity resolution, data governance, metadata, lineage, compliance, testing, cutover, and audit readiness in Agile, federally regulated environments.

Design and develop scalable data pipelines, data models, schemas, and integrations for a video advertising platform. Collaborate across engineering, define user stories, deliver features using AI-assisted tools, write unit tests, maintain code quality, and support production systems on a rotating schedule. The role requires strong SQL, ETL/ELT, dbt, Airflow, Snowflake, AWS, and data architecture expertise.

Design and build maintainable data pipelines, ETL processes, and data architecture standards. Collaborate with product managers, analysts, and machine learning engineers to translate requirements into automated, scalable solutions. Apply software engineering best practices, asynchronous systems, APIs, streaming, testing, monitoring, and Python and SQL expertise. Help prioritize data initiatives based on business impact and communicate complex technical concepts to technical and non-technical stakeholders.

Designs and delivers scalable data engineering, analytics, automation, AI-enabled solutions, and supply chain applications. Builds Python solutions, Snowflake data pipelines, data models, reporting, and self-service analytics supporting planning, procurement, logistics, forecasting, inventory optimization, and operational decision-making. Partners with business and technical teams to translate requirements into reliable solutions, improve processes, maintain data quality, and provide technical leadership across analytics and data engineering initiatives.

Designs, develops, and operates production data pipelines and curated, AI-ready data products for AbbVie R&D. Responsibilities include data integration, normalization, modeling, metadata, lineage, quality controls, governance, documentation, knowledge graph publication, and support for RAG and vector-search workflows. The role collaborates with scientists, engineers, architects, data owners, and vendors; provides technical guidance; monitors pipeline reliability; resolves issues; and ensures compliance with data security, GxP, and regulatory standards.

Designs, builds, deploys, and maintains scalable cloud-native data platforms and pipelines in AWS. Supports data acquisition, preparation, database architecture, cloud migration, AI/ML, data science, and business intelligence initiatives. Leads collaborative teams in evaluating data, designing solutions, and managing operational data flows. Requires TS/SCI clearance with polygraph and experience in all-source analysis and data engineering.

Designs, builds, deploys, and maintains scalable cloud-native data platforms and pipelines using AWS. Supports cloud migration, data science, AI/ML, and business intelligence initiatives by organizing structured and unstructured data. Responsibilities include database architecture, data acquisition and preparation, software development, platform modernization, analytics architecture evaluation, and cross-functional team leadership. Requires TS/SCI clearance with polygraph and substantial all-source analysis experience.

Designs and develops cloud data architectures, ingestion frameworks, data models, and analytical platforms. Advises clients on cloud migration, data warehousing, technical approaches, and implementation roadmaps. Collaborates with stakeholders through requirements gathering, workshops, whiteboarding, and project meetings while deploying end-to-end cloud analytics solutions. Requires experience with cloud platforms, big data technologies, BI tools, data warehousing methodologies, programming, SQL, version control, and Agile/DevOps practices.