Top Senior Data Engineer Jobs

Design, develop, and monitor large-scale data pipelines and cloud-native data applications; collaborate with consulting teams and clients; apply best practices (TDD, CI/CD); build and operationalize ML-ready data platforms; produce documentation and runbooks; mentor junior engineers and contribute to proposals and analytics assets.

Build and maintain centralized pricing data infrastructure, scalable workflows, and data pipelines; integrate AI capabilities; deliver pricing tools, reporting, and governance to support data-driven pricing and budgeting across the firm.

Build and scale core data infrastructure and foundational datasets. Design, develop, and maintain scalable data pipelines for analytics, ML, experimentation, and product use cases. Implement data quality, audits, alerting, and anomaly detection. Partner with product, engineering, and business stakeholders and help establish long-term, scalable data architecture and tooling.

Integrate operational data into enterprise data warehouses; design, optimize, and support SSIS ETL pipelines; develop SSRS and Power BI reporting solutions and reusable data models; deliver data migrations and self-service extracts. Design production AI/ML solutions using Python, OCR, AWS Bedrock, and Claude, including multi-agent LLM implementations. Partner with stakeholders, lead code reviews, mentor developers, and support production BI deployments.

The Senior Data Engineer will architect and enhance data infrastructure, create dependable data pipelines, oversee cloud-based data warehouses, and mentor engineers to enable scalable solutions for analytics and machine learning.

Designs, builds, and optimizes scalable AWS and Snowflake data pipelines, infrastructure, data models, semantic layers, and data quality frameworks. Analyzes Medicare, Medicaid, and CMS repository data to support analytics and reporting. Responsibilities include workflow monitoring, automation, governance, security, performance optimization, stakeholder collaboration, and Agile delivery using modern DevOps and software engineering practices.

Own end-to-end data engineering for a business domain, including API and other-source ingestion, dbt models, orchestration, data-quality testing, monitoring, documentation, and performance. Build reliable, AI-ready single sources of truth and ensure data freshness, accuracy, traceability, and scalability. Collaborate with stakeholders and the Director of Data, establish engineering patterns, review work, and mentor other engineers.

The Developer, Data and Integration maintains and develops scalable integration solutions focusing on B2B/EDI transactions, working with business units to translate data needs into technical solutions, and ensures the reliability and performance of data flows.

Own and evolve the data lake and analytics stack powering fleet observability. Build and maintain scalable ETL/ELT pipelines, operate data lake infrastructure (Iceberg, Trino, Airflow, Spark, Superset), produce analytics and executive reporting, create dashboards and runbooks, and implement data governance and observability.

Design and implement end-to-end data integration and warehousing solutions for large volumes. Implement Hadoop/Hive data movement, script in Linux shell and Python, develop SQL for integration and analysis, and perform high-volume DW performance tuning. Vertica experience is a plus. Requires technical independence and a BS in CS/EE.

Build and implement a transactional data system: design and develop SSIS ETL packages, consume web services in ETL, create SSRS reports for ETL status, and implement T-SQL/SQL Server solutions per functional requirements and system design.

Design, build and maintain a data transactional system performing ETL and web service calls to synchronize state between systems. Develop SSIS packages, data models, dictionaries, test plans, and assist architects on database strategy.

Implement OLTP and OLAP systems to persist court information from functional requirements and system design. Perform ETL, export data to external agencies, use managed service calls, design and model database structures, design/code/deploy SSIS packages, document data dictionaries and package definitions, develop SSIS test plans, and support architects.

Design, build, and maintain scalable data ingestion and ETL pipelines across a growing data lake. Define and enforce data quality standards, SLOs, and validation frameworks. Optimize pipelines for performance and cost, expand monitoring and alerting, and enable stakeholders to self-serve on data infrastructure.

Lead and mentor a data engineering team, define technical vision and strategy, oversee data pipeline design, and collaborate with cross-functional teams.

Design and implement large-scale GCP-based data platforms and ETL using PySpark/Spark, BigQuery, Dataproc, Composer/Airflow. Process and analyze large datasets, write SQL, collaborate on BI delivery, and work in a mature Agile team.

Build and operate streaming and batch data pipelines for energy-storage telemetry. Design reliable, query-ready time-series and event datasets using open table formats, orchestration frameworks, AWS, and infrastructure-as-code. Lead technical designs, partner with field operations and engineering teams, support on-call operations, and mentor engineers while improving data reliability and engineering practices.

Build and maintain Snowflake and dbt data platforms, including ELT pipelines, tested models, orchestration, monitoring, documentation, access controls, and governance. Optimize performance and costs while ensuring reliable, discoverable data for internal dashboards, client products, and AI/ML use cases. Translate ambiguous stakeholder needs into durable solutions and apply strong software engineering practices, including Git, CI/CD, code review, Python, testing, and alerting.

Design and maintain scalable batch and real-time data pipelines, build governed data models for a CDP, ensure data quality and security, support identity resolution and customer 360, mentor junior engineers, and collaborate with analytics and business stakeholders to deliver actionable customer insights.

The role involves engineering modern data platforms, focusing on data ingestion, transformation, and storage while utilizing Azure services and MS Fabric, supporting an investment management firm.

Design and build scalable backend services and data ingestion pipelines, perform data modeling and large-file processing, develop reusable APIs, and optimize systems for speed and scalability while collaborating in an Agile team.

Design and build Microsoft Fabric medallion architecture, including Bronze, Silver, and Gold Delta tables, Spark feature pipelines, canonical MERGE workflows, Direct Lake semantic models, and OneLake layouts. Optimize Delta and Parquet physical storage, establish idempotent Python-based writes, size Fabric capacity, and support infrastructure provisioning with Terraform. The role also contributes to risk analytics delivery, performance testing, and potential ClickHouse adoption while partnering with DevOps and technical leadership.

Builds and manages enterprise data pipelines, transformations, reporting structures, and analytics infrastructure using operational data from Oracle Fusion, SAP, and related platforms. Supports secure, accurate financial, HR, and procurement reporting through Microsoft Fabric and Power BI, including real-time dashboards and historical analysis.

Migrate SQL Server data products and analytical workloads to a modern cloud platform. Redesign legacy SQL, ETL processes, and business logic; build scalable pipelines and analytical models; validate data quality; collaborate with stakeholders; and improve platform reliability, performance, cost efficiency, and AI-assisted data engineering automation.

Design, build, and operate production data pipelines using Python, Spark SQL, and Airflow. Canonicalize healthcare and customer data into trusted internal models, optimize distributed processing, enforce schemas, and implement quality checks and observability. Support customer onboarding, streaming pipelines, troubleshooting, on-call operations, and platform best practices while collaborating with product, analytics, engineering, data science, and customer teams.