Top Data Engineer Jobs

Maintain and monitor Snowflake data warehouse and ingestion pipelines. Troubleshoot file/load/data quality issues, operate SFTP/drop-zone/file automation, support scheduled loads, build dbt models and tables, document runbooks, and serve as backup for core warehouse operations while collaborating with engineering and IT.

Design and build data warehouse, lakehouse, and analytics solutions on Microsoft Fabric and Azure SQL. Implement Medallion Architecture, develop reliable ELT/ETL pipelines, model data for analytics, ensure data quality and monitoring, consult with clients on requirements and governance, and provide technical leadership and mentoring.

Build and operate low-latency, real-time data and ETL pipelines for sports analytics products. Support production systems during live events, develop predictive analytics and APIs, and integrate complex real-time datasets into consumer and enterprise offerings.

Design, develop, operationalize, and maintain enterprise-scale data applications and relational databases. Build scalable ETL/ELT pipelines, process structured and unstructured data, develop scripts for data conversion, and collaborate with AI/ML engineers to train, deploy, and maintain models supporting mission-critical solutions.

Leads enterprise data engineering initiatives by designing and optimizing data pipelines, data lakes, warehouses, and analytics infrastructure. Uses Snowflake, Informatica, SQL, and related technologies to integrate diverse data sources, improve data quality, secure PII, and support analytics and data science teams. Establishes governance, monitoring, scalability, performance, and cost-efficiency practices while mentoring teammates and partnering with stakeholders on complex technical solutions.

Design, develop, and optimize cloud-based ETL/ELT pipelines and data architectures using Informatica and Databricks in AWS GovCloud. Author and optimize SQL and Python scripts, build secure RESTful APIs, perform data validation, migrations from on-premises to cloud, and troubleshoot performance issues across large datasets. Support DON Jupiter enterprise environment and related ETL frameworks.

Build, deploy, and maintain secure, scalable data pipelines and analytics on AWS/Databricks. Implement CI/CD, governance (Unity Catalog, lineage), platform observability, and operational support for enterprise datasets and Databricks SQL reporting.

Architect, build, and evolve AWS-based data platforms and pipelines handling large, complex datasets. Optimize data solutions for scalability, reliability, performance, and cost efficiency. Collaborate with engineering and product teams, make architectural decisions, establish best practices, provide technical mentorship, and support modernization toward intelligent data architectures. The role involves Python, SQL, Databricks, Kubernetes, automation, DevOps, and agentic AI technologies.

Designs and oversees secure cloud data platforms, dimensional models, lakehouses, scalable ETL pipelines, Spark workflows, and data governance frameworks. Builds sitewide tracking architecture and KPI dashboards, integrates disparate data sources, optimizes query performance, and applies machine learning and AI-assisted development practices. Collaborates with engineering, product, DevOps, and security teams to deliver data solutions. Mentors engineers and analysts and manages projects through completion.

Leads data and analytics engineering for Zero Trust maturity assessment and implementation measurement. Designs common data models, integrates and validates enterprise data, develops maturity and risk metrics, supports prioritization and gap analysis, and establishes data quality, lineage, traceability, and documentation practices. Partners with dashboard and automation specialists to streamline reporting and data refresh workflows.

Design, build, and optimize scalable data platforms, pipelines, and lakehouse/warehouse solutions using Microsoft Fabric and Azure. Implement ETL/ELT, data migration from SQL Server, governance, CI/CD, streaming integrations, and Power BI connectivity to enable analytics and AI initiatives while ensuring security and performance.

Designs, builds, and optimizes data pipelines and architectures (ETL/ELT) to support analytics and ML teams. Assembles complex datasets, implements process improvements, collaborates with IT on AWS and Snowflake infrastructure, applies statistical techniques, supports reporting and analytics, and ensures compliance with financial regulations.

The Senior Data Engineer will design and develop scalable data architectures, manage ETL processes, optimize databases, and implement MLOps pipelines, promoting data-driven decision-making across the organization.

Lead technical design and implementation of production-grade data platforms, ETL/ELT and streaming pipelines, containerized Python data applications, Snowflake and dbt modeling, observability, CI/CD, and AI/ML data integrations to enable scalable data products and business-aligned analytics.

Lead design and build of Snowflake-native medallion data architecture, ETL/ELT pipelines, master data and governance, and an enterprise semantic layer. Partner with Finance to produce reliable financial data products, optimize performance/cost, enforce data quality and compliance, mentor junior engineers, and support AI use cases and observability.

Own and scale streaming Kafka pipelines and large-scale Spark batch jobs processing billions of rows. Drive pipeline reliability, observability, data modeling, and cost/latency optimizations. Partner with data scientists and platform engineers, define SLOs, improve efficiency, contribute to shared infrastructure (Airflow, libraries, data catalog), and mentor junior engineers.

Lead design, maintenance, and optimization of on-prem and cloud data platforms. Perform DBA duties for SQL Server, manage HA/DR and replication, troubleshoot performance, lead on-prem to Azure migrations, maintain Azure data services and Microsoft Fabric, optimize cloud cost/performance, implement monitoring, collaborate with architects and BI teams, and mentor junior engineers.

Provide day-to-day administration and production support for Snowflake, Matillion, and related data platforms. Monitor jobs and performance, troubleshoot ETL/ELT and report refresh failures, manage access and deployments, maintain runbooks, and build AI-driven automation and agent-based workflows to improve operational reliability and efficiency.

Design, develop, and maintain batch and streaming data pipelines and ETL for large unstructured datasets. Build and operate CI/CD pipelines, containerize applications with Docker, deploy on Kubernetes, and collaborate with developers, data scientists, SMEs, and cyber analysts to deliver data management solutions.

Own and operate the Snowflake warehouse and Sigma semantic layer; manage ingestion (Fivetran), dbt model scoping and review, reverse-ETL, data quality SLAs, dashboards, month-end financial analytics, vendor management, and automation to support AdOps, Sales, Finance, and executive reporting.

Design, implement, and maintain automated ingestion and transformation workflows to bring spreadsheet-based operational data (JSON/CSV/Excel) into enterprise databases and Pega workflows. Validate data integrity, troubleshoot pipelines, support reporting integrations, document data flows, and collaborate with architects, developers, and stakeholders to modernize and secure enterprise data services.

Own and scale Provable's data platform on GCP: build and optimize ingestion pipelines from blockchain indexers, design privacy-aware data models, manage Postgres and BigQuery, develop high-performance data-serving APIs, ensure data quality and observability, and use IaC (Terraform, Helm) and Kubernetes to deploy and cost-optimize environments.

Design, build, and maintain scalable ETL/ELT data pipelines and data platform architecture. Build programmatic pipelines (primarily Python), optimize analytical data models (SQL), integrate sources into Snowflake, use orchestration/transformation tools (dbt, Airflow, Dagster), improve data quality/observability, and partner with product, engineering, and analytics to deliver reliable data for decision-making.

Design, develop, test, and maintain ETL solutions and data warehouse structures using SSIS and SQL Server. Build and support SSAS models, optimize ETL performance, ensure data quality, partner with stakeholders, and produce technical documentation to support BI and reporting initiatives.

Design, build, and operate scalable ingestion, curation, and metadata-enrichment pipelines for enterprise data catalog and discovery. Ensure data quality, schema evolution, lineage, and cost-efficient large-scale processing; translate technical concepts for non-technical stakeholders and support downstream mission use.