Top Senior Data Engineer Jobs in Pittsburgh, PA

The Data Engineer is responsible for designing data workflows and pipelines, implementing systems engineering principles, and deploying data streaming technologies while ensuring compliance with industry regulations and best practices.

Forward-deployed senior data engineer who deploys, hardens, integrates, and operates a data platform (lakehouse, streaming, governance) in DoD environments. Build pipelines across classification boundaries, produce accreditation evidence (STIG/cATO/FIPS), run day-2 operations, train mission teams, and mentor junior FDEs while feeding field feedback into product improvements.

Lead development of large-scale data analysis and validation workflows for autonomous driving ML. Design metrics, build datasets, run statistical error and regression analyses, collaborate with ML and software teams, and maintain AWS/Kubernetes orchestration for large-scale evaluation.

Owner of data platform modernization: design and migrate legacy systems to Kimball-style dimensional models and star schemas; build reliable production data pipelines; enforce data hygiene and validation; champion dbt best practices; mentor junior engineers; collaborate with analysts and stakeholders to ensure scalable, well-documented data models and platform observability.

Design, build, and maintain scalable data pipelines and infrastructure for large-scale healthcare claims and clinical datasets. Collaborate with cross-functional teams to evaluate data sources, optimize pipelines, ensure data quality, implement monitoring, and introduce modern data engineering practices to improve products and business outcomes.

The Senior/Staff Data Engineer will design and scale the core data platform for healthcare systems, focusing on infrastructure, tooling, and governance while mentoring engineers and collaborating with various teams.

The Senior Data Engineer will design and build scalable data platforms, handle automation for data operations, and ensure reliability and performance of data pipelines while collaborating with various teams.

The Senior Bioinformatics Data Engineer will build data pipelines, implement clinical data ingestion, and optimize platform infrastructure while ensuring data quality and compliance with legal standards.

Lead a team to design, build, and maintain cloud data engineering solutions using Microsoft Fabric and Azure Synapse. Responsibilities include architecture, data pipelines, lakehouse and warehousing implementation, governance, performance optimization, mentoring engineers, cross-functional collaboration, support/on-call, documentation, and ensuring reliability and compliance.

Build, operate, and modernize scalable data pipelines and warehouse environments for lottery reporting, analytics, and AI readiness. Improve ingestion, transformations, data models, contracts, observability, lineage, and onboarding patterns. Automate operations, troubleshoot production issues, mentor engineers, and support migration from legacy to cloud architectures while ensuring data quality, reliability, and regulatory continuity.

The Staff Data Engineer will lead financial data operations, ensuring accuracy and reliability of data pipelines, while collaborating with Finance, Product, and Engineering teams to enhance systems and decision-making processes.

The Senior Data Engineer will design and maintain scalable cloud-native data pipelines, develop APIs, implement advanced analytics, manage AI workflows, and enhance data operations collaboratively.

Lead the vision and execution for scalable data governance and quality across Airbnb. Architect future-proof data ecosystems, define best practices and tooling, drive cross-functional policy implementation (privacy, legal, infosec), mentor senior engineers, and influence executive strategy to embed stewardship into the data product lifecycle.

Administer, stabilize, and scale Oura's global Databricks environment. Manage workspace governance, cluster policies, access control, cost monitoring, job scheduling, and incident SLAs. Onboard teams, resolve performance and reliability issues, and partner with IT and Data Architecture. Over time contribute to pipeline development, Spark optimization, CI/CD, and infrastructure-as-code to support domain-oriented data mesh initiatives.

Lead architecture and scaling of the Databricks data warehouse and self-service data platform. Build reusable batch and streaming frameworks, enforce governance, SLOs, lineage, observability, CI/CD, and multi-tenancy. Mentor engineers, run design reviews, and ship documented patterns to enable analytics, data science, and app teams to move quickly without blocking on platform tickets.

Build end-to-end data and analytics features: ingest and model data, build transformations and pipelines, create client-facing dashboards and interfaces, and develop LLM-powered workflows to accelerate analysis and app development. Partner with stakeholders, perform exploratory analyses, and ensure data quality, observability, and maintainability while influencing data engineering strategy.

Lead design, build, and maintain scalable batch and streaming data pipelines and data warehouse models. Ensure data quality, observability, performance, and security. Own workstreams, support production incidents, and enable analysts and downstream applications.

Design, develop, and deliver analytics and BI products on Palantir Foundry integrating Appian and VA financial systems. Build dashboards, data models, and data quality monitoring; translate stakeholder requirements into KPIs and visualizations; support pipeline design, documentation, and training for VA acquisition and financial analytics.

Lead architecture, implementation, and optimization of scalable data platforms, ETL/ELT pipelines, and data governance. Ensure security and compliance, mentor junior engineers, drive CI/CD and IaC for data workflows, and collaborate with stakeholders to deliver actionable analytics and reporting.

Design, build, and operate large-scale AWS-based ETL pipelines using Glue/PySpark to ingest, transform, and curate multi-format data into Apache Iceberg tables. Ensure data quality, metadata management, semantic layer creation (Trino/Athena), CloudFormation deployments, documentation, and compliance within a FedRAMP federal agile environment.

Lead design and delivery of a cloud-based data platform: implement CDC/streaming ingestion, modeling, transformations, cross-region DB replication, observability, governance (PII, lineage, access), and enable downstream marts while mentoring engineers and driving IaC/automation-first practices.

Design, build, and maintain scalable ETL/data pipelines across distributed systems. Ensure data quality, integrity, security, and high availability. Monitor and optimize pipeline performance, perform root cause analysis, document systems, collaborate with global teams, and participate in on-call rotations to support production data systems.

Design, build, deploy, and operate scalable production data pipelines and workflows (Airflow, BigQuery, dbt). Own medium-sized platform initiatives end-to-end, ensure SLA-driven freshness, quality, and cost controls, implement monitoring and CI/CD, participate in on-call incident response, optimize warehouse performance, and collaborate with analytics, data science, product, and engineering stakeholders.

Lead architecture and hands-on engineering to design, scale, and govern a cloud-native lakehouse using Databricks and Microsoft Fabric. Build batch/streaming pipelines, ensure HIPAA-compliant PHI handling, produce analytics-ready datasets, mentor engineers, and drive platform strategy, governance, and reliability.

Design, build, and own data infrastructure and ETL/ELT pipelines (Airflow, S3, Lambda) into a governed Snowflake warehouse. Implement data quality, IaC (Terraform/CDK), CI/CD, and analytics solutions (SQL, Tableau). Enable ML/LLM use cases like forecasting and anomaly detection and deliver automated reporting and data-driven marketing outputs.