Top Senior Data Engineer Jobs in Pittsburgh, PA

Design and maintain Snowflake data pipelines and data lake architectures for asset-based finance analytics. Develop ETL/ELT workflows, validate and reconcile financial data, migrate legacy systems, and translate quantitative finance logic into scalable architectures. Support project execution through requirements breakdown, planning, testing, cutover, and go-live readiness. Collaborate across engineering, quantitative analytics, and stakeholder teams.

Design and architect scalable healthcare data systems, core data models, and production data pipelines. Integrate and normalize healthcare data using TUVA, OMOP, and FHIR standards; establish data quality and governance; optimize performance; deploy secure cloud infrastructure; ensure regulatory compliance; and build bi-directional EMR integrations. The role also requires independent technical decision-making, test automation, CI/CD, and DevOps practices in a fast-paced healthcare technology startup.

Design, build, and maintain scalable batch and streaming data pipelines using Databricks, PySpark, Python, SQL, Spark, and Delta Lake. Develop transformations, orchestration workflows, data models, validation processes, and curated data products. Troubleshoot performance and quality issues, apply governance and security practices, document solutions, and collaborate with architects, data scientists, DevOps teams, analysts, and clients.

Leads the design, development, and optimization of scalable data pipelines and analytics platforms. Builds ETL/ELT workflows using Databricks and Spark, integrates and transforms source data into curated models, manages SQL Server data, and maintains documentation and lineage. Collaborates with product, analytics, and engineering teams to deliver reliable data solutions. Applies responsible AI practices and delivers projects independently within established timelines.

Design, build, and operate end-to-end data pipelines and models for healthcare claims and payer data. Responsibilities include ingestion, canonical and analytical data modeling, legacy process migration, data quality, testing, CI/CD, deployment, operations, incident response, tool integration, documentation, and onboarding new data sources. The role partners across ML, product, analytics, platform, operations, and customer teams while critically evaluating AI-generated engineering work.

Build and operate scalable batch and streaming data pipelines, dimensional models, ELT/ETL workflows, and trusted data products. Improve data quality, observability, reliability, performance, security, and cost efficiency across the cloud data platform. Partner with analytics, risk, finance, product, data science, and machine learning teams to support business and AI use cases. Lead technical initiatives, influence architecture, mentor engineers, and establish engineering best practices.

Own Mux’s end-to-end data platform, including ingestion, Snowflake administration, dbt transformations, orchestration, data quality, observability, and reverse ETL. Build semantic models supporting AI agents, establish governance and reliability standards, and partner with Engineering, Finance, Product, and GTM. Use AI coding tools to develop and maintain pipelines while validating output quality. The role requires strong SQL, Python, data modeling, cloud warehouse administration, and production data engineering experience.

Designs, builds, and optimizes scalable Databricks-based data platforms, pipelines, integrations, and reusable engineering tools. The role focuses on platform performance, reliability, cost efficiency, security, governance, automation, and cloud infrastructure. It collaborates with engineering, analytics, security, and other stakeholders on architecture, technical planning, production support, and continuous improvement. The position requires hands-on data engineering experience with Databricks, cloud services, Python, SQL, Spark, infrastructure-as-code, and CI/CD practices.

Build and operate a governed Snowflake enterprise data warehouse, including ingestion, orchestration, dbt transformations, infrastructure as code, security controls, reliability checks, and CI/CD. Partner with data owners and BI teams during migration from legacy systems, ensure compliance for sensitive financial data, support reconciliation and incident resolution, and mentor engineers. The role requires hands-on ownership of pipelines and platform components across development and production environments.

Plans and executes enterprise data migrations, conversions, transformations, archival, and cloud data platform operations. Builds ETL/ELT pipelines and migration scripts, performs profiling and source-to-target mapping, validates data, manages cutovers and rollback procedures, and troubleshoots migration issues. Optimizes cloud platforms, databases, workloads, security, access, cost, and performance while collaborating with engineering, governance, architecture, and business teams.

Lead the architecture and development of Penn Foster Group’s Databricks-based cloud data platform. Build scalable batch, streaming, CDC, and API pipelines using Python, SQL, Spark, and Azure; establish engineering standards, governance, observability, and CI/CD practices; develop AI-ready semantic data products; and mentor data engineers. Partner with BI, product, security, governance, and MLOps teams to support analytics, machine learning, generative AI, and self-service reporting.

Own end-to-end client data migrations: reverse-engineer legacy ETL, design and build Airflow DAGs and Spark jobs, validate and reconcile data at scale, document architecture and decisions, and coordinate cross-functional teams through go-live and hypercare.

Lead production of marine and anadromous species range maps under FWS standards. Aggregate, normalize, transform, and validate spatial data; analyze habitat intersections; coordinate review cycles with FWS and NOAA Fisheries subject matter experts; document quality assurance; and obtain government sign-off for deliverables.

Designs and leads enterprise data pipelines and integrations across Snowflake, Oracle Fusion, on-premises databases, and cloud applications. Ensures data quality, governance, security, scalability, and performance while supporting Power BI, AI/ML, and self-service analytics. Partners with business and technical stakeholders, leads migrations, mentors engineers, optimizes data platforms, and establishes engineering best practices.

Designs, builds, deploys, and maintains scalable data pipelines, data lake systems, batch and streaming processing, MLOps frameworks, data documentation tooling, and an agentic data exploration platform. The role supports customer-facing products and enables engineering teams through reliable infrastructure, observability, data discovery, and AI capabilities.

Build and maintain production data ingestion, transformation, and pipeline systems for a governed federal data and AI platform. Develop data products, infrastructure-as-code, CI/CD workflows, monitoring, quality controls, cataloging, and access controls within FedRAMP, NIST 800-171, and CUI constraints. Support data science and machine learning teams, troubleshoot reliability and performance issues, and document engineering processes. The role is fully remote and requires U.S. citizenship and the ability to obtain a T5/SSBI adjudicated clearance.

Build and maintain production data pipelines that transform robot logs and telemetry into reliable, queryable datasets. Design Spark-based ETL workflows, orchestrate processing with Airflow or similar tools, manage gold-layer datasets, and implement data quality, schema evolution, monitoring, and metadata practices. Collaborate with robotics, hardware, reliability, analytics, and ML teams on data modeling, fleet insights, debugging, and root-cause analysis. The role may also contribute to Python, Java, or C++ libraries supporting data capture and consumption.

Designs and leads production-grade batch, incremental, streaming, and real-time data pipelines across Microsoft Fabric and Azure. Builds Delta Lake medallion architectures, dimensional and Data Vault models, CDC and incremental-loading solutions, CI/CD automation, governance, security, observability, and data-quality controls. Supports migrations to Fabric, prepares governed data for AI and RAG workloads, and leads client-facing engineering workstreams, estimates, risk management, mentoring, and operational handover.

Own PushPress’s data platform, including ingestion, orchestration, cloud warehouse performance, governance, privacy, data quality, monitoring, and AI-ready data foundations. Build reliable pipelines integrating product, payment, and third-party data; establish data contracts, access controls, auditability, and semantic definitions; support real-time analytics and trustworthy reporting. Partner with Engineering, Data, and AI teams while maintaining infrastructure, incident response, documentation, and operational runbooks.

Build and own production data infrastructure for a healthcare AI platform. Responsibilities include REST API ingestion, Azure Event Hubs streaming into Databricks, Delta Lake medallion pipelines, entity resolution, semantic metrics, data-quality instrumentation, reconciliation, schema-drift handling, and troubleshooting source-to-warehouse discrepancies. The role requires strong Python and SQL skills, independent pipeline ownership, and experience with Databricks, Spark, PySpark, streaming, and healthcare-related data is a plus.

Build and guide data platform capabilities supporting marketing, finance, analytics, and data science. Develop data collection, integration, scoring, experimentation, analytics, and infrastructure solutions; contribute code, lead cross-functional technical initiatives, improve system resiliency through incident response, and establish engineering standards. Partner with business and technical stakeholders to define strategy and long-term roadmaps.

Builds business-critical dashboards, scorecards, reports, and ad hoc analyses using SQL, Python, Excel, Power BI, and Tableau. Analyzes KPIs, identifies trends and root causes, automates recurring reporting, validates data, and translates complex findings into actionable insights for stakeholders and leadership. The role collaborates with data engineers and cross-functional teams to improve reporting workflows, data pipelines, and decision-making.

Lead financial data engineering initiatives involving commissions, incentive programs, and backend financial systems. Build scalable, accurate, and reliable data pipelines, platform tooling, partner integrations, analytics infrastructure, and data science infrastructure. Shape technical strategy and roadmaps, collaborate with Finance, Product, Data Science, and Engineering, mentor engineers, contribute code, lead incident response, and establish engineering standards.

Own and evolve UJET’s data platform, including MySQL CDC replication to BigQuery, dbt transformations, Terraform infrastructure, pipelines, data quality, observability, and Looker models. Build reliable, analytics-ready datasets and trusted metrics for internal and customer-facing reporting. Partner with Analytics, Finance, Product, and Engineering to deliver scalable data solutions, improve platform reliability, optimize performance and costs, and establish development standards and guardrails.

Designs, develops, and maintains scalable cloud-based data pipelines and enterprise data solutions. The role covers data ingestion, transformation, orchestration, integration, data lakes, cloud warehouses, batch and streaming processes, performance optimization, governance, and lineage. The Senior Data Engineer collaborates with analysts, data scientists, engineers, stakeholders, contractors, and vendors while mentoring junior staff. Core tools include Databricks, dbt, Azure Data Factory, SQL, Python, and Azure.