Top Data Engineer Jobs in Pittsburgh, PA

Design, build, and automate scalable batch and streaming data pipelines, implement data models and ETL, automate deployments, support ML/experimentation, maintain server architecture, and partner with stakeholders to deliver analytics and data-driven tools.

As a Lead Data Engineer, you'll optimize data workflows, manage data engineering projects, mentor junior engineers, and ensure robust data solutions meet business needs.

Own and architect the semantic layer and metrics/metadata for the data platform (Databricks/GCP). Build AI-ready models, enforce modeling and documentation standards, implement observability/testing for pipelines, enable self-serve analytics, and collaborate across product, clinical, and business teams to translate questions into reliable data solutions.

Design, operate, and scale end-to-end data infrastructure and pipelines. Build reusable data models and a semantic layer, ensure data quality and privacy, implement observability and SLAs, support marketing and growth feeds, partner with cross-functional stakeholders, and enable ML/AI consumption and reverse ETL workflows.

Design, build, and maintain scalable, secure data architectures, models, and ETL pipelines. Integrate diverse data sources, optimize performance and data quality, implement governance, monitor production SLAs, and collaborate with data scientists, analysts, and product teams. Provide technical leadership, documentation, and training to improve engineering practices across the organization.

Lead a team of 5-6 data engineers to design and implement scalable data pipelines (Airflow), manage Snowflake data architecture, build real-time streaming solutions with Kafka/Spark Streaming, develop and integrate APIs, enforce code quality, and drive technical decisions and best practices.

Design, build, and maintain scalable ETL/ELT pipelines and product-level data architectures. Improve pipeline performance and data freshness, lead code/design reviews, mentor engineers, and collaborate with Data Science, Product, and Engineering to make data reliable and accessible.

Build, maintain, and optimize cloud data pipelines and dbt models; design Airflow DAGs; implement dimensional models and BI dashboards; integrate healthcare data with HIPAA-compliant practices; contribute to RAG pipelines and MLOps workflows; review contractor code, monitor data quality, and document designs following governance standards.

Remote entry-level Big Data Engineer role building data acquisition and munging pipelines. Requires strong Python3 (NumPy, Pandas), advanced SQL, scalable algorithm and data-structure implementation on distributed clusters, converting code to functional paradigms, and the ability to learn PySpark or Kafka quickly. Product-development, startup experience and real-world pipeline projects preferred.

Design, build, and deliver a global analytics platform: manage data collection and pipelines, develop visualizations and reports, create semantic models, tune performance, collaborate with IT and business stakeholders, and implement governance for analytics products.

The Senior Data Engineer will design and build data pipelines and infrastructure to support data science and business intelligence solutions, utilizing AWS services and streaming technologies.

The Senior Data Engineer will design and implement lakehouse architectures, optimize ClickHouse deployments, develop ETL/ELT pipelines, and create data models to support analytical and operational functions.

Lead scaling of Arbital's AWS/Databricks lakehouse and Spark pipelines, implement actuarial healthcare calculations, own Airflow orchestration and CI/CD, ensure data quality and HIPAA-compliant PHI handling, partner with data scientists to deploy ML models, and set platform architecture and engineering standards.

Own and evolve end-to-end data pipeline architecture across ingestion, transformation, modeling, and serving. Lead platform improvements (cost, compute efficiency, access control), CI/CD, monitoring, and incident response. Drive cross-team technical initiatives, mentor engineers, and integrate AI tooling to improve workflows while remaining hands-on building and debugging production pipelines.

Own end-to-end data pipelines (ingest, dbt transformations, BigQuery warehousing) and consolidate the analytics stack into a single source of truth. Build and maintain dbt models with tests and documentation, establish data quality and observability, own product analytics and instrumentation, partner with GTM and marketing on reporting, and prepare for high-volume/streaming ingestion.

Lead design, build, test, and maintain scalable cloud data platforms and pipelines (ETL/ELT, batch and streaming). Ensure data quality, governance, security, CI/CD deployment, performance tuning, migration/archival, and mentor data engineering teams to support analytics and AI/ML use cases for a federal modernization program.

Design, build, test, and maintain scalable cloud-based data platforms and ETL/ELT pipelines (batch and near-real-time). Implement data models, data marts, governance, metadata, CI/CD and IaC, optimize pipeline performance, support migrations/DR, produce documentation, and collaborate with architects, DBAs, and stakeholders to meet federal security and audit requirements.

Lead design and execution of data migration, archival, and disaster recovery for a cloud-based court case management modernization. Own migration strategy, data lifecycle and retention, DR/HA design and drills, tooling evaluation, documentation, and coordination with Data Engineering, Governance, Security, and stakeholders to ensure auditable, resilient, and compliant migrations.

Design, build, and maintain production-scale data systems and web-scale datasets (Spark/Flink) to support personalization ML. Drive dataset/schema design, collaborate with algorithm teams, and improve distributed big-data processing for member experience.

Design, build, test, deploy, and support enterprise data solutions for financial reporting, reserving, and claims. Develop and maintain pipelines, transformations, data models, and controls using SQL, Python, PySpark, and Microsoft Fabric. Automate reconciliations and data quality checks, partner with business stakeholders, perform testing, review code, mentor peers, and resolve production issues to improve reporting accuracy and operational efficiency.

Technical leader for Data Engineering responsible for designing, operating, and optimizing Snowflake-based data platforms, self-hosted orchestration (Prefect), dbt practices, AWS infrastructure, and data pipelines. Drive architecture, mentor engineers, partner cross-functionally, ensure observability and production-grade practices, and enable model-ready datasets and AI/LLM workflows.

Design, build, operate, and optimize large-scale production data pipelines and foundational Healthcare Map data products using Python, SQL, Airflow, Spark, and AWS. Ensure data quality, observability, and performance; debug complex workflows; contribute to architecture, CI/CD, testing, documentation, and cross-functional delivery to enable analytics and AI/ML use cases.

Lead data engineering for a healthcare scheduling platform rebuild: map legacy multi-TB schema, design target schema, build translation layer (views/materialized views and write mappers), ensure data consistency during parallel systems, plan per-tenant cutover with verification and rollback, tune DB performance, instrument data quality/lineage/audit, and mentor engineers.

Design, build, and scale reliable batch and real-time data pipelines and warehouses. Partner with engineering, data science, and business teams to define data models, improve observability, optimize storage and querying, and evangelize data engineering best practices across the company.

Design, build, and maintain scalable Databricks-based data pipelines and ELT workflows; develop and document dbt models; define data modeling methodology; ensure data quality, reliability, and scalability; collaborate with clients and cross-functional teams; provide technical guidance and deliver improvements to clients' data infrastructure and analytics capabilities.