Top Data Engineer Jobs in Philadelphia, PA

The Senior Data Engineer designs and develops scalable data architectures across platforms, mentors team members, and enhances data engineering capabilities for insights and decision-making.

Design, build, and maintain end-to-end batch and streaming data pipelines on GCP. Migrate legacy warehouses to BigQuery/Bigtable/ClickHouse, orchestrate workflows in Airflow, ensure data quality and observability, and partner with ML engineers on feature pipelines, drift monitoring, and retraining.

Design and implement data integration and data warehouse solutions using Big Data and open-source technologies. Build cost-efficient, performant cloud data pipelines, apply data modeling and ML concepts, and implement real-time streaming and aggregation patterns. Hands-on SQL/NoSQL and programming experience required.

Design and implement data integration and data warehouse solutions using big data technologies. Build cost-efficient, performant cloud data pipelines, apply data modeling and machine learning knowledge, and implement real-time streaming and aggregation patterns.

Design, build, and automate scalable batch and streaming data pipelines, implement data models and ETL, automate deployments, support ML/experimentation, maintain server architecture, and partner with stakeholders to deliver analytics and data-driven tools.

As a Lead Data Engineer, you'll optimize data workflows, manage data engineering projects, mentor junior engineers, and ensure robust data solutions meet business needs.

Own and architect the semantic layer and metrics/metadata for the data platform (Databricks/GCP). Build AI-ready models, enforce modeling and documentation standards, implement observability/testing for pipelines, enable self-serve analytics, and collaborate across product, clinical, and business teams to translate questions into reliable data solutions.

Design, operate, and scale end-to-end data infrastructure and pipelines. Build reusable data models and a semantic layer, ensure data quality and privacy, implement observability and SLAs, support marketing and growth feeds, partner with cross-functional stakeholders, and enable ML/AI consumption and reverse ETL workflows.

As a Senior Data Engineer, you will develop data pipelines, architect innovative data products, and integrate AI/ML models to enhance business insights.

Design, develop, and maintain enterprise data solutions and pipelines using Azure data platform and Microsoft Fabric. Support data modeling, master data management, medallion architecture, data quality, and integrations to produce trusted, scalable data for analytics and BI.

Design, build, and maintain scalable, secure data architectures, models, and ETL pipelines. Integrate diverse data sources, optimize performance and data quality, implement governance, monitor production SLAs, and collaborate with data scientists, analysts, and product teams. Provide technical leadership, documentation, and training to improve engineering practices across the organization.

Lead a team of 5-6 data engineers to design and implement scalable data pipelines (Airflow), manage Snowflake data architecture, build real-time streaming solutions with Kafka/Spark Streaming, develop and integrate APIs, enforce code quality, and drive technical decisions and best practices.

Design, build, and maintain scalable ETL/ELT pipelines and product-level data architectures. Improve pipeline performance and data freshness, lead code/design reviews, mentor engineers, and collaborate with Data Science, Product, and Engineering to make data reliable and accessible.

Build, maintain, and optimize cloud data pipelines and dbt models; design Airflow DAGs; implement dimensional models and BI dashboards; integrate healthcare data with HIPAA-compliant practices; contribute to RAG pipelines and MLOps workflows; review contractor code, monitor data quality, and document designs following governance standards.

Remote entry-level Big Data Engineer role building data acquisition and munging pipelines. Requires strong Python3 (NumPy, Pandas), advanced SQL, scalable algorithm and data-structure implementation on distributed clusters, converting code to functional paradigms, and the ability to learn PySpark or Kafka quickly. Product-development, startup experience and real-world pipeline projects preferred.

Design, build, and deliver a global analytics platform: manage data collection and pipelines, develop visualizations and reports, create semantic models, tune performance, collaborate with IT and business stakeholders, and implement governance for analytics products.

The Senior Data Engineer will design and build data pipelines and infrastructure to support data science and business intelligence solutions, utilizing AWS services and streaming technologies.

The Senior Data Engineer will design and implement lakehouse architectures, optimize ClickHouse deployments, develop ETL/ELT pipelines, and create data models to support analytical and operational functions.

Lead scaling of Arbital's AWS/Databricks lakehouse and Spark pipelines, implement actuarial healthcare calculations, own Airflow orchestration and CI/CD, ensure data quality and HIPAA-compliant PHI handling, partner with data scientists to deploy ML models, and set platform architecture and engineering standards.

Own and evolve end-to-end data pipeline architecture across ingestion, transformation, modeling, and serving. Lead platform improvements (cost, compute efficiency, access control), CI/CD, monitoring, and incident response. Drive cross-team technical initiatives, mentor engineers, and integrate AI tooling to improve workflows while remaining hands-on building and debugging production pipelines.

Own end-to-end data pipelines (ingest, dbt transformations, BigQuery warehousing) and consolidate the analytics stack into a single source of truth. Build and maintain dbt models with tests and documentation, establish data quality and observability, own product analytics and instrumentation, partner with GTM and marketing on reporting, and prepare for high-volume/streaming ingestion.

Lead design, build, test, and maintain scalable cloud data platforms and pipelines (ETL/ELT, batch and streaming). Ensure data quality, governance, security, CI/CD deployment, performance tuning, migration/archival, and mentor data engineering teams to support analytics and AI/ML use cases for a federal modernization program.

Design, build, test, and maintain scalable cloud-based data platforms and ETL/ELT pipelines (batch and near-real-time). Implement data models, data marts, governance, metadata, CI/CD and IaC, optimize pipeline performance, support migrations/DR, produce documentation, and collaborate with architects, DBAs, and stakeholders to meet federal security and audit requirements.

Lead design and execution of data migration, archival, and disaster recovery for a cloud-based court case management modernization. Own migration strategy, data lifecycle and retention, DR/HA design and drills, tooling evaluation, documentation, and coordination with Data Engineering, Governance, Security, and stakeholders to ensure auditable, resilient, and compliant migrations.

Lead engineering strategy and hands-on implementation for Finance & Actuarial data platforms. Architect no-touch automated data pipelines, drive cloud migrations (Azure Synapse/Databricks/Snowflake), embed AI-assisted development and modern DevOps, establish CI/CD and runbooks, resolve complex incidents, evaluate tooling, and mentor engineering squads while communicating strategy to executive stakeholders.