Top Data Engineer Jobs in Philadelphia, PA

Lead design, build, test, and maintain scalable cloud data platforms and pipelines (ETL/ELT, batch and streaming). Ensure data quality, governance, security, CI/CD deployment, performance tuning, migration/archival, and mentor data engineering teams to support analytics and AI/ML use cases for a federal modernization program.

Lead design and execution of data migration, archival, and disaster recovery for a cloud-based court case management modernization. Own migration strategy, data lifecycle and retention, DR/HA design and drills, tooling evaluation, documentation, and coordination with Data Engineering, Governance, Security, and stakeholders to ensure auditable, resilient, and compliant migrations.

Lead engineering strategy and hands-on implementation for Finance & Actuarial data platforms. Architect no-touch automated data pipelines, drive cloud migrations (Azure Synapse/Databricks/Snowflake), embed AI-assisted development and modern DevOps, establish CI/CD and runbooks, resolve complex incidents, evaluate tooling, and mentor engineering squads while communicating strategy to executive stakeholders.

Design, build, and maintain production-scale data systems and web-scale datasets (Spark/Flink) to support personalization ML. Drive dataset/schema design, collaborate with algorithm teams, and improve distributed big-data processing for member experience.

Design, build, test, deploy, and support enterprise data solutions for financial reporting, reserving, and claims. Develop and maintain pipelines, transformations, data models, and controls using SQL, Python, PySpark, and Microsoft Fabric. Automate reconciliations and data quality checks, partner with business stakeholders, perform testing, review code, mentor peers, and resolve production issues to improve reporting accuracy and operational efficiency.

Technical leader for Data Engineering responsible for designing, operating, and optimizing Snowflake-based data platforms, self-hosted orchestration (Prefect), dbt practices, AWS infrastructure, and data pipelines. Drive architecture, mentor engineers, partner cross-functionally, ensure observability and production-grade practices, and enable model-ready datasets and AI/LLM workflows.

Design, build, operate, and optimize large-scale production data pipelines and foundational Healthcare Map data products using Python, SQL, Airflow, Spark, and AWS. Ensure data quality, observability, and performance; debug complex workflows; contribute to architecture, CI/CD, testing, documentation, and cross-functional delivery to enable analytics and AI/ML use cases.

Design, develop, and execute data migration solutions for Dynamics CRM/365 using KingswaySoft and SSIS. Build SQL queries, stored procedures, and SSIS packages; perform ETL, data mapping, cleansing, validation, testing, and production deployments. Migrate structured and unstructured data (attachments, correspondence), troubleshoot integration issues, and produce technical migration documentation while collaborating with senior developers and business analysts.

Design, develop, and execute enterprise CRM data migrations into Microsoft Dynamics CRM/365 using KingswaySoft and SSIS. Extract, transform, cleanse, validate, and load structured and unstructured data from legacy systems, optimize SQL/SSIS, troubleshoot performance, support integrations and customizations, perform validation testing and production cutovers, and document migration architecture and procedures while ensuring data governance and security compliance.

Lead data migration and ETL development for an SAP BRIM implementation: analyze legacy sources, design/execute EMIGALL and BODS migration jobs, validate/reconcile data, support integration with S/4HANA and CRM, and provide testing, production support, documentation, and stakeholder collaboration.

Lead data engineering for a healthcare scheduling platform rebuild: map legacy multi-TB schema, design target schema, build translation layer (views/materialized views and write mappers), ensure data consistency during parallel systems, plan per-tenant cutover with verification and rollback, tune DB performance, instrument data quality/lineage/audit, and mentor engineers.

Design, build, and scale reliable batch and real-time data pipelines and warehouses. Partner with engineering, data science, and business teams to define data models, improve observability, optimize storage and querying, and evangelize data engineering best practices across the company.

Design, build, and maintain scalable Databricks-based data pipelines and ELT workflows; develop and document dbt models; define data modeling methodology; ensure data quality, reliability, and scalability; collaborate with clients and cross-functional teams; provide technical guidance and deliver improvements to clients' data infrastructure and analytics capabilities.

Lead data engineering teams to design, build, and maintain scalable cloud-native data pipelines, data platforms, and data products using Snowflake, Databricks, Airflow, and modern architectures. Optimize ETL/ELT, SQL, and transformations for analytics, reporting, and AI use cases; ensure data quality, governance, observability, and stakeholder alignment. Produce documentation, runbooks, and present technical solutions to business and technical audiences.

Design, build, and maintain backend systems and data interactions for healthcare reporting. Develop APIs, data models, ETL pipelines, and interfaces; optimize performance, ensure data integrity and security, and support automated testing and CI/CD. Collaborate in Agile teams and reduce technical debt while enabling integrations with frontend and third-party systems.

The role involves designing and implementing data pipelines, advising clients on data engineering solutions, and mentoring engineers in a collaborative environment.

Provide production support for SQL Server databases, ETL/data integration, Azure cloud services, and enterprise reporting. Monitor performance, troubleshoot issues across Windows and Linux servers, support file transfers and enterprise applications, and collaborate with technical teams to ensure data availability and reliability.

Design, build, and optimize scalable batch and streaming data pipelines. Model and process structured and unstructured data, ensure production reliability and observability, apply ML techniques for insight extraction, and drive data strategy while adopting modern tooling and IaC practices.

Lead delivery of enterprise data governance, MDM, and modern data-platform components including Snowflake, CDC pipelines, schema-first contracts (JSON Schema/Avro/Protobuf), data catalog and PII classification, CI/CD schema management, AWS data services, and day-to-day leadership of an offshore delivery team.

Build and own data platform infrastructure and scalable pipelines (ingestion, orchestration, transformation, delivery). Define governance, observability, and AI-first architecture. Optimize performance, ensure data quality, mentor engineers, and integrate AI-assisted tooling.

Own and evolve the data platform: architect, build, and maintain data models, pipelines, and access layers. Ensure data quality, governance, and reliability; monitor and optimize infrastructure; provide technical leadership, code reviews, and collaborate with cross-functional teams to deliver scalable data solutions for operations and analytics.

Build and maintain scalable data pipelines and Python automations for ingesting, processing, and enriching data. Integrate SaaS sources via APIs, use Databricks/PySpark/Delta Lake and AI tools to power lead generation, enrichment, deduplication, and entity resolution. Collaborate cross-functionally to translate business needs into automated, production-ready solutions.

Lead technical design and hands-on development of Pantheon’s data platform, extending ingestion, curation, retention services and ML/LLM infrastructure. Mentor engineers, drive architecture and engineering standards, operate in a DevOps model, partner cross-functionally, and participate in on-call support to ensure reliable, compliant data access and analytics.

Lead and scale a distributed data engineering organization: design and maintain cloud-native data infrastructure, build ETL/ELT pipelines and event streams, ensure data quality and observability, deliver dashboards and analytics tools, partner with product and business stakeholders, and manage analytics project prioritization and team performance.

The Senior Data Engineer will design and build scalable data platforms, handle automation for data operations, and ensure reliability and performance of data pipelines while collaborating with various teams.