Top Senior Data Engineer Jobs in Philadelphia, PA

Develops, architects, and maintains production ETL/ELT and C#/.NET data pipelines across cloud data platforms. Responsibilities include supporting Iceberg, DynamoDB, AWS Lambda, and Trino/Starburst systems; onboarding data sources; tuning performance; monitoring data quality; resolving incidents; coordinating schemas; documenting processes; mentoring engineers; and supporting releases, deployments, architecture, and roadmap decisions.

Build and maintain SQL-based integrations connecting behavioral healthcare EHR/EMR systems to the Eleos platform. Investigate pipeline failures, data discrepancies, and quality issues to identify root causes. Develop reusable extraction, automation, and validation tooling; document data models, mappings, and business logic; and create standardized data models. Collaborate with platform engineers, product teams, and customer technical teams to establish secure access and deliver scalable, reliable integrations.

Design and operate Alpaca’s scalable data platform on GCP, including lakehouse infrastructure, Kubernetes-based deployments, streaming and CDC pipelines, batch ingestion, BI access, cataloging, monitoring, and governance. Build infrastructure as code with Terraform and Ansible, operate distributed query engines and Apache Iceberg, maintain reliability practices, and collaborate with DevOps and analytics teams to support rapidly evolving data requirements.

Own and improve Life360’s Ads Data Engineering platform on Databricks. Build, operate, and optimize batch and streaming pipelines, Delta Lake tables, dbt models, semantic layers, and core metrics. Integrate advertising and business data, implement quality and governance controls, manage AWS infrastructure with Terraform, reduce compute costs, and mentor engineers. Partner with analysts, ad strategists, and sales teams to deliver trusted data products while developing AI-assisted engineering tools and workflows.

Build and maintain production data ingestion, transformation, and pipeline code for a governed federal data and AI platform. Develop data products, support data science and ML teams, monitor quality and reliability, troubleshoot issues, and contribute to Terraform infrastructure and CI/CD workflows. Apply data governance, cataloging, access controls, and compliance practices within FedRAMP Moderate, NIST 800-171, and CUI environments. Collaborate with engineers and document pipelines and processes.

Plans and executes enterprise data migrations, conversions, transformations, archival, and cloud data platform operations. Builds ETL/ELT pipelines and migration scripts, performs profiling and source-to-target mapping, validates data, manages cutovers and rollback procedures, and troubleshoots migration issues. Optimizes cloud platforms, databases, workloads, security, access, cost, and performance while collaborating with engineering, governance, architecture, and business teams.

Lead the technical direction for audience data products and build high-volume pipelines for audience creation, partner data onboarding, identity mapping, and external data delivery. Mentor engineers, oversee design reviews and build-versus-buy decisions, and develop AI-enabled engineering tooling with appropriate guardrails. Collaborate with data science, product, engineering, and external partners.

Lead the technical direction for identity and audience data systems. Design identity models, partner mappings, high-volume production pipelines, privacy controls, data quality frameworks, monitoring, and anomaly detection. Collaborate with data science, product, legal, security, and engineering teams while mentoring engineers and leading design reviews. Develop AI-enabled engineering tools and guardrails, and ensure reliable, auditable data products at scale.

Own and operate the Snowflake warehouse and Sigma semantic layer; manage ingestion (Fivetran), dbt model scoping and review, reverse-ETL, data quality SLAs, dashboards, month-end financial analytics, vendor management, and automation to support AdOps, Sales, Finance, and executive reporting.

Leads and mentors an interdisciplinary team developing ETL pipelines and data infrastructure for AI/ML and LLM applications. Builds, normalizes, curates, and maintains complex datasets; implements machine learning algorithms; improves scalability, automation, and data delivery; and develops software using Agile methodologies. The role requires an active TS/SCI clearance with a recent CI polygraph and supports national security technology programs.

Design and maintain Snowflake-based data platforms, cloud-native data lakes, and scalable ETL/ELT pipelines for asset-backed finance analytics. Orchestrate workflows with Dagster and AWS services, ensure data reconciliation and integrity, and support migration from legacy systems. Contribute to project planning, Jira backlog management, testing, cutover planning, and cross-functional go-live readiness.

Design and maintain Snowflake data pipelines and data lake architectures for asset-based finance analytics. Develop ETL/ELT workflows, validate and reconcile financial data, migrate legacy systems, and translate quantitative finance logic into scalable architectures. Support project execution through requirements breakdown, planning, testing, cutover, and go-live readiness. Collaborate across engineering, quantitative analytics, and stakeholder teams.

Design, build, and maintain scalable batch and streaming data pipelines using Databricks, PySpark, Python, SQL, Spark, and Delta Lake. Develop transformations, orchestration workflows, data models, validation processes, and curated data products. Troubleshoot performance and quality issues, apply governance and security practices, document solutions, and collaborate with architects, data scientists, DevOps teams, analysts, and clients.

Lead managed services for clients' Azure, Databricks, and Microsoft Fabric data environments. Architect, implement, monitor, troubleshoot, and govern data platforms, ETL pipelines, data warehouses, semantic models, reporting, and AI/ML solutions. Manage incidents and SLAs, advise clients on licensing and technical strategy, communicate solutions, document environments, and mentor distributed engineering teams.

Design, build, and maintain data lakes, data warehouses, and end-to-end data pipelines for a multi-tenant SaaS platform. Lead code and design reviews, write infrastructure-as-code, optimize performance and scalability, participate in data governance, mentor junior engineers, evaluate new technologies, automate tests, collaborate cross-functionally, and join on-call rotation to ensure reliable data delivery.

Develop and support SAP BRIM data migration solutions using BODS and EMIGALL. Responsibilities include source-to-target mapping, ETL development, data cleansing, validation, reconciliation, migration testing, SAP integrations, SQL analysis, production support, documentation, and cutover activities. The role collaborates with architects, functional consultants, infrastructure teams, and business stakeholders while supporting SAP S/4HANA, FICA, billing, and customer account migrations.

Designs, develops, and optimizes enterprise data pipelines and platforms using Snowflake, integrating Oracle Fusion, on-premises databases, and cloud applications. Applies data quality, governance, security, and performance practices while supporting Power BI, AI, and machine learning use cases. Partners with business and technical stakeholders, leads data migrations, translates requirements into sustainable solutions, mentors junior engineers, and guides engineering standards.

Leads the design, development, and optimization of scalable data pipelines and analytics platforms. Builds ETL/ELT workflows using Databricks and Spark, integrates and transforms source data into curated models, manages SQL Server data, and maintains documentation and lineage. Collaborates with product, analytics, and engineering teams to deliver reliable data solutions. Applies responsible AI practices and delivers projects independently within established timelines.

Design, build, and optimize enterprise ETL/ELT pipelines, cloud data lakes, lakehouse solutions, data models, and semantic layers across AWS and Azure. Ensure data quality, security, performance, reliability, and governance while supporting analytics, reporting, and AI initiatives. Collaborate with product, engineering, IT, and business stakeholders to translate requirements into scalable data solutions, monitor pipeline health, troubleshoot issues, and improve data architecture and practices.

Own Step’s analytics data models, transformation pipelines, metric definitions, semantic layer, and data quality practices. Partner with Product, Marketing, Engineering, Risk, Growth, and Finance to establish trustworthy data foundations and enable self-service analysis. Build reusable query, visualization, and code components; apply AI-augmented workflows; and collaborate with data scientists, analysts, and platform engineers. The role requires strong SQL, modeling, pipeline, BI, communication, and independent ownership skills, with occasional travel for team onsites.

Leads the design, development, governance, and productization of enterprise data models, pipelines, data products, and ontologies. Builds machine-learning-ready datasets, implements security and lineage controls, optimizes Databricks and Delta Lake environments, establishes data-product standards, collaborates with architects and data scientists, and mentors engineering talent. The role also defines product roadmaps, service levels, usage metrics, and continuous-improvement processes for enterprise data assets supporting AI agents, analytics, and applications.

Design, build, and operate end-to-end data pipelines and models for healthcare claims and payer data. Responsibilities include ingestion, canonical and analytical data modeling, legacy process migration, data quality, testing, CI/CD, deployment, operations, incident response, tool integration, documentation, and onboarding new data sources. The role partners across ML, product, analytics, platform, operations, and customer teams while critically evaluating AI-generated engineering work.

Own Mux’s end-to-end data platform, including ingestion, Snowflake administration, dbt transformations, orchestration, data quality, observability, and reverse ETL. Build semantic models supporting AI agents, establish governance and reliability standards, and partner with Engineering, Finance, Product, and GTM. Use AI coding tools to develop and maintain pipelines while validating output quality. The role requires strong SQL, Python, data modeling, cloud warehouse administration, and production data engineering experience.

Designs, builds, and optimizes scalable Databricks-based data platforms, pipelines, integrations, and reusable engineering tools. The role focuses on platform performance, reliability, cost efficiency, security, governance, automation, and cloud infrastructure. It collaborates with engineering, analytics, security, and other stakeholders on architecture, technical planning, production support, and continuous improvement. The position requires hands-on data engineering experience with Databricks, cloud services, Python, SQL, Spark, infrastructure-as-code, and CI/CD practices.

Build and operate a governed Snowflake enterprise data warehouse, including ingestion, orchestration, dbt transformations, infrastructure as code, security controls, reliability checks, and CI/CD. Partner with data owners and BI teams during migration from legacy systems, ensure compliance for sensitive financial data, support reconciliation and incident resolution, and mentor engineers. The role requires hands-on ownership of pipelines and platform components across development and production environments.