Top Senior Data Engineer Jobs in Philadelphia, PA

Design, build, maintain, and optimize Spark and Scala ETL/ELT pipelines on AWS for terabyte- and petabyte-scale datasets. Work across S3, Snowflake, Kafka, and monitoring systems, resolve production data-quality and performance issues, write automated tests, participate in architecture and code reviews, and support on-call operations. Use generative AI to improve pipeline development, monitoring, and engineering productivity.

Lead architecture and hands-on engineering to design, scale, and govern a cloud-native lakehouse using Databricks and Microsoft Fabric. Build batch/streaming pipelines, ensure HIPAA-compliant PHI handling, produce analytics-ready datasets, mentor engineers, and drive platform strategy, governance, and reliability.

Design and implement end-to-end data solutions on Microsoft Fabric and Azure for insurance datasets. Build ingestion pipelines (batch, streaming, API), Lakehouse architectures, and data models. Enforce governance, security, compliance, and cost/performance optimizations while guiding engineers and stakeholders on architectural best practices.

Leads data engineering strategy and mentors an analytics engineering team. Designs scalable ELT pipelines, warehouse integrations, data models, API ingestion workflows, and data quality frameworks using cloud and database technologies. Conducts exploratory analysis, supports dashboards and analytical solutions, monitors warehouse performance and costs, and ensures data governance, security, and compliance. Collaborates with data scientists, analysts, engineers, and business stakeholders to deliver healthcare analytics solutions.

Own SQL and dbt-based data modeling and data quality for clinical and claims datasets. Author and refactor dbt models/tests, triage DQ alerts, design monitors, optimize SQL performance, and collaborate with Data Engineering and stakeholders to ensure trusted production datasets.

Lead the data engineering strategy and architecture for distributed pharmaceutical data systems. Design and scale pipelines, APIs, and data platforms while ensuring reliability, governance, quality, and PII/PHI protection. Drive technical decisions, improve developer efficiency, deliver business impact, influence cross-functional roadmaps, mentor engineers, communicate with executives, and promote organizational adoption of new technologies and processes.

Design, build, and maintain scalable data pipelines, lakes, and infrastructure using Databricks, Spark, Python, and AWS. Collaborate with ML engineers, data scientists, and analysts to deliver data products, ensure data quality and governance, implement DevOps/SDLC practices, mentor junior engineers, and evaluate new data technologies.

Design, build, modernize, and maintain operational and analytical data capabilities for Wealthscape Reporting, Analytics and Insights. Perform solution design, data analysis, ETL development, and production rollouts using Snowflake, AWS, cloud databases, and CI/CD pipelines. Collaborate across teams in a fast-paced financial services environment.

Lead architecture, systems, and roadmap for Coinbase's Compliance Reporting Data Platform. Design and build production-grade data models, pipelines, quality frameworks, validations, and certification processes. Establish data contracts, monitoring, reconciliation, and audit-ready processes. Partner with engineering and compliance stakeholders, respond to regulatory exams, and mentor engineers while shaping standards and documentation.

The Data Engineer is responsible for designing data workflows and pipelines, implementing systems engineering principles, and deploying data streaming technologies while ensuring compliance with industry regulations and best practices.

Design, develop, maintain, and optimize ADABAS database structures and data solutions. Support mainframe data processing (Natural, COBOL, JCL), perform migrations to modern platforms, tune performance, ensure data integrity/security, troubleshoot issues, and collaborate with developers, architects, and analysts on modernization, API/cloud integration, and data warehousing initiatives.

Leads the design and delivery of scalable data pipelines, dbt models, orchestration workflows, and analytical data models. Establishes data architecture, engineering standards, quality frameworks, governance, observability, and self-service analytics practices. Partners with stakeholders, leads technical reviews, mentors engineers, supports hiring, oversees analyses, and participates in incident response and continuous improvement.

The Senior Data Engineer will design and implement lakehouse architectures, optimize ClickHouse deployments, develop ETL/ELT pipelines, and create data models to support analytical and operational functions.

Design, build, and own business-critical data infrastructure, including AWS Glue and Spark pipelines, cloud warehouse or lakehouse systems, orchestration, and Tableau BI platforms. Define event-driven contracts, data models, schemas, observability, and batch or streaming architectures across multi-tenant, multi-region environments. Collaborate across producer and consumer teams while owning production data infrastructure and outcomes end to end.

Design and support ETL, data migration, transformation, import, export, and validation workflows for moving legacy EHR data into athenahealth systems. Build Python and SQL utilities, define source-to-target mappings, support HL7 and FHIR interoperability, validate EHI exports, investigate data quality issues, document processes, and collaborate with product, implementation, operations, sales, and engineering teams in a remote environment.

Design, build, and operate scalable PostgreSQL databases and cloud-native data infrastructure. Build and maintain ETL/ELT pipelines, optimize query and server performance, ensure high availability and disaster recovery, improve observability, troubleshoot production issues, guide schema and application design, evaluate database technologies, and mentor junior engineers to support reliable, secure data-driven applications.

Design, implement, and maintain cloud-based data pipelines and platforms. Advise clients on best practices, partner with stakeholders to translate requirements, provide technical leadership and mentoring, and stay current with cloud data technologies and architectures.

Design, build, deploy, and operationalize scalable data engineering solutions for customers. Responsibilities include developing pipelines, transforming and cleansing data, analyzing sources, implementing governance, security, and quality practices, testing data movement and transformation code, resolving defects and incidents, and advising customers on technical decisions. The role also supports AI, machine learning, business intelligence, and data product adoption while collaborating across teams and educating end users.

Lead teams to design, build, and operate scalable, AI-ready data pipelines and ecommerce data products (especially Shopify). Build semantic layers, curated data marts, and data models; ensure data quality, monitoring, and performance. Collaborate with data scientists, analysts, and governance to support feature engineering, ML datasets, and reliable downstream consumption.

Design and build Snowflake transformation layer and migrate legacy SQL to versioned dbt models. Define conformed dimensions/facts using Kimball principles, set modeling and CI/CD standards, implement data quality/lineage, support BI migration and AI/ML readiness, and mentor future hires. Hands-on work in dbt, SQL, and Python with stakeholder collaboration and governance for financial and operational data.

Design, build, and maintain scalable data pipelines and tenant-aware APIs to ingest and transform data from varied sources. Work with event-driven and batch architectures, implement authentication and integration patterns, ensure observability/monitoring, optimize data flows for cost and performance, and collaborate with product, infrastructure, and engineering teams to onboard and maintain data sources at scale.

Lead design and implementation of Jane's customer data infrastructure: own event collection, pipelines, CDP tooling, schema governance, identity resolution, and attribution. Work cross-functionally with marketing, BI, product, and engineering to set standards, evaluate tooling (e.g., RudderStack), ensure privacy-compliant instrumentation, and build reliable, consistent data delivery to the warehouse.

Responsible for designing, developing, and maintaining scalable data pipelines and infrastructure, implementing data governance, and collaborating with teams to meet data needs.

Lead design and scaling of ELT pipelines and analytics schemas on Snowflake. Build Looker views, CI/CD automation, and orchestration workflows (Prefect/Airflow). Ensure production reliability with monitoring (Datadog, Monte Carlo), partner with cross-functional teams, and provide technical leadership including code reviews, testing, and end-to-end ownership of data integrity and platform trustworthiness.

Leads data engineering strategy, architecture, delivery, support, and lifecycle management for secure, scalable cloud and hosted data solutions. Collaborates with technical and business stakeholders to deliver complex datasets, establish enterprise data standards, manage data engineering teams, and oversee maintenance, change management, capacity planning, business continuity, disaster recovery, and regulatory security requirements. The role also evaluates third-party tools and supports Azure DevOps, SDLC, CI/CD, and technical innovation.