Top Senior Data Engineer Jobs in Philadelphia, PA

Design, build, maintain, and optimize Spark and Scala ETL/ELT pipelines on AWS for terabyte- and petabyte-scale datasets. Work across S3, Snowflake, Kafka, and monitoring systems, resolve production data-quality and performance issues, write automated tests, participate in architecture and code reviews, and support on-call operations. Use generative AI to improve pipeline development, monitoring, and engineering productivity.

Designs and maintains healthcare data pipelines, ETL workflows, databases, schemas, and analytical frameworks. Analyzes claims and related healthcare data to identify trends and insights, while ensuring data quality and integrity. Creates reports, dashboards, and visualizations for nontechnical stakeholders. Collaborates with healthcare policy experts, analysts, and stakeholders to translate requirements into data solutions and improve infrastructure, processes, and analytics capabilities.

Build and maintain scalable batch and real-time data pipelines, model data to power analytics and ML, and operate distributed data systems. Collaborate with business, engineering, and data science teams to ensure data quality, documentation, and debugging while adopting new technologies and working in an ambiguous, fast-changing environment.

Build and maintain low-latency, highly available distributed data systems and services to deliver high-quality data for product, analytics, and ML. Partner with data scientists and product teams to design scalable, observable, multi-tenant data products using batch and real-time processing frameworks. Ensure 24x7 reliability, monitoring, and operational excellence while owning end-to-end delivery.

Design, build, and own large-scale batch and streaming data pipelines and core Ads data products. Collaborate with analytics, data science, and engineering teams to model, transform, govern, and deliver high-quality ad datasets for analysis, ML, and reporting while ensuring privacy compliance.

Own SQL and dbt-based data modeling and data quality for clinical and claims datasets. Author and refactor dbt models/tests, triage DQ alerts, design monitors, optimize SQL performance, and collaborate with Data Engineering and stakeholders to ensure trusted production datasets.

Design, build, and operate scalable cloud data pipelines and platforms (Azure preferred). Implement DevSecOps, CI/CD, automated testing, monitoring, performance tuning, and production readiness. Mentor engineers, drive operational excellence, and translate requirements into robust technical designs. Apply healthcare domain knowledge and collaborate in agile teams to deliver secure, reliable data products.

The job involves building responsive web dashboards, advanced data visualizations, and analytics tools for unmanned aircraft systems, requiring a deep understanding of UI/UX design and data presentation.

As a Data Engineer, you will design and maintain data pipelines, support DoD systems, and ensure data quality and compliance.

Design, build, and optimize scalable AWS-based data pipelines, data lakes, and warehouses. Migrate legacy systems, enforce data quality/security/governance, implement ETL/ELT and big-data solutions, adopt CI/CD and IaC, collaborate with stakeholders, and provide technical leadership and troubleshooting.

Design, build, and maintain scalable data pipelines, lakes, and infrastructure using Databricks, Spark, Python, and AWS. Collaborate with ML engineers, data scientists, and analysts to deliver data products, ensure data quality and governance, implement DevOps/SDLC practices, mentor junior engineers, and evaluate new data technologies.

Design, build, modernize, and maintain operational and analytical data capabilities for Wealthscape Reporting, Analytics and Insights. Perform solution design, data analysis, ETL development, and production rollouts using Snowflake, AWS, cloud databases, and CI/CD pipelines. Collaborate across teams in a fast-paced financial services environment.

Lead design and delivery of scalable data warehouses and analytics platforms for T-Mobile Advertising Solutions. Architect and implement cloud data pipelines, mentor engineers, run design workshops, scope projects, and deliver end-to-end data solutions using cloud data services and modern data platforms.

Build and maintain production-grade data processing systems and foundational infrastructure for enterprise AI. Collaborate with researchers and engineers, deliver end-to-end implementations, transform unstructured data into performant datasets, and use distributed processing frameworks and modern analytics tooling to inform products and strategy.

Designs and builds modern data applications, pipelines, transformations, enrichment processes, provisioning layers, and interfaces supporting clinical and operational healthcare processes. Analyzes clinical data to identify trends, collaborates with Product, Platform, and Architecture teams, mentors junior data engineers, and evaluates emerging technologies. The role emphasizes cloud computing, big data, data science, modern development frameworks, source control, documentation, and repeatable engineering practices.

Build and optimize scalable Databricks data pipelines across a medallion architecture. Develop data models, implement data quality checks and validation, integrate Azure services, and ensure data accuracy, governance, lineage, security, and performance. The role requires designing config-driven pipelines supporting CDC and event-based processing, maintaining CI/CD deployments, and working with structured and unstructured data across SQL and NoSQL systems.

Lead architecture, systems, and roadmap for Coinbase's Compliance Reporting Data Platform. Design and build production-grade data models, pipelines, quality frameworks, validations, and certification processes. Establish data contracts, monitoring, reconciliation, and audit-ready processes. Partner with engineering and compliance stakeholders, respond to regulatory exams, and mentor engineers while shaping standards and documentation.

The Data Engineer is responsible for designing data workflows and pipelines, implementing systems engineering principles, and deploying data streaming technologies while ensuring compliance with industry regulations and best practices.

Forward-deployed senior data engineer who deploys, hardens, integrates, and operates a data platform (lakehouse, streaming, governance) in DoD environments. Build pipelines across classification boundaries, produce accreditation evidence (STIG/cATO/FIPS), run day-2 operations, train mission teams, and mentor junior FDEs while feeding field feedback into product improvements.

Build and own production data pipelines using Snowflake, Airflow, dbt, and Python; implement canonical data models; embed validation, quality checks, lineage, freshness, and alerting; support governed self-service data delivery; migrate workloads; partner with business consumers; participate in on-call and incident reviews; and mentor engineers while maintaining strong testing, CI/CD, documentation, and code-review practices.

Design, build, and lead a scalable, configuration-driven data integration platform. Improve performance, automate monitoring and deployments, provide escalated support, and collaborate across product and engineering to deliver reliable, secure data integrations.

Design, develop, and maintain enterprise data solutions and pipelines using Azure data platform and Microsoft Fabric. Support data modeling, master data management, medallion architecture, data quality, and integrations to produce trusted, scalable data for analytics and BI.

Design and maintain scalable ETL/ELT pipelines, analytical dashboards, and reporting tools supporting clinical, research, and operational priorities. Write production-quality Python, R, and SQL; develop data architecture; partner with data scientists to operationalize analytics; integrate AI-enabled workflow improvements; establish engineering standards; and mentor junior team members.

Design, develop, and maintain scalable data pipelines and models in Databricks and Microsoft Azure. Perform data ingestion, transformation, integration, migration, and modernization across enterprise data sources. Monitor and optimize pipeline performance, reliability, and data quality. Translate business requirements into technical solutions, collaborate with architects and engineers, follow security and governance standards, participate in code reviews, and document data platforms and processes.

Design and implement scalable data pipelines and orchestration on GCP to support AI/ML-driven mail intelligence. Build stream and batch processing, ensure data governance and quality, optimize workflows, create visualizations, and collaborate with US cross-functional teams to align technical strategy and recover from failures.