Top Data Engineer Jobs in Philadelphia, PA

Manage, design, and optimize data activities for federal IAM systems. Develop data models, file layouts, source-to-target mappings, data dictionaries, integrations, ETL processes, and analytics support for identity analysis and fraud detection. Administer and tune databases, including configuration, backups, monitoring, capacity planning, and performance optimization. Support secure handling of identity and PII data, network-related data flows, documentation, token management processes, and collaboration across development, security, and operations teams.

Architect and maintain NetBrain’s first cloud data warehouse, ELT pipelines, transformation layer, semantic models, and BI foundation. Own data quality, governance, lineage, access controls, and curated models supporting product usage, customer adoption, account health, and go-to-market reporting. Partner with stakeholders to establish reliable metrics and a standardized source of truth, while supporting AI-assisted analytics and natural-language reporting use cases.

Design, build, and maintain cloud data pipelines and data architecture on AWS/Azure/GCP. Advise clients on cloud-based ingestion and processing, collaborate with stakeholders, and deliver production-ready data products while evaluating architectural trade-offs.

Design, build, and own scalable data pipelines and warehousing architecture from ingestion through analytics and incentive payouts. Lead data platform architecture, dbt modeling, data quality, lineage, observability, performance, and cost management. Partner with engineers and analysts on telematics accuracy and driver incentive reporting. Use AI coding tools daily to develop and review pipelines, SQL, and data models.

Designs, builds, and operates scalable enterprise data platforms supporting ingestion, processing, storage, governance, analytics, and AI/ML. Responsibilities include developing batch and real-time pipelines, lakehouse and warehouse architectures, orchestration, infrastructure automation, CI/CD, monitoring, security, cost optimization, and observability. The role partners with data, ML, DevOps, security, and application teams, troubleshoots complex platform issues, establishes reusable engineering standards, contributes to architecture strategy, and mentors engineers.

Build and extend automated enterprise data governance and quality frameworks. Define measurable trust rules, data contracts, validation and certification workflows, metadata, lineage, tagging, and trust scoring across a cloud data platform. Integrate governance checks into developer workflows and Collibra, coach engineering and product teams, and establish organization-wide data trust standards. The role requires strong SQL, BigQuery or comparable warehouse experience, and expertise with data quality or observability tools.

Design, build, and operate scalable batch, streaming, and CDC data pipelines across Snowflake and AWS. Lead ETL/ELT architecture, orchestration, data modeling, quality monitoring, observability, incident resolution, and performance optimization. Develop production solutions in SQL and Python, establish engineering standards for testing and CI/CD, and partner with Analytics Engineering, Data Science, Product, and Engineering teams to deliver reliable data products.

Build and maintain production-grade dbt data models and pipelines across ingestion, transformation, and visualization. Develop reliable datasets supporting reporting, analysis, finance, revenue recognition, and company decision-making. Collaborate with Finance, Engineering, Sales, Product, and Marketing to understand data needs, improve manual workflows, validate data accuracy, and create scalable solutions using modern data tools.

Own end-to-end data platform architecture across ingestion, transformation, modeling, and serving. Improve warehouse efficiency, access control, reliability, observability, orchestration, CI/CD, and developer experience. Lead cross-functional technical initiatives, build monitoring and alerting, mentor engineers, guide architectural decisions, and develop AI-powered data tooling. The role requires strong SQL and Python skills, production experience with Airflow, BigQuery, and containerized infrastructure, plus architectural ownership and stakeholder communication.

Design, build, and maintain scalable ETL/ELT data pipelines on Databricks and AWS S3; manage large geospatial and temporal datasets; productionize ML models; implement data validation, testing, and monitoring; optimize storage and processing; document workflows; collaborate cross-functionally.

The DMS Data Engineer is responsible for analyzing raw data, building data systems and pipelines, conducting complex data analyses, and collaborating on projects to enhance data quality and reliability.

The Data Engineer will develop data pipelines, support automation, and collaborate within an Agile team to manage complex data sets, ensuring performance and reliability in data processing.

Design, develop, and maintain scalable ETL/ELT pipelines using Python, PySpark, Snowflake, and Azure technologies. Build data ingestion frameworks, dimensional data models, and enterprise warehouse solutions. Optimize Snowflake workloads, implement data quality and governance controls, monitor production pipelines, troubleshoot incidents, document data processes, and collaborate with architects, analysts, data scientists, and business stakeholders. Support secure, compliant, reliable data platforms for analytics, reporting, and operational use cases.

Design, build, maintain, and optimize Spark and Scala ETL/ELT pipelines on AWS for terabyte- and petabyte-scale datasets. Work across S3, Snowflake, Kafka, and monitoring systems, resolve production data-quality and performance issues, write automated tests, participate in architecture and code reviews, and support on-call operations. Use generative AI to improve pipeline development, monitoring, and engineering productivity.

Lead architecture and hands-on engineering to design, scale, and govern a cloud-native lakehouse using Databricks and Microsoft Fabric. Build batch/streaming pipelines, ensure HIPAA-compliant PHI handling, produce analytics-ready datasets, mentor engineers, and drive platform strategy, governance, and reliability.

Design, build, and maintain ETL pipelines, databases, and data models to process healthcare claims and related data. Ensure data quality, analyze claims data for trends, and produce reports and visualizations for nontechnical stakeholders. Collaborate with policy and analytics teams to translate requirements into data solutions and improve data infrastructure and analytics capabilities.

Design and implement end-to-end data solutions on Microsoft Fabric and Azure for insurance datasets. Build ingestion pipelines (batch, streaming, API), Lakehouse architectures, and data models. Enforce governance, security, compliance, and cost/performance optimizations while guiding engineers and stakeholders on architectural best practices.

Develop and maintain large-scale, cloud-native data services and distributed pipelines for multi-tenant healthcare systems. Responsibilities include data modeling, database component development, SQL programming, performance tuning, testing, deployment, code reviews, proof-of-concepts, and full software development lifecycle ownership. Collaborate with global engineering teams, evaluate technologies, apply security and operational requirements, and use AI tools to accelerate development.

Build and maintain scalable batch and real-time data pipelines, model data to power analytics and ML, and operate distributed data systems. Collaborate with business, engineering, and data science teams to ensure data quality, documentation, and debugging while adopting new technologies and working in an ambiguous, fast-changing environment.

Build and maintain low-latency, highly available distributed data systems and services to deliver high-quality data for product, analytics, and ML. Partner with data scientists and product teams to design scalable, observable, multi-tenant data products using batch and real-time processing frameworks. Ensure 24x7 reliability, monitoring, and operational excellence while owning end-to-end delivery.

Build scalable, privacy-focused data frameworks and ETL pipelines using big-data technologies (Spark, Presto, Flink, Kafka, Hive). Ensure appropriate handling of personal data, support privacy and legal needs, partner cross-functionally, and lead system design while mentoring teammates.

Design, build, and own large-scale batch and streaming data pipelines and core Ads data products. Collaborate with analytics, data science, and engineering teams to model, transform, govern, and deliver high-quality ad datasets for analysis, ML, and reporting while ensuring privacy compliance.

Designs and leads scalable data platforms, event-driven services, orchestration pipelines, and DataOps practices using Python, Airflow, Snowflake, Kafka, and related technologies. The role establishes engineering standards, governance, security, observability, cost efficiency, and AI-assisted development practices. It also mentors engineers, drives cross-functional initiatives, modernizes data ingestion, and ensures reliable, compliant, and well-governed systems.

Lead database engineering for a federal species-data integration program in a hybrid AWS cloud environment. Responsibilities include harmonizing schemas, documenting source-to-target mappings and lineage, enforcing metadata and data-quality standards, implementing encryption and NIST-aligned security controls, building authoritative source registries, optimizing performance, and leading production migration, validation, monitoring, and operational documentation. The role requires Databricks or equivalent lakehouse expertise, ETL programming, federal governance knowledge, and database migration leadership.

Leads data engineering strategy and mentors an analytics engineering team. Designs scalable ELT pipelines, warehouse integrations, data models, API ingestion workflows, and data quality frameworks using cloud and database technologies. Conducts exploratory analysis, supports dashboards and analytical solutions, monitors warehouse performance and costs, and ensures data governance, security, and compliance. Collaborates with data scientists, analysts, engineers, and business stakeholders to deliver healthcare analytics solutions.