Top Data Engineer Jobs in Philadelphia, PA

Support design, development, and maintenance of data pipelines and infrastructure. Assist with ETL/ELT workflows, data ingestion, cleaning, validation, modeling, and warehousing. Document processes and collaborate with data teams to support analytics use cases.

Designs and operates batch, streaming, and real-time data platforms and pipelines using Spark, Kafka, Iceberg, Airflow, and cloud infrastructure. Owns data lake evolution, data quality, observability, reliability, governance, event instrumentation, schema management, and privacy controls for PII, retention, deletion, and residency. Leads complex initiatives end-to-end, troubleshoots production issues, mentors engineers, and develops AI agent harnesses that enforce data engineering standards and quality gates.

Builds and maintains scalable data pipelines, ETL infrastructure, data warehouses, and analytics tools. The role assembles complex datasets, automates processes, optimizes data delivery architecture, and supports cross-functional data initiatives. Collaborates with executive, product, data, and design stakeholders to resolve technical issues and improve analytics systems. Requires proficiency in SAS, Python, Java, MATLAB, SQL, NoSQL, Hadoop, MapReduce, Hive, Presto, UNIX, and Linux, with JavaScript, R, and basic machine learning preferred.

Build and operate large-scale data pipelines, web-scraping systems, and data-collection tools for AI datasets. Maintain analytical databases, optimize queries, troubleshoot pipeline and data-quality issues, manage containerized workloads across Kubernetes and Linux infrastructure, and support CI/CD workflows. The role also involves documenting technical processes, researching improvements, and developing scalable APIs in a fully remote environment.

The Data Engineer is responsible for building and maintaining data pipelines, ensuring data quality and reliability, and collaborating with various teams on data needs. This involves working with AWS tools and programming in Python and SQL to support analytics and infrastructure.

As the first in-house Data Engineer, you will own the data infrastructure, build and maintain data pipelines, and collaborate with teams to ensure quality data access and insights.

Design and build PerfectServe’s unified cloud data platform, including ingestion pipelines, integrations, data models, metrics, and consumer-facing data layers. Establish architecture, engineering, quality, and testing standards; enable safe extraction from production systems; partner with data users; and mentor data engineers. The role requires substantial cloud data platform experience, deep SQL, warehouse expertise, ELT, change-data-capture, AWS, modeling, orchestration, and data quality skills.

Designs, builds, and maintains enterprise data pipelines, ETL processes, integrations, cloud data infrastructure, and complex data models. Supports analytics partners, develops data warehouse solutions, tunes SQL and database performance, troubleshoots production issues, and delivers end-to-end data engineering projects. The role collaborates with architects, analysts, developers, and business stakeholders, applies big data technologies, supports agile delivery, and mentors team members.

Leads the design, development, and maintenance of scalable AWS data platforms, pipelines, ETL/ELT workflows, data models, and orchestration systems. Uses Python, PySpark, SQL, dbt, AWS services, modern lakehouse technologies, and CI/CD practices to deliver secure federal data solutions. Responsibilities include platform modernization, performance optimization, AI-enabled data integration, compliance support, technical mentoring, architecture discussions, and cross-functional Agile collaboration.

Staff Data Engineer responsible for defining data architecture strategy, building fault-tolerant batch and real-time streaming infrastructure, and managing scalable lakehouse and database systems. The role processes telemetry from millions of connected devices, drives performance tuning and data quality, supports on-call operations, evaluates modern technologies, and mentors engineers. It requires strong expertise in Python, SQL, cloud data platforms, streaming systems, infrastructure as code, and enterprise-scale architecture.

Designs, builds, and maintains batch and near-real-time data pipelines and curated datasets for insurance and annuity reporting, analytics, and business operations. Translates business requirements into integration solutions using SQL and ETL tools, implements data quality and reconciliation controls, optimizes workflows, documents lineage, and supports testing, deployment, monitoring, and issue resolution. Works independently on moderately complex pipelines while escalating architectural decisions to senior engineers or data architects.

Build and manage scalable ETL/ELT pipelines using Microsoft Fabric and Azure Databricks, implement medallion architecture, support data migrations and legacy SSRS decommissioning, develop Power BI data models, and maintain governance, security, and CI/CD practices. The role also supports migration events and modernizes data infrastructure for advanced analytics and reporting.

Designs and maintains scalable cloud data architectures, pipelines, ETL processes, data warehouses, databases, and data models. Ensures data quality, accuracy, security, availability, and consistency across sources. Develops SQL queries for analytics and reporting, and documents pipelines, schemas, architectures, and models. The role requires expertise with Python, Java, Scala, R, SQL, relational and NoSQL databases, cloud platforms, and Snowflake.

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.

Designs and manages scalable data pipelines, contracts, transformation layers, and analytics models. The role focuses on data governance, observability, lineage, configuration validation, and collaboration with product engineering teams. It requires processing large datasets, integrating cloud and on-premises industrial technologies, and implementing streaming and message-queuing solutions, ideally in cybersecurity or industrial environments.

Designs and maintains scalable data architecture, warehouses, ETL/ELT pipelines, and data platforms. Responsibilities include ensuring data quality, integrity, governance, accessibility, reliability, and performance; supporting customer onboarding and analytics tools; contributing to architecture and engineering best practices; troubleshooting complex data issues; and participating in on-call rotations. The role collaborates with engineering, product, solutions, business intelligence, and other cross-functional teams in healthcare and social care data environments.

Owns SQL Server and Azure data warehouse health, ETL/ELT pipelines, data modeling, security, and performance. Administers Azure infrastructure, access controls, costs, monitoring, and legacy-system decommissioning. Builds internal applications and automations using AI-assisted development, integrating business systems with trusted data platforms. Partners with BI, IT, and operations teams while applying software engineering, governance, security, and compliance practices.

Own the analytics data layer by translating stakeholder needs into certified dimensional models, governed metrics, semantic layers, dashboards, and reports. Build with dbt, SQL, Databricks, Power BI, and Airflow while ensuring data quality, observability, reconciliation, documentation, and dependable orchestration. Partner closely with finance, operations, and client-facing teams, automate recurring workflows, and use AI-assisted engineering practices in a fully remote environment.

Build and operate cloud data capabilities, including ingestion pipelines, transformations, data models, curated data products, and data-quality controls. Use Snowflake, dbt, SQL, and Python to deliver governed data for analytics, applications, automation, and AI workflows. Implement testing, CI/CD, documentation, lineage, access controls, monitoring, incident resolution, and performance optimization. Collaborate with engineering, analytics, governance, security, and business teams in an Agile, product-oriented environment with active AI-assisted development.

Design, build, and optimize modern Azure and Databricks data platforms for clients. Develop batch and streaming ingestion pipelines, lakehouse and medallion architectures, dimensional models, and transformation workflows. Lead discovery sessions, requirements workshops, architecture discussions, and solution reviews. Recommend practices for governance, lineage, monitoring, DevOps, security, and data modeling while translating business needs into scalable technical solutions and communicating with technical and executive stakeholders.

Leads the architecture, development, and maintenance of scalable batch and real-time data pipelines, cloud data platforms, ETL/ELT workflows, and ML data infrastructure. Establishes standards for data quality, observability, lineage, governance, security, and modeling. Partners with data scientists, engineers, DevOps, and business stakeholders; evaluates technologies, drives technical initiatives, mentors engineers, and supports production-grade APIs and machine learning pipelines.

Design and operate scalable, cloud-native data pipelines and orchestration systems for imaging, biomarker, and healthcare data. Build Databricks and distributed processing workflows, integrate DICOM data into data lakes, and implement validation, observability, monitoring, and fault tolerance. Collaborate with data science, AI, R&D, product, and data management teams to deliver secure, compliant, reliable data for analytics and machine learning.

Develop and maintain Tableau dashboards, business intelligence solutions, and reporting tools. Lead data-cleaning scripts using Databricks, SQL, and Python; support data transformation, workflow automation, and analytics use cases. Partner with clients and stakeholders to translate business needs into scalable data solutions, present technical concepts, and support consulting, business development, and internal initiatives.

Own and maintain the companys data infrastructure and pipelines. Design, build, and monitor ETL/ELT workflows and data architecture; integrate SaaS sources; enforce data quality, standards, and governance; partner with stakeholders to deliver analytics-ready data and meet data availability SLAs.

Designs and operates an AWS-native lakehouse supporting analytics, reporting, visualization, and AI/ML. Builds batch and streaming ingestion pipelines using Python and PySpark, Apache Iceberg data structures, governance and metadata services, quality controls, security, observability, and CI/CD automation. Optimizes performance, scalability, reliability, and cost while collaborating with cross-functional technical teams and documenting architecture, operations, and secure configurations.