Top Data Engineer Jobs in Philadelphia, PA

Senior Exasol data engineer to design, build, optimize, and validate SQL-based data pipelines for healthcare analytics. Responsibilities include complex query tuning, extracting/staging from SQL Server, chart validation, applying clinical terminologies, quality measure development, and maintaining disciplined version-controlled engineering practices.

Design, build, and maintain scalable ETL/ELT pipelines and data models using Databricks, Spark, dbt, SQL, and AWS services. Optimize ingestion, transformation, orchestration, and monitoring across structured and semi-structured data. Collaborate in Agile teams, support analytics and reporting for large-scale federal environments, and evaluate new data tools and platform improvements.

Design, build, and maintain scalable AWS-native data platforms and ETL/ELT pipelines using Databricks, Spark, Python, dbt, and SQL. Implement ingestion, transformation, orchestration, and analytics solutions (Iceberg, Parquet, Redshift, Athena), support FedRAMP/NIST controls, migrate legacy systems to cloud-native services, and mentor junior engineers while collaborating in Agile teams.

Lead design and development of web UI and REST middleware within an Agile team. Define requirements and acceptance criteria, implement Java/Spring and Angular solutions, build CI/CD pipelines, work with Product Owner and testers, and produce/update design documentation.

As a Data Engineer, you will develop and manage data pipelines, ensuring reliable data ingestion and delivery while optimizing for simplicity and performance.

Design, build, and maintain end-to-end batch and streaming data pipelines; develop ETL/ELT workflows and modular Python code; write and optimize SQL; implement analytics data models; monitor data quality, troubleshoot failures, and document pipelines; collaborate with stakeholders and mentor teammates. Remote role for candidates based in Latin America.

Design, build, and maintain scalable ETL/ELT data pipelines on Databricks and AWS S3; manage large geospatial and temporal datasets; productionize ML models; implement data validation, testing, and monitoring; optimize storage and processing; document workflows; collaborate cross-functionally.

The DMS Data Engineer is responsible for analyzing raw data, building data systems and pipelines, conducting complex data analyses, and collaborating on projects to enhance data quality and reliability.

Design, build, and maintain scalable cloud data pipelines and ETL/ELT processes using Azure Data Factory, Snowflake, SQL, and Python. Integrate enterprise and third-party data, validate and model datasets for BI, reporting, automation, and AI, monitor and optimize pipeline performance, and document data flows while partnering with stakeholders.

Design, develop, and release data ingestion and streaming solutions using Big Data technologies (Flume, NiFi, Kafka, Spark/Storm). Collaborate with stakeholders and distributed teams, follow agile practices, and support data warehousing and reporting efforts.

Lead data discovery and design of enterprise data models, contracts, validation rules, and QA practices. Define metadata, data quality checks, and governance; partner with stakeholders and engineers to implement automated validation and ensure reusable, trustworthy city data.

Design, build, and maintain ETL pipelines, databases, and data models to process healthcare claims and related data. Ensure data quality, analyze claims data for trends, and produce reports and visualizations for nontechnical stakeholders. Collaborate with policy and analytics teams to translate requirements into data solutions and improve data infrastructure and analytics capabilities.

Build and maintain low-latency, highly available distributed data systems and services to deliver high-quality data for product, analytics, and ML. Partner with data scientists and product teams to design scalable, observable, multi-tenant data products using batch and real-time processing frameworks. Ensure 24x7 reliability, monitoring, and operational excellence while owning end-to-end delivery.

Build scalable, privacy-focused data frameworks and ETL pipelines using big-data technologies (Spark, Presto, Flink, Kafka, Hive). Ensure appropriate handling of personal data, support privacy and legal needs, partner cross-functionally, and lead system design while mentoring teammates.

Design, build, and own large-scale batch and streaming data pipelines and core Ads data products. Collaborate with analytics, data science, and engineering teams to model, transform, govern, and deliver high-quality ad datasets for analysis, ML, and reporting while ensuring privacy compliance.

Build and maintain scalable batch and real-time data pipelines, model data to power analytics and ML, and operate distributed data systems. Collaborate with business, engineering, and data science teams to ensure data quality, documentation, and debugging while adopting new technologies and working in an ambiguous, fast-changing environment.

Lead design and implementation of scalable cloud data lakes, warehouses, and marts. Build ELT/ETL pipelines, apply Data Vault 2.0 and dimensional modeling, implement data quality, lineage, observability, and governance. Optimize Snowflake/Databricks/Synapse platforms, champion CI/CD and DataOps, mentor engineers, and enable AI/ML-ready data products through collaboration with architecture and product teams.

Build and maintain data pipelines, applications, workflows, and governance within Palantir Foundry. Apply industrial engineering and operations research methods to analyze depot, MRO, and supply chain processes, integrate ERP/MRO data into models, run capacity/throughput analyses, deliver decision‑support briefings, and support adoption of advanced analytics and digital engineering. Coordinate with stakeholders and support business development activities.

Design, build, and optimize scalable Azure data platforms and lakehouse architectures. Develop ETL/ELT pipelines (PySpark/Spark SQL), enable Power BI datasets, implement CI/CD and IaC, ensure data governance/quality with Purview, support cloud migrations and production operations while collaborating with stakeholders and agile teams.

Lead design and delivery of scalable, secure cloud data pipelines and products. Translate requirements into architecture, apply advanced data modeling (Data Vault 2.0/dimensional), embed data quality, observability, security, and DataOps/CI-CD practices, optimize performance and cost, mentor engineers, and enable AI/ML-ready datasets within an agile DevSecOps model.

Design, build, and operate scalable cloud data pipelines and platforms (Azure preferred). Implement DevSecOps, CI/CD, automated testing, monitoring, performance tuning, and production readiness. Mentor engineers, drive operational excellence, and translate requirements into robust technical designs. Apply healthcare domain knowledge and collaborate in agile teams to deliver secure, reliable data products.

The job involves building responsive web dashboards, advanced data visualizations, and analytics tools for unmanned aircraft systems, requiring a deep understanding of UI/UX design and data presentation.

Design, build, and optimize scalable Azure data platforms and lakehouse architectures. Develop ETL/ELT pipelines (PySpark, ADF, Fabric), enforce data governance and quality, enable Power BI reporting, lead cloud migration and CI/CD, and provide production support and performance tuning across enterprise data systems.

Build and maintain production data pipelines and foundations for People Analytics and AI-driven tools. Integrate HR systems (Workday, Greenhouse), design data models, ensure governance for sensitive employee data, support data science and reporting, and deliver dashboards and Streamlit apps. Optimize queries, enable LLM consumption with quality and latency controls, and collaborate cross-functionally to transition AI prototypes to production.

Maintain and build data products, pipelines, and automation to support care management and clinical programs. Integrate multiple data sources into single sources of truth, perform root cause analysis, and serve as a subject-matter expert for partner teams to drive clinical, operational, and financial insights.