Top Data Engineer Jobs in Philadelphia, PA

Build and maintain scalable data pipelines, data applications, planning tools, APIs, and automated quality processes for network capacity planning. Develop ETL/ELT workflows, anomaly detection, monitoring, metadata and lineage solutions, and machine learning or AI-enabled applications. Analyze data, optimize performance, document systems, and collaborate with engineering, product, operations, software development, and data science teams to deliver reliable production solutions.

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, implementing security and compliance controls, developing dbt data models, cataloging assets in OpenMetadata, automating with Python, and mentoring engineers. The role requires extensive infrastructure and data engineering experience, cloud expertise, container orchestration, and eligibility for CJIS clearance.

Designs and delivers large-scale, governed data pipelines and infrastructure across the full data lifecycle. Responsibilities include coding in Python and SQL, optimizing Airflow, dbt, AWS, Kafka, and Iceberg/Parquet workflows, implementing data quality and observability, contributing to architecture and tool evaluations, mentoring engineers, collaborating with stakeholders, and participating in on-call support.

Builds scalable data pipelines and infrastructure supporting AI and machine learning algorithms, including large language models, NLP, and time-series analytics. Responsibilities include data extraction, transformation, loading, normalization, curation, automation, dashboard development, and process improvement. The role also implements AI/ML algorithms and uses Agile software development practices while requiring an active TS/SCI clearance and willingness to obtain a CI or full-scope polygraph.

Designs and optimizes ETL processes, data pipelines, databases, and AWS-based data infrastructure. Integrates complex datasets, develops Spark, Python, and SQL solutions, and builds Power BI dashboards and reporting automation. Translates business and regulatory requirements into technical designs, ensures data quality, supports production releases, and partners with compliance, analytics, and business teams. Serves as a data engineering subject matter expert and mentors less-experienced professionals, with a focus on Financial Crimes and regulatory compliance reporting.

Maintains and monitors Azure Databricks data pipelines, troubleshoots data issues, collaborates with stakeholders on data requirements, documents processes, performs backups and disaster recovery drills, and supports data access and usage. The role requires extensive data engineering experience, Azure expertise, incident management knowledge, and strong problem-solving skills.

Build and maintain reliable data pipelines, computed tables, and scalable data models using SparkSQL and PySpark. Integrate IoT, product, customer, external, unstructured, and ML-related data into a central data lake for analytics, causal inference, model training, and dashboards. Ensure high data quality and uptime while collaborating with data science, analytics, AI/ML, and engineering teams.

Lead the reverse-engineering and migration of legacy ETL pipelines from SAP BusinessObjects Data Services and JD Edwards into dbt and Databricks architectures. Build automated data validation, maintain SQL Server write-back mechanisms, collaborate with client stakeholders, and lead and mentor a small engineering team. The role requires hands-on expertise in SQL, Python, Spark, orchestration, cloud platforms, and legacy ERP and ETL migrations.

Designs, builds, tests, and maintains scalable data infrastructure and ETL/ELT pipelines for mission partners. Uses AWS Glue, Glue Catalog, and Step Functions to integrate, migrate, transform, and validate data. Develops data models, schemas, queries, and production-ready datasets while collaborating with analytics and business teams. The role may also support AI/ML pipelines, data governance, DevOps workflows, Databricks, and real-time streaming architectures.

Architects, builds, tests, and maintains scalable data infrastructure and ELT/ETL pipelines using AWS Glue, Glue Catalog, and Step Functions. Performs data modeling, SQL querying, data migration, schema optimization, validation, and data quality improvements. Partners with analytics and business teams to transform raw data into production-ready datasets. The role may also support AI/ML pipelines, governance, access controls, DevOps workflows, and real-time data architectures.

Own Eve’s data platform end to end, including ingestion, orchestration, incremental dbt models, Snowflake administration, Terraform infrastructure, observability, access controls, and pipeline reliability. Build schema-change detection, freshness SLAs, CI environments, and incident processes while managing performance and compute costs. Partner with analytics engineers and stakeholders to maintain trusted data for reporting and AI systems, using AI-assisted development and documenting platform standards.

Designs, builds, operates, and modernizes secure ETL/ELT data pipelines for public health interoperability. Responsibilities include using NiFi, Kafka, Python, and SQL; deploying pipelines on Azure or AWS; implementing CI/CD with GitHub Actions; monitoring with Grafana; troubleshooting production systems; supporting legacy migrations; and ensuring data security, compliance, scalability, and reliability. The role collaborates with architects, integration engineers, data scientists, DevOps/SRE, and product teams.

Leads data architecture and engineering modernization across business domains. Designs and implements complex pipelines, integrations, data models, and orchestration using Snowflake, AWS, and Airflow. Establishes data quality, governance, security, testing, observability, CI/CD, and reliability practices. Provides architectural guidance, evaluates technical solutions, leads cross-team initiatives, mentors engineers, and improves platform performance and cost efficiency.

Build and maintain production ETL pipelines for structured and unstructured data, integrate machine learning models for enrichment, develop data transformations and quality monitoring, design warehouses and dimensional models, establish governance frameworks, and contribute to data architecture and platform improvements. Collaborate with data scientists, analysts, and engineering teams to deliver reliable, actionable intelligence.

Leads the architecture, development, and production operation of complex data pipelines and platforms. Resolves scalability, data quality, reliability, and architectural challenges; evaluates data technologies; mentors engineers; establishes engineering standards; partners with product, analytics, and operations teams; communicates technical trade-offs; and conducts proofs of concept to guide platform strategy.

Supports and modernizes enterprise data services, including SQL Server and cloud-based ETL/ELT, data warehouses, pipelines, data integration, dimensional modeling, and OLTP environments. Develops SSIS, Azure Data Factory, and Microsoft Fabric pipelines; troubleshoots production data and integration issues; optimizes SQL and stored procedures; documents data flows and lineage; and collaborates with technical and business teams on secure, compliant data solutions.

Designs and optimizes Power BI dashboards, semantic models, datasets, DAX measures, and reporting solutions for identity governance and administration analytics. Partners with ETL engineers and stakeholders to validate Parquet data from Azure Synapse and SailPoint sources, establish data-quality checks, monitor refreshes, define KPIs, and document data lineage. Supports compliance reporting, access governance, audit readiness, certification metrics, and Zero Trust analytics.

Build and maintain scalable Snowflake-based ELT/ETL pipelines, production data models, and observability frameworks. Translate business requirements into reliable solutions supporting analytics, BI, and ML. Establish data quality, governance, lineage, security, and compliance practices while optimizing warehouse performance, cost, and data freshness. Collaborate with Analytics, Product, and Engineering teams, contribute to architecture decisions, evaluate Snowflake tooling, and use AI-assisted development tools to accelerate delivery.

Designs, builds, and optimizes scalable data collection, storage, access, and analytics systems. Creates and automates reliable data pipelines, supports data quality and governance, ensures SLA and performance compliance, and monitors pipeline operations. The role requires collaboration with analytics, business, and customer teams, with potential work involving AI/ML pipelines, Databricks, DevOps practices, streaming data, and event-driven architectures.

Build and maintain scalable batch and incremental data pipelines using Python, SQL, and Snowflake. Develop data warehouse models, transformations, automation, quality checks, lineage, alerting, and performance optimizations. Collaborate with analysts, data scientists, and application teams to deliver trusted datasets, while documenting pipelines, schemas, and data contracts.

Build and maintain scalable batch and incremental data pipelines using Python, SQL, and Snowflake. Develop warehouse models, transformations, automation, data quality checks, lineage, alerting, and performance optimizations. Collaborate with analysts, data scientists, and application teams to deliver trusted datasets, while documenting pipelines, schemas, and data contracts.

Designs and maintains a scalable data platform supporting analytics, machine learning, and AI workloads. Builds tooling for reliable data pipelines, semantic layers, data agents, LLM applications, and evaluation systems. Ensures data quality, availability, observability, and reliability while establishing modeling, testing, and platform best practices. Collaborates with Data Science and Product Engineering, leads solutions from design through implementation, and contributes individually in a fast-paced startup environment.

Build, test, and maintain batch and event-driven data pipelines and ETL/ELT workflows. Transform and validate large datasets, troubleshoot data-quality issues, improve workflow reliability, and support platform modernization. Collaborate with engineering, product, and data stakeholders while following strong practices for version control, testing, monitoring, documentation, and code review. The role may occasionally require work outside standard business hours.

Own EULER’s data lifecycle, including instrumentation, validation, reconciliation, privacy, anonymization, canonical data modeling, analytics datasets, documentation, and production pipelines. The role requires strong SQL, software engineering practices, independent ownership, skepticism toward data quality, and clear communication. Preferred experience includes GDPR/LGPD, multi-tenant B2B SaaS, dbt, statistics, Cloudflare Workers, Postgres, Parquet, DuckDB, and Bubble.

Develop and maintain scalable data pipelines, ETL/ELT processes, APIs, data models, and analytics datasets using Python, SQL, Spark, and Databricks. Integrate sensitive federal health, financial, and operational data while implementing validation, governance, testing, documentation, and performance optimization. Collaborate with engineers, architects, analysts, and stakeholders to deliver reliable data products and resolve technical data needs.