Top Data Engineer Jobs in Philadelphia, PA

Build, optimize, and support scalable batch and streaming data pipelines for enterprise workforce, billing, and interaction datasets. Develop cloud-native solutions with AWS, Databricks, PySpark, Kafka, Kubernetes, and Airflow while processing tens of terabytes of data. Provide production support, performance tuning, troubleshooting, and data platform automation. Collaborate across Product, Governance, Analytics, and Engineering teams, support data warehousing and reliability practices, participate in architecture decisions, and mentor junior engineers.

Build and maintain reliable data pipelines, computed tables, and scalable data models using SparkSQL and PySpark. Integrate IoT, product, customer, external, unstructured, and ML-related data into a central data lake for analytics, causal inference, model training, and dashboards. Ensure high data quality and uptime while collaborating with data science, analytics, AI/ML, and engineering teams.

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.

Designs, builds, and maintains secure data pipelines, ETL processes, data warehouses, and quality controls. Collects, validates, cleanses, and analyzes data; develops SQL queries, Tableau dashboards, and AWS-based solutions; investigates data integrity issues; documents standards; and partners with stakeholders to deliver technical solutions using Agile and DevOps practices.

Build, optimize, and maintain healthcare data pipelines and integrations for clinical, operational, and analytical reporting. Develop SQL transformations, data models, quality checks, and documentation while supporting Azure Data Factory, Databricks, Python, and Spark workflows. Integrate EMR, CMS, and vendor data sources; troubleshoot pipeline and quality issues; and collaborate with analysts and senior engineers while following healthcare interoperability, security, governance, and HIPAA requirements.

Build and maintain FinOps data pipelines, BigQuery and dbt models, cost attribution systems, forecasting and anomaly detection models, and cost-versus-revenue analytics. Identify and implement AWS and GCP savings opportunities, automate governance with Python, Terraform, and Lambda, and partner with Engineering, Finance, Product, and leadership on cloud costs, forecasting, reporting, and architecture decisions.

Designs, develops, maintains, and improves software applications and business processes. Responsibilities include full lifecycle development, troubleshooting, performance and reliability improvements, CI/CD collaboration, requirements analysis, technology research, package maintenance, portfolio planning, and mentoring junior engineers. The role requires independent work, cross-functional collaboration, and strong software development, documentation, and problem-solving skills.

Build and maintain scalable Python-based data pipelines and cloud-native solutions supporting U.S. Army financial-system modernization. Develop ETL/ELT workflows using AWS Glue, Lambda, S3, and CloudWatch; integrate APIs and diverse file formats; improve data reliability, performance, security, and governance; implement testing and monitoring; and collaborate with engineers and stakeholders in an Agile environment.

Build and own scalable data platforms and ingestion pipelines using BigQuery, dbt, and modern ingestion tools. Design batch and CDC workflows, improve reliability and observability, implement governance and access controls, and support analytics and AI agents. Develop Python services and internal tooling, contribute to architecture and lakehouse experiments, collaborate with stakeholders, and mentor engineers. The role requires strong SQL, Python, cloud infrastructure, testing, CI/CD, and AI-assisted development experience.

Develop and maintain data pipelines, backend programs, and integrations in Azure Government Cloud. Transform and cleanse data, evolve scripts and notebooks, manage relational databases, support data quality, document technical processes, and collaborate with engineers, geospatial experts, scientists, and government clients. The role also involves project coordination, status reporting, client travel, and compliance with government background and security requirements.

Designs, develops, maintains, and optimizes complex data systems, SQL/ETL processes, reporting solutions, and .NET applications supporting pharmacy benefit management. Responsibilities include database performance tuning, data warehousing, troubleshooting pharmacy claims, technical specification development, software testing, cloud integration, stakeholder collaboration, Agile participation, and mentoring. The role requires strong SQL Server, dimensional modeling, cloud database, Python, PowerShell, and healthcare data standards expertise.

Designs, develops, and maintains scalable data pipelines, data warehouses, databases, and analytical systems. Responsibilities include ETL implementation, data modeling, performance monitoring, troubleshooting, infrastructure optimization, process automation, and collaboration with cross-functional teams to support reporting and analytics. Requires 5+ years of data engineering experience and a relevant bachelor’s degree. Financial services experience is preferred.

Designs and optimizes scalable data platforms, architectures, and production pipelines supporting AI and machine learning. Responsibilities include Databricks Lakehouse development, batch and real-time processing, data governance, security, monitoring, performance tuning, infrastructure planning, and collaboration with DevOps, MLOps, and cross-functional teams. The role serves as the AI team’s data engineering subject matter expert and ensures reliable, secure, cost-effective data solutions.

Build and operate data-intensive web products and APIs, extend high-throughput ETL pipelines and scrapers, ensure reliability/observability, design self-scaling services, participate in code review, and collaborate across product, data, and infrastructure teams to meet production SLAs.

Leads the architecture, development, and production operation of complex data pipelines and platforms. Resolves scalability, data quality, reliability, and architectural challenges; evaluates data technologies; mentors engineers; establishes engineering standards; partners with product, analytics, and operations teams; communicates technical trade-offs; and conducts proofs of concept to guide platform strategy.

Build and operate batch and streaming data pipelines on Google Cloud for analytics and machine learning. Ingest, transform, validate, and curate datasets in BigQuery; implement data quality, governance, security, monitoring, Terraform infrastructure, and CI/CD. Provide technical direction, lead code reviews, and document data processes. The role requires cloud data engineering experience, technical team leadership, strong SQL and Python skills, and eligibility for a federal Public Trust investigation.

Develop and maintain data pipelines, infrastructure, and integrations supporting analytics, data science, and business intelligence. Ensure data quality and integrity, optimize workflows, and collaborate with Operations, IT, Accounting, HR, Property Services, Marketing, and other departments. The role requires SQL Server, programming, shell scripting, cloud, containerization, version control, and data pipeline knowledge, with occasional travel and flexible scheduling as project deadlines require.

Leads the design, development, and optimization of scalable data pipelines and analytics platforms. Builds ETL/ELT workflows using Databricks and Spark, integrates and transforms source data into curated models, manages SQL Server data, and maintains documentation and lineage. Collaborates with product, analytics, and engineering teams to deliver reliable data solutions. Applies responsible AI practices and delivers projects independently within established timelines.

Build and maintain secure data pipelines and integrations across business platforms, laboratory systems, analytical instruments, and messy data sources. Own schema design, orchestration, monitoring, quality controls, documentation, and compliant data isolation for export-controlled information. Create a unified lakehouse foundation supporting analytics, dashboards, machine learning, R&D, manufacturing, and operations. Partner with scientists and technical teams to integrate HPLC, GC, Invert Bio, APIs, spreadsheets, PDFs, and semi-structured records.

Support design, development, and maintenance of data pipelines and infrastructure. Assist with ETL/ELT workflows, data ingestion, cleaning, validation, modeling, and warehousing. Document processes and collaborate with data teams to support analytics use cases.

Develop and manage Workday PSA and Financials data solutions, including conversions, transformations, integrations, reporting, APIs, EIBs, and ETL processes. Create technical documentation, perform data analysis and loading, support migrations and M&A initiatives, and ensure security, compliance, access controls, and data quality. Partner with business analysts, functional leads, engineers, and security teams while managing multiple projects and serving as a Workday data subject matter expert.

Build and maintain production knowledge graphs in Stardog using semantic web standards, ontology modeling, SPARQL, virtual mappings, Python, and SQL. Integrate life science data sources, implement data quality and validation, automate CI/CD deployments, support governance and lineage, and collaborate with subject matter experts to develop defensible semantic models.

Design, build, and optimize scalable data pipelines, warehouses, lakes, and processing systems for analytics and business intelligence. Ensure data quality, security, reliability, and cost efficiency while collaborating with data scientists, analysts, and engineers. Maintain technical documentation, support Databricks solutions, and apply emerging data engineering technologies. The role requires strong programming, SQL, ETL, orchestration, data modeling, cloud, and big data expertise.

Architects and leads enterprise data engineering platforms, including scalable ETL/ELT pipelines, streaming frameworks, cloud infrastructure, data warehouses, and AI/ML data systems. Establishes engineering standards, governance, monitoring, data quality, security, and schema management practices. Designs AI agents using LLMs, partners across business and infrastructure teams, and makes high-impact architectural decisions for reliable, secure, multi-region data environments.

Design and build scalable cloud-native data platforms, batch and streaming pipelines, data lakes, and integrated data services. Support analytics and AI/ML workloads while implementing DevSecOps, infrastructure as code, and reliability improvements. Collaborate with data scientists, engineers, architects, consultants, and clients to solve complex data challenges and translate requirements into technical solutions. The role supports Defence, Government, and National Security projects and requires high-level security clearance and on-site work three to four days weekly.