Top Senior Data Engineer Jobs in Philadelphia, PA

Build, optimize, and support scalable batch and streaming data pipelines for enterprise workforce, billing, and interaction datasets. Develop cloud-native solutions with AWS, Databricks, PySpark, Kafka, Kubernetes, and Airflow while processing tens of terabytes of data. Provide production support, performance tuning, troubleshooting, and data platform automation. Collaborate across Product, Governance, Analytics, and Engineering teams, support data warehousing and reliability practices, participate in architecture decisions, and mentor junior engineers.

Supports and modernizes enterprise data services, including SQL Server and cloud-based ETL/ELT, data warehouses, pipelines, data integration, dimensional modeling, and OLTP environments. Develops SSIS, Azure Data Factory, and Microsoft Fabric pipelines; troubleshoots production data and integration issues; optimizes SQL and stored procedures; documents data flows and lineage; and collaborates with technical and business teams on secure, compliant data solutions.

Designs scalable data architectures, ELT/ETL pipelines, data models, quality frameworks, and self-service data platforms. Partners with engineering, product, program, leadership, and data science teams to translate business needs into technical solutions. The role includes end-to-end technical ownership, large-scale batch and streaming data processing, mentoring junior engineers, system optimization, and on-call support for platform stability.

Own data pipelines into and out of the warehouse, dbt models, data integrity, governance, identity resolution, reverse ETL, and quality monitoring across growth, lifecycle, and brokerage data. Partner with product, marketing, and operations teams to establish data contracts, ensure accurate and timely business metrics, and support regulated financial data requirements.

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.

Staff Data Engineer responsible for setting technical direction, architecting scalable data platforms, leading cross-functional initiatives, improving reliability and performance, and enabling AI-assisted analytics and development. The role includes hands-on development with Python, SQL, cloud data warehouses, orchestration, infrastructure as code, Kubernetes, Kafka, and streaming pipelines, along with mentoring, technical advocacy, documentation, code reviews, and on-call troubleshooting.

Build and maintain Nex’s data backend, reporting infrastructure, and automated data pipelines. Partner with Accounting, Finance, Supply Chain, Publishing, and other cross-functional teams to understand data needs, prioritize projects, improve data access, and ensure reliable, cost-effective operations. Investigate issues, iterate on data workflows, and support data environments using AWS and related technologies.

Data Engineer II will modernize BlueLabs’ data platform by leading Kimball dimensional modeling and legacy warehouse migrations, building reliable production data pipelines, and enforcing data quality standards. The role requires advanced SQL, Python, and dbt expertise, hands-on Snowflake and Redshift experience, and ownership of testing, documentation, observability, and scalable architecture. The engineer will collaborate cross-functionally, guide Data Engineer I team members, contribute to architectural decisions, and translate business logic into maintainable, cloud-agnostic data layers.

The AVP, Data Engineer will design and build data ingestion, transformation, and replication pipelines using SQL, Python, dbt, and Dagster. Responsibilities include translating requirements into technical designs, developing data products, debugging production issues, supporting testing, and improving data engineering practices. The role also involves data modeling, mentoring junior engineers, conducting code reviews, and providing technical leadership while remaining hands-on. Experience with modern data platforms, workflow orchestration, cloud ecosystems, and insurance or financial services is preferred.

Designs, builds, and optimizes scalable data pipelines, ETL workflows, integrations, and reporting solutions. Develops SQL, Python, and Spark data-processing solutions using Azure Data Factory and Microsoft Fabric, while monitoring production reliability and performance. Collaborates with stakeholders, participates in code reviews, documents technical solutions, mentors junior engineers, and improves engineering practices. Requires strong data modeling, cloud data platform, Git, communication, and problem-solving skills.

Design, build, and operate production data pipelines and shared data foundations using SQL, Python, PySpark, Databricks, and cloud technologies. Develop data models, ingestion and transformation workflows, resilient processing, observability, data-quality controls, and secure customer-aware data flows. Collaborate with engineering and product teams, evaluate architecture and tooling, support analytics and application services, contribute to testing and documentation, and mentor other engineers.

Designs, builds, and maintains secure data pipelines, ETL processes, data warehouses, and quality controls. Collects, validates, cleanses, and analyzes data; develops SQL queries, Tableau dashboards, and AWS-based solutions; investigates data integrity issues; documents standards; and partners with stakeholders to deliver technical solutions using Agile and DevOps practices.

Build and deliver Azure and Microsoft Fabric data solutions for clients. Responsibilities include developing data pipelines with Azure Databricks, Data Factory, Synapse Analytics, and Fabric; writing SQL, Python, and PySpark; supporting data integration, testing, deployments, troubleshooting, CI/CD, and infrastructure management. The role involves consulting with client stakeholders, collaborating with architects and developers, and delivering modern data platforms and reporting solutions.

Design and maintain Snowflake-based data platforms, cloud-native data lakes, and scalable ETL/ELT pipelines for asset-backed finance analytics. Orchestrate workflows with Dagster and AWS services, ensure data reconciliation and integrity, and support migration from legacy systems. Contribute to project planning, Jira backlog management, testing, cutover planning, and cross-functional go-live readiness.

Design and maintain Snowflake data pipelines and data lake architectures for asset-based finance analytics. Develop ETL/ELT workflows, validate and reconcile financial data, migrate legacy systems, and translate quantitative finance logic into scalable architectures. Support project execution through requirements breakdown, planning, testing, cutover, and go-live readiness. Collaborate across engineering, quantitative analytics, and stakeholder teams.

Design, build, and maintain scalable batch and streaming data pipelines using Databricks, PySpark, Python, SQL, Spark, and Delta Lake. Develop transformations, orchestration workflows, data models, validation processes, and curated data products. Troubleshoot performance and quality issues, apply governance and security practices, document solutions, and collaborate with architects, data scientists, DevOps teams, analysts, and clients.

Build and own scalable data platforms and ingestion pipelines using BigQuery, dbt, and modern ingestion tools. Design batch and CDC workflows, improve reliability and observability, implement governance and access controls, and support analytics and AI agents. Develop Python services and internal tooling, contribute to architecture and lakehouse experiments, collaborate with stakeholders, and mentor engineers. The role requires strong SQL, Python, cloud infrastructure, testing, CI/CD, and AI-assisted development experience.

Leads the design, development, and optimization of scalable data pipelines and analytics platforms. Builds ETL/ELT workflows using Databricks and Spark, integrates and transforms source data into curated models, manages SQL Server data, and maintains documentation and lineage. Collaborates with product, analytics, and engineering teams to deliver reliable data solutions. Applies responsible AI practices and delivers projects independently within established timelines.

Design and build scalable cloud-native data platforms, batch and streaming pipelines, data lakes, and integrated data services. Support analytics and AI/ML workloads while implementing DevSecOps, infrastructure as code, and reliability improvements. Collaborate with data scientists, engineers, architects, consultants, and clients to solve complex data challenges and translate requirements into technical solutions. The role supports Defence, Government, and National Security projects and requires high-level security clearance and on-site work three to four days weekly.

Own and evolve UJET’s data platform, including MySQL CDC replication to BigQuery, dbt transformations, Terraform infrastructure, pipelines, data quality, observability, and Looker models. Build reliable, analytics-ready datasets and trusted metrics for internal and customer-facing reporting. Partner with Analytics, Finance, Product, and Engineering to deliver scalable data solutions, improve platform reliability, optimize performance and costs, and establish development standards and guardrails.

Own and evolve WorkOS’s internal data platform, including ingestion, orchestration, Snowflake, dbt models, data governance, reverse ETL, semantic views, and AI-enabled data workflows. Ensure pipeline reliability, freshness, security, and scalability while partnering with Product, Finance, RevOps, GTM, Engineering, and Security. Build monitoring, runbooks, CI/CD gates, access controls, masking policies, and infrastructure automation across AWS and Kubernetes.

Build and optimize batch and streaming data pipelines, ETL/ELT processes, data models, and analytics solutions on Google Cloud. Support Vertex AI and Gemini-based ML solutions, MLOps, prompt engineering, embeddings, and RAG experimentation. Participate in client requirements gathering, architecture implementation, data governance, quality validation, security, monitoring, and documentation while collaborating with senior engineers and architects.

Designs, builds, and maintains scalable AWS and Snowflake data pipelines, ETL/ELT processes, and dbt transformation models. Ensures data quality, reliability, security, governance, privacy, and performance through testing, profiling, validation, and optimization. Partners with engineering, analytics, product, and business stakeholders to deliver maintainable data solutions, participates in planning and code reviews, documents work, and improves platform automation.

Design, build, deploy, and maintain AWS-based data and AI/ML infrastructure for enterprise agentic AI platforms. Develop data lake pipelines, observability systems, agent-enablement tooling, and production MLOps/LLMOps capabilities. Own features end-to-end, contribute to architecture and design decisions, optimize reliability, scalability, security, and cost, and collaborate with AWS Professional Services, client teams, and junior engineers.

Build and operate production pipelines for legal records from PACER, court systems, opinions, PDFs, scans, XML, and HTML. Develop LLM-assisted extraction workflows, validate data quality, optimize SQL, and support RAG and semantic search products. Manage AWS S3 and RDS systems within security guardrails while collaborating with engineering teams. The role requires strong Python and SQL skills, legal data experience, document extraction expertise, and autonomous problem-solving with large, messy datasets.