Top Senior Data Engineer Jobs

Design, develop, maintain, and test data infrastructures and pipelines; optimize data flow and collection; collaborate with data science to integrate models; analyze IT environments; deliver data solutions for stakeholders and support project milestones.

Own the go-to-market data infrastructure, integrating HubSpot, Dreamdata, advertising platforms, PostHog, and website data into BigQuery. Diagnose tracking and attribution discrepancies, configure multi-touch revenue attribution, and build executive dashboards covering channel performance and revenue. Develop ABM workflows using Clay, enrichment, behavioral signals, and AI personalization. Partner with sales and marketing to improve funnel visibility, campaign decisions, and outbound effectiveness.

Design, build, and maintain scalable Hadoop-based data processing pipelines and ETL for structured and unstructured data. Implement streaming and batch solutions (Spark, Storm, Kafka), integrate multiple data sources and NoSQL stores, optimize performance, define retention, and collaborate with product and data science teams in an Agile environment.

Design, implement, and own reliable data solutions across design, manufacturing, and mission operations. Lead data architecture, migrations, ETL/replication, schema design, and optimizations. Partner with cross-functional teams, drive tradeoffs, prioritize work using data, mentor team members, and deliver production-ready data products.

Build and lead Harvey’s central data platform, including streaming and batch ingestion, CDC, Snowflake warehousing, orchestration, transformation frameworks, real-time processing, self-service tooling, and data quality, lineage, and governance. Establish secure patterns for PII, access control, retention, and multi-region data residency while setting technical direction and mentoring a growing team.

Build and lead Harvey’s central data platform, including streaming and batch ingestion, CDC, Snowflake warehousing, orchestration, transformations, real-time processing, and self-service tooling. Establish data quality, observability, lineage, governance, PII protection, access controls, and multi-region data residency. Own architecture and technical direction while setting standards, mentoring engineers, and partnering with Analytics, Data Engineering, Product, and Infrastructure teams.

Designs, develops, and maintains Databricks-based ETL pipelines, data lake architectures, datasets, and data quality processes supporting reporting, analytics, and AI/ML workloads. Maintains and migrates legacy SSIS and SQL Server systems, optimizes pipeline performance, and supports complex SSRS reporting. Collaborates with business users, analysts, and IT teams to define data requirements, troubleshoot issues, document solutions, and advance AI-assisted engineering practices.

Designs and maintains data models, databases, dictionaries, ETL workflows, and data quality processes. Partners with data owners and reporting teams to define requirements, resolve discrepancies, establish stewardship, and improve data sharing. Develops scalable PySpark and Python pipelines, optimizes SQL and Spark jobs, and implements AI/ML solutions using technologies including Snowflake and Oracle. Requires collaboration across teams, strong documentation, and adherence to data standards.

Designs, develops, and maintains Databricks ETL pipelines, data lake architectures, datasets, and data integrations supporting reporting, analytics, and AI/ML workloads. Troubleshoots and optimizes Databricks and SSIS processes, maintains legacy systems, implements data quality controls, and supports data warehousing. Maintains SSRS reports and collaborates with business users, analysts, and IT teams to deliver reporting solutions. Documents work, communicates technical information, and contributes to AI-assisted development practices.

Designs, develops, optimizes, and supports large-scale ETL/ELT data pipelines and transformation processes. Responsibilities include complex SQL, Python automation, XML processing, Linux and shell scripting, validation, monitoring, troubleshooting, and system integration support. The role collaborates with technical and nontechnical stakeholders, participates in Agile delivery, and communicates risks and recommendations. Java, AWS data services, relational databases, and reporting tools are preferred.

Build scalable data pipelines, ELT processes, infrastructure, and dimensional data models supporting internal analytics and customer-facing data products. Implement data quality monitoring, auditing, alerting, warehouse optimization, and governed semantic layers for AI and LLM-enabled analytics. Partner with technical and business stakeholders, improve data processes using AI, and deliver reliable metrics from diverse data sources.

Design, build, and optimize enterprise ETL/ELT pipelines, cloud data lakes, lakehouse solutions, data models, and semantic layers across AWS and Azure. Ensure data quality, security, performance, reliability, and governance while supporting analytics, reporting, and AI initiatives. Collaborate with product, engineering, IT, and business stakeholders to translate requirements into scalable data solutions, monitor pipeline health, troubleshoot issues, and improve data architecture and practices.

Own and scale the data platform powering ReadyOn's real-time labor OS. Design and operate batch and real-time pipelines, transformations, and data services (Python, PySpark, Airflow, Glue, Snowflake, Postgres). Build connectors, observability, data quality, and feature-store infrastructure while partnering with AI, backend, and product teams and providing technical leadership and mentorship.

Designs, builds, and operates high-throughput streaming and batch data infrastructure for AI products. Responsibilities include developing Kafka, Flink, and Airflow pipelines; managing analytical data layers; optimizing query and pipeline performance; implementing Terraform and GitOps practices; improving observability, reliability, and cost efficiency; partnering with product and research teams; and participating in on-call operations and automation initiatives.

Design, build, deploy, and operationalize scalable data engineering solutions for customers. Responsibilities include developing pipelines, transforming and cleansing data, analyzing sources, implementing governance, security, and quality practices, testing data movement and transformation code, resolving defects and incidents, and advising customers on technical decisions. The role also supports AI, machine learning, business intelligence, and data product adoption while collaborating across teams and educating end users.

Designs and develops enterprise cloud data solutions, including batch, near-real-time, and API-based pipelines. Builds data models, warehouses, lakes, and lakehouses while implementing governance, quality, lineage, and curation practices. Supports CI/CD, testing, monitoring, observability, security, and compliance. Collaborates with architects, product owners, analysts, and leadership on platform strategy and modernization. Mentors engineers, leads reviews, presents technical topics, and explores AI-enabled data capabilities.

Lead modernization of data platforms, design and maintain ETL/ELT pipelines and data warehouse models, improve data governance and quality, optimize platform performance, and collaborate with IT, business units, and leadership to drive data-driven initiatives and stakeholder alignment.

Build and own the data platform backbone: design ingestion patterns, Snowflake warehouses, governance, and freshness strategy. Implement reliable batch and streaming pipelines, data quality, observability, and onboarding processes. Lead legacy migrations, create data contracts and SLAs, and apply AI-native tooling to automate debugging, documentation, and operational workflows while partnering with Analytics, Engineering, and vendors.

Lead design and ownership of a modern data platform: ingestion, Snowflake governance, pipeline reliability, migrations, data contracts, observability, and AI-enabled tooling. Partner with Analytics, Engineering, and vendors to deliver trustworthy data products and operate production pipelines.

Design, build, and maintain cloud data pipelines and governance on Databricks or Snowflake. Optimize Databricks clusters, implement Delta Lake, automate CI/CD with Azure DevOps, integrate with Azure services, and create monitoring and governance solutions.

Design, implement, and maintain Azure-based ELT/ETL pipelines and data architecture. Migrate and normalize source data into ADLS, enforce quality controls, source control, documentation, and self-service analytics. Optimize storage/processing, audit pipelines, and explore AI-assisted tooling.

Lead design and operation of a cloud-native data platform: set technical direction, build scalable ingestion/processing/warehousing pipelines (batch & streaming), support ML data needs, mentor engineers, drive projects end-to-end, run planning/standups/on-call, and eventually lead a data engineering team.

Own and scale the data platform: design and implement ETL/ELT pipelines, optimize warehouse/lake architecture, support streaming and batch ingestion, enable ML workflows, mentor engineers, write design documents, participate in sprints and on-call rotation, and deliver reliable clinical data at scale to customers.

Design, develop, and maintain enterprise data solutions and pipelines using Azure data platform and Microsoft Fabric. Support data modeling, master data management, medallion architecture, data quality, and integrations to produce trusted, scalable data for analytics and BI.

Design, build, and maintain scalable data pipelines and architectures (ETL, data lake, MDM) using Snowflake and Talend Cloud. Ensure data quality and governance, enable AI-readiness, pilot AI/ML proofs-of-concept, support reporting (Tableau/Power BI), and manage data operations and external vendors.