Top Data Engineer Jobs

Design, build, and operate scalable ingestion, curation, and metadata-enrichment pipelines for enterprise data catalog and discovery. Ensure data quality, schema evolution, lineage, and cost-efficient large-scale processing; translate technical concepts for non-technical stakeholders and support downstream mission use.

Design and maintain cloud-native data platforms (lakes, lakehouses, warehouses) on AWS/Azure/GCP. Build CI/CD templates and IaC for self-service, develop ETL/ELT for batch and streaming, enforce RBAC, encryption, data lineage and compliance, monitor performance and cost, and collaborate with architects, developers, and data scientists to integrate APIs and deliver end-to-end data products.

Lead architecture and execution of Faire's data platform and analytics capabilities. Build and operate scalable, secure ETL/ELT, streaming, storage, compute, orchestration, and data warehousing at petabyte scale. Drive performance, cost, monitoring, governance, and self-serve analytics; influence cross-functional teams and mentor engineers.

Design and maintain a dbt-based business data layer for GTM metrics, centralize and reconcile multi-source data, implement automated data quality and reconciliation checks, align and document metrics with stakeholders, mentor analytics team, and lead root-cause investigations into complex data anomalies.

Design and build production-grade data pipelines on Databricks and AWS extracting from enterprise ERPs, implement medallion architectures, ensure data quality/governance, collaborate with business SMEs, and deliver AI-ready data products.

Leads enterprise data ingestion and integration for AI, machine learning, Generative AI, analytics, and BI workloads. Designs scalable pipelines for structured, semi-structured, unstructured, and multimodal data; establishes quality, governance, lineage, security, and observability standards; and supports RAG, AI Search, vector retrieval, and MCP capabilities. Partners with technical and business stakeholders, mentors engineers, evaluates emerging technologies, and drives production delivery and continuous improvement in a regulated financial-services environment.

Design, build, and optimize scalable ETL/ELT data pipelines using Databricks and cloud platforms. Implement data quality checks, monitor and troubleshoot jobs, audit pipelines for compliance, and collaborate with analysts and business stakeholders to define data models and support reporting.

Build and maintain end-to-end event-driven analytics pipelines for telemetry from robots and cloud systems. Own metrics catalog, schema evolution, data quality validation, and performant analytical models and queries to enable reporting and self-service analytics.

Build and own production data pipelines and financial data models to turn payments and operational data into trusted metrics and actionable insights. Ship features for Whop Financial Reports, standardize financial semantics, ensure data quality and lineage, and enable self-serve analytics across Finance, Product, GTM, and Exec teams.

Design, build, and optimize end-to-end data pipelines, ETL processes, and data models to support purchasing and finance analytics. Collaborate with data scientists and stakeholders to deploy predictive models, ensure data quality and governance, and deliver dashboards and analytics for operational insight and forecasting.

Build, maintain, and monitor batch, streaming, and replication data pipelines; translate business needs into data solutions; enforce data modeling, orchestration, and quality best practices; participate in code reviews and knowledge sharing; enable self-service curated data products and semantic layers for analytics and compliance.

Design, develop, and deploy end-to-end real-time streaming and ETL/ELT solutions on AWS (including geospatial pipelines). Build APIs, implement infrastructure-as-code, ensure security/compliance, and move systems to production and O&M for high‑scale distributed environments.

Design, build, and maintain scalable ETL/ELT pipelines and Lakehouse solutions; ingest and transform diverse data formats; optimize Databricks and SQL Server environments; implement data quality, lineage, and governance; support batch and streaming ingestion; collaborate with analysts and stakeholders to enable analytics (fraud/anomaly detection, financial oversight); troubleshoot and improve pipelines. Candidates must be willing to undergo a U.S. government background investigation.

Develop and support Informatica MDM and IDMC solutions across customer, supplier, product, material, and finance domains. Design master data configurations, integration pipelines, data quality rules, mappings, and governance workflows. Integrate MDM with SAP S/4HANA, ERP, cloud, and legacy systems while supporting cloud modernization, production troubleshooting, deployments, testing, and CI/CD. Collaborate with data governance teams, business stakeholders, and Agile engineering teams to deliver scalable, accurate, and compliant enterprise data solutions.

Designs and implements Oracle Cloud data migration solutions by analyzing legacy sources, mapping fields, developing ETL processes, validating transfers, troubleshooting conversion issues, and documenting procedures. Collaborates with business and technical teams, supports testing and post-implementation activities, and helps optimize large-scale, multi-system data conversion initiatives.

Designs and operates scalable serverless AWS data pipelines, data models, ETL/ELT workflows, feature stores, and analytics-ready data assets. Partners with AI, Analytics, Product, and Underwriting teams to support reproducible ML training and scoring, MLOps, data quality, monitoring, governance, and production troubleshooting. The role handles sensitive healthcare and financial data, optimizes serverless workloads, supports batch and near-real-time processing, and applies infrastructure-as-code, CI/CD, documentation, and responsible data-use practices.

Lead the architecture and implementation of scalable batch and streaming data pipelines across GCP, AWS, and Azure. Build production-grade Python data products, AI/ML, RAG, vector database, and agentic workflows; establish MLOps, LLMOps, CI/CD, containerization, observability, governance, and security practices. Optimize platform performance and cloud costs, resolve incidents, translate business strategy into technical solutions, set engineering standards, and mentor data engineers through hands-on coding.

Designs and leads an AI-enabled data platform for Office Product Group. Owns architecture for governed data and semantic layers across Microsoft Fabric, Kusto/Eventhouse, and OneLake; builds agent orchestration, guardrails, evaluations, observability, and self-healing operations; ensures AI-generated outputs use deterministic data; and partners across teams to deliver scalable platform capabilities.

Design, build, and maintain petabyte-scale ETL pipelines and data platforms using Spark (PySpark/Java), AWS, and Kafka. Model complex data structures, convert varied data formats, operationalize and monitor scalable data applications, and lead cross-functional teams to support mission-driven analytics. Must meet TS/SCI with polygraph requirements.

Build, test, and support Databricks Lakehouse pipelines using Spark, Delta Lake, Python, and SQL. Develop notebooks, jobs, and reusable components; manage data ingestion and integrations with on-prem SQL Server and SaaS systems. Implement data quality, governance, monitoring, CI/CD, and platform administration while partnering with analysts, data scientists, and stakeholders to deliver analytics-ready datasets.

Design, build, and maintain scalable data pipelines and ETL/ELT processes. Integrate data from multiple sources, design and manage databases/data warehouses, ensure data quality and governance, automate workflows, maintain compliance (e.g., GDPR, HIPAA), and optimize data system performance in collaboration with product and engineering teams.

Design, build, test, and operationalize data pipelines and solutions using cloud technologies. Ensure data quality, governance, and security; analyze sources; resolve defects; collaborate across teams; support AI/ML and BI use cases; and document and educate users on data products.

Design, build, and operate scalable data platforms and pipelines ingesting radar sensor data. Implement ingestion, transformation, enrichment, aggregation, and publishing workflows across relational, NoSQL, time-series, and lake/warehouse systems. Optimize PostgreSQL performance, ensure data quality, observability, and collaborate with engineering, product, and infrastructure teams to enable AI and analytics.

Senior Exasol data engineer to design, build, optimize, and validate SQL-based data pipelines for healthcare analytics. Responsibilities include complex query tuning, extracting/staging from SQL Server, chart validation, applying clinical terminologies, quality measure development, and maintaining disciplined version-controlled engineering practices.

Design, build, and maintain scalable ETL/data pipelines and an authoritative Lakehouse using Databricks and cloud platforms. Collaborate on data platform strategy, implement CI/CD, model data, refresh dashboards, apply advanced analytics (LLMs/AI) to unstructured data, and support post-award reporting to improve grant program outcomes.