Top Data Engineer Jobs in San Diego, CA

Leads enterprise data engineering initiatives by designing and optimizing data pipelines, data lakes, warehouses, and analytics infrastructure. Uses Snowflake, Informatica, SQL, and related technologies to integrate diverse data sources, improve data quality, secure PII, and support analytics and data science teams. Establishes governance, monitoring, scalability, performance, and cost-efficiency practices while mentoring teammates and partnering with stakeholders on complex technical solutions.

Leads data and analytics engineering for Zero Trust maturity assessment and implementation measurement. Designs common data models, integrates and validates enterprise data, develops maturity and risk metrics, supports prioritization and gap analysis, and establishes data quality, lineage, traceability, and documentation practices. Partners with dashboard and automation specialists to streamline reporting and data refresh workflows.

Own and operate the Snowflake warehouse and Sigma semantic layer; manage ingestion (Fivetran), dbt model scoping and review, reverse-ETL, data quality SLAs, dashboards, month-end financial analytics, vendor management, and automation to support AdOps, Sales, Finance, and executive reporting.

Own and scale Provable's data platform on GCP: build and optimize ingestion pipelines from blockchain indexers, design privacy-aware data models, manage Postgres and BigQuery, develop high-performance data-serving APIs, ensure data quality and observability, and use IaC (Terraform, Helm) and Kubernetes to deploy and cost-optimize environments.

Design, build, and maintain scalable ETL/ELT data pipelines and data platform architecture. Build programmatic pipelines (primarily Python), optimize analytical data models (SQL), integrate sources into Snowflake, use orchestration/transformation tools (dbt, Airflow, Dagster), improve data quality/observability, and partner with product, engineering, and analytics to deliver reliable data for decision-making.

Lead architecture and execution of Faire's data platform and analytics capabilities. Build and operate scalable, secure ETL/ELT, streaming, storage, compute, orchestration, and data warehousing at petabyte scale. Drive performance, cost, monitoring, governance, and self-serve analytics; influence cross-functional teams and mentor engineers.

Design and maintain a dbt-based business data layer for GTM metrics, centralize and reconcile multi-source data, implement automated data quality and reconciliation checks, align and document metrics with stakeholders, mentor analytics team, and lead root-cause investigations into complex data anomalies.

Designs and operates scalable serverless AWS data pipelines, data models, ETL/ELT workflows, feature stores, and analytics-ready data assets. Partners with AI, Analytics, Product, and Underwriting teams to support reproducible ML training and scoring, MLOps, data quality, monitoring, governance, and production troubleshooting. The role handles sensitive healthcare and financial data, optimizes serverless workloads, supports batch and near-real-time processing, and applies infrastructure-as-code, CI/CD, documentation, and responsible data-use practices.

Designs, builds, maintains, and optimizes scalable data pipelines and ETL/ELT workflows using Azure Databricks, SAS, SSIS, SQL, Python, Spark, and Azure services. Integrates internal and external data sources, improves pipeline performance and reliability, troubleshoots processing issues, supports Big Data solutions, and partners with engineering, product management, SRE, analytics, and cross-functional teams to deliver enterprise data platforms.

Design and maintain healthcare data integration pipelines, models, and validation processes for claims, billing, clinical, pharmacy, EMR, FHIR, and value-based care data. Collaborate with clients and internal analytics, product, and customer success teams to interpret data, document business rules, support implementations, and build reusable Ursa data models. Apply healthcare domain expertise, data security practices, HIPAA compliance, and appropriate judgment when using AI-assisted tools.

Designs and implements big-data data management solutions (Cloudera/Hortonworks/Databricks). Builds and automates reporting and analytics using SQL and Databricks, optimizes queries, manages ETL, integrates multiple data sources, enforces data governance, and supports payment integrity reporting requirements.

Design, build, and maintain scalable data pipelines and integrations across AWS, Azure, and BigQuery. Normalize, aggregate, and ensure data quality for large web and transactional datasets, leveraging APIs, ETL/orchestration tools, and big-data technologies to support analytics and BI in an e-commerce environment.

Build and maintain scalable data pipelines for healthcare claims; implement de-identification and PII-reduction; ensure data quality and observability; integrate data stores and APIs; draft technical designs and documentation; gather product feedback and iterate quickly.

Lead performance investigations across the data product stack to diagnose and fix slow queries and UX issues. Design data architecture changes, build benchmarks, measure latency/throughput/cost (ClickHouse Cloud), prototype solutions, instrument monitoring, and partner with product and engineering to balance responsiveness, scalability, and cost.

Design, build, and operate large-scale data pipelines and ETL processes to normalize varied partner datasets. Lead technical decisions, mentor engineers, implement testing and monitoring, manage data warehouses/lakes, and collaborate cross-functionally to deliver robust data infrastructure that supports ML and product teams.

Define and lead the technical architecture for a lakehouse on AWS, build production pipelines and data models for time-series and multi-source data, introduce data governance and catalog foundations, author platform playbooks (ADRs, runbooks, Terraform modules), deliver projects end-to-end, and mentor engineers while representing the platform to senior leadership and non-technical stakeholders.

Founding data engineer to design and build Payabli's data platform: architect lakehouse/warehouse, build batch and streaming pipelines, model canonical datasets, ensure data quality/observability, enforce access/masking/lineage for regulated financial data, and enable analytics/ML feature pipelines while establishing team standards and CI/CD.

The Senior Data Engineer will design and implement data processing pipelines using Java and Spark, optimize performance, and mentor junior engineers while ensuring compliance with data governance standards.

Lead design and delivery of scalable production data pipelines and data products (Spark/Python/SQL) on Databricks; integrate diverse federal health systems, define reusable ingestion patterns, ensure data quality/governance, mentor engineers, and troubleshoot/optimize production workflows.

Design, build, and operate scalable batch and streaming data pipelines and a lakehouse on AWS. Implement ETL/ELT, CDC, metadata/cataloging, lineage, governance, data quality, IaC, and CI/CD for reliable, observable, and secure data platforms to support analytics and ML.

Design, build, and scale cloud lakehouse data products (Databricks/Snowflake) from ingestion to analytics-ready datasets using medallion architecture. Develop reusable Python frameworks, Spark pipelines, and dbt/SQL transformations. Implement data modeling, governance, observability, validation, and SLA monitoring. Troubleshoot production issues, adopt AI to accelerate engineering, and provide technical leadership, code reviews, architecture decisions, and mentoring for global engineering teams.

Build and maintain scalable ETL/data pipelines and internal frameworks to support ML and product teams. Drive architecture, observability, data quality, and engineering best practices across AI/ML workflows and prompt-engineering pipelines.

Lead design, build, and operate scalable Databricks/Delta Lake data pipelines and Kimball dimensional models using dbt. Manage governance with Unity Catalog, optimize performance and cost, operationalize ML with MLflow, and coordinate/quality-check offshore vendor engineering. Mentor engineers, uphold standards, and deliver trusted data products that power analytics, reporting, and MLOps workflows.

Lead SAP S/4HANA data migration activities: extract, map, transform, load, validate, and reconcile master and transactional data using BODS, Migration Cockpit, LSMW/BDC and HANA SQL. Support mock loads, cutover execution, defect remediation, and collaborate with functional owners to cleanse and correct source data.

Design, build, and maintain scalable data pipelines, data models, ETL/ELT, and BI solutions. Collaborate with data scientists and stakeholders to improve data quality, accessibility, and PHI security. Develop and document workflows, optimize processing/storage, support data warehouse and visualization, and adopt AI tools to drive data-informed outcomes.