Top Remote Data Engineer Jobs in San Diego, CA

Own and evolve WorkOS’s internal data platform, including ingestion, orchestration, Snowflake, dbt models, data governance, reverse ETL, semantic views, and AI-enabled data workflows. Ensure pipeline reliability, freshness, security, and scalability while partnering with Product, Finance, RevOps, GTM, Engineering, and Security. Build monitoring, runbooks, CI/CD gates, access controls, masking policies, and infrastructure automation across AWS and Kubernetes.

Designs, builds, and operates large-scale Hadoop-based data pipelines and analytics platforms. Responsibilities include ingesting, transforming, and analyzing structured and unstructured data; developing Spark applications; managing streaming systems; working with relational and NoSQL stores; orchestrating workflows; troubleshooting distributed systems; and supporting reliable, scalable production data platforms. Preferred experience includes cloud Hadoop platforms, lakehouse formats, data governance, Kubernetes, CI/CD, and infrastructure as code.

Lead pre-sales technical engagements to design and optimize scalable cloud lakehouse data platforms (Snowflake/Databricks). Provide architecture reviews, ETL/ELT pipeline design, governance and AI-ready data foundations, support services sales, and translate technical tradeoffs into actionable recommendations for engineering and executive stakeholders.

Lead architecture, development, and optimization of a cloud-native data platform. Design high-volume batch and streaming pipelines, optimize data processing across AWS, Snowflake, Redshift, and Athena, and implement Iceberg-based data management. Establish security, privacy, observability, and DataOps practices while mentoring engineers, guiding technical direction, collaborating with data science teams, and delivering scalable petabyte-level data infrastructure.

Design, build, deploy, and maintain AWS-based data and AI/ML infrastructure for enterprise agentic AI platforms. Develop data lake pipelines, observability systems, agent-enablement tooling, and production MLOps/LLMOps capabilities. Own features end-to-end, contribute to architecture and design decisions, optimize reliability, scalability, security, and cost, and collaborate with AWS Professional Services, client teams, and junior engineers.

Designs and productionizes hybrid knowledge graph solutions for healthcare and clinical data using LPG and RDF technologies. Builds FHIR transformation and ingestion pipelines, implements ontology mappings, entity linking, identifiers, provenance, validation, and graph queries with Cypher or SPARQL. Collaborates with ontology, terminology, FHIR, clinical, and data engineering teams, while contributing to architecture reviews, code reviews, testing, and engineering best practices.

Design, develop, and maintain Customer Data Platform solutions and data pipelines to create unified customer profiles, manage identity resolution, enable audience segmentation and activation, ensure data quality and governance, and support integrations with marketing, CRM, and cloud data systems.

Build customer-facing data products for the single-family rental market. Responsibilities include architecting real estate data models, designing reliable data pipelines and workflows, shaping data platform architecture, establishing engineering standards, and developing real estate domain expertise. The role partners with data science and product teams and requires leadership in scalable data engineering.

Designs and implements scalable data pipelines, cloud data platforms, storage solutions, and analytics infrastructure. The role focuses on Snowflake and AWS architecture, migrating legacy systems to cloud environments, developing Python and SQL data-processing logic, orchestrating workflows, and implementing Infrastructure-as-Code and CI/CD. The engineer also contributes to data governance, quality, observability, stakeholder communication, mentoring, and technical leadership.

Build and operate production pipelines for legal records from PACER, court systems, opinions, PDFs, scans, XML, and HTML. Develop LLM-assisted extraction workflows, validate data quality, optimize SQL, and support RAG and semantic search products. Manage AWS S3 and RDS systems within security guardrails while collaborating with engineering teams. The role requires strong Python and SQL skills, legal data experience, document extraction expertise, and autonomous problem-solving with large, messy datasets.

Lead enterprise data engineering efforts supporting defense missions. Responsibilities include prioritizing technical tasks, mentoring engineers, conducting code reviews, translating government requirements into scalable data architectures, developing Databricks ETL/ELT pipelines with Python, PySpark, and SQL, troubleshooting pipeline performance and reliability, and documenting systems. The role collaborates with government stakeholders, product owners, data scientists, analysts, and technical teams to deliver secure, high-throughput data platforms and actionable insights.

Designs and maintains scalable Azure data pipelines and ETL/ELT solutions across data lakes, warehouses, lakehouses, streaming platforms, and enterprise sources. Builds integrations using Azure Data Factory, Synapse, Databricks, Spark, Kafka, and related services; applies security, governance, monitoring, and performance optimization practices. Develops Power BI dashboards, reports, data models, and visualizations, while supporting analytics and AI/ML use cases. Collaborates in Agile teams and automates deployments through DevOps and CI/CD practices.

Designs and automates data validation, profiling, testing, monitoring, and quality frameworks for multi-source cloud data. The role uses Azure Synapse, Databricks, SQL, Python, Scala, Collibra, and Profisee to detect anomalies, enforce governance, and improve data reliability. Responsibilities include developing automated test plans, analyzing structured and unstructured datasets, supporting Azure data engineering workflows, and collaborating with engineers, analysts, data scientists, and product teams. A Public Trust or Suitability/Fitness determination may be required.

Designs and operates data infrastructure for a clinical trial platform. Builds pipelines that extract, normalize, validate, and link information from clinical documents and publications into Aurora and GraphDB. Develops embeddings, vector search, RAG workflows, data-serving APIs, lineage tracking, and regulatory audit trails. The role also requires AWS-based orchestration, clinical data quality controls, biomedical knowledge graph modeling, and deployment automation using infrastructure-as-code and containerization.

Build and maintain data pipelines for network and operational telemetry, integrate DataMiner and other monitoring systems, create Power BI dashboards, configure monitoring metrics and alerts, automate reporting, analyze network performance and recovery events, and translate technical findings into actionable insights for technical and executive stakeholders.

Designs, builds, and maintains scalable batch and streaming data pipelines across AWS and GCP. Develops ETL/ELT workflows using Python, PySpark, and advanced SQL; optimizes performance, storage, and query execution; implements data quality and governance controls; and supports data lakes, warehouses, and ML workflows. Collaborates with data scientists and ML engineers on MLOps automation and production deployments while maintaining CI/CD, Docker, infrastructure standards, and technical documentation.

Designs and delivers backend systems, APIs, data models, ETL workflows, data interactions, and user interfaces. Optimizes data operations for scalability, performance, integrity, and security while contributing to automated testing and CI/CD. Requires strong Python and Apache Spark experience, distributed computing knowledge, Agile experience, and data analysis skills. The role supports healthcare-focused digital services in a remote-first environment.

Lead Cohere’s Data Foundation pillar, managing a team responsible for the full data lifecycle. Own the roadmap, BigQuery warehouse, Airflow and Cloud Run orchestration, dbt modeling, Looker and API serving, Terraform infrastructure, governance, access controls, reliability, incident response, and data freshness SLAs. Lead development of an agentic analytics platform and evaluation framework, establish company-wide analytics standards, and partner with product, engineering, security, legal, and business teams.

Architect and lead enterprise data platforms, pipelines, and infrastructure using Spark, Databricks, and cloud technologies. Build scalable data models and dimensional schemas, establish governance and data quality frameworks, optimize performance and reliability, and implement monitoring. Partner with stakeholders to translate requirements into technical solutions, lead design reviews, mentor engineers, contribute to platform strategy, troubleshoot complex failures, and support hiring and team development.

Leads the architecture, development, and maintenance of scalable batch and real-time data pipelines, cloud data platforms, ETL/ELT workflows, and ML data infrastructure. Establishes standards for data quality, observability, lineage, governance, security, and modeling. Partners with data scientists, engineers, DevOps, and business stakeholders; evaluates technologies, drives technical initiatives, mentors engineers, and supports production-grade APIs and machine learning pipelines.

Lead development of a unified fleet knowledge model and decision-capture pipeline for autonomous data-center operations. Build data access layers across relational, telemetry, monitoring, and time-series systems; capture labeled operator decisions; negotiate data requirements with source-system owners; and own scaling considerations including vector indexing, schema evolution, retention, and analytics separation. The role requires strong infrastructure-domain modeling, PostgreSQL expertise, and experience handling time-series and event data at scale.

Designs, builds, maintains, and optimizes scalable data pipelines and ETL/ELT workflows using Azure Databricks, SAS, SSIS, SQL, Python, and Spark. Integrates data from internal and external sources, improves performance and reliability, troubleshoots complex processing issues, and supports cloud-based data platform architecture. Collaborates with engineering, analytics, product management, SRE, and other stakeholders to deliver high-quality data solutions.

Own end-to-end production data platforms, writing Python and SQL, designing AWS pipelines, modeling analytics data, and implementing quality and reconciliation controls. Make architecture decisions independently, ensure correctness and auditability, and use AI coding tools effectively. The role also supports applied AI initiatives including entity resolution, LLM-assisted analytics, embeddings, and anomaly scoring.

Owns the end-to-end data platform, including Snowflake infrastructure, ingestion pipelines, Airflow orchestration, dbt transformations, governed gold-layer models, and metric definitions. Ensures reliability, performance, testing, documentation, governance, and CI/CD standards. Builds data systems from scratch, partners with analytics stakeholders, and uses AI-assisted development tools to accelerate engineering work. Requires strong SQL, platform ownership, software engineering practices, and experience with Snowflake, Airflow, and dbt.

Build and optimize data transformation pipelines using SQL, dbt, Airflow, Python, BigQuery, and relational databases. Collaborate with stakeholders and data engineers, manage task scheduling, resolve data issues, perform analyses, present recommendations, support data exploration tool adoption, and mentor team members. The role also contributes to hiring, onboarding, and professional development while ensuring data accuracy and insight quality.