Top Senior Data Engineer Jobs in San Diego, CA

Build and operate large-scale data pipelines that collect, process, and optimize audio datasets for AI model training. The role involves discovering data sources, improving data quality, throughput, and cost efficiency, collaborating with AI scientists, and owning engineering projects from discovery through continuous improvement.

Designs and maintains secure, reliable data platforms, including relational data models, migrations, pipelines, monitoring, data quality processes, and self-service reporting access. The role protects PHI and PII through access controls, encryption, audit logging, and governance in a HIPAA environment. It also involves backend API development, code reviews, security reviews, stakeholder collaboration, and mentoring teams on data practices.

Own Moxie’s end-to-end data infrastructure, including pipelines, Snowflake warehousing, dbt and Omni modeling, orchestration, observability, and documentation. Partner with Engineering and Finance on schema changes, accounting logic, metrics, and business-critical reporting. Deliver financial or historical EMR data models, establish SOPs and reliability KPIs, optimize performance and cost, and help advance Practice Intelligence toward predictive and prescriptive products with appropriate AI safeguards.

Build and lead scalable batch and streaming data pipelines, data products, and platform architecture for digital marketing. Own customer, audience, campaign, consent, and activation data domains while ensuring reliability, privacy, governance, quality, and operational performance. Lead cross-functional initiatives, production incident resolution, data modeling, architectural reviews, migrations, and mentorship. Support marketing analytics, personalization, audience segmentation, identity resolution, and compliant data activation.

Build and own Snout’s data foundation, including PostgreSQL and dbt warehouses, ingestion pipelines, dimensional models, data quality, documentation, and reliable rebuilds. Reconcile data from veterinary practice-management systems, support LLM/AI tooling, translate stakeholder needs into technical plans, and establish the foundation for a future data team and analyst.

Design, develop, and operate large-scale data ingestion, transformation, enrichment, and processing pipelines across cloud, hybrid, and on-premises environments. Build distributed services using Java, Python, and Kafka; optimize data models and platform performance; deploy applications on Kubernetes; support infrastructure automation and CI/CD; troubleshoot production systems; and collaborate with customers and solution architects on implementations.

Leads and develops a data engineering team implementing Navigate360 integrations for partner campuses. Oversees integration design, data mapping, validation, reconciliation, quality controls, delivery planning, and scalable implementation processes. Partners with Product, Launch, and Partner Success teams to resolve technical and partner challenges, improve adoption, manage project health, and ensure reliable outcomes. Provides technical mentorship, code and design review, stakeholder communication, and continuous process improvement.

Design, build, and own business-critical data pipelines and infrastructure across warehouses, orchestration, BI, and multiple regions. Develop AWS Glue and Spark jobs, data models, event contracts, observability, and batch or streaming architectures. Collaborate across producer and consumer teams, support Federal workloads, and operate production data platforms in government cloud environments.

Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.

Lead the architecture and development of Vercel’s next-generation data platform, supporting batch and real-time integrations, analytics, data warehousing, and AI/ML workloads. Design scalable systems using Kafka, ClickHouse, Tinybird, and Snowflake; establish data governance and security standards; guide architectural decisions and roadmaps; collaborate with engineering, product, security, compliance, and leadership teams; write production code; and mentor engineers.

Designs, builds, and maintains scalable ETL and data processing pipelines supporting analytics, forecasting, risk, and customer insights. Leads complex SQL development, data modeling, governance, quality, lineage, security, and compliance. Partners with engineering, finance, sales, compliance, product, analysts, and data scientists to translate requirements into reliable workflows. Evaluates emerging technologies, leads proof-of-concepts, and develops automated solutions using Python, Spark, Databricks, cloud platforms, orchestration tools, and modern data warehouses.

Leads the design, development, optimization, and migration of modern data platforms in Snowflake. Builds pipelines with dbt, Python, and cloud services; gathers client requirements; creates solution designs and project plans; advises on Snowflake performance, cost, security, and workload management; integrates BI, governance, and AI/ML tools; contributes to accelerators and mentors junior engineers. The role is remote, client-facing, consultative, and focused primarily on technical delivery rather than sales.

Build and operate batch and streaming data pipelines, ETL/ELT workflows, data warehouses, dimensional models, and reusable data services. Improve reliability, performance, quality, and cost efficiency through monitoring, testing, automation, and incident response. Partner with analytics, data science, product, business, platform, and infrastructure teams to deliver production data solutions and roadmap initiatives. Apply AI-assisted tools responsibly to development, testing, documentation, and troubleshooting.

Own and operate the Snowflake warehouse and Sigma semantic layer; manage ingestion (Fivetran), dbt model scoping and review, reverse-ETL, data quality SLAs, dashboards, month-end financial analytics, vendor management, and automation to support AdOps, Sales, Finance, and executive reporting.

Build and operate scalable batch, streaming, and event-driven data pipelines, cloud data platforms, trusted data products, and analytical models. Improve data quality, observability, reliability, performance, and cost efficiency while supporting risk, finance, product, analytics, and AI initiatives. Partner cross-functionally, influence architecture, lead complex technical initiatives, mentor engineers, and establish strong engineering practices including testing, CI/CD, governance, and infrastructure automation.

Lead data engineering strategy and develop enterprise data lake solutions on AWS. Build data pipelines using AWS data integration, engineering, and analytics resources, develop API services with FastAPI or Flask, optimize engineering practices, create long-term data plans, and represent the team in executive meetings.

Build and maintain dbt and semantic data models in Snowflake, develop ingestion and transformation pipelines, define trusted product metrics, and improve data collection. Partner with Product and Engineering to support experimentation and feature analysis. Establish data quality testing, documentation, HIPAA-aware access controls, and compliance practices. Use and validate AI-generated code and Snowflake Cortex outputs while raising technical standards across the team.

Own the analytics data layer by translating stakeholder needs into certified dimensional models, governed metrics, semantic layers, dashboards, and reports. Build with dbt, SQL, Databricks, Power BI, and Airflow while ensuring data quality, observability, reconciliation, documentation, and dependable orchestration. Partner closely with finance, operations, and client-facing teams, automate recurring workflows, and use AI-assisted engineering practices in a fully remote environment.

Design, build, and operate production data pipelines using Python, Spark SQL, and Airflow. Canonicalize healthcare and customer data into trusted internal models, optimize distributed processing, enforce schemas, and implement quality checks and observability. Support customer onboarding, streaming pipelines, troubleshooting, on-call operations, and platform best practices while collaborating with product, analytics, engineering, data science, and customer teams.

Develop and optimize enterprise Oracle SQL and PL/SQL solutions, including data models, database designs, APIs, ETL processes, batch jobs, and performance tuning. Collaborate with cross-functional teams to translate requirements into scalable implementations, support testing and CI/CD, troubleshoot production issues, and document solutions. Provide technical leadership, mentor engineers, participate in architecture and code reviews, and drive engineering best practices across data modernization initiatives.

Leads the design and lifecycle management of Oncology R&D data products, including data modeling, architecture, ETL/ELT pipelines, data integration, quality controls, governance, and AI-ready datasets. Partners with scientific, clinical, data science, and IT stakeholders to translate requirements into scalable solutions across clinical, preclinical, real-world, genomic, and omics data. Supports advanced analytics, ML, and GenAI use cases while ensuring interoperability, reliability, compliance, and operational performance.

Design, build, and operate scalable ETL/ELT pipelines and backend data services using Go. Integrate relational, NoSQL, blockchain, API, web, and social data sources; develop NLP pipelines for text extraction and classification; and support production APIs, dashboards, alerts, and intelligence systems. Collaborate with engineering, data science, and investigations teams on architecture, data quality, lineage, validation, monitoring, and client-facing products.

Design, build, and maintain scalable batch and streaming data pipelines using Python, SQL, Kafka, and GCP. Develop REST and GraphQL data services, CI/CD automation, observability, and data-quality frameworks. Integrate ML and NLP models into production workflows, including continuous retraining and real-time inference. Support structured and unstructured healthcare datasets, distributed systems, microservices, and reliable data infrastructure while collaborating with data science and MLOps teams.

Design, build, and maintain scalable data platforms and ETL/ELT pipelines using Databricks/Spark and AWS. Develop backend data services in C#/.NET, ensure data quality and performance, leverage AI-assisted coding tools, collaborate with cross-functional teams, lead technical design decisions, and mentor engineers.

Lead the design and optimization of healthcare data pipelines integrating EHR, payer, HIE, and vendor data. Build AWS-based ETL/ELT infrastructure, reusable integration tooling, data quality monitoring, and ML enablement foundations. Ensure HIPAA-compliant handling of clinical data, including security controls, audit logging, encryption, and de-identification. Provide technical leadership, mentor engineers, influence platform architecture, and lead complex partner integrations involving FHIR, HL7v2, CCDA, and healthcare terminology standards.