Top Data Engineer Jobs in San Diego, CA

Build and maintain Databricks-based data platforms, including ingestion, transformation, storage, governance, data modeling, and serving pipelines. Establish medallion architecture standards, canonical data models, quality controls, lineage, schema evolution, and reliable batch or incremental processing. Improve pipeline observability, scalability, idempotency, and recoverability while moving curated data to systems such as ClickHouse. Collaborate across application and analytics teams to create durable, governed production datasets.

Build and operate scalable batch, streaming, and event-driven data pipelines, cloud data platforms, trusted data products, and analytical models. Improve data quality, observability, reliability, performance, and cost efficiency while supporting risk, finance, product, analytics, and AI initiatives. Partner cross-functionally, influence architecture, lead complex technical initiatives, mentor engineers, and establish strong engineering practices including testing, CI/CD, governance, and infrastructure automation.

Designs and advances Providence’s enterprise data platform through data architecture, governance, metadata management, Snowflake modernization, legacy migrations, and scalable integration patterns. Establishes engineering, DataOps, CI/CD, repository, and data quality standards while supporting analytics, reporting, AI, and data products. Collaborates across multidisciplinary teams to implement large-scale data initiatives in a healthcare environment.

Lead data engineering strategy and develop enterprise data lake solutions on AWS. Build data pipelines using AWS data integration, engineering, and analytics resources, develop API services with FastAPI or Flask, optimize engineering practices, create long-term data plans, and represent the team in executive meetings.

Build and own scalable data architecture, canonical data models, configurable source integrations, and reliable pipelines for AI-driven financial intelligence. Use SQL, Python, dbt, cloud data warehouses, and orchestration tools to deliver idempotent, auditable data workflows. Establish lineage, data contracts, quality controls, and schema evolution practices. Lead architecture reviews, mentor distributed data engineers, and support customer-hosted multi-cloud deployments with strict tenant isolation and traceability.

Build and maintain dbt and semantic data models in Snowflake, develop ingestion and transformation pipelines, define trusted product metrics, and improve data collection. Partner with Product and Engineering to support experimentation and feature analysis. Establish data quality testing, documentation, HIPAA-aware access controls, and compliance practices. Use and validate AI-generated code and Snowflake Cortex outputs while raising technical standards across the team.

Own the analytics data layer by translating stakeholder needs into certified dimensional models, governed metrics, semantic layers, dashboards, and reports. Build with dbt, SQL, Databricks, Power BI, and Airflow while ensuring data quality, observability, reconciliation, documentation, and dependable orchestration. Partner closely with finance, operations, and client-facing teams, automate recurring workflows, and use AI-assisted engineering practices in a fully remote environment.

Design, build, and operate production data pipelines using Python, Spark SQL, and Airflow. Canonicalize healthcare and customer data into trusted internal models, optimize distributed processing, enforce schemas, and implement quality checks and observability. Support customer onboarding, streaming pipelines, troubleshooting, on-call operations, and platform best practices while collaborating with product, analytics, engineering, data science, and customer teams.

Own end-to-end client data migrations: reverse-engineer legacy ETL, design and build Airflow DAGs and Spark jobs, validate and reconcile data at scale, document architecture and decisions, and coordinate cross-functional teams through go-live and hypercare.

Develop and optimize enterprise Oracle SQL and PL/SQL solutions, including data models, database designs, APIs, ETL processes, batch jobs, and performance tuning. Collaborate with cross-functional teams to translate requirements into scalable implementations, support testing and CI/CD, troubleshoot production issues, and document solutions. Provide technical leadership, mentor engineers, participate in architecture and code reviews, and drive engineering best practices across data modernization initiatives.

Build and maintain full-stack data engineering solutions supporting BioIntelliSense’s remote patient monitoring and clinical intelligence platform. The role likely involves processing health-monitoring data, enabling analytics, and supporting reporting for clinicians, patients, and employers. Specific responsibilities and qualifications are not provided in the description.

Leads the design and lifecycle management of Oncology R&D data products, including data modeling, architecture, ETL/ELT pipelines, data integration, quality controls, governance, and AI-ready datasets. Partners with scientific, clinical, data science, and IT stakeholders to translate requirements into scalable solutions across clinical, preclinical, real-world, genomic, and omics data. Supports advanced analytics, ML, and GenAI use cases while ensuring interoperability, reliability, compliance, and operational performance.

Design, build, and operate scalable ETL/ELT pipelines and backend data services using Go. Integrate relational, NoSQL, blockchain, API, web, and social data sources; develop NLP pipelines for text extraction and classification; and support production APIs, dashboards, alerts, and intelligence systems. Collaborate with engineering, data science, and investigations teams on architecture, data quality, lineage, validation, monitoring, and client-facing products.

Design, build, and operate Azure-based data pipelines and integrations. Consolidate data from multiple sources into centralized SQL systems, perform transformations and field mapping, and maintain data warehouse capabilities. Troubleshoot quality, integrity, latency, security, and reliability issues while applying governance, monitoring, and SLA practices. Collaborate with engineers, analysts, and stakeholders in Agile pods to deliver reusable, analytics-ready data assets.

Design and deliver cloud-native data platforms, scalable big data pipelines, lakehouses, warehouses, transformation frameworks, BI solutions, and ML-enabled data workflows. Lead client-facing pre-sales engagements, technical workshops, proof-of-concepts, executive conversations, and enterprise data modernization initiatives. Build reusable architectural IP, influence senior stakeholders, and translate ambiguous business challenges into production-ready solutions using AWS and modern data technologies.

Design, build, and maintain scalable batch and streaming data pipelines using Python, SQL, Kafka, and GCP. Develop REST and GraphQL data services, CI/CD automation, observability, and data-quality frameworks. Integrate ML and NLP models into production workflows, including continuous retraining and real-time inference. Support structured and unstructured healthcare datasets, distributed systems, microservices, and reliable data infrastructure while collaborating with data science and MLOps teams.

Build and configure a government Databricks workspace, develop ingestion and integration pipelines from enterprise and legacy systems, and prepare data for reporting. Implement Unity Catalog governance, metadata management, auditing, and lineage; configure MLflow workflows; assess security controls for sensitive data; and create architecture documentation, data dictionaries, and SOPs to support long-term sustainment.

Lead the design and optimization of healthcare data pipelines integrating EHR, payer, HIE, and vendor data. Build AWS-based ETL/ELT infrastructure, reusable integration tooling, data quality monitoring, and ML enablement foundations. Ensure HIPAA-compliant handling of clinical data, including security controls, audit logging, encryption, and de-identification. Provide technical leadership, mentor engineers, influence platform architecture, and lead complex partner integrations involving FHIR, HL7v2, CCDA, and healthcare terminology standards.

Design, build, and maintain scalable data platforms and ETL/ELT pipelines using Databricks/Spark and AWS. Develop backend data services in C#/.NET, ensure data quality and performance, leverage AI-assisted coding tools, collaborate with cross-functional teams, lead technical design decisions, and mentor engineers.

Architect, build, and operate scalable data platforms processing billions of daily events through real-time and batch pipelines. Own production reliability, data quality, security, observability, and performance while partnering with engineering, analytics, data science, growth, and business teams. Develop frameworks and datasets, make architectural decisions, evaluate technologies, mentor engineers, and help define the platform roadmap.

Develop and maintain data engineering solutions using Informatica Data Management Cloud, Control-M, Snowflake, and SQL. Responsibilities include sourcing, transforming, cleansing, ingesting, analyzing, and visualizing data; building automated workflows and scalable ETL processes; supporting data architecture and deployments; and delivering reusable code for large datasets. The role requires collaboration with technical and business partners, troubleshooting, mentoring, and managing multiple priorities.

Build and maintain marketing data pipelines connecting Salesforce, Marketo, and cloud data warehouses. Automate campaign reporting, develop SQL datasets and views, improve attribution and data quality, support CRM and marketing automation configuration, and document data models and processes. Use AI tools such as Claude to accelerate analytics workflows while ensuring reporting accuracy. Partner with Marketing Analytics, Demand Generation, and Marketing Operations to support executive-level pipeline reporting.

Design and lead scalable, secure, highly available database infrastructure for multi-terabyte SQL Server environments. Set technical direction for data architecture, performance, real-time pipelines, security, and growth. Troubleshoot complex production issues, optimize queries and indexes, guide cross-functional projects, mentor engineers, review changes, reduce technical debt, and evaluate emerging technologies. Monitor database health using Splunk, Datadog, and Grafana while influencing engineering and Site Reliability strategy.

Build and operate a large-scale enterprise data platform spanning batch and streaming processing, lakehouse storage, Kafka infrastructure, APIs, observability, and agentic MCP interfaces. Develop reusable ingestion and data-quality frameworks, improve scalability and resilience, establish engineering practices, support production operations, and mentor engineers. The role requires deep ownership of distributed data infrastructure and practical use of AI coding agents.

Design and operate production-grade data pipelines, backend services, APIs, and agentic AI workflows. Build scalable systems that ingest, transform, and operationalize data for customer-facing and internal applications. Translate ambiguous operational workflows into reliable architectures, improve service observability and performance, and own technical decisions across data modeling, system design, security, and compliance.