Top Senior Data Engineer Jobs in San Diego, CA

Design, build, and maintain scalable ETL and data pipelines on AWS using Python/PySpark. Develop Glue/Lambda/Step Function workflows, event-driven integrations, and data lake/warehouse solutions. Tune SQL, implement monitoring/validation, support API/JSON integrations, troubleshoot operations, document and automate deployments, and mentor junior engineers.

Design and implement scalable data pipelines and orchestration on GCP to support AI/ML-driven mail intelligence. Build stream and batch processing, ensure data governance and quality, optimize workflows, create visualizations, and collaborate with US cross-functional teams to align technical strategy and recover from failures.

Design, develop, maintain, and optimize ADABAS database structures and data solutions. Support mainframe data processing (Natural, COBOL, JCL), perform migrations to modern platforms, tune performance, ensure data integrity/security, troubleshoot issues, and collaborate with developers, architects, and analysts on modernization, API/cloud integration, and data warehousing initiatives.

Owner of data platform modernization: design and migrate legacy systems to Kimball-style dimensional models and star schemas; build reliable production data pipelines; enforce data hygiene and validation; champion dbt best practices; mentor junior engineers; collaborate with analysts and stakeholders to ensure scalable, well-documented data models and platform observability.

Design, build, and maintain scalable data platforms and ETL/ELT pipelines using Databricks/Spark and AWS. Develop backend data services in C#/.NET, ensure data quality and performance, leverage AI-assisted coding tools, collaborate with cross-functional teams, lead technical design decisions, and mentor engineers.

Analyze large and diverse datasets to uncover insights, develop/train/deploy machine learning models, design data preprocessing pipelines, and create visualizations and reports. Collaborate with cross-functional teams to build predictive models, recommendation systems, and optimization algorithms to drive business improvements.

Design, build, and operate scalable PostgreSQL databases and cloud-native data infrastructure. Build and maintain ETL/ELT pipelines, optimize query and server performance, ensure high availability and disaster recovery, improve observability, troubleshoot production issues, guide schema and application design, evaluate database technologies, and mentor junior engineers to support reliable, secure data-driven applications.

Lead architecture and engineering of a Microsoft Fabric lake-house, build scalable data pipelines from 50+ sources, provide technical leadership, oversee vendors, implement governance/security, establish SLAs/monitoring, and develop semantic layers and Power BI datasets.

Design, build, and maintain ingestion and transformation pipelines for a knowledge-graph analytics platform. Profile and prepare structured and semi-structured source data, ensure data lineage and traceability, implement transformation logic for graph loading, collaborate with data scientists on graph modeling and entity resolution, improve pipeline reliability, and document ingestion patterns using version control and issue tracking.

Designs, builds, maintains, and optimizes scalable data pipelines and ETL/ELT workflows using Azure Databricks, SAS, SSIS, SQL, Python, Spark, and Azure services. Integrates internal and external data sources, improves pipeline performance and reliability, troubleshoots processing issues, supports Big Data solutions, and partners with engineering, product management, SRE, analytics, and cross-functional teams to deliver enterprise data platforms.

Build and own the data platform backbone: design ingestion patterns, Snowflake warehouses, governance, and freshness strategy. Implement reliable batch and streaming pipelines, data quality, observability, and onboarding processes. Lead legacy migrations, create data contracts and SLAs, and apply AI-native tooling to automate debugging, documentation, and operational workflows while partnering with Analytics, Engineering, and vendors.

Lead design and ownership of a modern data platform: ingestion, Snowflake governance, pipeline reliability, migrations, data contracts, observability, and AI-enabled tooling. Partner with Analytics, Engineering, and vendors to deliver trustworthy data products and operate production pipelines.

As a Senior Data & Analytics Engineer, you'll lead data initiatives, manage a team, and ensure data quality while turning insights into actionable decisions across the company.

Design and build Snowflake transformation layer and migrate legacy SQL to versioned dbt models. Define conformed dimensions/facts using Kimball principles, set modeling and CI/CD standards, implement data quality/lineage, support BI migration and AI/ML readiness, and mentor future hires. Hands-on work in dbt, SQL, and Python with stakeholder collaboration and governance for financial and operational data.

Design, build, deploy, and maintain configurable, metadata-driven analytics platforms and workflow/decision engines for Risk Adjustment. Partner with analysts to translate processes into auditable, scalable solutions; own full lifecycle, production support, monitoring, and performance optimization while applying AI where beneficial.

The Senior Data Engineer will scale and evolve the data platform, develop ETL/ELT pipelines, establish best practices, and optimize systems for performance while collaborating with various teams.

Own and optimize data infrastructure and ETL/ELT pipelines using SSIS and Microsoft Fabric. Build and maintain SQL Server data warehouse staging, transformations, and lakehouse ingestion. Implement CI/CD, version control with GitHub, monitor pipeline health, troubleshoot data issues, document data flows, and translate stakeholder requirements into data engineering solutions that support BI reporting.

The role involves architecting intelligence infrastructure, building data pipelines, collaborating with other teams, and ensuring data accessibility and security for threat detection systems.

Lead architecture and scaling of the Databricks data warehouse and self-service data platform. Build reusable batch and streaming frameworks, enforce governance, SLOs, lineage, observability, CI/CD, and multi-tenancy. Mentor engineers, run design reviews, and ship documented patterns to enable analytics, data science, and app teams to move quickly without blocking on platform tickets.

Design and develop data ingestion pipelines and star-schema models, build calculations using BI native languages (DAX), create dashboards and paginated reports, manage governance/RLS and access, and collaborate with cross-functional teams to deliver actionable visual analytics.

Designs and implements scalable data and technology solutions, develops ETL pipelines and APIs, manages cloud and big-data platforms, maintains data models, supports monitoring and scheduling, participates in Agile development and technical reviews, and mentors junior engineers.

Seeking a Senior BODS Developer to develop and maintain complex BODS processes for data transformation. The role includes improving data quality using Information Steward and GAC/URAC techniques, collaborating with teams, creating documentation, and mentoring others.

Design, build, and maintain scalable data pipelines and tenant-aware APIs to ingest and transform data from varied sources. Work with event-driven and batch architectures, implement authentication and integration patterns, ensure observability/monitoring, optimize data flows for cost and performance, and collaborate with product, infrastructure, and engineering teams to onboard and maintain data sources at scale.

Responsible for designing, developing, and maintaining scalable data pipelines and infrastructure, implementing data governance, and collaborating with teams to meet data needs.

Build and manage data pipelines, ETL workflows, and DAGs using dbt, Apache Airflow, Python, SQL, and Snowflake. Develop custom Airflow operators and hooks, perform data modeling and source-to-target mapping, and implement data quality and cleansing processes. Use cloud platforms, CI/CD, version control, and Snowflake utilities including Snowpipe, Tasks, Streams, stored procedures, and data sharing. Collaborate across teams, communicate insights, solve complex problems, and participate in on-call escalation.