Top Senior Data Engineer Jobs in San Diego, CA

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, implementing security and compliance controls, developing dbt data models, cataloging assets in OpenMetadata, automating with Python, and mentoring engineers. The role requires extensive infrastructure and data engineering experience, cloud expertise, container orchestration, and eligibility for CJIS clearance.

Architects, deploys, and operates large-scale Apache Kafka and Confluent environments for mission-critical event-driven workloads. Owns platform sizing, configuration, security, automation, observability, high availability, disaster recovery, and developer enablement. Partners with application and business teams to deliver reliable streaming solutions, troubleshoot production issues, conduct design and code reviews, document systems, and mentor junior engineers.

Build and deploy scalable data pipelines and platforms that organize structured and unstructured data. Perform ETL, pipeline integration, analytical exploration, and data platform design and maintenance in agile, multidisciplinary teams. Develop deployable software, support data visualization, and work with relational and non-relational databases. Projects support missions including fraud detection, cancer research, and national intelligence.

Design, build, and operate scalable batch and streaming data pipelines, lakehouse and warehouse models, and data services. Own datasets end to end, improve Snowflake, Iceberg, Spark, and Flink performance and reliability, implement governance and observability, and support graph-serving data models. Partner with product and engineering teams, participate in on-call, review code and designs, and mentor junior engineers.

Designs scalable data architectures, ELT/ETL pipelines, data models, quality frameworks, and self-service data platforms. Partners with engineering, product, program, leadership, and data science teams to translate business needs into technical solutions. The role includes end-to-end technical ownership, large-scale batch and streaming data processing, mentoring junior engineers, system optimization, and on-call support for platform stability.

Designs and optimizes Power BI dashboards, semantic models, datasets, DAX measures, and reporting solutions for identity governance and administration analytics. Partners with ETL engineers and stakeholders to validate Parquet data from Azure Synapse and SailPoint sources, establish data-quality checks, monitor refreshes, define KPIs, and document data lineage. Supports compliance reporting, access governance, audit readiness, certification metrics, and Zero Trust analytics.

Own data pipelines into and out of the warehouse, dbt models, data integrity, governance, identity resolution, reverse ETL, and quality monitoring across growth, lifecycle, and brokerage data. Partner with product, marketing, and operations teams to establish data contracts, ensure accurate and timely business metrics, and support regulated financial data requirements.

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.

Design and build scalable data infrastructure, including lakehouse architecture, ClickHouse deployments, ETL/ELT pipelines, and data models connecting Postgres with analytics systems. Establish data quality, observability, performance, cost, and reliability standards. Collaborate with product and engineering teams, define data contracts and specifications, support real-time analytics, and use AI-assisted coding and LLMs to accelerate pipeline development and transformation.

Staff Data Engineer responsible for setting technical direction, architecting scalable data platforms, leading cross-functional initiatives, improving reliability and performance, and enabling AI-assisted analytics and development. The role includes hands-on development with Python, SQL, cloud data warehouses, orchestration, infrastructure as code, Kubernetes, Kafka, and streaming pipelines, along with mentoring, technical advocacy, documentation, code reviews, and on-call troubleshooting.

Data Engineer II will modernize BlueLabs’ data platform by leading Kimball dimensional modeling and legacy warehouse migrations, building reliable production data pipelines, and enforcing data quality standards. The role requires advanced SQL, Python, and dbt expertise, hands-on Snowflake and Redshift experience, and ownership of testing, documentation, observability, and scalable architecture. The engineer will collaborate cross-functionally, guide Data Engineer I team members, contribute to architectural decisions, and translate business logic into maintainable, cloud-agnostic data layers.

The AVP, Data Engineer will design and build data ingestion, transformation, and replication pipelines using SQL, Python, dbt, and Dagster. Responsibilities include translating requirements into technical designs, developing data products, debugging production issues, supporting testing, and improving data engineering practices. The role also involves data modeling, mentoring junior engineers, conducting code reviews, and providing technical leadership while remaining hands-on. Experience with modern data platforms, workflow orchestration, cloud ecosystems, and insurance or financial services is preferred.

Designs, builds, and optimizes scalable data pipelines, ETL workflows, integrations, and reporting solutions. Develops SQL, Python, and Spark data-processing solutions using Azure Data Factory and Microsoft Fabric, while monitoring production reliability and performance. Collaborates with stakeholders, participates in code reviews, documents technical solutions, mentors junior engineers, and improves engineering practices. Requires strong data modeling, cloud data platform, Git, communication, and problem-solving skills.

Build and deliver Azure and Microsoft Fabric data solutions for clients. Responsibilities include developing data pipelines with Azure Databricks, Data Factory, Synapse Analytics, and Fabric; writing SQL, Python, and PySpark; supporting data integration, testing, deployments, troubleshooting, CI/CD, and infrastructure management. The role involves consulting with client stakeholders, collaborating with architects and developers, and delivering modern data platforms and reporting solutions.

Design and maintain Snowflake-based data platforms, cloud-native data lakes, and scalable ETL/ELT pipelines for asset-backed finance analytics. Orchestrate workflows with Dagster and AWS services, ensure data reconciliation and integrity, and support migration from legacy systems. Contribute to project planning, Jira backlog management, testing, cutover planning, and cross-functional go-live readiness.

Design and maintain Snowflake data pipelines and data lake architectures for asset-based finance analytics. Develop ETL/ELT workflows, validate and reconcile financial data, migrate legacy systems, and translate quantitative finance logic into scalable architectures. Support project execution through requirements breakdown, planning, testing, cutover, and go-live readiness. Collaborate across engineering, quantitative analytics, and stakeholder teams.

Design, build, and maintain scalable batch and streaming data pipelines using Databricks, PySpark, Python, SQL, Spark, and Delta Lake. Develop transformations, orchestration workflows, data models, validation processes, and curated data products. Troubleshoot performance and quality issues, apply governance and security practices, document solutions, and collaborate with architects, data scientists, DevOps teams, analysts, and clients.

Lead product data engineering across architecture, data modeling, pipelines, monitoring, lineage, and data quality. Build reliable analytical datasets, support experimentation and machine learning use cases, and resolve business-critical pipeline issues. Partner with product and engineering stakeholders to translate business needs into automated data solutions. The role requires ownership of end-to-end data engineering projects, on-call participation, and development of AI-assisted monitoring and automation.

Lead product data engineering initiatives by designing data models, owning critical pipelines, building data quality and lineage monitoring, and supporting experimentation and ML-ready datasets. Translate business needs into automated data solutions, maintain pipeline SLAs through on-call support, and develop AI-assisted tools for issue detection and resolution. Collaborate with Product, Engineering, Data Science, Machine Learning, and Applied AI teams across Block’s products.

Leads the design, development, and optimization of scalable data pipelines and analytics platforms. Builds ETL/ELT workflows using Databricks and Spark, integrates and transforms source data into curated models, manages SQL Server data, and maintains documentation and lineage. Collaborates with product, analytics, and engineering teams to deliver reliable data solutions. Applies responsible AI practices and delivers projects independently within established timelines.

Design and maintain data architecture and pipelines to support compliance and risk teams. Build and optimize data models, standardize metrics, and create data dictionaries. Implement data quality, lineage monitoring, AI-driven agents for false-positive reduction and automation, and participate in on-call rotations to ensure SLAs are met.

Lead design and optimization of data models and pipelines for compliance and risk; standardize metrics and documentation; build data quality, lineage, and monitoring (including AI agents for automation); manage ETL scheduling, on-call pipeline support, and collaborate with product and non-technical partners to translate business needs into automated, production-ready data solutions.

Own and evolve UJET’s data platform, including MySQL CDC replication to BigQuery, dbt transformations, Terraform infrastructure, pipelines, data quality, observability, and Looker models. Build reliable, analytics-ready datasets and trusted metrics for internal and customer-facing reporting. Partner with Analytics, Finance, Product, and Engineering to deliver scalable data solutions, improve platform reliability, optimize performance and costs, and establish development standards and guardrails.

Designs and manages enterprise Databricks data platforms, including workspaces, clusters, Unity Catalog, SQL warehouses, Terraform infrastructure, and secure data ingestion pipelines. Builds medallion architecture with Delta Lake, supports Genie dashboards and self-service analytics, implements governance and access controls, and maintains CI/CD, testing, documentation, and operational processes. Partners with technical and business stakeholders and supports MCP connectors and agentic data integrations.

Own and evolve WorkOS’s internal data platform, including ingestion, orchestration, Snowflake, dbt models, data governance, reverse ETL, semantic views, and AI-enabled data workflows. Ensure pipeline reliability, freshness, security, and scalability while partnering with Product, Finance, RevOps, GTM, Engineering, and Security. Build monitoring, runbooks, CI/CD gates, access controls, masking policies, and infrastructure automation across AWS and Kubernetes.