Top Data Engineer Jobs in San Diego, CA

Design, develop, and maintain PySpark applications and ETL pipelines to process, transform, and integrate large-scale datasets from SQL, NoSQL, data lakes, and streaming sources. Optimize Spark job performance, implement robust error handling, and collaborate with data analysts, scientists, and architects using orchestration tools like Airflow or Luigi.

Design, develop, test, and deploy high-performance Spark/Scala data processing applications and ETL pipelines using the Cloudera Hadoop ecosystem. Optimize Spark and platform performance, ensure data integrity and security, collaborate with data scientists and analysts, troubleshoot issues, and implement version control and CI/CD for Spark applications.

Design and develop Big Data applications using Java, Spark, and MapReduce on Cloudera/Hadoop ecosystems. Work with Hive, Impala, YARN, Kafka, and large datasets; write tests (JUnit), perform data analysis, and script in Unix/Python. Lead and manage global technology teams and follow industry best practices.

Design and implement big data solutions (Spark, Hive, Java, CDP). Analyze and consolidate disparate data sources, produce functional specifications, review data models, gather stakeholder requirements, validate implementations, support production deployments, investigate data quality and data lineage, and collaborate with technology leads to ensure data completeness and accuracy.

Design, build, test, and maintain high-performance Python data applications and backend services. Lead technical design, review code, mentor junior engineers, integrate with databases and cloud services, optimize performance, and ensure security, scalability, and reliability.

Design, develop, maintain, and optimize enterprise Tableau dashboards and BI solutions. Integrate and cleanse data from Oracle/Sybase/Big Data, tune SQL, automate Tableau extracts, manage Tableau Server on Linux, support testing, UAT, deployments, and troubleshoot data integrity and performance issues.

Design and implement data federation and lakehouse architectures, build scalable ETL/ELT pipelines with Python and Spark, optimize performance across federated queries, manage Delta/Iceberg/Hudi tables, and enforce governance, security, and access controls for analytics and AI teams.

Own and build scalable ELT pipelines and event-driven ingestion in AWS, using Dagster for orchestration. Implement IaC (Terraform), data quality, lineage, monitoring, and troubleshoot cross-system issues while partnering with analytics and product teams to ensure downstream analytical correctness.

Architect, build, and maintain Snowflake-based ELT pipelines and production data models. Implement observability, data quality, and governance; optimize cost and freshness. Partner with Analytics, Product, and Engineering, use dbt/CI-CD and AI-assisted tooling, and participate in reviews and architecture planning to support analytics, BI, and ML.

Design, build, and maintain scalable, secure data pipelines and platforms to acquire, transform, and store large financial datasets. Enable AI/GenAI-ready data foundations for model training, inference, retrieval, and RAG workflows. Collaborate with cross-functional teams, ensure data quality, governance, observability, and compliance, and support production deployments and troubleshooting.

Support and maintain clients' Azure data platforms and Power BI environments. Design and deploy data pipelines, models, and analytics solutions using Microsoft stack (ADF, Synapse, Databricks, SSIS/SSAS/SSRS). Troubleshoot incidents, communicate with clients, manage licensing, document environments, and promote best practices while collaborating with stakeholders and continuous skill development.

Design, build, and operate secure, scalable cloud-native data platforms (lakehouse/data mesh) supporting batch, streaming, ML, GIS and operational workloads. Lead ingestion/transformation pipelines, distributed processing (Spark/Kafka), data governance, observability, and mentor teams while ensuring compliance in regulated environments.

The Senior Data Engineer will design scalable data processing frameworks using Java and Apache Spark, manage data pipelines, and mentor junior engineers.

Design and deploy scalable data infrastructure and models, maintain CDC pipelines, build reporting tools and dashboards, write high-performance SQL, partner with product and engineering to enable enterprise-wide analytics and data-driven decision making.

Responsible for designing, developing, and maintaining scalable data pipelines and infrastructure, implementing data governance, and collaborating with teams to meet data needs.

As a Data Engineering Architect, lead the transformation of data engineering into a modern platform, oversee architecture and technical leadership, design scalable systems, ensure data quality and governance, and mentor teams for a data-driven culture.

As a Data Analytics Engineer I, you'll bridge engineering and analytics, manage data pipelines, collaborate with stakeholders, and utilize modern open-source tech for data transformation and integration in structured finance.

As an Associate Engineer in Data Science, you will leverage data analysis and machine learning to solve complex problems and develop inspiring digital products.

Nagarro seeks an Associate Principal Engineer in Big Data to leverage extensive IT experience for strategic organizational value. The role values self-starters and innovation.

Design, build, and maintain data lakes, data warehouses, and end-to-end data pipelines for a multi-tenant SaaS platform. Lead code and design reviews, write infrastructure-as-code, optimize performance and scalability, participate in data governance, mentor junior engineers, evaluate new technologies, automate tests, collaborate cross-functionally, and join on-call rotation to ensure reliable data delivery.

Design and execute SQL-based ETL processes to migrate legacy public safety data into Mark43. Collaborate with customers, contractors, and internal teams to map legacy schemas, handle edge cases, ensure data fidelity, and improve migration tooling while managing timelines and stakeholder relationships.

The Senior Data Engineer designs and maintains data infrastructure, creating scalable data pipelines and ensuring data quality while collaborating with cross-functional teams.

Design, build, and maintain an internal data platform enabling secure, governed access for engineering and analytics. Partner with architects, implement data pipelines and automations, enforce security and compliance, support platform services, recommend architecture improvements, mentor teams, and drive adoption of scalable, self-service data capabilities.

The Senior Azure Data Platform Engineer manages Azure SQL databases and Data Factory operations, ensuring stability and performance in a complex environment. The role involves troubleshooting, automating processes, and engaging with clients while leading data load ownership initiatives and enhancing operational practices.

The Principal Data Platform Engineer leads the architecture and delivery of data platforms using Databricks, focusing on data pipeline design and client relationships.