Top Data Engineer Jobs in San Luis Obispo, CA

Build and maintain reliable data pipelines, computed tables, and scalable data models using SparkSQL and PySpark. Integrate IoT, product, customer, external, unstructured, and ML-related data into a central data lake for analytics, causal inference, model training, and dashboards. Ensure high data quality and uptime while collaborating with data science, analytics, AI/ML, and engineering teams.

Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.

Staff Data Engineer responsible for setting technical direction, architecting scalable data platforms, leading cross-functional initiatives, improving reliability and performance, and enabling AI-assisted analytics and development. The role includes hands-on development with Python, SQL, cloud data warehouses, orchestration, infrastructure as code, Kubernetes, Kafka, and streaming pipelines, along with mentoring, technical advocacy, documentation, code reviews, and on-call troubleshooting.

Staff Data Engineer leading architecture and technical direction for real-time and batch motorsports data platforms. Responsibilities include telemetry ingestion, streaming systems, data quality, observability, cloud platforms, reliability, incident response, technical standards, roadmap planning, stakeholder influence, and mentoring. The role delivers scalable solutions supporting race-day operations and cross-functional analytical products.

The Associate Data Engineer role is listed with KKR, but the provided description contains only company information and equal-opportunity notices. No specific responsibilities, technologies, qualifications, salary, travel, or clearance requirements are provided.

Design, build, and operate production data pipelines and shared data foundations using SQL, Python, PySpark, Databricks, and cloud technologies. Develop data models, ingestion and transformation workflows, resilient processing, observability, data-quality controls, and secure customer-aware data flows. Collaborate with engineering and product teams, evaluate architecture and tooling, support analytics and application services, contribute to testing and documentation, and mentor other engineers.

Builds and maintains data pipelines and datasets supporting analytics, AI, and modeling. Responsibilities include ingesting healthcare claims and lab data into Snowflake and AWS Iceberg, processing structured and unstructured sources, curating data for AI use cases, implementing medallion architectures, evaluating data quality, and contributing to pilot initiatives using SQL, Python, AWS Glue, Terraform, and Snowflake.

Design, build, and optimize scalable data pipelines using Databricks, PySpark, SQL, Delta Lake, and lakehouse architecture. Collaborate with analytics, product, and engineering teams while developing batch and streaming workflows, integrating data warehouse systems, and using cloud platforms and orchestration tools such as Azure, Airflow, ADF, or Prefect.

Build and maintain large-scale data processing pipelines using Apache Spark (PySpark/Scala) and Python. Design ETL workflows, implement distributed data processing, use version control (Git), and work with cloud platforms (GCP/AWS/Azure).

Designs Azure-based data models, simulations, test environments, automated testing frameworks, and performance validation solutions for healthcare data pipelines. Develops test data generators, validates ETL and HL7 FHIR transformations, supports data quality and reliability, and collaborates with engineers and architects on design and code reviews. The role also provides technical guidance on testing architecture, CI/CD, infrastructure as code, resiliency, and large-scale cloud data processing.

Build and maintain production data pipelines and foundational datasets for Market Intelligence. Automate survey ingestion, cleaning, joining, scheduling, monitoring, and reporting-layer integration. Develop repeatable queries, improve data quality practices, document assumptions, support reproducible outputs, and translate research needs into technical solutions. The role requires close collaboration with technical and nontechnical stakeholders and ownership of reliable data infrastructure.

Design, build, and maintain scalable batch and streaming data pipelines using Databricks, PySpark, Python, SQL, Spark, and Delta Lake. Develop transformations, orchestration workflows, data models, validation processes, and curated data products. Troubleshoot performance and quality issues, apply governance and security practices, document solutions, and collaborate with architects, data scientists, DevOps teams, analysts, and clients.

Designs, builds, and maintains Snowflake-based enterprise data warehouse solutions, including data architecture, ETL/ELT pipelines, security, deployment, data quality, modeling, and performance optimization. Partners with integration, analytics, governance, business intelligence, and architecture teams. Supports production operations, resolves ingestion and transformation issues, develops AWS-to-Snowflake scripts, documents implementations, and translates business requirements into scalable data solutions.

Designs, develops, and maintains scalable ETL/ELT pipelines and data platform capabilities for high-volume healthcare data. Responsibilities include complex SQL development, Airflow orchestration, dbt transformations, data quality frameworks, pipeline monitoring, troubleshooting, performance optimization, and documentation. The role collaborates with Data Operations, Product, Analytics, Data Science, and clinical teams to deliver reliable data for analytics, reporting, product features, and AI/ML initiatives.

Design and manage financial systems for accurate cashback calculations, build and maintain reconciliation processes, ensure data integrity for yield-bearing instruments, collaborate with compliance, and partner with cross-functional teams to improve financial system efficiency.

Build and maintain FinOps data pipelines, BigQuery and dbt models, cost attribution systems, forecasting and anomaly detection models, and cost-versus-revenue analytics. Identify and implement AWS and GCP savings opportunities, automate governance with Python, Terraform, and Lambda, and partner with Engineering, Finance, Product, and leadership on cloud costs, forecasting, reporting, and architecture decisions.

Designs, develops, maintains, and improves software applications and business processes. Responsibilities include full lifecycle development, troubleshooting, performance and reliability improvements, CI/CD collaboration, requirements analysis, technology research, package maintenance, portfolio planning, and mentoring junior engineers. The role requires independent work, cross-functional collaboration, and strong software development, documentation, and problem-solving skills.

Build and maintain scalable Python-based data pipelines and cloud-native solutions supporting U.S. Army financial-system modernization. Develop ETL/ELT workflows using AWS Glue, Lambda, S3, and CloudWatch; integrate APIs and diverse file formats; improve data reliability, performance, security, and governance; implement testing and monitoring; and collaborate with engineers and stakeholders in an Agile environment.

Lead product data engineering across architecture, data modeling, pipelines, monitoring, lineage, and data quality. Build reliable analytical datasets, support experimentation and machine learning use cases, and resolve business-critical pipeline issues. Partner with product and engineering stakeholders to translate business needs into automated data solutions. The role requires ownership of end-to-end data engineering projects, on-call participation, and development of AI-assisted monitoring and automation.

Lead product data engineering initiatives by designing data models, owning critical pipelines, building data quality and lineage monitoring, and supporting experimentation and ML-ready datasets. Translate business needs into automated data solutions, maintain pipeline SLAs through on-call support, and develop AI-assisted tools for issue detection and resolution. Collaborate with Product, Engineering, Data Science, Machine Learning, and Applied AI teams across Block’s products.

Build and own scalable data platforms and ingestion pipelines using BigQuery, dbt, and modern ingestion tools. Design batch and CDC workflows, improve reliability and observability, implement governance and access controls, and support analytics and AI agents. Develop Python services and internal tooling, contribute to architecture and lakehouse experiments, collaborate with stakeholders, and mentor engineers. The role requires strong SQL, Python, cloud infrastructure, testing, CI/CD, and AI-assisted development experience.

Develop and maintain data pipelines, backend programs, and integrations in Azure Government Cloud. Transform and cleanse data, evolve scripts and notebooks, manage relational databases, support data quality, document technical processes, and collaborate with engineers, geospatial experts, scientists, and government clients. The role also involves project coordination, status reporting, client travel, and compliance with government background and security requirements.

Designs, develops, maintains, and optimizes complex data systems, SQL/ETL processes, reporting solutions, and .NET applications supporting pharmacy benefit management. Responsibilities include database performance tuning, data warehousing, troubleshooting pharmacy claims, technical specification development, software testing, cloud integration, stakeholder collaboration, Agile participation, and mentoring. The role requires strong SQL Server, dimensional modeling, cloud database, Python, PowerShell, and healthcare data standards expertise.

Designs and optimizes scalable data platforms, architectures, and production pipelines supporting AI and machine learning. Responsibilities include Databricks Lakehouse development, batch and real-time processing, data governance, security, monitoring, performance tuning, infrastructure planning, and collaboration with DevOps, MLOps, and cross-functional teams. The role serves as the AI team’s data engineering subject matter expert and ensures reliable, secure, cost-effective data solutions.

Build and operate data-intensive web products and APIs, extend high-throughput ETL pipelines and scrapers, ensure reliability/observability, design self-scaling services, participate in code review, and collaborate across product, data, and infrastructure teams to meet production SLAs.