Top Data Engineer Jobs in San Luis Obispo, CA

Build and operate production pipelines for legal records from PACER, court systems, opinions, PDFs, scans, XML, and HTML. Develop LLM-assisted extraction workflows, validate data quality, optimize SQL, and support RAG and semantic search products. Manage AWS S3 and RDS systems within security guardrails while collaborating with engineering teams. The role requires strong Python and SQL skills, legal data experience, document extraction expertise, and autonomous problem-solving with large, messy datasets.

Lead enterprise data engineering efforts supporting defense missions. Responsibilities include prioritizing technical tasks, mentoring engineers, conducting code reviews, translating government requirements into scalable data architectures, developing Databricks ETL/ELT pipelines with Python, PySpark, and SQL, troubleshooting pipeline performance and reliability, and documenting systems. The role collaborates with government stakeholders, product owners, data scientists, analysts, and technical teams to deliver secure, high-throughput data platforms and actionable insights.

Designs and automates data validation, profiling, testing, monitoring, and quality frameworks for multi-source cloud data. The role uses Azure Synapse, Databricks, SQL, Python, Scala, Collibra, and Profisee to detect anomalies, enforce governance, and improve data reliability. Responsibilities include developing automated test plans, analyzing structured and unstructured datasets, supporting Azure data engineering workflows, and collaborating with engineers, analysts, data scientists, and product teams. A Public Trust or Suitability/Fitness determination may be required.

Designs and maintains scalable Azure data pipelines and ETL/ELT solutions across data lakes, warehouses, lakehouses, streaming platforms, and enterprise sources. Builds integrations using Azure Data Factory, Synapse, Databricks, Spark, Kafka, and related services; applies security, governance, monitoring, and performance optimization practices. Develops Power BI dashboards, reports, data models, and visualizations, while supporting analytics and AI/ML use cases. Collaborates in Agile teams and automates deployments through DevOps and CI/CD practices.

Designs and operates data infrastructure for a clinical trial platform. Builds pipelines that extract, normalize, validate, and link information from clinical documents and publications into Aurora and GraphDB. Develops embeddings, vector search, RAG workflows, data-serving APIs, lineage tracking, and regulatory audit trails. The role also requires AWS-based orchestration, clinical data quality controls, biomedical knowledge graph modeling, and deployment automation using infrastructure-as-code and containerization.

Build and maintain data pipelines for network and operational telemetry, integrate DataMiner and other monitoring systems, create Power BI dashboards, configure monitoring metrics and alerts, automate reporting, analyze network performance and recovery events, and translate technical findings into actionable insights for technical and executive stakeholders.

Designs, builds, and maintains scalable batch and streaming data pipelines across AWS and GCP. Develops ETL/ELT workflows using Python, PySpark, and advanced SQL; optimizes performance, storage, and query execution; implements data quality and governance controls; and supports data lakes, warehouses, and ML workflows. Collaborates with data scientists and ML engineers on MLOps automation and production deployments while maintaining CI/CD, Docker, infrastructure standards, and technical documentation.

Designs and delivers backend systems, APIs, data models, ETL workflows, data interactions, and user interfaces. Optimizes data operations for scalability, performance, integrity, and security while contributing to automated testing and CI/CD. Requires strong Python and Apache Spark experience, distributed computing knowledge, Agile experience, and data analysis skills. The role supports healthcare-focused digital services in a remote-first environment.

Lead Cohere’s Data Foundation pillar, managing a team responsible for the full data lifecycle. Own the roadmap, BigQuery warehouse, Airflow and Cloud Run orchestration, dbt modeling, Looker and API serving, Terraform infrastructure, governance, access controls, reliability, incident response, and data freshness SLAs. Lead development of an agentic analytics platform and evaluation framework, establish company-wide analytics standards, and partner with product, engineering, security, legal, and business teams.

Architect and lead enterprise data platforms, pipelines, and infrastructure using Spark, Databricks, and cloud technologies. Build scalable data models and dimensional schemas, establish governance and data quality frameworks, optimize performance and reliability, and implement monitoring. Partner with stakeholders to translate requirements into technical solutions, lead design reviews, mentor engineers, contribute to platform strategy, troubleshoot complex failures, and support hiring and team development.

Leads the architecture, development, and maintenance of scalable batch and real-time data pipelines, cloud data platforms, ETL/ELT workflows, and ML data infrastructure. Establishes standards for data quality, observability, lineage, governance, security, and modeling. Partners with data scientists, engineers, DevOps, and business stakeholders; evaluates technologies, drives technical initiatives, mentors engineers, and supports production-grade APIs and machine learning pipelines.

Lead development of a unified fleet knowledge model and decision-capture pipeline for autonomous data-center operations. Build data access layers across relational, telemetry, monitoring, and time-series systems; capture labeled operator decisions; negotiate data requirements with source-system owners; and own scaling considerations including vector indexing, schema evolution, retention, and analytics separation. The role requires strong infrastructure-domain modeling, PostgreSQL expertise, and experience handling time-series and event data at scale.

Own end-to-end production data platforms, writing Python and SQL, designing AWS pipelines, modeling analytics data, and implementing quality and reconciliation controls. Make architecture decisions independently, ensure correctness and auditability, and use AI coding tools effectively. The role also supports applied AI initiatives including entity resolution, LLM-assisted analytics, embeddings, and anomaly scoring.

Owns the end-to-end data platform, including Snowflake infrastructure, ingestion pipelines, Airflow orchestration, dbt transformations, governed gold-layer models, and metric definitions. Ensures reliability, performance, testing, documentation, governance, and CI/CD standards. Builds data systems from scratch, partners with analytics stakeholders, and uses AI-assisted development tools to accelerate engineering work. Requires strong SQL, platform ownership, software engineering practices, and experience with Snowflake, Airflow, and dbt.

Build and optimize data transformation pipelines using SQL, dbt, Airflow, Python, BigQuery, and relational databases. Collaborate with stakeholders and data engineers, manage task scheduling, resolve data issues, perform analyses, present recommendations, support data exploration tool adoption, and mentor team members. The role also contributes to hiring, onboarding, and professional development while ensuring data accuracy and insight quality.

Build and operate large-scale audio data pipelines for AI model training. Responsibilities include discovering data sources, improving data-processing systems for quality, throughput, and cost, collaborating with AI scientists, and owning engineering projects through continuous improvement.

Build and operate large-scale audio data pipelines for AI model training. Responsibilities include discovering data sources, developing reliable processing systems, optimizing data quality, throughput, and cost, and collaborating with AI scientists. The role requires ownership of engineering projects from discovery through continuous improvement in a distributed, ambiguous environment.

Build and operate large-scale audio data pipelines for AI model training. Responsibilities include discovering data sources, developing reliable data acquisition and processing systems, optimizing quality, throughput, and cost, and collaborating with AI scientists. The role requires ownership of engineering projects from discovery through continuous improvement, with emphasis on backend development, production systems, and scalable data processing.

Build and operate large-scale audio data pipelines for AI model training. Responsibilities include discovering data sources, processing petabyte-scale datasets, optimizing quality, throughput, and cost, collaborating with AI scientists, and owning engineering projects from discovery through continuous improvement.

Build and operate large-scale data pipelines that acquire, process, and improve audio datasets for AI model training. The role focuses on data quality, throughput, cost optimization, production systems, and collaboration with AI scientists. Responsibilities include discovering data sources, developing reliable processing systems, and owning engineering projects from discovery through continuous improvement.

Build and operate large-scale audio data pipelines for AI model training. Responsibilities include discovering data sources, developing reliable data-processing systems, optimizing data quality, throughput, and cost, and collaborating with AI scientists. The role requires ownership of engineering projects from discovery through continuous improvement in a distributed, autonomous environment.

Build and operate large-scale data pipelines that collect, process, and optimize audio datasets for AI model training. The role involves discovering data sources, improving data quality, throughput, and cost efficiency, collaborating with AI scientists, and owning engineering projects from discovery through continuous improvement.

Designs and maintains secure, reliable data platforms, including relational data models, migrations, pipelines, monitoring, data quality processes, and self-service reporting access. The role protects PHI and PII through access controls, encryption, audit logging, and governance in a HIPAA environment. It also involves backend API development, code reviews, security reviews, stakeholder collaboration, and mentoring teams on data practices.

Own Moxie’s end-to-end data infrastructure, including pipelines, Snowflake warehousing, dbt and Omni modeling, orchestration, observability, and documentation. Partner with Engineering and Finance on schema changes, accounting logic, metrics, and business-critical reporting. Deliver financial or historical EMR data models, establish SOPs and reliability KPIs, optimize performance and cost, and help advance Practice Intelligence toward predictive and prescriptive products with appropriate AI safeguards.

Leads the architecture and evolution of scalable data platforms, pipelines, and data products across multiple teams. Designs Snowflake and cloud-based solutions for batch, streaming, CDC, ingestion, transformation, orchestration, and data delivery. Establishes engineering standards, governance, observability, testing, CI/CD, and reliability practices; mentors engineers; guides architecture and roadmap decisions; resolves complex incidents; and evaluates AI, automation, and MCP-enabled data capabilities.