Top Data Engineer Jobs in San Luis Obispo, CA

Design and implement data architecture and scalable ETL/ELT pipelines using cloud platforms (AWS/Azure/GCP). Develop data models, ensure governance and security compliance, analyze complex problems, mentor junior staff, build client relationships, and enhance technical skills to deliver high-quality data solutions.

Design and build data infrastructure, pipelines, and integration solutions using cloud and big-data tools. Develop and manage data lakes and warehouses, apply data architecture and dimensional modeling, validate data quality, implement security best practices, and collaborate with clients to deliver analytics and data strategies. Mentor peers and manage growing client responsibilities as a Senior Associate.

Lead design and delivery of cloud-based data architecture, data models, ETL/ELT pipelines, data warehouses/lakes, and data security. Manage projects, mentor team members, ensure governance compliance, collaborate with stakeholders, and optimize cloud infrastructure for performance, cost, and scalability.

Lead design and implementation of data architecture and cloud-based data engineering solutions. Manage large projects, translate stakeholder requirements into technical designs, ensure data governance and security, develop data models and pipelines, advise clients strategically, and coach teams to deliver operational excellence.

The Data Engineer will develop and implement ETL processes, design data architectures, work with data platforms, and ensure data solutions meet scalability and security needs. Responsibilities include mentoring junior engineers and collaborating with stakeholders to gather requirements and optimize data transformations.

Build, model, and maintain scalable BigQuery-based data solutions on GCP. Implement performant data models, storage partitioning/clustering, ETL improvements, data validation, and documentation. Collaborate with architects, data scientists, and engineers to deliver governed, high-quality data for reporting and AI initiatives.

As a Data Engineer, you'll lead data engineering projects, develop data transformations, build workflows with Apache Airflow, and ensure data quality and integrity while collaborating with stakeholders.

The Data Engineer will architect and develop robust data frameworks for data platforms, focusing on data transformations and automated workflows. Responsibilities include collaborating with stakeholders, ensuring data quality, and maintaining high engineering standards.

The Data Engineer will build and maintain data pipelines, optimize workflows, manage infrastructure, and enhance pipeline observability while collaborating with teams for effective data delivery.

Lead architecture and reliability of the data platform, build and harden ingestion (batch and CDC), own BigQuery+dbt transformations, establish testing/observability/governance, mentor engineers, develop Python tooling and APIs, run POCs for lakehouse/open table formats, and define AI-assisted development practices.

Design, build, and operate large-scale data platforms and Spark/PySpark pipelines. Enable data integration, modeling, quality, and observability. Build MCP servers and AI-augmented tooling, mentor engineers, and lead cross-functional projects to deliver reliable data products.

Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.

The role involves architecting and improving data systems, defining governance standards, optimizing performance, and mentoring engineers in data engineering.

Build and maintain cloud cost monitoring, alerting, and optimization tooling. Develop automation, cost allocation/tagging, data pipelines, dashboards, and integrations with billing APIs. Support FinOps processes, implement cost guardrails, troubleshoot cost systems, participate in on-call rotation, and collaborate with senior engineers and product teams to drive cost-efficient infrastructure and reporting.

Lead the evolution of data platform by designing scalable pipelines, improving data processes, mentoring teams, and modernizing data architecture.

Own and architect large-scale data pipelines, orchestration, and integrations. Drive IaC strategy (Terraform), third-party API and AI/LLM tool integrations, build export pipelines and internal tooling, mentor engineers, and align cross-team technical strategy for reliable, scalable data infrastructure.

Own SQL and dbt-based data modeling and data quality for clinical and claims datasets. Author and refactor dbt models/tests, triage DQ alerts, design monitors, optimize SQL performance, and collaborate with Data Engineering and stakeholders to ensure trusted production datasets.

Build and maintain large-scale data processing pipelines using Apache Spark (PySpark/Scala) and Python. Design ETL workflows, implement distributed data processing, use version control (Git), and work with cloud platforms (GCP/AWS/Azure).

Lead design and implementation of scalable cloud data lakes, warehouses, and marts. Build ELT/ETL pipelines, apply Data Vault 2.0 and dimensional modeling, implement data quality, lineage, observability, and governance. Optimize Snowflake/Databricks/Synapse platforms, champion CI/CD and DataOps, mentor engineers, and enable AI/ML-ready data products through collaboration with architecture and product teams.

Build and maintain data pipelines, applications, workflows, and governance within Palantir Foundry. Apply industrial engineering and operations research methods to analyze depot, MRO, and supply chain processes, integrate ERP/MRO data into models, run capacity/throughput analyses, deliver decision‑support briefings, and support adoption of advanced analytics and digital engineering. Coordinate with stakeholders and support business development activities.

Design, build, and optimize scalable Azure data platforms and lakehouse architectures. Develop ETL/ELT pipelines (PySpark/Spark SQL), enable Power BI datasets, implement CI/CD and IaC, ensure data governance/quality with Purview, support cloud migrations and production operations while collaborating with stakeholders and agile teams.

Design and maintain data architecture and pipelines to support compliance and risk teams. Build and optimize data models, standardize metrics, and create data dictionaries. Implement data quality, lineage monitoring, AI-driven agents for false-positive reduction and automation, and participate in on-call rotations to ensure SLAs are met.

Lead design and delivery of scalable, secure cloud data pipelines and products. Translate requirements into architecture, apply advanced data modeling (Data Vault 2.0/dimensional), embed data quality, observability, security, and DataOps/CI-CD practices, optimize performance and cost, mentor engineers, and enable AI/ML-ready datasets within an agile DevSecOps model.

Design, build, and operate scalable cloud data pipelines and platforms (Azure preferred). Implement DevSecOps, CI/CD, automated testing, monitoring, performance tuning, and production readiness. Mentor engineers, drive operational excellence, and translate requirements into robust technical designs. Apply healthcare domain knowledge and collaborate in agile teams to deliver secure, reliable data products.

The job involves building responsive web dashboards, advanced data visualizations, and analytics tools for unmanned aircraft systems, requiring a deep understanding of UI/UX design and data presentation.