Data Engineer Jobs in Oakland, CA

Lead product data engineering across architecture, data modeling, pipelines, monitoring, lineage, and data quality. Build reliable analytical datasets, support experimentation and machine learning use cases, and resolve business-critical pipeline issues. Partner with product and engineering stakeholders to translate business needs into automated data solutions. The role requires ownership of end-to-end data engineering projects, on-call participation, and development of AI-assisted monitoring and automation.

Lead product data engineering initiatives by designing data models, owning critical pipelines, building data quality and lineage monitoring, and supporting experimentation and ML-ready datasets. Translate business needs into automated data solutions, maintain pipeline SLAs through on-call support, and develop AI-assisted tools for issue detection and resolution. Collaborate with Product, Engineering, Data Science, Machine Learning, and Applied AI teams across Block’s products.

Lead design and build of ETL pipelines and Gold Layer tables in Databricks; develop semantic layers, data dictionaries, and AI-ready documentation; create dashboards and ad-hoc analyses to surface marketing and sales KPIs; partner with stakeholders to translate requirements into analytics-ready datasets and enable self-serve BI and agentic AI workflows.

Design and maintain data architecture and pipelines to support compliance and risk teams. Build and optimize data models, standardize metrics, and create data dictionaries. Implement data quality, lineage monitoring, AI-driven agents for false-positive reduction and automation, and participate in on-call rotations to ensure SLAs are met.

Lead design and optimization of data models and pipelines for compliance and risk; standardize metrics and documentation; build data quality, lineage, and monitoring (including AI agents for automation); manage ETL scheduling, on-call pipeline support, and collaborate with product and non-technical partners to translate business needs into automated, production-ready data solutions.

Designs and optimizes AI and machine learning solutions, transforms data into insights, and develops production AI systems. Responsibilities include building data infrastructure, speech recognition and NLP tools, and reusable evaluation and monitoring capabilities. The role independently tests AI systems for performance, robustness, bias, explainability, and failure modes; evaluates technical controls; documents findings; communicates recommendations to clients; and mentors junior team members.

Leads the design, development, testing, and evaluation of AI and machine learning solutions. Directs data analysis, modeling, infrastructure, monitoring, and integration efforts while establishing standards for AI robustness, bias, explainability, failure modes, and technical controls. Manages large projects, advises clients, coaches teams, and develops reusable evaluation tools and evidence workflows for responsible AI deployment.

Design and deploy AI systems and machine learning models, perform data wrangling and analysis, and integrate solutions into data infrastructure. Develop scalable AI applications, relational data systems, evaluation tools, automated tests, and monitoring capabilities. Assess AI behavior, robustness, bias, explainability, drift, hallucinations, and guardrails while evaluating technical controls and communicating findings to clients and stakeholders.

Develop and implement AI and machine learning solutions, including algorithms, data models, infrastructure, evaluation tools, automated tests, monitoring, and responsible AI controls. Lead testing for robustness, bias, drift, explainability, hallucinations, and failure modes. Manage client accounts and technical workstreams, review evidence and controls, communicate trade-offs, mentor teams, and maintain delivery and professional standards.

Build reusable Python libraries and reproducible analysis pipelines for image and experimental data; define data models and provenance; partner with wet‑lab scientists to translate requirements and validate methods; establish testing, validation, versioning, and observability for scientific workflows.

Owns biological knowledge representation through LinkML and Biolink ontology engineering, semantic mappings, metadata harmonization, and schema governance. The role administers agentic curation and MCP tooling, develops LLM-driven extraction and validation workflows, and establishes automated quality controls, provenance, CI/CD, and evaluation standards. This senior individual contributor translates biological research requirements into canonical data models supporting genomics, single-cell, screening, imaging, and prior-knowledge datasets.

Own and scale a multi-cloud data platform across AWS and Azure. Manage Apache Airflow, Kubernetes, Terraform, Helm, ArgoCD, CI/CD, observability, big data infrastructure, governance tooling, and FinOps initiatives. Provide end-to-end architectural and operational ownership, improve developer tooling, define platform roadmaps, manage incidents, enforce engineering standards, and mentor data platform engineers.

Build and operate Block’s data platform, including warehousing, orchestration, business intelligence, governance, and agentic workflows. Develop reliable Python services, developer tools, and Terraform infrastructure for petabyte-scale data. Partner with data practitioners and product teams, establish engineering standards, provide technical direction, and mentor engineers while ensuring security, reliability, observability, usability, and data governance.

Build and operate a scalable data platform supporting warehousing, orchestration, business intelligence, governance, and agentic workflows. Develop Python services, Terraform infrastructure, and developer tools for petabyte-scale data. Partner with data practitioners and product teams, establish security and reliability patterns, set technical direction, improve engineering standards, and mentor engineers.

Build and operate reliable data pipelines transforming flight test, simulation, and operational data into versioned, traceable ML training datasets. Responsibilities include ingestion, normalization, time alignment, validation, dataset lineage, anomaly mining, labeling workflows, deployment feedback loops, monitoring, and data coverage analysis. Collaborate with flight test and operations teams on instrumentation and data access. The role is on-site in Boston and requires production data engineering experience supporting machine learning pipelines.

Own production-grade analytics pipelines from design through maintenance, build dbt-based analytical models using Kimball dimensional modeling, and deliver reliable data features. Partner with Product, Engineering, and Data Science teams to translate retail signals into business insights. Establish standards for monitoring, documentation, reproducibility, and code quality. Use AI tools to accelerate development and prototype conversational data experiences for natural-language retail data exploration.

Own and scale the company’s analytics infrastructure, including BigQuery data warehouses, dbt data marts, external data exchange, DataOps, data quality, governance, security, and cloud cost optimization. Partner with application database teams, analytics engineers, and data scientists to enable reliable metrics and scalable client data delivery.

The AI-Native Data Engineer will build data pipelines, architect databases, design GCP infrastructure, and automate workflows for energy management using AI.

The role involves designing and building data pipelines for analyzing user feedback on AI models, ensuring data quality and infrastructure scalability.

Design and implement secure, resumable cloud pipelines to ingest multi-terabyte medical imaging data; build GPU-accelerated orchestration with strong retry semantics and cost controls; define data lifecycle and retention; implement HIPAA/PHI security and compliance controls; and deliver operational tooling (monitoring, alerting, runbooks) for a device fleet.

Build and operate streaming and batch data pipelines for energy-storage telemetry. Design reliable, query-ready time-series and event datasets using open table formats, orchestration frameworks, AWS, and infrastructure-as-code. Lead technical designs, partner with field operations and engineering teams, support on-call operations, and mentor engineers while improving data reliability and engineering practices.

Build and maintain scalable financial data infrastructure, including ingestion, validation, normalization, and integrations. Develop systems that calculate portfolio performance metrics efficiently across high-volume datasets, improve reliability and observability, and support distributed processing. Create internal tools, dashboards, reusable schemas, asset data feeds, and self-service analytics capabilities. Collaborate cross-functionally to expand market-data coverage, support B2B integrations, and strengthen operational resilience.

Lead architecture and implementation of fleet telemetry, time-series storage, streaming pipelines, and CRM/warehouse integrations on AWS. Build tools for proactive fleet health, partner cross-functionally (firmware, manufacturing, ops), support on-call as systems mature, and design LLM-driven automations to increase team leverage.

Build and operate scalable data ingestion, transformation, and connector frameworks; design and maintain a knowledge-graph-based data fabric; normalize and vectorize enterprise data for LLM/AI workflows; implement governance, lineage, access controls, and secure APIs to serve ML/agent pipelines.

Lead architecture and implementation of agentic AI systems powering Zuma's platform. Rebuild onboarding and integration frameworks, implement analytics and observability for LLM performance, translate product needs into technical solutions, mentor engineers, establish engineering standards, and work directly with customers to enable scalable, production-grade AI experiences.