Data Engineer Jobs in Oakland, CA

Design and implement data architecture and scalable ETL/ELT pipelines on cloud platforms (AWS/Azure/GCP). Analyze complex problems, mentor junior staff, ensure data governance/security compliance, liaise with stakeholders, and deliver high-quality client solutions while developing technical and client-facing skills.

Design and implement AI systems and scalable machine learning models, perform data wrangling and software engineering to deploy AI solutions, interpret data for client recommendations, collaborate across teams, uphold technical standards, and build client relationships while navigating complex, ambiguous problems.

Build and maintain scalable, reliable ML data platform systems to support dataset generation, model training, analytics, monitoring, and large-scale inference. Collaborate with ML, software, and infrastructure engineers to design cost-efficient data lake and training infrastructure using vendor and open-source tools to enable next-generation ML models.

Lead design and implementation of enterprise data architecture and cloud-based data solutions. Manage large data engineering projects, develop data models and pipelines, ensure governance and security compliance, advise clients strategically, and build high-performing inclusive teams.

Lead design and implementation of data architecture, ETL/ELT pipelines, data models, warehouses and lakes. Ensure data governance, security, cloud deployments, performance and cost optimization. Coach and manage team members, partner with stakeholders, and drive data-driven solutions for clients.

Design, build, and operate production ML systems that generate trusted signals for ranking, retrieval, recommendations, propensity/churn/LTV, and next-best-action decisioning. Define signal/data contracts, own feature and candidate generation through serving, experimentation, monitoring, and feedback loops, and evaluate long-term business impact, trust, fairness, and compliance. Partner across product, data, modeling, risk, and compliance and apply AI/agents to accelerate engineering and operations.

Design and maintain data architecture and pipelines to support compliance and risk teams. Build and optimize data models, standardize metrics, and create data dictionaries. Implement data quality, lineage monitoring, AI-driven agents for false-positive reduction and automation, and participate in on-call rotations to ensure SLAs are met.

Lead design and implementation of scalable cloud data lakes, warehouses, and marts. Build ELT/ETL pipelines, apply Data Vault 2.0 and dimensional modeling, implement data quality, lineage, observability, and governance. Optimize Snowflake/Databricks/Synapse platforms, champion CI/CD and DataOps, mentor engineers, and enable AI/ML-ready data products through collaboration with architecture and product teams.

Design, build, and operate scalable cloud data pipelines and platforms (Azure preferred). Implement DevSecOps, CI/CD, automated testing, monitoring, performance tuning, and production readiness. Mentor engineers, drive operational excellence, and translate requirements into robust technical designs. Apply healthcare domain knowledge and collaborate in agile teams to deliver secure, reliable data products.

Join a talent network connecting data engineers with VC-backed startups. Build scalable batch and real-time pipelines, data models, warehouses/lakehouses, ensure data quality, support ML pipelines, integrate diverse data sources, and define data architecture and governance.

The AI-Native Data Engineer will build data pipelines, architect databases, design GCP infrastructure, and automate workflows for energy management using AI.

Design and implement secure, resumable cloud pipelines to ingest multi-terabyte medical imaging data; build GPU-accelerated orchestration with strong retry semantics and cost controls; define data lifecycle and retention; implement HIPAA/PHI security and compliance controls; and deliver operational tooling (monitoring, alerting, runbooks) for a device fleet.

Lead design and operation of Block's real-time, event-driven data systems. Build and run high-throughput streaming pipelines, turn Kafka event streams into low-latency data products, improve reliability and observability, mentor engineers, and define platform architecture and standards for projections, third-party data proxy, and graph data capabilities.

Lead design and optimization of data models and pipelines for compliance and risk; standardize metrics and documentation; build data quality, lineage, and monitoring (including AI agents for automation); manage ETL scheduling, on-call pipeline support, and collaborate with product and non-technical partners to translate business needs into automated, production-ready data solutions.

Design, build, and operate production ML signal systems—ranking, retrieval, recommendations, propensity, and next-best-action—covering feature/candidate generation, serving, experimentation, monitoring, and feedback. Define signal contracts (freshness, provenance, confidence), evaluate long-term impact (trust, fairness, compliance), and partner across product, data, and risk teams to deliver reusable customer-intelligence capabilities.

Build and operate scalable data ingestion, transformation, and connector frameworks; design and maintain a knowledge-graph-based data fabric; normalize and vectorize enterprise data for LLM/AI workflows; implement governance, lineage, access controls, and secure APIs to serve ML/agent pipelines.

Build and validate data pipelines, improve data quality, contribute to data product features, write tests, document solutions, and support cloud data architecture. The intern will use SQL and programming skills, explore AI and machine learning techniques, automate workflows with CI/CD and version control, and participate in agile ceremonies while learning platforms such as Azure and Snowflake.

Build and scale AI data and ML infrastructure: evaluation systems, fine-tuning pipelines, agent-first product surfaces, high-throughput data workflows, and integrations of new models into production.

The Software Engineer will manage data collection for model training, enhance cloud infrastructure, and collaborate with scientists for data processing and improvements.

Build and maintain core financial backend systems (trading, ledger, billing), transaction processing, reconciliation, and portfolio state management. Design and scale real-time and batch data pipelines, architect APIs and backend services, ensure reliability and observability, and contribute to distributed system design (event-driven, microservices, streaming). Partner with ML teams as needed.

Lead architecture and implementation of agentic AI systems powering Zuma's platform. Rebuild onboarding and integration frameworks, implement analytics and observability for LLM performance, translate product needs into technical solutions, mentor engineers, establish engineering standards, and work directly with customers to enable scalable, production-grade AI experiences.

Design and implement real-time MAC data-plane software for high-throughput satellite links. Build packet-processing pipelines, queue and buffer management, retransmission and loss recovery, and integrate with PHY, modem, FPGA, DMA, and SoC hardware. Optimize for low latency and high throughput using zero-copy, scatter-gather, lock-free structures, and hardware offload. Lead architecture through prototyping, hardware integration, performance qualification, and operational deployment while diagnosing timing and synchronization issues.

Responsible for utilizing Hortonworks architecture and tools such as Hadoop and Spark for data analysis and engineering tasks. Candidates should have relevant experience and may be considered for contract-to-hire roles.

Build and automate large-scale ML data pipelines and tooling for autonomous trucking. Improve dataset curation, deduplication, labeling, evaluation, and metrics infrastructure. Collaborate with robotics, autonomy, and infra teams to support continuous learning, deployment, and scalable AI infrastructure for Kodiak's fleet.

Lead strategy and operations for on-prem Kafka and support Perforce-based asset version control. Maintain mission-critical Linux services, automate with scripting and IaC, troubleshoot complex issues, coordinate with production/engineering/vendors, mentor teammates, and participate in on-call rotations.