Data Engineer Jobs in Sunnyvale, CA

Lead product data engineering across architecture, data modeling, pipelines, monitoring, lineage, and data quality. Build reliable analytical datasets, support experimentation and machine learning use cases, and resolve business-critical pipeline issues. Partner with product and engineering stakeholders to translate business needs into automated data solutions. The role requires ownership of end-to-end data engineering projects, on-call participation, and development of AI-assisted monitoring and automation.

Lead product data engineering initiatives by designing data models, owning critical pipelines, building data quality and lineage monitoring, and supporting experimentation and ML-ready datasets. Translate business needs into automated data solutions, maintain pipeline SLAs through on-call support, and develop AI-assisted tools for issue detection and resolution. Collaborate with Product, Engineering, Data Science, Machine Learning, and Applied AI teams across Block’s products.

Lead data infrastructure engineering for multi-regional datastores and stream-processing platforms. Drive technical decisions, mentor engineers, establish event-driven architecture, and design scalable managed data solutions. Improve platform performance, security, reliability, and scalability while participating in on-call support. Define data access and storage guidelines, ensure regulatory compliance, and operate distributed data systems using technologies such as Kubernetes, Kafka or NATS, NewSQL databases, Go, and Python.

Lead design and build of ETL pipelines and Gold Layer tables in Databricks; develop semantic layers, data dictionaries, and AI-ready documentation; create dashboards and ad-hoc analyses to surface marketing and sales KPIs; partner with stakeholders to translate requirements into analytics-ready datasets and enable self-serve BI and agentic AI workflows.

Architect and operate RaptorDB database platforms across data centers and public clouds. Lead deployment, backup, restore, replication, failover, resilience, performance optimization, and cloud-native adoption. Develop maintainable software, automation, testing, and deployment pipelines while collaborating across engineering, infrastructure, security, and support teams. Provide technical leadership during production incidents, establish architecture standards, and document operational knowledge.

Develop scalable Java software for platform persistence, data lifecycle management, concurrency, distributed storage, and relational systems. Improve data performance, security, loss detection, and recovery while collaborating across teams. Deploy and manage services on Kubernetes, work with S3 and Apache Iceberg, support telemetry and visualization initiatives, and apply AI-assisted development practices with appropriate guardrails.

Design and maintain data architecture and pipelines to support compliance and risk teams. Build and optimize data models, standardize metrics, and create data dictionaries. Implement data quality, lineage monitoring, AI-driven agents for false-positive reduction and automation, and participate in on-call rotations to ensure SLAs are met.

Lead design and optimization of data models and pipelines for compliance and risk; standardize metrics and documentation; build data quality, lineage, and monitoring (including AI agents for automation); manage ETL scheduling, on-call pipeline support, and collaborate with product and non-technical partners to translate business needs into automated, production-ready data solutions.

Architect and lead billion-scale real-time and batch data platforms supporting advertising and customer signals. Define streaming and processing architectures, modernize legacy pipelines, and build reusable multi-tenant platforms with standardized schemas, governance, observability, privacy, and deployment patterns. Establish secure, explainable agentic data capabilities for pipeline automation, monitoring, optimization, onboarding, and AI-ready products. Provide principal-level technical leadership across advertising data domains and guide architecture, standards, design reviews, and strategic trade-offs.

Designs and optimizes AI and machine learning solutions, transforms data into insights, and develops production AI systems. Responsibilities include building data infrastructure, speech recognition and NLP tools, and reusable evaluation and monitoring capabilities. The role independently tests AI systems for performance, robustness, bias, explainability, and failure modes; evaluates technical controls; documents findings; communicates recommendations to clients; and mentors junior team members.

Leads the design, development, testing, and evaluation of AI and machine learning solutions. Directs data analysis, modeling, infrastructure, monitoring, and integration efforts while establishing standards for AI robustness, bias, explainability, failure modes, and technical controls. Manages large projects, advises clients, coaches teams, and develops reusable evaluation tools and evidence workflows for responsible AI deployment.

Design and deploy AI systems and machine learning models, perform data wrangling and analysis, and integrate solutions into data infrastructure. Develop scalable AI applications, relational data systems, evaluation tools, automated tests, and monitoring capabilities. Assess AI behavior, robustness, bias, explainability, drift, hallucinations, and guardrails while evaluating technical controls and communicating findings to clients and stakeholders.

Develop and implement AI and machine learning solutions, including algorithms, data models, infrastructure, evaluation tools, automated tests, monitoring, and responsible AI controls. Lead testing for robustness, bias, drift, explainability, hallucinations, and failure modes. Manage client accounts and technical workstreams, review evidence and controls, communicate trade-offs, mentor teams, and maintain delivery and professional standards.

Develop and maintain data-protection features in CrowdStrike Falcon sensor on Windows, working across kernel and user mode. Implement filesystem minifilter drivers, AI-aware detection/protection logic, debug kernel issues, own features end-to-end, and collaborate with cross-functional teams to ship and support endpoint data security capabilities.

Leads architecture and development of ServiceNow’s enterprise data access layer across multiple database engines. Owns technical direction, data architecture, feature delivery, code and design reviews, testing strategy, performance optimization, production troubleshooting, and cross-team solutions. The role requires deep Java and backend platform expertise, distributed systems knowledge, database experience, technical leadership, mentoring, and responsibility for scalable, reliable, secure platform capabilities.

Support and execute GRAIL’s Data Integrity Program, serving as a subject matter expert on ALCOA+ principles across the data lifecycle. Conduct data integrity reviews, reporting, risk and impact assessments, and support CAPA, deviations, change controls, audits, and supplier oversight. Partner cross-functionally across clinical, laboratory, software, research, manufacturing, and commercial teams to ensure GxP compliance, product quality, regulatory compliance, and patient safety.

Lead architecture, roadmap, and implementation for Veza’s scalable Access Graph data platform. Solve complex distributed-systems and graph-database challenges, establish engineering standards, drive high-impact technical initiatives, and ensure correctness, performance, testing, and rollback safety. Collaborate across product and engineering teams, mentor engineers, represent technical roadmaps, and use AI-assisted development tools with rigorous verification.

Leads the design, development, and operation of highly available, multi-tenant data platform services on Kubernetes, including Postgres, streaming systems, and key-value stores. Defines distributed-systems architecture, failover, disaster recovery, observability, scalability, and SLOs. Builds operators, controllers, automation, and self-service APIs; drives major technical initiatives; partners across engineering; leads reliability efforts; and mentors engineers. The role requires deep hands-on software development and operation of stateful systems at scale.

Build and operate cloud-native data platform components and services from design through production. Lead scoped projects, create technical designs, improve reliability and scalability, write tests and instrumentation, maintain runbooks, and participate in on-call rotations. Develop Kubernetes operators, controllers, automation, and platform services. Collaborate with senior engineers and mentor junior team members through code reviews, design feedback, and pairing.

Lead electrical engineering design and delivery for hyperscale data center facilities. Develop scalable electrical infrastructure solutions, review consultant and contractor designs, validate electrical loads and system performance, conduct technical studies, ensure code compliance, and support testing, inspections, commissioning, troubleshooting, budgets, and schedules. Coordinate with consultants, vendors, IT, operations, mechanical, and project teams. Travel to various data center sites is required.

Build and operate scalable multimodal data pipelines from requirements through delivery. Own feasibility, planning, quality standards, annotation, processing, storage, cost tracking, and acceptance criteria. Coordinate engineers, annotation teams, vendors, and client-facing stakeholders while improving infrastructure, automation, tooling, dataset visibility, and data quality for AI and foundation model teams.

Build reusable Python libraries and reproducible analysis pipelines for image and experimental data; define data models and provenance; partner with wet‑lab scientists to translate requirements and validate methods; establish testing, validation, versioning, and observability for scientific workflows.

Owns biological knowledge representation through LinkML and Biolink ontology engineering, semantic mappings, metadata harmonization, and schema governance. The role administers agentic curation and MCP tooling, develops LLM-driven extraction and validation workflows, and establishes automated quality controls, provenance, CI/CD, and evaluation standards. This senior individual contributor translates biological research requirements into canonical data models supporting genomics, single-cell, screening, imaging, and prior-knowledge datasets.

Own and scale a multi-cloud data platform across AWS and Azure. Manage Apache Airflow, Kubernetes, Terraform, Helm, ArgoCD, CI/CD, observability, big data infrastructure, governance tooling, and FinOps initiatives. Provide end-to-end architectural and operational ownership, improve developer tooling, define platform roadmaps, manage incidents, enforce engineering standards, and mentor data platform engineers.

Build and operate a security data platform connecting SIEM, identity, asset, threat intelligence, and knowledge graph systems. Design core APIs, distributed data pipelines, schemas, risk scoring, entity resolution, and coverage queries. Own architecture and platform workstreams from scoping through delivery, collaborate with detection and identity teams, review code, mentor engineers, and drive partner adoption. The role requires expert Python, deep Splunk expertise, cybersecurity experience, and senior-level project ownership.