Top Data Engineer Jobs in Yokohama

Build and operate scalable financial market data pipelines for Binance stock products and AI applications. Responsibilities include sourcing, ingesting, modeling, processing, storing, and serving real-time and historical data; designing multi-market data frameworks; optimizing Flink pipelines; and establishing quality, reconciliation, monitoring, lineage, and recovery systems. The role also evaluates vendors and data sources, defines data contracts, and collaborates with trading, product, AI, legal, and compliance teams.

Build and operate scalable data pipelines for autonomous-driving machine learning workflows. Responsibilities include ingesting, transforming, curating, validating, and monitoring large real-world and synthetic datasets; improving pipeline performance and reliability; supporting scenario mining and model evaluation; and collaborating with ML engineers, Data Corpus teams, AI Platform, and external partners.

Build full-stack tools, backend services, APIs, dashboards, and data workflows for assessing and improving AI training data and evaluations. Partner with quality and research teams to inspect agent trajectories, validate graders, measure quality, investigate workflow issues, and turn internal prototypes into reliable production platform capabilities.

Develop and maintain scalable Python applications, APIs, microservices, and data pipelines using PySpark and Airflow. Deploy and operate solutions on Azure with Docker and Kubernetes, implementing monitoring, logging, alerting, and production support. Collaborate with product managers, data scientists, and engineering teams on global projects while contributing to coding standards, architecture, testing, documentation, and Agile delivery.

Develop robotics datasets and evaluations for embodied AI systems. Responsibilities include defining data schemas, annotations, quality standards, collection protocols, validation tools, and review workflows. The role also involves running experiments to assess how data quality and structure affect model performance, collaborating with research, engineering, vendors, and customers, and taking research tools from conception through deployment.

Leads the design, development, deployment, and continuous improvement of scalable Azure data solutions. Builds cloud-native platforms using Spark, Databricks, Python, and SQL; establishes CI/CD, testing, automation, and DevOps practices; resolves complex technical issues; collaborates with global stakeholders; and mentors engineers while contributing to platform architecture and roadmap decisions.

Lead the design and development of cloud-based data platforms, pipelines, ETL/ELT processes, data models, warehouses, and lakes using Azure and Databricks. Build integrations, optimize performance, implement governance, monitor pipelines, resolve issues, and create Power BI reports. Collaborate with product managers and technical teams to deliver scalable, reusable data solutions and document processes.

Build, automate, and operate enterprise-scale data platforms using Databricks, Snowflake, Microsoft Fabric, Kubernetes, and cloud technologies. Responsibilities include Infrastructure as Code, CI/CD, GitOps, platform provisioning, reliability engineering, observability, security, governance, incident remediation, performance optimization, and FinOps. The role supports multi-environment deployments and self-service capabilities for data engineering and analytics teams.

Designs and maintains database solutions, ETL workflows, data pipelines, and cloud data integrations using PL/SQL, Python, and AWS. Provides application and production support, including incident resolution, monitoring, troubleshooting, root cause analysis, deployment, and release management. Owns change requests from requirements through post-production support, develops automation and applications, and collaborates with stakeholders to deliver scalable technical solutions.

Lead the design and development of cloud-based data platforms using Azure and Databricks. Build and optimize ETL/ELT pipelines, data models, warehouses, lakes, and integrations; implement governance, monitoring, and troubleshooting; and create Power BI reports. Collaborate with product managers and cross-functional teams to deliver scalable, high-quality data solutions, while documenting processes and applying coding and DevOps best practices.

Build and operate production-grade AI data pipelines and financial knowledge services for equities content. Responsibilities include processing text, tables, documents, and multimedia; creating knowledge bases and search indexes; engineering RAG retrieval and citation systems; integrating LLMs and NLP models; managing orchestration, APIs, quality, cost, observability, reliability, and scalable production operations.

Own the Data Products function across reporting, analytics, immutable ledgers, shareholder intelligence, and compliance governance. Lead strategy, architecture, customer discovery, production development, data engineering, real-time reporting, APIs, AI-enabled querying, disaster recovery, and governance. Collaborate with product leadership on onboarding and ingestion while representing the function to customers, executives, board members, and prospects.

Designs, develops, and maintains secure enterprise data pipelines and ETL/ELT processes integrating government and commercial systems. Ensures data quality, performance, availability, and real-time delivery for logistics, mission support, analytics, and operational decision-making. Responsibilities include database and pipeline optimization, cloud migration support, technical documentation, cybersecurity and governance compliance, troubleshooting, stakeholder coordination, operational exercise support, and mentoring junior personnel.

Lead HUD's data quality strategy for RL training data: build QC systems, validate synthetic data at scale, design evaluation experiments, partner with researchers and vendors, convert research insights into production validation pipelines and tools, and mentor research engineers.

Develop, deploy, and maintain LLM pipelines and RAG QA/search systems; design and optimize prompts and multi-agent LLM architectures; operate multi‑GPU/cluster inference; build evaluation pipelines for model quality, bias, and hallucination; collaborate with product and CS teams to integrate conversational AI.