Top Data Engineer Jobs in Yokohama

The Data Engineer will develop automated systems for data extraction and formatting, optimize data processing, and facilitate tool development for easy data validation and reporting.

Lead design, development, deployment, and continuous improvement of cloud-native data and analytics solutions on Azure. Act as a hands-on technical lead building scalable, secure end-to-end data platforms using Spark/Databricks, Python/PySpark, and orchestration tools. Ensure CI/CD, DevOps, automation, code quality, mentor team members, resolve complex technical issues, and collaborate with stakeholders and vendors to drive platform evolution.

Support and optimize large-scale Spark/YARN jobs and storage (S3/EMR). Build job-profiling, cost-analysis, AI-assisted automation, monitoring/alerting (Prometheus, Flink/Spark), and internal ops tooling to improve stability and reduce costs.

Develop, deploy, and maintain LLM pipelines and RAG QA/search systems; design and optimize prompts and multi-agent LLM architectures; operate multi‑GPU/cluster inference; build evaluation pipelines for model quality, bias, and hallucination; collaborate with product and CS teams to integrate conversational AI.

Lead site-based CSA activities for data centre projects: manage contractors, ensure compliance with design, safety and quality, coordinate stakeholders, produce reports, and support project leadership.