Senior Computer Vision/Machine Learning Engineer, Digital Twin Platform

Posted 2 Days Ago
Be an Early Applicant
Tokyo, JPN
Hybrid
Senior level
Automotive • Software • Automation
The Role
Design, train, optimize, and deploy deep learning models for object detection, tracking, classification, and activity recognition in industrial environments. Lead dataset strategy, annotation, evaluation, architecture, and real-time inference pipelines. Drive the technical roadmap, establish engineering standards, make architectural decisions, and mentor engineers while delivering production computer vision and machine learning systems.
Summary Generated by Built In
About Woven by Toyota
Woven by Toyota is enabling Toyota’s once-in-a-century transformation into a mobility company. Inspired by a legacy of innovating for the benefit of others, our mission is to challenge the current state of mobility through human-centric innovation — expanding what “mobility” means and how it serves society.

Our work centers on four pillars: AD/ADAS, our autonomous driving and advanced driver assist technologies; Arene, our software development platform for software-defined vehicles; Woven City, a test course for mobility; and Cloud & AI, the digital infrastructure powering our collaborative foundation. Business-critical functions empower these teams to execute, and together, we’re working toward one bold goal: a world with zero accidents and enhanced well-being for all.

=========================================================================

TEAM

    Toyota is redefining what it means to move. We're challenging the current state of mobility by enhancing the movement of people, goods, information and energy. Centered around three core concepts - A Living Laboratory™, Human-Centered, and Ever Evolving City™ - Woven City serves as a test course for mobility to fulfill our purpose of well-being for all.

    We do this by bringing together a diverse community of people with a shared passion for the future of mobility to co-create, develop and refine innovative products and services. This cross-section of social infrastructure, mobility, and people provides a unique opportunity for inventors, residents and visitors to interact seamlessly with new technologies throughout daily life in an environment that emulates a real city.

    Our team, Digital Twin Platform, as one of the core Social Infrastructure/Common Platform teams under the Woven City umbrella, is responsible for the realization of Woven City's vision: "Expand mobility. Enhance humanity. Engage society" by developing a robust software platform, on one hand to enable inventors and business owners to “test” their products in a virtual environment before deploying to the physical Woven City; on the other hand, to create analytics to assist in decision making based on both simulated results and more importantly operational data collected from the physical city, such as residents daily life, traffic dynamics, energy consumption, etc.
    As the Digital Twin Platform is still in its early growth phase, you'll have the rare chance to influence not just what we build but how we bring it to market and experiment with different business models as the platform and its commercial strategy mature together.

    For more information about Woven City, please visit: https://www.woven-city.global/

WHO ARE WE LOOKING FOR?

    We’re looking for a Senior Computer Vision and Machine Learning Engineer who can go beyond integrating pre-built APIs and off-the-shelf pipelines. You’ll design, train, evaluate, and optimize models at a deep technical level, applying them to real-world challenges across logistics hubs, distribution centers, and factories.
    As a Senior Engineer, you’ll be expected to lead technical direction, define standards, and operate with a high degree of autonomy. You will shape how the team approaches hard problems, influence architecture across the CV/ML stack, and help grow the engineers around you.
    Your work may include detecting and tracking workers, vehicles, and packages; analyzing space utilization; and interpreting worker activity to identify productive workflows and operational inefficiencies. We value candidates with a strong research background, including PhD-level expertise in a relevant field. However, a PhD is not required, we also welcome engineers with substantial applied experience and a comparable level of technical rigor.

    You’ll join a small, high-ownership team where your technical judgment will directly shape both the product’s direction and its real-world impact.

RESPONSIBILITIES

  • Design, train, and optimize deep learning models for object detection, multi-object tracking, classification, and activity recognition in industrial environments
  • Build and maintain real-time computer vision inference pipelines and analytics systems deployed across logistics, distribution, and factory operations
  • Lead dataset strategy, annotation standards, model evaluation, and experimentation to continuously improve CV/ML performance and reliability
  • Define and drive the technical roadmap, architecture, and integration strategy for CV/ML systems within the broader platform ecosystem
  • Establish engineering best practices and mentor engineers through technical leadership, design reviews, and adoption of state-of-the-art CV/ML advances

MINIMUM QUALIFICATIONS

  • At least a bachelor’s degree in a relevant field and 7+ years of hands-on CV/ML engineering experience, or a PhD in a relevant field plus 5+ years of applied experience
  • Hands-on experience in model design, training, and hyperparameter tuning, with strong proficiency in PyTorch or TensorFlow
  • Experience leading the development of scalable perception pipelines, including state-of-the-art object detection and multi-object tracking systems, with strong understanding of model trade-offs, data quality strategy, evaluation methodology, and real-world deployment constraints
  • Proven track record of delivering complex CV/ML systems end-to-end in production environments
  • Demonstrated ability to lead technical projects, drive architectural decisions, and influence engineering direction
  • Solid understanding of classical computer vision geometry - camera intrinsics/extrinsics, calibration, and 3D reconstruction fundamentals
  • Strong English communication skills - written and verbal

NICE TO HAVES

  • PhD in Computer Vision, Machine Learning, or a closely related field
  • Experience with human pose estimation, skeleton-based action recognition, or temporal activity recognition in video
  • Familiarity with edge inference optimization: TensorRT, ONNX export, quantization, or pruning
  • Experience with 3D sensing modalities such as LiDAR, depth cameras, or multi-camera calibration and fusion
  • Background working in industrial, logistics, or warehouse environments
  • Experience with space utilization analysis, occupancy estimation, or pedestrian/vehicle flow analysis
  • Hands-on experience building video annotation pipelines or active learning loops
  • Publications in top-tier CV/ML conferences (e.g., CVPR, ECCV, ICCV, NeurIPS, or similar)
  • Experience with Vision-Language Models (VLMs) or agentic system design
  • Hands-on experience with cloud platforms (AWS, GCP) for ML workloads

=========================================================================
Important Points
・All interviews will be arranged via Google Meet, unless otherwise stated.
・The same job descriptions are available in both English and Japanese; therefore, we kindly ask that you apply to only one version.
・We kindly request that you submit your resume in English, if possible. However, Japanese resumes are also acceptable. Please note that, depending on the English proficiency requirements of the role, we may request an English version of your resume later in the process.

WHAT WE OFFER
・Competitive Salary - Based on experience
・Work Hours - Flexible working time
・Paid Holiday - 20 days per year (prorated)
・Sick Leave - 6 days per year (prorated)
・Holiday - Sat & Sun, Japanese National Holidays, and other days defined by our company
・Japanese Social Insurance - Health Insurance, Pension, Workers’ Comp, and Unemployment Insurance, Long-term care insurance
・Housing Allowance
・Retirement Benefits
・Rental Cars Support
・In-house Training Program (software study/language study)

Our Commitment
・We are an equal opportunity employer and value diversity.
・Any information we receive from you will be used only in the hiring and onboarding process. Please see our privacy notice for more details.

Skills Required

  • Bachelor's degree in a relevant field with 7+ years of hands-on computer vision or machine learning engineering experience, or a relevant PhD with 5+ years of applied experience
  • Hands-on experience designing models, training, and hyperparameter tuning
  • Strong proficiency in PyTorch or TensorFlow
  • Experience developing scalable perception pipelines using object detection and multi-object tracking systems
  • Strong understanding of model trade-offs, data quality strategy, evaluation methodology, and real-world deployment constraints
  • Proven experience delivering complex computer vision or machine learning systems end-to-end in production
  • Ability to lead technical projects, drive architectural decisions, and influence engineering direction
  • Understanding of camera intrinsics, camera extrinsics, calibration, and 3D reconstruction fundamentals
  • Strong written and verbal English communication skills
  • PhD in Computer Vision, Machine Learning, or a closely related field
  • Experience with human pose estimation, skeleton-based action recognition, or temporal activity recognition
  • Experience with edge inference optimization, including TensorRT, ONNX export, quantization, or pruning
  • Experience with LiDAR, depth cameras, or multi-camera calibration and fusion
  • Industrial, logistics, or warehouse experience
  • Experience with space utilization analysis, occupancy estimation, or pedestrian and vehicle flow analysis
  • Experience building video annotation pipelines or active learning loops
  • Publications in top-tier computer vision or machine learning conferences
  • Experience with Vision-Language Models or agentic system design
  • Hands-on experience with AWS or GCP for machine learning workloads
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Tokyo, Chuo-ku
1,679 Employees
Year Founded: 2023

What We Do

Woven by Toyota will help to deliver the safest, most intelligent mobility experiences and lifestyle for Toyota customers everywhere. At Woven by Toyota, we envision a human-centered future, where world-class technology expands global access to mobility, enhances the capabilities of drivers, and empowers people to thrive. We achieve this with a unique global culture that weaves modern Silicon Valley innovation with Japanese quality craftsmanship. As society, technology and customer needs evolve, we continuously pursue new ways to create a more personal, seamless experience for customers.

Similar Jobs

Flatiron Health Logo Flatiron Health

Data Scientist

Healthtech • Software • Biotech • Pharmaceutical
Hybrid
Tokyo, JPN
2500 Employees

Tulip Logo Tulip

Solutions Engineer

Enterprise Web • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
Japan
310 Employees

Rokt Logo Rokt

Business Development Manager

Artificial Intelligence • Digital Media • eCommerce • Marketing Tech • Software • Automation
In-Office
Tokyo, JPN
800 Employees
10M-26M Annually

CrowdStrike Logo CrowdStrike

Sales Development Representative

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Hybrid
Tokyo, JPN
11000 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account