TEAM
The Vehicle Perception team at Woven by Toyota tackles the core challenges of machine learning for 3D perception, sensor fusion, and computer vision in autonomous vehicles. Our work involves a variety of challenges, such as analyzing petabytes of multimodal driving data, solving optimization problems in computer vision, minimizing latency on hardware accelerators, deploying scalable and efficient machine learning (ML) training and evaluation pipelines, and designing novel neural network architectures to advance state-of-the-art ML for onboard perception. We are looking for doers and creative problem solvers to join us in improving mobility for everyone with human-centered automated driving solutions for personal and commercial applications.
WHO ARE WE LOOKING FOR?
The team is looking for a skilled Machine Learning Engineer to help advance a cutting-edge machine learning system for perception foundation models leveraging large-scale multimodal sensor data. You will have the chance to design and implement innovative machine learning models for our next-generation autonomous vehicle platform, influencing millions of Toyota production vehicles. We are looking for individuals who are passionate about self-driving car technology and its potential impact on humanity. Furthermore, we highly value candidates who exhibit a "giver" mindset, consistently seeking opportunities to assist their colleagues while maintaining a strong focus on delivering solutions to production.
RESPONSIBILITIES
Lead / influence the design and development of perception foundation models for autonomous vehicles, unifying diverse sensor data for scalable 3D scene understanding
Design and develop advanced perception models for the autonomy stack, utilizing deep learning and large-scale data analysis.
Deploy scalable and efficient ML models on our autonomous vehicle platform.
Integrate modern technologies with rigorous safety standards while maintaining cost efficiency.
Significantly contribute to development of needed components for end-to-end ML training and deployment, from data strategy to optimization and validation.
Be a champion of the scientific method and critical thinking in inventing state-of-the-art deep learning solutions
Work in a high-velocity environment and employ agile development practices.
Collaborate closely with teams such as Perception, Motion Planning, Simulation, Infrastructure, and Tooling to drive unified solutions.
Work in a hybrid workspace, with the requirement to be present in our Nihonbashi (Japan), Palo Alto (California), or Ann Arbor (Michigan) offices three days per week.
MINIMUM QUALIFICATIONS
MS or PhD in Machine Learning, Computer Vision, Robotics or related quantitative fields, or equivalent industry experience.
Experience with Python, any major deep learning framework, and software engineering best practices
Experience with deep learning approaches such as supervised/unsupervised learning, transfer learning, multi-task learning, and/or deep reinforcement learning.
Experience covering machine learning workflows, data sampling and curation, pre-processing, model training, ablation studies, evaluation, deployment, and inference optimization.
Experience working with large-scale foundation models, including pretraining, multimodal architectures, self-supervised learning approaches.
Deep understanding of runtime complexity, distributed/cloud ML infrastructure, data pipeline architecture,resource-aware optimization.
Comfortable in writing C++ code to help integrate with our autonomous vehicle platform.
Strong leadership skills to influence others and the team's technical strategy.
Strong communication skills with the ability to communicate concepts clearly and precisely.
Your base salary is one part of your total compensation. We offer a base salary, short term and long term incentives, and a comprehensive benefits package. The total compensation offered to an employee will be dependent upon the individual's skills, experience, qualifications, location, and level.
Skills Required
- MS or PhD in Machine Learning, Computer Vision, Robotics, or a related quantitative field, or equivalent industry experience
- Experience with Python, a major deep learning framework, and software engineering best practices
- Experience with supervised or unsupervised learning, transfer learning, multi-task learning, and/or deep reinforcement learning
- Experience across machine learning workflows, including data sampling and curation, preprocessing, model training, ablation studies, evaluation, deployment, and inference optimization
- Experience with large-scale foundation models, pretraining, multimodal architectures, and self-supervised learning
- Deep understanding of runtime complexity, distributed or cloud ML infrastructure, data pipeline architecture, and resource-aware optimization
- Ability to write C++ code for integration with an autonomous vehicle platform
- Strong leadership skills to influence others and technical strategy
- Strong communication skills and ability to communicate concepts clearly and precisely
- Ability to work in a hybrid workspace three days per week at the Nihonbashi, Palo Alto, or Ann Arbor office
What We Do
Woven by Toyota will help to deliver the safest, most intelligent mobility experiences and lifestyle for Toyota customers everywhere. At Woven by Toyota, we envision a human-centered future, where world-class technology expands global access to mobility, enhances the capabilities of drivers, and empowers people to thrive. We achieve this with a unique global culture that weaves modern Silicon Valley innovation with Japanese quality craftsmanship. As society, technology and customer needs evolve, we continuously pursue new ways to create a more personal, seamless experience for customers.
