Just in the last few years, advances in machine vision have helped many robots and autonomous vehicles achieve almost human-like levels of perception. Using a myriad of optic sensors, like high-resolution cameras, these robots and cars, in their own way, are finally able to see.
What Is Machine Vision?
What Is Machine Vision?
Machine vision is the technology that enables robots and other machines like autonomous vehicles to see and recognize objects in their surrounding environment. By pairing optic sensors with artificial intelligence and machine learning tools that can analyze and process image data, robots and autonomous vehicles equipped with machine vision systems are able to perform more complex tasks, like pulling orders in a warehouse or navigating downtown traffic.
As prices of cameras have fallen, computing power has increased and algorithms have matured, machine vision has helped robotics emerge from what Tom Hummel, vice president of technology at Rapid Robotics, described as a statically programmed state. Thanks to recent advances in deep learning, which allows robots to actually analyze what they’re seeing, robots are able to complete tasks that once seemed impossible or too cost-prohibitive, like picking specific items out of a bin, Hummel said.
How Does Machine Vision Work?
Most machine vision systems require a light source, either mounted directly on the robot or set up within the facility where it operates, so the camera (or cameras), used can clearly capture objects, humans, potential hazards and other features within its surroundings.
Once the robot captures images, that visual data is sent to a processor or onboard computer that analyzes the images using artificial intelligence and machine learning algorithms, often along with data collected from other sensing modalities like LiDAR, radar and microphones, too.
After the images and other data are processed, that information is communicated back to the robot or other machines working alongside it. From there, the machines can make appropriate decisions, whether that’s stopping at a crosswalk or picking the right item for an order, which improves efficiency and safety.
Components of Machine Vision
Components of machine vision include:
- Lighting. With the proper lighting in place, machine vision can analyze and inspect objects more quickly.
- Staging. A staging apparatus is required to hold an object in place long enough for machine vision to create and process an image of the object.
- Lenses. A camera lens captures light reflected from an object and sends this visual data to optic sensors, which convert the light into pixels.
- Cameras. The camera itself contains the optic sensors, which first transform light into electrical signals and then digitize them in the form of pixels.
Types of Machine Vision
There are three main types of machine vision:
- One-Dimensional Vision. 1D vision doesn’t analyze the image of an entire object at once, but reads it one line at a time, often using a line-scan camera. This type of machine vision is typically used in inspection processes to spot defects in products moving on a conveyor.
- Two-Dimensional Vision. 2D vision uses a digital camera to collect image data, which is then processed by comparing contrast variations from one image to another. This type of machine vision is often used to track objects, as well as verification and inspection.
- Three-Dimensional Vision. 3D vision uses multiple digital cameras and other sensors in various locations to capture a digital model of an object, which provides an accurate assessment of its location, size and features. This type of machine vision is typically used to help robots navigate their surroundings as well perform order fulfillment tasks.
Machine Vision Applications
From self-driving taxis to robotic arms, machine vision is powering a number of new technologies in the manufacturing, automotive and logistics industries.
Machine Vision Applications
- Inspects parts to improve quality control.
- Allows self-driving cars to perceive the world around them.
- Helps robots locate products and navigate warehouses.
Machine Vision Improves Quality Control for Manufacturers
When humans inspect parts coming off an assembly line, they don’t typically scrutinize each one looking for defects. It would take too much time, too much money and require a level of focus humans just don’t have, Hummel told Built In.
But a robot arm equipped with a machine vision system, like Rapid Robotics’ Rapid Machine Operator, can inspect each one. “The camera doesn’t sleep. The camera doesn’t care. And the camera’s fast,” Hummel said. “So you can check every part that comes out of that injection molder, or comes out of any process, and decide to discard it.”
As a result, factories are less likely to ship out bad parts and operators have a better understanding of the quality of the products they’re producing.
Machine Vision Guides Self-Driving Taxis
Just before a pedestrian crosses a street, they often hint at what they’re going to do right before their foot even steps into the crosswalk. Recognizing those cues is one of the strengths of machine vision and where the technology shines.
Using artificial intelligence and machine learning algorithms alongside cameras and other sensing modalities like LiDAR, radar and thermal cameras, Zoox’s electric self-driving cars are able to see and interact with the world around them. The cars, which are being tested in the San Francisco Bay Area, Las Vegas and Seattle, can even predict what nearby cars, trucks, cyclists and pedestrians may or may not do, like a person stepping into a roadway.
“The magic happens when you are very thoughtful about how you use the individual sensing modalities and how they complement each other,” said RJ He, director of perception at Zoox, a robotaxi company owned by Amazon. “Both in terms of things like field of view and coverage, but more importantly, the algorithmic aspect of things.”
By leveraging individual strengths of machine vision and all these different sensor modalities and algorithms, Zoox is able to create an accurate representation of the world their cars can respond to in real time, without harming or inconveniencing their passengers or the other people and living things around them.
Machine Vision Helps Robots Fulfill Orders
While many robotics companies working in the logistics industry rely on LiDAR to help their robots navigate warehouses and fulfill orders, inVia Robotics relies on machine vision instead.
According to inVia’s CEO and co-founder, Lior Elazary, the company’s robots use machine vision to operate inside warehouses, pulling products for e-commerce orders by scanning AprilTags, which Elazary describes as QR codes affixed to containers. A robot analyzes the code it captures, which allows it to understand what it’s looking at.
The machine vision systems are also trained inside the warehouse where it collects and captures surrounding features that are analyzed using algorithms to essentially form what Elazary referred to as the “hypothesis” of where the robot is located within the warehouse as well as the container or bin it needs to pull from. It uses visual servoing, which controls the robot’s motion and allows it to grab an object much like a human would.
“Ultimately, we go and grab things with our eyes — you see where it is, and you home in,” Elazary said. “And that’s what our robots do.”
Benefits of Machine Vision
Industries have adopted machine vision because it offers a range of advantages, including:
- Higher Consistency. Machine vision doesn’t get tired or commit human errors, improving consistency and product quality.
- Increased Efficiency. Not making errors like miscounting means machine vision can perform tasks at a faster pace with fewer mistakes, boosting efficiency.
- Reduced Costs. By eliminating excessive labor and wasted materials, machine vision can lower costs for businesses.
- Less Downtime. Machine vision systems don’t physically touch products, lessening the chances of equipment damage and wear and tear.
- Safer Working Conditions. Machine vision can take on manual labor, keeping humans out of harm’s way.
Machine Vision vs. Computer Vision
While the terms machine vision and computer vision are often used interchangeably, they do come with some differences. Essentially, machine vision is the eye, while computer vision is the brain.
Machine vision systems:
- require cameras to capture and provide image data;
- only look for individual elements within an image;
- are trained to perform specific tasks;
- can be used for quality assurance, sorting and pattern detection.
Computer vision systems:
- can be fed images from other sources (like the internet);
- analyze the entire image;
- are where the AI and machine learning algorithms live that process that visual data;
- can be used for safety compliance, object or facial recognition and augmented reality.
Machine Vision Companies
While enabling autonomous vehicles and other robots to see, machine vision systems are most often used in applications like inspection and quality assurance. Here are a few companies developing machine vision technology for use in manufacturing, logistics and more.
3D Infotech is an industrial automation company specializing in universal metrology, essentially a precision measurement application, for the aerospace, automotive and electronics industries. The company’s In-Sight machine vision software system, which uses cameras from Cognex, employs deep learning algorithms for industrial applications in factories like inspection and assembly verification of parts and kits.
Cognex develops machine vision sensors and 2D and 3D machine vision systems that are used to inspect and identify parts in industrial settings. The company’s In-Sight 3D-L4000 machine vision system pairs 3D laser displacement technology with a smart camera to capture better images for inspection applications.
The U.K.-based company, Industrial Vision, develops machine vision sensors and systems for use in the pharmaceutical and automotive industries, among others. In the aerospace industry, the company’s machine vision cameras inspect heads-up displays, a transparent screen in fighter jets that shows important data, ensuring screws and bolts are in place, as well as performing pass and fail inspections.
Stemmer Imaging’s machine vision systems are used in applications ranging from logistics to agriculture. The company is providing systems that can automate harvesting tasks, detect invasive plants and single out infected produce, among other services within the food and agriculture industry. Stemmer is also enabling cobots to work in the automotive industry with 3D machine vision systems, which help them pick and place parts and materials onto conveyor belts and pallets.
VAIA Technologies recently developed a robotic knife sharpening system for a knife manufacturer that utilizes 3D machine vision for inspection, enabling the system to sharpen knives in less than 30 seconds and at a rate of 3,000 per day. The company’s other machine vision inspection systems are used for label verification and ensuring tamper-evident caps are properly applied in packaging applications.
Frequently Asked Questions
What is machine vision?
Machine vision enables robots to process visual data and recognize objects. By combining AI and machine learning with optic sensors, machine vision gives robots the ability to perform tasks like sorting items, handling products and counting inventory.
Is machine vision the same as computer vision?
While machine vision and computer vision are similar, the two remain distinct technologies. Machine vision uses algorithms that are trained to pick out specific elements in images. Computer vision, on the other hand, analyzes entire images and can be fed training data to learn how to perform tasks like humans. In this sense, machine vision acts as the eyes of robots while computer vision serves as the brain.