Machine vision comes of age in automotive manufacturing applications

Machine vision developments such as 3-D imaging, barcode scanning, and improved traceability are allowing robots to take over operations on the plant floor and allow automotive companies to meet consumer demand for more customized products.

11/29/2017


Image courtesy: Bob Vavra, CFE MediaAutomotive manufacturing has been a leader in the adoption of automation technology, including machine vision and robots—and for good reason. The use of automation has made automobiles more affordable to the masses and significantly safer due to higher-quality construction and advanced automotive systems, many of which wouldn't be possible without the assistance of automation technology.

Given the automotive industry's adoption of automation tech, it's no surprise the number of new applications being automated for the first time isn't driving the adoption of vision and other advanced automation solutions. Instead, growth in the automotive industry comes more from retooling and retrofits to production lines, rather than new applications solved for the first time. Today, integrated vision systems packed with intelligence to simplify their setup and operation are driving vision's penetration into the motor vehicle market, helping the automotive manufacturing industry to achieve new heights in productivity and profitability.

Bumper-to-bumper vision

A list of automotive systems that use vision technology during assembly or quality inspection reads like the table of contents from a service manual, covering every aspect of the automobile from chassis and power trains to safety, electronics, and tire and wheel. In most cases, machine vision is tracking the product through the use of 1-D and 2-D barcodes and performing quality inspections. But it's also helping to assemble the products.

"Most of the applications we're solving today involve material handling, moving parts and racks to assembly lines using either 2-D or 3-D vision," said David Bruce, engineering manager for general industry & automotive segment for Fanuc America. "But the biggest buzz word right now is '3-D.'"

Automotive manufacturing is going away from manual processes. Few remain on the plant floor and robots may be taking those away, too.

"Today, one of the last manual processes on the automotive manufacturing line involves part feeding, getting parts out of bins, and so on," Bruce said. 

In some of the most advanced material handling work cells, one robot with a 3-D sensor picks the parts out of the bin and places them on a table so a second robot with a 2-D vision system can easily pick up the part and feed another machine, conveyor, or other process. Bruce also noted end-of-arm tooling is one of the toughest challenges for bin picking applications; magnets and vacuum work best.

"By having the vision system controller directly integrated with the robot instead of using a PC, the engineers can focus on the mechanical engineering challenges and developing a bin picking system with buffering to make sure acceptable cycle times are achieved," Bruce says.

Tighter integration between vision system and robot also makes it easier for end users to train the work station. "You can take images of the robot in 7, 8, or 10 different poses and the system will guide you through programming. Or if you're looking at a large part that won't fit in the field of view—not uncommon in automotive manufacturing—you can take images from several small fields of view of the part, and the robot controller can determine the full 3-D location of the part."

3-D vision is also enhancing the latest class of robot assembly: lightweight robots, also called collaborative robots due to their low-force operation and ability to work next to humans with minimal safety systems.

While the automotive industry is boosting the number of collaborative vision work cells, "Right now the killer application is kitting," Bruce said. Kitting is the process of collecting parts into a bin for a specific product configuration or assembly.

The path to full traceability

Any kitting or assembly task is only as good as the quality and accuracy of the incoming parts, which is why track-and-trace vision applications are so important to the automotive industry. "Over the last 31 years, the industry average was 1,115 car recalls per every 1,000 sold, according to the National Highway Traffic Safety Administration," said Adam Mull, business development manager machine vision/laser marking for Datalogic. The recall rate can exceed 1,000 because a single car can have more than one recall.

"While we're seeing applications across the board from inspection to vision-guided robotics [VGR], we're definitely seeing a trend toward full traceability," said Bradley Weber, application engineering leader and industry product specialist—manufacturing industry at Datalogic. "There's always been traceability of the most critical components of the car, but now it's going everywhere. Every part is being laser marked or peened, read, and tracked. That's part of what has opened a lot of doors for Datalogic because we have many types of laser markers, vision systems to verify those marks, and then both handheld and fixed barcode readers to read and track those marks all through the process."

According to Mull, while one manufacturing plant used to manufacture only one type of vehicle, today plants either makes parts for multiple vehicles or assembles different vehicles.

Consumer demand is driving the need for more automation in the factory. "When you go to a dealership, there are so many more options than there were years ago, from the color of the dashboard to the onboard electronics," Weber said. "With all those choices, original equipment manufacturers (OEMs) need a strong manufacturing execution system that is being fed data from every part along the manufacturing process."

With machine-readable codes going on more and more components, it also opens up the possibility of reworking problem parts instead of scrapping them.

As automation and machine-to-machine communication continue to blur the lines between robot, vision, marking system, and production equipment, the benefit to the manufacturer is greater ease of use, leading to greater machine vision adoption.

Advanced vision software is aiding new adopters to set up ID, VGR, and inspection routines using simple flow-chart programming and automated sample image acquisition, according to Fabio Perelli, product manager at Matrox Imaging.

Better automation integration is also helping to educate engineers, opening up even more opportunities for vision and other automation solutions.

"In automotive, engineers often work in bubbles," Mull said. "Everyone's running with their own part of the project. But as one system works more closely with another system, the team members start to cross-pollinate, opening up the opportunity to teach the engineer who only knows about smart cameras how to use embedded controllers and advanced vision or marking systems. And since our systems all use the same software environment, it makes it seamless for an engineer to move from smart cameras to embedded controllers to other Datalogic solutions."

Winn Hardin is contributing editor for AIA. This article originally appeared in Vision Online. AIA is a part of the Association for Advancing Automation (A3), a CFE Media content partner. Edited by Chris Vavra, production editor, CFE Media, cvavra@cfemedia.com.



Top Plant
The Top Plant program honors outstanding manufacturing facilities in North America. View the 2017 Top Plant.
Product of the Year
The Product of the Year program recognizes products newly released in the manufacturing industries.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
May 2018
Electrical standards, robots and Lean manufacturing, and how an aluminum packaging plant is helping community growth.
April 2018
2017 Product of the Year winners, retrofitting a press, IMTS and Hannover Messe preview, natural refrigerants, testing steam traps
March 2018
SCCR, 2018 Maintenance study, and VFDs in a washdown environment.
April 2018
ROVs, rigs, and the real time; wellsite valve manifolds; AI on a chip; analytics use for pipelines
February 2018
Focus on power systems, process safety, electrical and power systems, edge computing in the oil & gas industry
December 2017
Product of the Year winners, Pattern recognition, Engineering analytics, Revitalize older pump installations
Spring 2018
Burners for heat-treating furnaces, CHP, dryers, gas humidification, and more
April 2018
Implementing a DCS, stepper motors, intelligent motion control, remote monitoring of irrigation systems
February 2018
Setting internal automation standards

Annual Salary Survey

Before the calendar turned, 2016 already had the makings of a pivotal year for manufacturing, and for the world.

There were the big events for the year, including the United States as Partner Country at Hannover Messe in April and the 2016 International Manufacturing Technology Show in Chicago in September. There's also the matter of the U.S. presidential elections in November, which promise to shape policy in manufacturing for years to come.

But the year started with global economic turmoil, as a slowdown in Chinese manufacturing triggered a worldwide stock hiccup that sent values plummeting. The continued plunge in world oil prices has resulted in a slowdown in exploration and, by extension, the manufacture of exploration equipment.

Read more: 2015 Salary Survey

The Maintenance and Reliability Coach's blog
Maintenance and reliability tips and best practices from the maintenance and reliability coaches at Allied Reliability Group.
One Voice for Manufacturing
The One Voice for Manufacturing blog reports on federal public policy issues impacting the manufacturing sector. One Voice is a joint effort by the National Tooling and Machining...
The Maintenance and Reliability Professionals Blog
The Society for Maintenance and Reliability Professionals an organization devoted...
Machine Safety
Join this ongoing discussion of machine guarding topics, including solutions assessments, regulatory compliance, gap analysis...
Research Analyst Blog
IMS Research, recently acquired by IHS Inc., is a leading independent supplier of market research and consultancy to the global electronics industry.
Marshall on Maintenance
Maintenance is not optional in manufacturing. It’s a profit center, driving productivity and uptime while reducing overall repair costs.
Lachance on CMMS
The Lachance on CMMS blog is about current maintenance topics. Blogger Paul Lachance is president and chief technology officer for Smartware Group.
Maintenance & Safety
The maintenance journey has been a long, slow trek for most manufacturers and has gone from preventive maintenance to predictive maintenance.
Industrial Analytics
This digital report explains how plant engineers and subject matter experts (SME) need support for time series data and its many challenges.
IIoT: Operations & IT
This digital report will explore several aspects of how IIoT will transform manufacturing in the coming years.
Randy Steele
Maintenance Manager; California Oils Corp.
Matthew J. Woo, PE, RCDD, LEED AP BD+C
Associate, Electrical Engineering; Wood Harbinger
Randy Oliver
Control Systems Engineer; Robert Bosch Corp.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
click me