Vision sensing technology in track-and-trace applications

Sensors work with control systems to follow perishable and critical products through manufacturing and distribution.


Figure 1: Barcodes on containers can help identify counterfeit, expired, or adulterated products in the field. Sensors can also spot badly printed or mislocated barcodes during packaging. Courtesy: Banner EngineeringVision sensors are a critical component to an industrial manufacturing process, helping to optimize productivity and improve product quality by detecting faulty parts before they leave the production line. Vision sensors see, analyze, and interpret data in complex visual inspections, including parts verification, gauging, measuring, orientation, flaw detection, and sorting. Vision sensing is especially significant in food manufacturing processes, providing track, trace, and inspection functions to follow a product from initial development to the final packaged result.

Vision sensing (or electronic imaging) provides control to manufacturers over multiple processes from machine tools and robots to product quality and inspection. Starting with a camera, which determines the range of the product features and performance, and a control system that is used to interface the sensors with machine controls, vision sensors allow users to set product-specific parameters for inspection. The inspection process consists of a three-step process: The camera acquires an image of the part; next a processor analyzes the image; and finally, it determines if the inspection passes or fails, reporting the results to the manufacturing line.

Vision sensors are a superior manufacturing detection tool due to their unparalleled abilities to handle high-speed assembly lines, allowing the sensor to inspect products with 100% accuracy. This is in comparison to human inspection capabilities, which at best are approximately 80% accurate. Additionally, vision sensors are able to conduct simultaneous, repetitive, multiple, and consistent inspections on objects (same or differing), providing reliable results for complex detection needs. With their user-friendly, easy-to-install application, enhanced functionality, plus reliable communication to operation devices, today’s vision sensors offer a nearly universal vision solution, delivering cost-effective, powerful, and controlled vision capabilities for manufacturers.

Beyond presence detection

Vision sensors are inspection tools using and interpreting light (or the absence of it) to control machines and processes for product detection. Unlike traditional photoelectric sensors’ simplistic operation of presence detection, vision sensors can also analyze the color, shape, size, or position of an object’s feature. Vision sensors do not rely on the object to trigger inspection, but instead use dedicated light to illuminate and capture the entire image for complete visual feedback. A single vision sensor can inspect multiple points on an object, reducing equipment requirements while gaining expanded range. The vision sensor “sees” an area, and senses many thousands of distinct points (or pixels) in the specified area. Further, users can change the lens of the sensor, making the field of view smaller or larger, to obtain accurate detail, even at a microscopic level if needed. Upon image capture, the vision sensor provides a binary output with enhanced communication capabilities, allowing users to send large amounts of data about an object’s parts or features serially or via computer protocols such as Ethernet. This enables data to be communicated to the entire manufacturing enterprise.

For example, in food manufacturing processes, a vision sensor can verify the correct label on the food product’s packaging by reading the 2D Datamatrix barcode or matching the pattern on the label. This not only prevents incorrect cartons or packaging from being added to a product, but also effectively tracks and traces the product throughout the entire manufacturing process. In addition, a vision sensor can verify that the date and lot code are printed legibly, ensuring the correct range of products are easily identified if a recall occurs. 

Enhancing communication

Figure 2: Information from inspections during manufacturing can be incorporated into the complete history file for a given product or manufacturing lot. Courtesy: Banner EngineeringMost vision sensors have multiple communication methods to interface with the control system, ranging from simple discrete I/O to serial communication to Ethernet. Discrete I/O is used for parts of the system that require higher speeds or simple controls, such as trigger or pass-and-fail outputs. Serial and Ethernet communications are used for data transfer and system information, including pattern names, pass/fail counts, and program selection. When high-speed communication is necessary, such as when exporting images, Ethernet is the primary method.

Ethernet connectivity provides ease of configuration and networking capabilities in manufacturing processes. With the advent of standard industrial protocols over Ethernet, vision sensors have the ability to exchange input and output data directly to PLCS, HMIs, or alternative factory devices with minimal programming of commands, allowing operators to retrieve data quickly and easily. For example, users can access valuable inspection data such as inspection time, pass/fail status, system error, trigger (or mis-trigger), ready signal, and additional inspection data directly from the factory device. Additionally, data used for authentication can be remotely accessed and updated, including up-to-the-minute pattern variations providing unparalleled control over production. In barcode applications, Ethernet communication also permits the reference barcode value to be uploaded automatically into the sensor.

Improving inspection

Recent advancements have improved the ease of use of vision sensors. Advances in touchscreen capabilities and inspection algorithms have allowed sophisticated sensors to break free from the PC, eliminating the need for cables. For example, some vision sensors feature inspection tools like match, blemish, sort, and barcode readings that are powerful, yet simple to configure. Installation and configuration is easier using menu-driven tools that guide users through selecting specific inspection designations for each product. This allows a plant technician to configure an inspection step to sort between multiple products without the need to bring a laptop to the manufacturing line. With some advanced vision sensors capable of storing up to 100 inspections at a time, working with high-speed assembly lines and rapid product changeover is simple. Configuration and testing can be done remotely using a sensor emulator, which allows offline updates and modifications, shortening setup time on actual production equipment.

Vision sensors now offer remote monitoring possibilities, pairing a sensor and separate touch screen to support inspection capabilities in difficult-to-monitor areas. Once vision sensors have been installed, users can operate the remote features to configure, monitor, and update inspection requirements for all vision sensors, providing a new comprehensiveness to product inspection. 

For food manufacturing and other washdown environments, vision sensors can be provided with enclosures of IP67 ratings or greater in plastic or stainless steel to accommodate harsh conditions.

Field applications

Figure 3: Sensor units that incorporate a touch screen allow operators to adjust the configuration or programming at the device without a computer. Courtesy: Banner EngineeringVision sensors can perform specialized functions in food packaging and distribution applications, ranging from reading barcodes on cartons to verifying packaging labels. For example, many food operations require a date/lot code to be present on the packaging. To verify each package has that information printed on it, a vision sensor can use a match inspection function, which captures an image of the date/lot code. When the inspection is running, if the sensor detects a package without the code, the sensor sends a fail output to the control system, which tells the line to reject the project. This ensures the correct range of products is easily identified if a recall occurs. 

Track-and-trace functions are also crucial for ensuring product authenticity. For instance, a vision sensor can effectively inspect and authenticate wine bottles through barcode readings. A vision sensor first reads the 2D Datamatrix codes, typically printed on the bottles’ labels. The scanned information is then either inspected by the vision sensor’s internal data comparison tool or sent externally to a remote secure database. If a barcode is misapplied for that product, is not recognized by the system, or suggests a possible counterfeit, the product is rejected and quarantined for investigation. Vision sensors configured with 2D Datamatrix barcode reading capability are commonly used to read and verify 2D Datamatrix barcodes to track and trace products in the manufacturing process and throughout the distribution infrastructure.  

As vision sensing technology continues to develop, manufacturing processes will experience significantly improved error-proofing and productivity, creating a product that is not only of the highest quality, but also meets the most critical industry expectations.

Mark Lampert and Steve Wong are business development managers for Banner Engineering.

The Top Plant program honors outstanding manufacturing facilities in North America. View the 2017 Top Plant.
The Product of the Year program recognizes products newly released in the manufacturing industries.
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
2017 Top Plant winner, Best practices, Plant Engineering at 70, Top 10 stories of 2017
Pipe fabrication and IIoT; 2017 Product of the Year finalists
The future of electrical safety; Four keys to RPM success; Picking the right weld fume option
Product of the Year winners, Pattern recognition, Engineering analytics, Revitalize older pump installations
Control room technology innovation; Practical approaches to corrosion protection; Pipeline regulator revises quality programs
The cloud, mobility, and remote operations; SCADA and contextual mobility; Custom UPS empowering a secure pipeline
Knowing how and when to use parallel generators
PID controllers, Solar-powered SCADA, Using 80 GHz radar sensors
Natural gas engines; New applications for fuel cells; Large engines become more efficient; Extending boiler life

Annual Salary Survey

Before the calendar turned, 2016 already had the makings of a pivotal year for manufacturing, and for the world.

There were the big events for the year, including the United States as Partner Country at Hannover Messe in April and the 2016 International Manufacturing Technology Show in Chicago in September. There's also the matter of the U.S. presidential elections in November, which promise to shape policy in manufacturing for years to come.

But the year started with global economic turmoil, as a slowdown in Chinese manufacturing triggered a worldwide stock hiccup that sent values plummeting. The continued plunge in world oil prices has resulted in a slowdown in exploration and, by extension, the manufacture of exploration equipment.

Read more: 2015 Salary Survey

Maintenance and reliability tips and best practices from the maintenance and reliability coaches at Allied Reliability Group.
The One Voice for Manufacturing blog reports on federal public policy issues impacting the manufacturing sector. One Voice is a joint effort by the National Tooling and Machining...
The Society for Maintenance and Reliability Professionals an organization devoted...
Join this ongoing discussion of machine guarding topics, including solutions assessments, regulatory compliance, gap analysis...
IMS Research, recently acquired by IHS Inc., is a leading independent supplier of market research and consultancy to the global electronics industry.
Maintenance is not optional in manufacturing. It’s a profit center, driving productivity and uptime while reducing overall repair costs.
The Lachance on CMMS blog is about current maintenance topics. Blogger Paul Lachance is president and chief technology officer for Smartware Group.
The maintenance journey has been a long, slow trek for most manufacturers and has gone from preventive maintenance to predictive maintenance.
This digital report explains how plant engineers and subject matter experts (SME) need support for time series data and its many challenges.
This digital report will explore several aspects of how IIoT will transform manufacturing in the coming years.
Maintenance Manager; California Oils Corp.
Associate, Electrical Engineering; Wood Harbinger
Control Systems Engineer; Robert Bosch Corp.
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
click me