Technology Update: Computer vision systems get help from board-level systems

PCI Express (PCIe) has multiple gigabits/second of bandwidth and deterministic behavior, well suited for use with a computer vision system frame-grabber; it can capture high-resolution and high-frame-rate image streams for more effective machine vision applications. See table, graphics.


Traditional computer vision systems consist of a desktop PC with a plug-in PCI Express (PCIe)-based frame grabber card. The frame grabber captures images from attached camera streams and forwards them on the PCIe bus to the PC for image processing. Frame grabbers can be found in a variety of flavors for interfacing to analog and digital cameras, with popular digital camera types, such as CameraLink, IEEE 1394; and GigE Vision.

Figure 1. Benchmarks are shown for low-level OpenCV functions on Texas Instruments’ TMS320C6A81x C6-Integra DSP + ARM processor. Courtesy: TI

PCIe’s multiple gigabits/second of bandwidth and deterministic behavior is particularly useful for a frame-grabber’s PC bus, with the ability to capture high-resolution and high-frame-rate image streams.

While PC-based computer vision systems are still being widely deployed, many original equipment manufacturers (OEMs) are moving to embedded computer vision systems that provide several advantages over PC-based systems in the areas of ruggedness, portability, and power consumption. The latest embedded vision systems are powered by ARM processors and digital signal processors (DSPs) that run at frequencies up to, and in some cases beyond, 1.0 GHz to enable processing of sophisticated vision algorithms.

The latest generation of embedded processors excels in processing vision algorithms and features a highly integrated peripheral set, including camera and video ports for interfacing to image sensors and video decoders. Built-in camera and video ports can serve as integrated frame grabbers, eliminating the need for a traditional PCIe-based frame grabber plug-in card in the system.

Even though a PCIe-based frame grabber plug-in card is not required, developers have found alternative applications for the PCIe interface in these new embedded vision systems. The most prevalent of these applications is in the area processor intercommunication. Many of today’s embedded vision systems are powered by two or more specialized embedded processing ICs such as:

  • An ARM-based processor for running a high-level operating system (OS) like Linux, Google Android, or Microsoft Windows Embedded CE, controlling the system and providing the networking and display capabilities
  • A field-programmable gate array (FPGA) for image preprocessing
  • A DSP for accelerating the vision algorithms (Figure 1 shows the performance improvement that can be achieved by using a DSP to offload sample real-time image processing functions from the popular open computer vision (OpenCV) library.)
  • 3D graphics processors for accelerating advanced graphical user interface (GUI) rendering. 

When each of the processors in the system has a PCIe interface, a PCIe switch can be used to enable high-bandwidth, low-latency communication between them. Select PCIe switches even provide two root complex ports that allow a backup master processor, such as the ARM above, to be quickly switched into the system if the primary master processor experiences a failure. Figure 2 illustrates how the various processors in an embedded vision system can be interconnected via a PCIe switch.

Figure 2. PCIe enables multiprocessing in embedded vision systems. Courtesy: TI

Some IC vendors have even gone so far as to integrate the ARM processor, DSP, image preprocessor, and graphics processor into a single system-on-chip (SoC). An example of this is the aforementioned C6A81x C6-Integra DSP + ARM processor.

PCIe serves another important role in such highly integrated SoCs in the form of providing an expansion port, or bridge, to emerging interconnect technologies such as 10 Gigabit Ethernet, Super Speed USB (USB3), and SATA 6 Gbit/s. These PCIe bridges give the SoC access to input/output (I/O) technologies that were not mature enough to be integrated into the SoC during its development. In essence, the PCIe bus acts to future-proof the I/O capabilities of the SoC. Figure 3 illustrates how PCIe bridges can be used to expand the I/O capability of an embedded vision system. 

Figure 3. PCIe provides I/O expansion in embedded vision systems. Courtesy: TI

Just as its role in computer vision systems is evolving, PCIe as a technology continues to evolve. PCIe in embedded systems today is primarily dominated by PCIe 1.x implementations, with the latest devices from major IC vendors providing PCIe 2.x implementations. In November 2010, PCI-SIG made available the specification for a PCIe 3.0 interconnect that roughly doubles the bandwidth of PCIe 2.x implementations. This increase in bandwidth will provide several important benefits for embedded vision systems that integrate PCIe 3.0.

PCIe 3.0 will enable higher throughput between individual ICs in an embedded vision system that employs multiprocessing, allowing these systems to handle even higher resolutions/frame rates and a larger number of concurrent image streams. For systems that do not necessarily require higher throughput, PCIe 3.0 will allow processers to achieve similar bandwidth to PCIe 2.0 using fewer data lanes. This can be especially helpful since today’s embedded processors are becoming increasingly pin constrained.

Finally, processors with PCIe 3.0 ports will provide embedded vision systems with an interface to bridge to the next generation of multigigabit camera communication protocols, similar in function to the PCIe-based plug-in card frame grabbers of today.

A parallel evolution of PCIe is its inclusion in the new Thunderbolt technology, developed by Intel in collaboration with Apple, which combines PCIe and DisplayPort into one cable connection from a computer. As Thunderbolt becomes more prevalent, embedded vision systems will include Thunderbolt-to-PCIe bridges to enable high-bandwidth connections to a nearby computer. This is another example of how PCIe takes on a new role in computer vision by providing a bridge between the PC world and the embedded vision world.

- Brad Cobb is system applications engineer, Texas Instruments; Edited by Mark T. Hoske, CFE Media, Control Engineering, 


IEEE 1394 

GigE Vision 

Control Engineering machine vision articles

The Top Plant program honors outstanding manufacturing facilities in North America. View the 2015 Top Plant.
The Product of the Year program recognizes products newly released in the manufacturing industries.
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
Doubling down on digital manufacturing; Data driving predictive maintenance; Electric motors and generators; Rewarding operational improvement
2017 Lubrication Guide; Software tools; Microgrids and energy strategies; Use robots effectively
Prescriptive maintenance; Hannover Messe 2017 recap; Reduce welding errors
The cloud, mobility, and remote operations; SCADA and contextual mobility; Custom UPS empowering a secure pipeline
Infrastructure for natural gas expansion; Artificial lift methods; Disruptive technology and fugitive gas emissions
Mobility as the means to offshore innovation; Preventing another Deepwater Horizon; ROVs as subsea robots; SCADA and the radio spectrum
Research team developing Tesla coil designs; Implementing wireless process sensing
Commissioning electrical systems; Designing emergency and standby generator systems; Paralleling switchgear generator systems
Natural gas engines; New applications for fuel cells; Large engines become more efficient; Extending boiler life

Annual Salary Survey

Before the calendar turned, 2016 already had the makings of a pivotal year for manufacturing, and for the world.

There were the big events for the year, including the United States as Partner Country at Hannover Messe in April and the 2016 International Manufacturing Technology Show in Chicago in September. There's also the matter of the U.S. presidential elections in November, which promise to shape policy in manufacturing for years to come.

But the year started with global economic turmoil, as a slowdown in Chinese manufacturing triggered a worldwide stock hiccup that sent values plummeting. The continued plunge in world oil prices has resulted in a slowdown in exploration and, by extension, the manufacture of exploration equipment.

Read more: 2015 Salary Survey

Maintenance and reliability tips and best practices from the maintenance and reliability coaches at Allied Reliability Group.
The One Voice for Manufacturing blog reports on federal public policy issues impacting the manufacturing sector. One Voice is a joint effort by the National Tooling and Machining...
The Society for Maintenance and Reliability Professionals an organization devoted...
Join this ongoing discussion of machine guarding topics, including solutions assessments, regulatory compliance, gap analysis...
IMS Research, recently acquired by IHS Inc., is a leading independent supplier of market research and consultancy to the global electronics industry.
Maintenance is not optional in manufacturing. It’s a profit center, driving productivity and uptime while reducing overall repair costs.
The Lachance on CMMS blog is about current maintenance topics. Blogger Paul Lachance is president and chief technology officer for Smartware Group.
The maintenance journey has been a long, slow trek for most manufacturers and has gone from preventive maintenance to predictive maintenance.
Featured articles highlight technologies that enable the Industrial Internet of Things, IIoT-related products and strategies to get data more easily to the user.
This digital report will explore several aspects of how IIoT will transform manufacturing in the coming years.
Maintenance Manager; California Oils Corp.
Associate, Electrical Engineering; Wood Harbinger
Control Systems Engineer; Robert Bosch Corp.
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
click me