Artificial intelligence tools can aid sensor systems

At least seven artificial intelligence (AI) tools can be useful when applied to sensor systems: knowledge-based systems, fuzzy logic, automatic knowledge acquisition, neural networks, genetic algorithms, case-based reasoning, and ambient-intelligence. See diagrams.

By David Sanders October 30, 2013

Seven artificial intelligence (AI) tools are reviewed that have proved to be useful with sensor systems. They are: knowledge-based systems, fuzzy logic, automatic knowledge acquisition, neural networks, genetic algorithms, case-based reasoning, and ambient-intelligence. Each AI tool is outlined, together with some examples of its use with sensor systems. Applications of these tools within sensor systems have become more widespread due to the power and affordability of present-day computers. Many new sensor applications may emerge, and greater use may be made of hybrid tools that combine the strengths of two or more of the tools reviewed.

The tools and methods reviewed here have minimal computation complexity and can be implemented with small sensor systems, single sensors, or system arrays with low-capability microcontrollers. The appropriate deployment of the new AI tools will contribute to the creation of more competitive sensor systems and applications. Other technological developments in AI that will impact sensor systems include data mining techniques, multi-agent systems, and distributed self-organizing systems. Ambient sensing involves integrating many microelectronic processors and sensors into everyday objects to make them “smart.” They can explore their environment, communicate with other smart things, and interact with humans. Advice provided aims to help users cope with their tasks in intuitive ways, but the repercussion of such integration into our lives is difficult to predict. Using ambient intelligence and a mix of AI tools is an effort to use the best of each technology. The concepts are generically applicable across industrial processes, and this research is intended to show that the concepts work in practice.

Creating smarter sensor systems

Sensor systems can be improved using artificial intelligence (AI). [1] AI emerged as a computer science discipline in the mid 1950s, [2,3] and it has produced a number of powerful tools that are useful in sensor systems for automatically solving problems that would normally require human intelligence. Seven such tools are here: knowledge-based systems, fuzzy logic, inductive learning, neural networks, genetic algorithms, case-based reasoning, and ambient-intelligence.

AI systems have been improving, [4] and new advances in machine intelligence are creating seamless interactions between people and digital sensor systems. Although the introduction of AI into industry has been slow, it promises to bring improvements in flexibility, reconfigurability, and reliability. New machine systems are exceeding human performance in increasing numbers of tasks. As they merge with us more intimately, and we combine our brain power with computer capacity to deliberate, analyze, deduce, communicate, and invent, then we may be on the threshold of a new age of machine intelligence. [5]

AI (or machine intelligence) combines a wide variety of advanced technologies to give machines an ability to learn, adapt, make decisions, and display new behaviors. [6] This is achieved using technologies such as neural networks, [7] expert systems, [8,9] self-organizing maps, [10] fuzzy logic, [11] and genetic algorithms, [12] and that machine intelligence technology has been developed through its application to many areas where sensor information has needed to be interpreted and processed, for example:

  • Assembly [1, 14]
  • Biosensors [13]
  • Building modeling [16]
  • Computer vision [17]
  • Cutting tool diagnosis [30]
  • Environmental engineering [18]
  • Force sensing [31]
  • Health monitoring [29]
  • Human-computer interaction [19, 20]
  • Internet use [21, 22]
  • Laser milling [15]
  • Maintenance and inspection [25, 26]
  • Powered assistance [23, 24]
  • Robotics [27, 28]
  • Sensor networks [32]
  • Teleoperation. [33, 34]

These developments in machine intelligence are being introduced into ever more complex sensor systems. The click of a mouse, the flick of a switch, or the thought of a brain might convert almost any sensor data to information and transport it to you. Recent examples of this research work are provided, which include work at the University of Portsmouth. Seven areas where AI can help sensor systems follow.

1. Knowledge-based systems

Knowledge-based (or expert) systems are computer programs embodying knowledge about a domain for solving problems related to that domain. [2] An expert system usually has two main elements, a knowledge base and an inference mechanism. The knowledge base contains domain knowledge which may be expressed as a combination of ‘IF–THEN’ rules, factual statements, frames, objects, procedures, and cases. An inference mechanism manipulates stored knowledge to produce solutions to problems. Knowledge manipulation methods include using inheritance and constraints (in a frame-based or object-oriented expert system), retrieval and adaptation of case examples (in case-based systems), and the application of inference rules (in rule-based systems), according to some control procedure (forward or backward chaining) and search strategy (depth or breadth first). [1]

A rule-based system describes knowledge of a system in terms of IF… THEN… ELSE. Specific knowledge can be used to make decisions. These systems are good at representing knowledge and decisions in a way that is understandable to humans. Due to the rigid rule-base structure they are less good at handling uncertainty and are poor at handling imprecision. A typical rule-based system has four basic components: a list of rules or rule base, which is a specific type of knowledge base; an inference engine [35, 36] or semantic reasoner, which infers information or takes action based on the interaction of input and the rule base; temporary working memory; and a user interface or other connection to the outside world through which input and output signals are received and sent. [1]

The concept in case-based reasoning is to adapt solutions from previous problems to current problems. These solutions are stored in a database and can represent the experience of human specialists. When a problem occurs that a system has not experienced, it compares with previous cases and selects one that is closest to the current problem. It then acts upon the solution given and updates the database depending upon the success or failure of the action. [37] Case-based reasoning systems are often considered to be an extension of rule-based systems. They are good at representing knowledge in a way that is clear to humans, but they also have the ability to learn from past examples by generating additional new cases.

2. Case-based reasoning 

Case-based reasoning has been formalized for purposes of computer reasoning as a four-step process:

1) Retrieve: Given a target problem, retrieve cases from memory that are relevant to solving it. A case consists of a problem, its solution, and, typically, annotations about how the solution was derived.

2) Reuse: Map the solution from the previous case to the target problem. This may involve adapting the solution as needed to fit the new situation.

3) Revise: Having mapped the previous solution to the target situation, test the new solution in the real world (or a simulation) and, if necessary, revise.

4) Retain: After the solution has been successfully adapted to the target problem, store the resulting experience as a new case in memory.

Critics argue that it is an approach that accepts anecdotal evidence as its main operating principle. Without statistically relevant data for backing and implicit generalization, there is no guarantee that the generalization is correct. However, all inductive reasoning where data is too scarce for statistical relevance is inherently based on anecdotal evidence. [1]

The concept in case-based reasoning (CBR) is to adapt solutions from previous problems to current problems. These solutions are stored in a database and represent the experience of human specialists. When a problem occurs that a system has not experienced, it compares with previous cases and selects one closest to the current problem. It then acts upon the solution given and updates the database depending upon the success or failure of the action.

CBR systems are often considered to be an extension of rule-based systems. [1] As with rule-based systems, CBR systems are good at representing knowledge in a way that is clear to humans; however, CBR systems also have the ability to learn from past examples by generating additional new cases. Figure 1 shows a CBR system.

Many expert systems are developed using programs known as “shells,” which are ready-made expert systems complete with inferencing and knowledge storage facilities but without the domain knowledge. Some sophisticated expert systems are constructed with the help of “development environments.” The latter are more flexible than shells in that they also provide means for users to implement their own inferencing and knowledge representation methods. [Some details about expert systems shells and development environments are in Ref. 40.]

Expert systems are probably the most mature among tools mentioned here, with many commercial shells and development tools available to facilitate their construction. Consequently, once the domain knowledge to be incorporated in an expert system has been extracted, the process of building the system is relatively simple. The ease with which expert systems can be developed has led to a large number of applications of the tool. In sensor systems, applications can be found for a variety of tasks, including selection of sensor inputs, interpreting signals, condition monitoring, fault diagnosis, machine and process control, machine design, process planning, production scheduling, and system configuring. Some examples of specific tasks undertaken by expert systems are:

  • Assembly [44]
  • Automatic programming [41]
  • Controlling intelligent complex vehicles [42]
  • Planning inspection [46]
  • Predicting risk of disease [48]
  • Selecting tools and machining strategies [45]
  • Sequence planning [43]
  • Controlling plant growth. [47]

[More information on the technology of expert systems is in 3, 49.]

3. Fuzzy logic

A disadvantage of ordinary rule-based expert systems is that they cannot handle new situations not covered explicitly in their knowledge bases (that is, situations not fitting exactly those described in the “IF” parts of the rules). These rule-based systems are unable to produce conclusions when such situations are encountered. They are therefore regarded as shallow systems which fail in a “brittle” manner, rather than exhibit a gradual reduction in performance when faced with increasingly unfamiliar problems, as human experts would. [1]

The use of fuzzy logic, [50] which reflects the qualitative and inexact nature of human reasoning, can enable expert systems to be more resilient. With fuzzy logic, the precise value of a variable is replaced by a linguistic description, the meaning of which is represented by a fuzzy set, and inferencing is carried out based on this representation. For example, an input from a sensor system of 20 can be replaced by “normal” as the linguistic description of the variable “sensor input.” A fuzzy set defining the term “normal sensor input” might be:

normal sensor input = 0.0/below 10 widgets per minute +0.5/10−15 widgets per minute +1.0/15−25 widgets per minute +0.5/25−30 widgets per minute +0.0/above 30 widgets per minute.

The values 0.0, 0.5, and 1.0 are the degrees or grades of membership of the sensor ranges below 10 (above 30), 10−15 (25−30), and 15−25 to the given fuzzy set. A grade of membership equal to 1 indicates full membership, and a null grade of membership corresponds to total non-membership.

Knowledge in an expert system employing fuzzy logic can be expressed as qualitative statements (or fuzzy rules), such as, “If the input from the room temperature sensor is normal, then set the heat input to normal.” A reasoning procedure known as the compositional rule of inference, which is the equivalent of the modus-ponens rule in rule-based expert systems, enables conclusions to be drawn by generalization (extrapolation or interpolation) from the qualitative information stored in the knowledge base. [1] For instance, when a sensor input is detected to be “slightly below normal,” a controlling fuzzy expert system might deduce that the sensor inputs should be set to “slightly above normal.” Note that this conclusion might not have been contained in any of the fuzzy rules stored in the system.

Fuzzy expert systems (FES) use fuzzy logic to handle the uncertainties generated by incomplete or partially corrupt data. The technique uses the mathematical theory of fuzzy sets to simulate human reasoning. Humans can easily deal with ambiguity (areas of grey) in terms of decision making, yet machines find it difficult. [51]

Figure 2 shows an architecture for a fuzzy logic-based controller.

Fuzzy logic has many applications in sensor systems where the domain knowledge can be imprecise. Fuzzy logic is well suited where imprecision is inherent due to imprecise limits between structures or objects, limited resolution, numerical reconstruction methods, and image filtering. For example, applications in structural object recognition and scene interpretation have been developed using fuzzy sets within expert systems. Fuzzy expert systems are suitable for applications that require an ability to handle uncertain and imprecise situations. They do not have the ability to learn as the values within the system are preset and cannot be changed. [Further information on fuzzy logic and fuzzy sets can be found in Refs. 52, 53, 54.]

Notable successes have been achieved in the areas of:

  • Cooperative robots [58]
  • Mobile robots [56]
  • Prediction of sensory properties [57]
  • Supply chain management [59]
  • Welding. [28, 55]

[Further information on fuzzy logic and fuzzy sets can be found in Ref. 60.]

4. Automatic knowledge acquisition

Getting domain knowledge to build into a knowledge base can be complicated and time consuming. It can be a bottleneck in constructing an expert system. [1] Automatic knowledge acquisition techniques were developed to address this, for example, in the form of IF–THEN rules (or an equivalent decision tree). This sort of learning program usually requires a set of examples as a learning input. Each example is characterized by the values of a number of attributes and the class to which they belong.

One approach for example is through a process of “dividing-and-conquering,” where attributes are selected according to some strategy (for example, to maximize the information gain) to divide the original example set into subsets, and the inductive learning program builds a decision tree that correctly classifies the given example set. The tree represents the knowledge generalized from the specific examples in the set. This can subsequently be used to handle situations not explicitly covered by the example set.

In another approach known as the “covering approach,” the inductive learning program attempts to find groups of attributes uniquely shared by examples in given classes and forms rules with the IF part as conjunctions of those attributes and the THEN part as the classes. The program removes correctly classified examples from consideration and stops when rules have been formed to classify all examples in the given set. [2]

Another approach is to use logic programming instead of propositional logic to describe examples and represent new concepts. That approach employs the more powerful predicate logic to represent training examples and background knowledge and to express new concepts. Predicate logic permits the use of different forms of training examples and background knowledge. It enables the results of the induction process (the induced concepts) to be described as general first-order clauses with variables and not just as zero-order propositional clauses made up of attribute-value pairs. There are two main types of these systems, the first based on the top-down generalization/specialization method, and the second on the principle of inverse resolution. [36]

A number of learning programs have been developed, for example  ID3, [61] which is a divide-and-conquer program; the AQ program, [35] which follows the covering approach; the FOIL program, [36] which is an ILP system adopting the generalization/specialization method; and the GOLEM program, [36] which is an ILP system based on inverse resolution. Although most programs only generate crisp decision rules, algorithms have also been developed to produce fuzzy rules. [62]

The requirement for a set of examples in a rigid format (with known attributes and of known classes) has been easily satisfied by requirements in sensor systems and networks so that automatic learning has been widely used in sensor systems. This sort of learning is most suitable for problems where attributes have discrete or symbolic values rather than those with continuous-valued attributes as in many sensor systems problems. [More information is in 63, 64, 65.]

Some examples of applications of inductive learning are:

  • Laser cutting [66]
  • Mine detection [67]
  • Robotics. [68]

5. Neural networks

Neural networks can also capture domain knowledge from examples. However, they do not archive the acquired knowledge in an explicit form such as rules or decision trees, and they can readily handle both continuous and discrete data. [1] They also have a good generalization capability as with fuzzy expert systems.

A neural network is a computational model of the brain. Neural network models usually assume that computation is distributed over several simple units called neurons, which are interconnected and operate in parallel. (Hence, neural networks are also called parallel-distributed-processing systems or connectionist systems.)

The most popular neural network is the multi-layer perceptron, which is a feedforward network: all signals flow in one direction from the input to the output of the network. Feedforward networks can perform static mapping between an input space and an output space: the output at a given instant is a function only of the input at that instant. Recurrent networks, where the outputs of some neurons are fed back to the same neurons or to neurons in layers before them, are said to have a dynamic memory: the output of such networks at a given instant reflects the current input as well as previous inputs and outputs.

Implicit “knowledge” is built into a neural network by training it. Some neural networks can be trained by being presented with typical input patterns and the corresponding expected output patterns. The error between the actual and expected outputs is used to modify the strengths, or weights, of the connections between the neurons. This method of training is known as supervised training. In a multi-layer perceptron, the back-propagation algorithm for supervised training is often adopted to propagate the error from the output neurons and compute the weight modifications for the neurons in the hidden layers.

Some neural networks are trained in an unsupervised mode, where only the input patterns are provided during training and the networks learn automatically to cluster them in groups with similar features. [For more information on neural networks, see Refs. 69, 70, 71.]

Artificial neural networks (ANNs) typically have inputs and outputs, with processing within hidden layers in between. Inputs are independent variables and outputs are dependent. ANNs are flexible mathematical functions with configurable internal parameters. To accurately represent complicated relationships, these parameters are adjusted through a learning algorithm. In “supervised” learning, examples of inputs and corresponding desired outputs are simultaneously presented to networks, which iteratively self-adjust to accurately represent as many examples as possible.

Once trained, ANNs can accept new inputs and attempt to predict accurate outputs. To produce an output, the network simply performs function evaluation. The only assumption is that there exists some continuous functional relationship between input and output data. Neural networks can be employed as mapping devices, pattern classifiers, or pattern completers (auto-associative content addressable memories and pattern associators). Like expert systems, they have found a wide spectrum of applications in almost all areas of sensor systems, addressing problems ranging from modeling, prediction, control, classification, and pattern recognition, to data association, clustering, signal processing, and optimization. Some recent application examples are:

  • Feature recognition [72]           
  • Heat exchangers [75]
  • Inspection of soldering joints [74]
  • Optimizing spot welding parameters [77]
  • Power [78]
  • Tactile displays [76]
  • Vehicle sensor systems. [73]

6. Genetic algorithms

A genetic algorithm is a stochastic optimization procedure inspired by natural evolution. [2] A genetic algorithm can yield the global optimum solution in a complex multi-modal search space without requiring specific knowledge about the problem to be solved. However, for a genetic algorithm to be applicable, potential solutions to a given problem must be representable as strings of numbers (usually binary) known as chromosomes, and there must be a means of determining the goodness, or fitness, of each chromosome. A genetic algorithm operates on a group or population of chromosomes at a time, iteratively applying genetically based operators such as cross-over and mutation to produce fitter populations containing better solution chromosomes.

The algorithm normally starts by creating an initial population of chromosomes using a random number generator. It then evaluates each chromosome. The fitness values of the chromosomes are used in the selection of chromosomes for subsequent operations. After the cross-over and mutation operations, a new population is obtained and the cycle is repeated with the evaluation of that population. [For further information on genetic algorithms, see Refs. 79, 80, 81.]

Genetic algorithms have found applications in sensor systems problems involving complex combinatorial or multi-parameter optimization. Some recent examples of those applications are:

  • Assembly [82]
  • Assembly line balancing [85]
  • Fault diagnosis [83]
  • Health monitoring [86]
  • Power steering. [84]

7. Ambient-intelligence

Ambient intelligence has been promoted for the last decade as a vision of people working easily in digitally controlled environments in which the electronics can anticipate their behavior and respond to their presence. The concept of ambient intelligence is for seamless interaction between people and sensor systems to meet actual and anticipated needs.

Use in industry has been limited, but new, more intelligent and more interactive systems are at the research stage. From the perspective of sensor systems, a less human and more system-centered definition of ambient intelligence needs to be considered. Modern sensor concepts tend to be human-centered approaches so that the application of ambient intelligence technologies in a combination with knowledge management may be a promising approach. Many research issues still have to be resolved to bring the ambient intelligence technology to industrial sectors, such as robust, reliable (wireless) sensors and context-sensitivity, intelligent user interfaces, safety, security, and so forth.

Ambient intelligence information and knowledge gathered from sensors within an environment represents an untapped resource for optimization processes and for possibilities to provide more efficient services. The introduction of ambient intelligence technologies is still in an initial phase. However, it is promising to bring advantages in flexibility, reconfigurability, and reliability. At the same time, prices of sensors and tags are decreasing. Development and implementation of new concepts based on ambient intelligence systems in the mid- and long-term are likely. A large number of industrial companies will probably introduce different ambient intelligence technologies to the shop-floor.

On the other hand, vendors of sensors will need to equip their products with additional ambient intelligence features and utilize the advantages of ambient intelligence integrated sensors within the environment to provide new functionalities (for example: self-configuration, context-sensitivity, etc.) and improve performances of their products.

[More information is in 87, 88.]

AI applications, University of Portsmouth

AI tools are being applied at the University of Portsmouth to assist industry in the adoption of artificial intelligence for use with sensor systems.

Monitoring and controlling machinery: Simple rules are being investigated that modify pre-planned paths and improve gross robot motions associated with pick-and-place assembly tasks, [89] and rules to predict terrain contours are being developed using a feed-forward neural network. [90] Case-based reasoning is being applied to reuse programs (or parts of programs) to automatically program sensor arrays. The combined work is already showing that automatic programming and re-programming may help to introduce environmental sensors into smaller and medium enterprises. Other projects are using simple expert systems to improve the use of sensor data in tele-operation applications. [91, 92, 93]

Process monitoring and control: An expert system is being developed to assist in process control and to enhance the implementation of statistical process control. A bespoke expert system uses a hybrid rule-based and pseudo object-oriented method of representing standard statistical process control knowledge and process-specific diagnostic knowledge. The amount of knowledge from sensor arrays and sensor systems can be large, which justifies the use of a knowledge-based systems approach. The system is being enhanced by integrating a neural network module with the expert system modules to detect any abnormal patterns. [94]

Monitoring sensor arrays: A system has been created to monitor sensors in a high recirculation airlift reactor (a process to produce clean water). [8, 18, 95] Reactors can be at the edge of stability, and that requires accurate interpretation of real-time sensor data from sensors, such as: flow rate, air input, pressure, etc. A second system is interpreting data from ultrasonic sensor arrays on tele-operated mobile robots and on wheelchairs. [23, 24, 33, 34]

Fuzzy monitoring and control: A robotic welding system is being created that uses image processing techniques and a computer-aided design (CAD) model to provide information to a multi-intelligent decision module. [96] The system uses a combination of techniques to suggest weld requirements. These suggestions are evaluated, decisions are made, and then weld parameters are sent to a program generator. The status of the welding process is difficult to monitor because of the intense disturbance during the process. Other work is using multiple sensors to obtain information about the process. Fuzzy measurement and fuzzy integral methods are being investigated to fuse extracted signal features in order to predict the penetration status of the welding process.

Neural-network-based product inspection: Two projects are using neural networks for product inspection: one is recognizing shipbuilding parts and a second is using cameras to detect and classify defects. Neural networks are useful for these types of applications because of the common difficulty in precisely describing various types of defects and differences. The neural networks can learn the classification task automatically from examples.

The first system is managing to recognize shipbuilding parts using artificial neural networks and Fourier descriptors. [17] Improvements have been made to a pattern recognition system for recognizing shipbuilding parts. [26] This has been achieved by using a new, simple and accurate corner-finder. The new system initially finds corners in an edge-detected image of a part and uses that new information to extract Fourier descriptors to feed into a neural network to make decisions about shapes. Using an all-or-nothing accuracy measure, the new systems have achieved an improvement over other systems.

A second intelligent inspection system has been built that consists of cameras connected to a computer that implements neural-network-based algorithms for detecting and classifying defects. Outputs from the network indicate the type of defect. Initial investigation suggests that the accuracy of defect classification is good (in excess of 85%) and faster than manual inspection. The system is also used to detect defective parts with a high accuracy (almost 100%).

Genetic algorithms to create an ergonomic workplace layout: A genetic algorithm for deciding where to place sensors in a work cell is being developed. The layout produced by the program will be such that the most frequently needed sensors are prioritized. A genetic algorithm is suitable for this optimization problem because it can readily accommodate multiple constraints.

Ambient intelligence to improve energy efficiency: Ambient intelligence and knowledge management technologies are being used to optimize the energy efficiency of manufacturing units. [88] This benefits both the company and the environment as the carbon footprint is reduced. Different measuring systems are being applied to monitor energy use. [97] Ambient data provide the opportunity to have detailed information on the performance of a manufacturing unit. [98] Knowledge management facilitates processing this information and advises on actions to minimize energy usage but maintain production. Existing energy consumption data from standard measurements is being complemented by ambient intelligence related measurements (from interactions of human operators and machines/processes and smart tags) as well as process related measurements (manufacturing line temperatures, line pressure, production rate) and knowledge gathered within the manufacturing assembly unit. This is fed to a service oriented architecture system. Figure 3 shows an experimental system to use ambient intelligence to improve energy efficiency.

Combining different systems

The purpose of a hybrid system is to combine the desirable elements of different AI techniques into one system. Each different methods of implementing AI has its own strengths and weaknesses. Some effort has been made in combining different methods to produce hybrid techniques with more strengths and fewer weaknesses. An example is the neuro-fuzzy system, which seeks to combine the uncertainty handling of fuzzy systems with the learning strength of artificial neural networks.

A solution to the problems associated with weld programming is being addressed in this way. [96] An existing system consists of two software systems working in series to construct viable robot programs. The first system, the CAD model interpreter, accepts a CAD model and determines the welds required. This data is fed to the program generator, which re-orientates the weld requirements in line with the actual real-world orientation of the panel. The program generator then sends any programs sequentially to the robot (normally one program per weld line). Additional software systems could be incorporated into the existing system at the point where the robot programs are sent to the robot system. This is because the transmission protocol at this point is standard TCP/IP [transmission control protocol/Internet protocol] and any programs to be sent can be viewed as text files.

A new proposed system (shown in Figure 4) will gather that data from an image sensor. The visual data and CAD model data will be used in conjunction to determine an object list, and that object list will be passed to a weld identifier module that will use AI techniques to determine weld requirement.

The proposed system uses a combination of AI techniques working in parallel to suggest weld requirements. These suggestions are then evaluated and decisions made regarding the weld required. These parameters are then sent to a new program generator, which produces a custom robot program for use on the shop floor. Image capture methods are being combined with a decision making system that uses multiple AI techniques to decide on weld requirements for a job.

The system will combine real-world visual sensor data with data provided by the CAD model. It will then use this combined data to present differing AI systems with the same information. These systems will then make weld requirement suggestions to a weld identifier module (Figure 5). This module will evaluate the suggestions and determine the optimum weld path. The suggestions will then be passed to the existing robot program generator.

The robot program generation systems have been created, tested, and used to produce consistent straight line welds. A simple edge detection system has been created. Work surrounding the AI systems is in the early stages and will be advanced. The multi-intelligent decision module framework will be further developed and combinations of AI techniques tested. The AI techniques to be tested will include rule-based, case-based, and fuzzy systems. Any created system needs to be able to handle the uncertainty of unidentified objects within the image; however, when all objects are positively identified there should be little doubt as to the weld path.

Another example of combining different artificial intelligence tools is the fuzzy network. The nodes of this type of network are fuzzy rule bases and the connections between the nodes are interactions in the form of outputs from nodes that are fed as inputs to the same or other nodes. The fuzzy network is a hybrid tool combining fuzzy systems and neural networks due to its underlying grid structure with horizontal levels and vertical layers. This tool is quite suitable for modeling the assembly automation process because the separate assembly stages can be described as modular fuzzy rule bases interacting in sequential/parallel fashion and feedforward/feedback context.

The main advantages from the application of this hybrid modeling tool are better accuracy due to the single fuzzification-inference-de-fuzzification and higher transparency due to the modular approach used. These advantages are quite crucial bearing in mind the uncertainties in the data and the interconnected structure of some sensor systems.

Mix of sensor and logic systems

Portsmouth University researchers are mixing sensor systems [97] and some powerful new technologies, and the longer use is yielding better results. [5] Over time, results include less use of energy, space, and time, along with more output for less cost. In the Regional Centre for Manufacturing Industry at Portsmouth University, machines read in data from real objects and lay-down successive layers to build up a model of the object from a series of cross sections. AI is becoming important everywhere in reducing costs and time.

AI can increase effective communication, reduce mistakes, minimize errors, and extend sensor life.

Over the past 40 years, artificial intelligence has produced a number of powerful tools, including those reviewed here: knowledge-based systems, fuzzy logic, automatic learning, neural networks, ambient intelligence, and genetic algorithms. Applications of these tools in sensor systems have become more widespread due to the power and affordability of present-day computers. Many new sensor systems applications may emerge, and greater use may be made of hybrid tools that combine the strengths of two or more of the tools mentioned. Other technological developments in AI that will impact sensor systems include data mining, multi-agent systems, and distributed self-organizing systems. The appropriate deployment of the new AI tools will contribute to the creation of more competitive sensor systems.

It may take another decade for engineers to recognize the benefits given the current lack of familiarity and the technical barriers associated with using these tools, but this field of study is expanding.

The tools and methods described have minimal computation complexity and can be implemented on small assembly lines, single robots, or systems with low-capability microcontrollers. These novel approaches proposed use ambient intelligence and the mixing of different AI tools in an effort to use the best of each technology. The concepts are generically applicable across many processes.

– David Sanders is research coordinator, School of Engineering, Reader in Systems & Knowledge Engineering, University of Portsmouth, U.K. Edited by Mark T. Hoske, content manager, CFE Media, Control Engineering, Plant Engineering, and Consulting-Specifying Engineer, mhoske@cfemedia.com.

ONLINE extra

This online, full-length version of this article contains citations in the article above and references on the next page.

More information about the author, David Sanders, is available from the University of Portsmouth.

https://www.port.ac.uk/departments/academic/eng/ourstaff/title,134485,en.html

(See 99 references, next page.)

References for Control Engineering article: Artificial intelligence tools can aid sensor systems

[1] Sanders DA and Gegocv A (2012). Review of some artificial intelligence tools for use in Assembly Automation and some examples of recent applications. Assembly Automation In press.

[2] Pham D.T and Pham PTN (1999). Artificial intelligence in engineering. International Journal of Machine Tools and Manufacture, Vol 39, Iss: 6, June 1999, Pages 937-949.

[3] Pham D.T and Pham PTN (1988). Expert systems in mechanical and manufacturing Assembly Automation. Int. J. Adv. Manuf. Technol. 3 (1988), pp. 3-21.

[4] Sanders D (1999). Perception in robotics. Industrial Robot: An International Journal; Vol: 26 (2), pp 90-91.

[5] Sanders D (2009). Introducing AI into MEMS can lead us to brain-computer interfaces and super-human intelligence. ASSEMBLY AUTOMATION, Vol 29, Iss: 4, pp: 309-312.

[6] Sanders (2008). Progress in Machine Intelligence. Industrial Robot – An International Journal 35 (6), Pages: 485-487.

[7] Sanders DA, Haynes BP, Tewkesbury GE, et al. (1996). The addition of neural networks to the inner feedback path in order to improve on the use of pre-trained feed forward estimators. Mathematics and computers in simulation 41 (5-6), pp 461-472.

[8] Hudson AD, Sanders DA, Golding H, et al. (1997). Aspects of an expert design system for the wastewater treatment industry. Jnl of Systems Architecture 43 (1-5): 59-65.

[9] Tewkesbury G, Sanders D (1999). A new simulation based robot command library applied to three robots. Journal of robotic systems 16 (8), pp 461-469.

[10] Burn K, Home G (2008). Environment classification using Kohonen self-organizing maps. Expert Systems 25 (2), pp 98-114.

[11] Zoumponos GT, Aspragathos NA (2008). Fuzzy logic path planning for the robotic placement of fabrics on a work table. Robotics and computer-integrated manufacturing 24 (2), pp 174-186.

[12] Manikas TW, Ashenayi K, Wainwright RL (2007). Genetic algorithms for autonomous robot navigation IEEE Instrumentation & Measurement, Vol: 10 (6), pp 26-31.

[13] Rajamani S and Sayre R (2011). FRET-Based Biosensors for the Detection and Quantification of AI-2 Class of Quorum Sensing Compounds. Editor: Rumbaugh KP. Quorum Sensing: Methods and Protocols. Book Series “Methods in Molecular Biology,” Volume 692, pp: 31-46 {DOI: 10.1007/978-1-60761-971-0_3}.

[14] Guru SM, Fernando S, Halgamuge S and Chan K (2004). Intelligent fastening with A-BOLT technology and sensor networks. Assembly Automation 24 (4), pp 386 – 393.

[15] Bustillo A; Sedano J; Ramon Villar J; et al. (2008). AI for Modelling the Laser Milling of Copper Components. Editors: Fyfe C; Kim D; Lee SY et al. Proceedings of the 9th International Conference on Intelligent Data Engineering and Automated Learn Location: Daejeon, SOUTH KOREA (November 2008). Book Series “Lecture Notes in Computer Science,” Volume 5326, pp: 498-507.

[16] Gegov, A (2004). Application of computational intelligence methods for intelligent modelling of buildings. Applications and science in soft computing ISSN: 1615-3871 (Advances in soft computing ISBN: 3-540-40856-8 Editors: Loffi A, Garobaldi J), Springer-Verlag, Berlin, pp 263-270.

[17] Sanders DA (2009b). Recognizing shipbuilding parts using artificial neural networks and Fourier descriptors. Proc. IMechE, Part B: J. Engineering Manufacture, 2009, 223(B3), 337–342.

[18] Sanders DA and Hudson AD (2000). A specific blackboard expert system to simulate and automate the design of high recirculation airlift reactors. Mathematics & Computers in simulation 53 (1-2), pp 41-65

[19] Sanders DA and Baldwin A (2001). X-by-wire technology. Total vehicle technology: Challenging current thinking, pp 3-12.

[20] Sanders DA, Urwin-Wright SD, Tewkesbury GE, et al. (2005). Pointer device for thin-film transistor and cathode ray tube computer screens. Electronics Letters 41 (16), pp 894-896.

[21] Bergasa-Suso J, Sanders DA, Tewkesbury GE (2005). Intelligent browser-based systems to assist Internet users. IEEE Transactions 48 (4), pp 580-585.

[22] Chester, S; Tewkesbury, G; Sanders, D, et al. (2006). New electronic multi-media assessment system. WEBIST 2006: Proceedings of the Second International Conference on Web Information Systems and Technologies, pp: 320-324.

[23] Stott I, Sanders D (2000). New powered wheelchair systems for the rehabilitation of some severely disabled users. Int Jnl of rehabilitation research 23 (3), pp 149-153.

[24] Sanders DA, Langner M and Tewkesbury GE (2010). Improving wheelchair-driving using a sensor system to control wheelchair-veer and variable-switches as an alternative to digital-switches or joysticks. INDUSTRIAL ROBOT-AN INTERNATIONAL JOURNAL, Vol 37 (2), pp: 157-167.

[25] Nadakatti, M; Ramachandra, A; Kumar ANS (2008). Artificial intelligence-based condition monitoring for plant maintenance. Assembly Automation 28 (2), pp 143-150.

[26] Sanders DA, Lambert G and Pevy L (2009). Pre-locating corners in images in order to improve the extraction of Fourier descriptors and subsequent recognition of shipbuilding parts, PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART B-JOURNAL OF ENGINEERING MANUFACTURE, Vol 223, Iss: 9, pp: 1217-1223.

[27] Bullinaria, JA; Li, XL (2007). An introduction to computational intelligence techniques for robot control. Industrial robot – an international journal 34 (4), pp 295-302.

[28] Tewkesbury G and Sanders D (1999). A new robot command library which includes simulation. Industrial Robot: An International Journal 26 (1), pp 39-48.

[29] Lopatin C and Mahmood S (2006). AI techniques for health monitoring: Application to embedded sensors in solid rocket motors. Editor: Guemes A. Proceedings of the 3rd European Workshop on Structural Health Monitoring (Granada, Spain – July 06), pp: 1125-1132

[30] Morales-Menendez R; Vallejo A; Garza Luis E.; et al. (2007). AI approaches for cutting tool diagnosis in machining processes. Editor: Devedzic V. Proceedings of the IASTED International Conference on Artificial Intelligence and Applications (Innsbruck, Austria – February 07), pp: 186-191.

[31] Sanders D (2007). Viewpoint – Force sensing. Industrial Robot: An International Journal 34 (4), pp 268-268.

[32] Guru SM, Fernando S, Halgamuge S and Chan K (2004). Intelligent fastening with A-BOLT technology and sensor networks. Assembly Automation 24 (4), pp 386-393.

[33] Sanders (2008c). Controlling the direction of “walkie” type forklifts and pallet jacks on sloping ground. Assembly Automation 28 (4), pp 317–324.

[34] Sanders DA (2010). Comparing speed to complete progressively more difficult mobile robot paths between human tele-operators and humans with sensor systems to assist, SENSOR REVIEW, Vol: 30, Iss: 1, pp: 40-50.

[35] Michalski RS (1990), A theory and methodology of inductive learning, in Shavlik JW and Dietterich TG (Eds.), Kaufmann, Readings in Machine Learning, San Mateo, CA, pp. 70–95.

[36] Muggleton S (Ed.) (1992), Inductive Logic Programming. Academic Press, London, 1992. 565 p.

[37] Kolonder JL (1994) Case-based reasoning. Morgan Kaufmann.

[38] Garcia-Crespo Angel; Ruiz-Mezcua Belen; Luis Lopez-Cuadrado Jose; et al. (2011). A review of conventional and knowledge based systems for machining price quotation. Journal of intelligent manufacturing Vol 22 (6), pp: 823-841.

[39] Ma Q. C.; Liu X. W. (Editor(s): Cheng K; Yao YX; Zhou L) (2008). Review of knowledge based engineering with PLM. Proceedings of the 6th International Conference on e-Engineering and Digital Enterprise Technology (Harbin – China 07), E-Engineering and digital enterprise technology. Book Series: Applied Mechanics and materials 10-12, pp: 127-131.

[40] Ashiru I, Czanecki C and Routen T (1995). Intelligent operators and optimal genetic-based path planning for mobile robots. Proceedings of the International Conference on Recent Advances in Mechatronics, Istanbul, Turkey (August 95) pp: 1018–1023.

[41] Wang L, Tian Y and Sawaragi T (2011). Case-based automatic programming in robotic assembly production. INDUSTRIAL ROBOT-AN INTERNATIONAL JOURNAL, Vol 38 (1), pp: 86-96.

[42] Hossain A, Rahman A and Mohiuddin AKM (2011). Fuzzy expert system for controlling swamp terrain intelligent air-cushion tracked vehicle. Int Journal of automotive technology 12 (5), pp: 745-753.

[43] Wu YH and Shaw HJ (2011). Document based knowledge base engineering method for ship basic design. OCEAN ENGINEERING Vol 38 (13), pp: 1508-1521.

[44] Gamez Garcia J, Gomez Ortega J. Satorres Martinez S et al. (2011). Expert system based controller for the high-accuracy automatic assembly of vehicle headlamps. Expert systems with applications 38 (10), pp: 12818-12825.

[45] Mawussi KB and Tapie L (2011). A knowledge base model for complex forging die machining. COMPUTERS & INDUSTRIAL ENGINEERING, Vol 61 (1), pp: 84-97.

[46] Peers SMC, Tang MX and Dharmavasan S (1994). A knowledge-based scheduling system for offshore structure inspection, in G. Rzevski, R.A. Adey, D.W. Russell (Eds.), Artificial Intelligence in Assembly Automation IX (AIEng 9), Computational Mechanics, Southampton. pp: 181-188.

[47] May GA, Lanoue MA, Bethel M et al. (2011). Expert system for controlling plant growth in a contained environment. Patent Number: US 07987632. Patent Assignee: The Institute for Technology Development. Official Gazette of the United States Patent and Trademark Office Patents (August 2011).

[48] Armero C, Artacho A, Lopez-Quilez A et al. (2011). A probabilistic expert system for predicting the risk of Legionella in evaporative installations. Expert systems with applications 38 (6), pp: 6637-6643.

[49] Garcia-Crespo A, Ruiz-Mezcua B and Luis Lopez-Cuadrado J et al. (2011). A review of conventional and knowledge based systems for machining price quotation. JOURNAL OF INTELLIGENT MANUFACTURING Vol 22 (6), pp: 823-841.

[50] L.A. Zadeh, Fuzzy sets. Inf. Control 8 (1965), pp: 338-353.

[51] F. Lara Rosano, N. Kemper Valverde, C. De La Paz Alva, J. Alcántara Zavala, Tutorial expert system for the design of energy cogeneration plants, Proceedings of the Third World Congress on Expert Systems, Seoul, Korea, February, 1996. Pp: 300-305.

[52] H.-J. Zimmermann, Fuzzy Set Theory and its Applications, 2nd Edn. Kluwer, Boston. 1991.

[53] Azadegan Arash; Porobic Lejla; Ghazinoory Sepehr; et al. (2011). Fuzzy logic in manufacturing: A review of literature and a specialized application. INTERNATIONAL JOURNAL OF PRODUCTION ECONOMICS, Vol 132 (2), pp: 258-270.

[54] Liu D (20110. Fuzzy Logic and Computational Intelligence. IEEE INTELLIGENT SYSTEMS, Vol 26 (4), pp: 11-11.

[55] Chen B and Chen SB (2010). Multi-sensor information fusion in pulsed GTAW based on fuzzy measure and fuzzy integral Author(s): Source: ASSEMBLY AUTOMATION Vol: 30 .: 3 Pages: 276-285 DOI: 10.1108/01445151011061172 Published: 2010

[56] Cheng Y, Fan Y and Huang M (2012). Innovative intelligent navigation system by applying fuzzy logic and cell assemblies in rescuing robot. Applied artificial intelligence 26 (3), pp: 183-203.

[57] Jeguirim Selsabil El-Ghezal; Dhouib Amal Babay; Sahnoun Mahdi; et al. (2011). The use of fuzzy logic and neural networks models for sensory properties prediction from process and structure parameters of knitted fabrics. JOURNAL OF INTELLIGENT MANUFACTURING, Vol 22, Iss: 6, pp: 873-884.

[58] Ni J and Yang SX (2012). A fuzzy-logic based chaos GA for cooperative foraging of multi-robots in unknown environments. Int Journal of robotics and automation 27 (1), pp: 15-30.

[59] Devos GGM and Ribeiro CLC (2011). A fuzzy logic approach to supply chain performance management. INTERNATIONAL JOURNAL OF PRODUCTION ECONOMICS, Vol 134, Iss: 1, pp: 177-187.

[60] Azadegan Arash; Porobic Lejla; Ghazinoory Sepehr; et a (2011). Fuzzy logic in manufacturing: A review of literature and a specialized application. Int Journal of production economics, Vol 132, Iss: 2, pp: 258-270.

[61] J.R. Quinlan, Learning efficient classification procedures and their applications to chess end games, in R.S. Michalski, J.G. Carbonell, T.M. Mitchell (Eds.), Machine Learning, An Artificial Intelligence Approach, Morgan Kaufmann, Palo Alto, CA, 1983. pp: 463-482.

[62] L.X. Wang and M. Mendel, Generating fuzzy rules by learning from examples. IEEE Trans. Syst., Man Cybernet. 22 (1992), pp. 1414-1427.

[63] Robinet V, Lemaire B and Gordon MB (2011). MDLChunker: A MDL-Based Cognitive Model of Inductive Learning . COGNITIVE SCIENCE Vol: 35 .: 7 Pages: 1352-1389.

[64] Schmid U and Kitzelmann E (2011). Inductive rule learning on the knowledge level. COGNITIVE SYSTEMS RESEARCH , Vol 12, Iss: 3-4, pp: 237-248.

[65] Piramuthu S and Sikora RT (2009). Iterative feature construction for improving inductive learning algorithms. EXPERT SYSTEMS WITH APPLICATIONS, Vol 36, Iss: 2, pp: 3401-3406.

[66] D. Luzeaux, Process control and machine learning: rule-based incremental control. IEEE Transiblic Autom. Control 39 (1994), pp: 1166-1171.

[67] Kercel SW and Dress WB (1997). Inductive learning as a fusion engine for mine detection. Book Series: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics – Computational Cybernetics and Simulation (SMC 97 = Orlando FL), Volumes 1-5, pp: 4133-4138.

[68] Nakasuka S, Yairi T and Wajima H (1997). Autonomous generation of reflexion-based robot controller using inductive learning. Robotics and autonomous systems 17 (4), pp: 287-305.

[69] D.T. Pham, X. Liu, Neural Networks for Identification, Prediction and Control, Springer Verlag, London, Berlin and Heidelberg, Third printing, 1997. 238 pp.

[70] Paliwal Mukta; Kumar Usha A (2009). Neural networks and statistical techniques: A review of applications. EXPERT SYSTEMS WITH APPLICATIONS, Vol 36, Iss: 1, pp: 2-17.

[71] Bae JK and Jinhwa K (2011). Combining models from neural networks and inductive learning algorithms. EXPERT SYSTEMS WITH APPLICATIONS, Vol 38, Iss: 5, pp: 4839-4850.

[72] Ontman AYM and Shiflet GJ (2011). Application of artificial neural networks for feature recognition in image registration. Journal of microscopy 246 (1), pp: 20-32.

[73] Naranjo Jose E, Jimenez Felipe, Serradilla Francisco J et al. (2012). Floating Car Data Augmentation Based on Infrastructure Sensors and Neural Networks. IEEE Transactions on intelligent transportation systems 1, pp: 107-114.

[74] Matsushima Michiya; Kawai Naohiro; Fujie Hiroyuki; et al. (Editors: Shirase K and Aoyagi S) (2010). Visual Inspection of Soldering Joints by Neural Network with Multi-angle View and Principal Component Analysis. Service robots and mechatronics, pp: 329-334.

[75] Ferreiro GR (2012). Improving heat exchanger supervision using neural networks and rule based techniques. Expert systems with applications 39 (3), pp: 3012-3021.

[76] Ohka M, Esumi K and Sawamoto Y (2012). Two-Axial Piezoelectric Actuator Controller Using a Multi-Layer Artificial Neural Network Featuring Feedback Connection for Tactile Displays. Advanced robotics 26 (1-2), pp: 219-232.

[77] Hamedi M.; Shariatpanahi M.; Mansourzadeh A (2007). Optimizing spot welding parameters in a sheet metal assembly by neural networks and genetic algorithm. PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART B-JOURNAL OF ENGINEERING MANUFACTURE Vol: 221 .: 7 Pages: 1175-1184.

[78] P. Smith, J. MacIntyre, S. Husein, The application of neural networks in the power industry, Proceedings of the Third World Congress on Expert Systems, Seoul, Korea, February, 1996. pp: 321–326.

[79] J.H. Holland, Adaptation in Natural and Artificial Systems. The University of Michigan Press, Ann Arbor, MI. 1975.

[80] L. Davis, Handbook of Genetic Algorithms. Van Nostrand, New York, NY. 1991.

[81] Akgunduz Onur Serkan; Tunali Semra (2011). A review of the current applications of genetic algorithms in mixed-model assembly line sequencing. INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH Vol: 49 .: 15 Pages: 4483-4503.

[82] Raj M. Victor; Sankar S. Saravana; Ponnambalam S. G. (2011). Genetic algorithm to optimize manufacturing system efficiency in batch selective assembly. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, Vol 57, Iss: 5-8, pp: 795-810.

[83] Wu Q (2011). Car assembly line fault diagnosis model based on triangular fuzzy Gaussian wavelet kernel support vector classifier machine and genetic algorithm. EXPERT SYSTEMS WITH APPLICATIONS, Vol 38, Iss: 12, pp: 14812-14818.

[84] Zhao WZ and Wang CY (2012). Mixed H-2/H-a road feel control of EPS based on genetic algorithm. Science China-Technological Sciences 55 (1), pp: 72-80.

[85] Yu Jianfeng; Yin Yuehong (2010). Assembly line balancing based on an adaptive genetic algorithm. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, Vol 48, Iss: 1-4, pp: 347-354.

[86] Zhang XL; Liang D, Zeng J et al. (2012). Genetic algorithm-support vector regression for high reliability SHM system based on FBG sensor network. Optics and lasers in engineering 50 (2), pp: 148-153.

[87] Stokic Dragan; Neves-Silva Rui; Marques Maria; et al. (2007). Ambient intelligence based system for life-cycle management of complex manufacturing and assembly lines. 5th IEEE International Conference on Industrial Informatics Location: Vienna, Austria (JUN 23-27, 2007). pp: 945-950.

[88] DA Sanders, H Liu, DJ Harrison and A Gegov (2008). Energy efficiency based on ambient intelligence. Journal of computing in systems and engineering, Vol 9 (1), pp: 114-120.

[89] Sanders D, Tewkesbury G and Graham-Jones J (2011). Simple rules to modify pre-planned paths and improve gross robot motions associated with pick & place assembly tasks. ASSEMBLY AUTOMATION, Vol 31, Iss: 1, pp: 69-78.

[90] Urwin-Wright S, Sanders D, Chen S (2003). Predicting terrain contours using a feed-forward neural network. Engineering Applications of Artificial Intelligence 16 (5-6), pp: 465-472.

[91] Sanders D, Tewkesbury G, Stott I et al. (2011). Simple expert systems to improve an ultrasonic sensor-system for a tele-operated mobile-robot SENSOR REVIEW, Vol 31, Iss: 3, pp: 246-260.

[92] Sanders D (2010). Comparing ability to complete simple tele-operated rescue or maintenance mobile-robot tasks with and without a sensor system. SENSOR REVIEW, Vol 30, Iss: 1, pp: 40-50.

[93] Sanders, DA; Graham-Jones, J; Gegov, A (2010). Improving ability of tele-operators to complete progressively more difficult mobile robot paths using simple expert systems and ultrasonic sensors. INDUSTRIAL ROBOT-AN INTERNATIONAL JOURNAL, Vol 37, Iss: 5, pp: 431-440.

[94] Sanders, D; Tan, YC; Rogers, I, et al. (2009). An expert system for automatic design-for-assembly. ASSEMBLY AUTOMATION, Vol 29, Iss: 4, pp: 378-388.

[95] Hudson, AD; Sanders, DA; Tewkesbury, GE, et al. (1996). Simulation of a high recirculation airlift reactor for steady-state operation. WATER SCIENCE AND TECHNOLOGY, Vol 34, Iss: 5-6, pp: 59-66.

[96] Sanders, DA; Lambert, G; Graham-Jones, J, et al. A robotic welding system using image processing techniques and a CAD model to provide information to a multi-intelligent decision module. ASSEMBLY AUTOMATION, Vol 30, . 4, pp: 323-332.

[97] Sanders (2008). Environmental sensors and networks of sensors. Sensor Review 28 (4), pp: 273 – 274.

[98] Riva G, Vatalaro F, Davide F & Alcañiz M (Eds) (2005). Ambient Intelligence in Practice: Future Perspectives and Applications. IOS Press, pp: 237-264.

[99] Brooks M (2000). Whatever you want. New Scientist Magazine September. Number 2258.