Five elements of KPI lifecycle

Key Performance Indicators (KPIs) have a lifecycle with a similarly cyclic pattern: from definition to collection to set composition to implementation to assessment and back to definition. Manufacturers who use KPIs naturally implement this lifecycle, but there is some real value to clearly and carefully articulate the elements of the lifecycle.

05/26/2016



Humans go through distinct phases of life: from dependence to learning to producing to sharing and back to dependence. We call this a lifecycle. The phases of life keep repeating as new persons are born and the elderly complete their lives. 

Key Performance Indicators (KPIs) also have a lifecycle with a similarly cyclic pattern: from definition to collection to set composition to implementation to assessment and back to definition

Manufacturers who use KPIs naturally implement this lifecycle, but there is some real value to clearly and carefully articulate the elements of the lifecycle. 

Key Performance Indicators (KPIs) have a lifecycle with a similarly cyclic pattern: from definition to collection to set composition to implementation to assessment and back to definition. Courtesy: MESA

An accurate and detailed model of the KPI Lifecycle:

  • Enables efficient and effective performance management 
  • Enables a cottage industry of performance methods and software tools
  • Provides a basis for open standards on KPI use.

Assuming the target processes have been identified, here is an outline of five elements to consider to successfully use KPIs in your manufacturing process throughout their entire lifecycle. 

KPI lifecycle element 1: definition

The first element of the KPI lifecycle is KPI definition. Since there are probably tens of thousands of different KPIs used by manufacturers, one might think that all the KPIs that need to be defined have been defined. To be sure, KPIs like quality ratio, overall equipment efectiveness index, scrap ratio and rework ratio are not going away any time soon, but KPIs may sometimes need to be redefined as a more focused or aggregate KPI. 

Furthermore, as corporate objectives change over time, KPIs change. Corporate objectives drive the definition and use of KPIs—remember how the sustainability objective quickly became an increasingly important metric? But, it’s important to follow good KPI definition practices, otherwise interoperability will suffer throughout your supply chain. 

KPI lifecycle element 2: collection

The second element of the lifecycle is KPI collection. Collection consists largely of excluding obvious outlier KPIs from consideration like irrelevant KPIs. Still, one can easily end up with far too many candidate KPIs. 

Keep in mind that humans typically monitor KPIs, but humans can only comprehend and process five to nine distinct items simultaneously (the “seven plus or minus two” rule from psychologist George Miller). Therefore, we have a need for KPI set composition, our next step in the lifecycle.

KPI lifecycle element 3: set composition

The third element of the lifecycle is KPI set composition, which is substantially more complicated than KPI collection. The following guidelines should be followed: 

  • Select appropriate KPI performance criteria (ISO 22400 Part 1).
  • Follow the “seven plus or minus two” rule for the number of KPIs selected.
  • Find the sweet spot between detailed versus aggregate KPIs. 
  • Ensure that the chosen KPIs satisfy all the stated critical objectives of the process.

A structured criteria-based method to satisfy these guidelines has been generated at the National Institute of Standards and Technology. It enables a group of stakeholders to form an effective subset of KPIs from a larger set of candidate KPIs, whether the KPIs are currently in use or not. It also employs value-based decision-making for accurate stakeholder elicitation. 

The criteria chosen constitute a comprehensive, unambiguous and independent set. Along with the criteria, user-defined critical objectives are used to guide KPI set composition. The particular decision-making approach was selected to keep the number of process stakeholder measurements manageable while allowing the maximum number of relevant and independent criteria. The method has been tested at a chemical process plant on the environment, health and safety process. One of the benefits of KPI set composition is that it may reveal that new KPIs need to be generated. 

KPI lifecycle element 4: implementation

Implementation starts with a selected set of KPIs that will keep the process operating optimally in the face of variation. These chosen KPIs can now be properly implemented within the target process. In this fourth element of the lifecycle, the stakeholders need to:

  • Ensure that the KPIs implemented are accurate, actionable, aligned, documented, independent, inexpensive, predictive, quantifiable, relevant, standardized, timely, traceable, understandable, verified and have buy-in from stakeholders.
  • Ensure that candidate KPI sets satisfy critical objectives and that set size is kept small.
  • Define and implement stakeholder training.
  • Define and conduct process-performance assessments, examining KPI values and trends periodically.
  • Define procedures for handling changing circumstances, such as customer requirements, machine health, critical objectives, KPI definitions, new stakeholders, etc.
  • Define procedures for using knowledge about KPI-to-KPI relationships and dependencies and for describing action plans for improving process control from KPI values.

KPI lifecycle element 5: assessment

The final activity in the lifecycle is KPI assessment. This is when stakeholders take time to examine how relevant the KPIs are performing (different than process performance). It is also the time to examine how well have the KPIs been implemented. KPI assessment is typically done over longer time spans as compared with assessment of KPI values. The following are the key elements in the assessment: 

  • Determine how well the KPIs align with current performance objectives for the process. 
  • Determine how well the KPIs perform with respect to the criteria.

Take these results and generate a prioritized list of action items by KPI, criterion  pairs formed by measuring the importance of the KPI to the process. And then list how well the KPI performs with respect to the criteria. Plot the KPI, criterion performance with the KPI, critical objective performance and assess ways to improve the performance of the KPIs. 

— John Horst, MESA member, National Institute of Standards and Technology (NIST) and Barry Ezell, Virginia Modeling, Analysis and Simulation Center (VMASC). This article originally appeared on MESA’s blog. MESA is a CFE Media content partner. Edited by Erin Dunne, production coordinator, CFE Media, edunne@cfemedia.com.



No comments
The Top Plant program honors outstanding manufacturing facilities in North America. View the 2015 Top Plant.
The Product of the Year program recognizes products newly released in the manufacturing industries.
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
2017 Lubrication Guide; Software tools; Microgrids and energy strategies; Use robots effectively
Prescriptive maintenance; Hannover Messe 2017 recap; Reduce welding errors
Safety standards and electrical test instruments; Product of the Year winners; Easy and safe electrical design
Infrastructure for natural gas expansion; Artificial lift methods; Disruptive technology and fugitive gas emissions
Mobility as the means to offshore innovation; Preventing another Deepwater Horizon; ROVs as subsea robots; SCADA and the radio spectrum
Future of oil and gas projects; Reservoir models; The importance of SCADA to oil and gas
Diagnostic functions for system safety; Specifying industrial enclosures; Effective decision support for a crisis
Transformers; Electrical system design; Selecting and sizing transformers; Grounded and ungrounded system design, Paralleling generator systems
Natural gas for tomorrow's fleets; Colleges and universities moving to CHP; Power and steam and frozen foods

Annual Salary Survey

Before the calendar turned, 2016 already had the makings of a pivotal year for manufacturing, and for the world.

There were the big events for the year, including the United States as Partner Country at Hannover Messe in April and the 2016 International Manufacturing Technology Show in Chicago in September. There's also the matter of the U.S. presidential elections in November, which promise to shape policy in manufacturing for years to come.

But the year started with global economic turmoil, as a slowdown in Chinese manufacturing triggered a worldwide stock hiccup that sent values plummeting. The continued plunge in world oil prices has resulted in a slowdown in exploration and, by extension, the manufacture of exploration equipment.

Read more: 2015 Salary Survey

Maintenance and reliability tips and best practices from the maintenance and reliability coaches at Allied Reliability Group.
The One Voice for Manufacturing blog reports on federal public policy issues impacting the manufacturing sector. One Voice is a joint effort by the National Tooling and Machining...
The Society for Maintenance and Reliability Professionals an organization devoted...
Join this ongoing discussion of machine guarding topics, including solutions assessments, regulatory compliance, gap analysis...
IMS Research, recently acquired by IHS Inc., is a leading independent supplier of market research and consultancy to the global electronics industry.
Maintenance is not optional in manufacturing. It’s a profit center, driving productivity and uptime while reducing overall repair costs.
The Lachance on CMMS blog is about current maintenance topics. Blogger Paul Lachance is president and chief technology officer for Smartware Group.
The maintenance journey has been a long, slow trek for most manufacturers and has gone from preventive maintenance to predictive maintenance.
Featured articles highlight technologies that enable the Industrial Internet of Things, IIoT-related products and strategies to get data more easily to the user.
This digital report will explore several aspects of how IIoT will transform manufacturing in the coming years.
Maintenance Manager; California Oils Corp.
Associate, Electrical Engineering; Wood Harbinger
Control Systems Engineer; Robert Bosch Corp.
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
click me