Five elements of KPI lifecycle

Key Performance Indicators (KPIs) have a lifecycle with a similarly cyclic pattern: from definition to collection to set composition to implementation to assessment and back to definition. Manufacturers who use KPIs naturally implement this lifecycle, but there is some real value to clearly and carefully articulate the elements of the lifecycle.

05/26/2016



Humans go through distinct phases of life: from dependence to learning to producing to sharing and back to dependence. We call this a lifecycle. The phases of life keep repeating as new persons are born and the elderly complete their lives. 

Key Performance Indicators (KPIs) also have a lifecycle with a similarly cyclic pattern: from definition to collection to set composition to implementation to assessment and back to definition

Manufacturers who use KPIs naturally implement this lifecycle, but there is some real value to clearly and carefully articulate the elements of the lifecycle. 

Key Performance Indicators (KPIs) have a lifecycle with a similarly cyclic pattern: from definition to collection to set composition to implementation to assessment and back to definition. Courtesy: MESA

An accurate and detailed model of the KPI Lifecycle:

  • Enables efficient and effective performance management 
  • Enables a cottage industry of performance methods and software tools
  • Provides a basis for open standards on KPI use.

Assuming the target processes have been identified, here is an outline of five elements to consider to successfully use KPIs in your manufacturing process throughout their entire lifecycle. 

KPI lifecycle element 1: definition

The first element of the KPI lifecycle is KPI definition. Since there are probably tens of thousands of different KPIs used by manufacturers, one might think that all the KPIs that need to be defined have been defined. To be sure, KPIs like quality ratio, overall equipment efectiveness index, scrap ratio and rework ratio are not going away any time soon, but KPIs may sometimes need to be redefined as a more focused or aggregate KPI. 

Furthermore, as corporate objectives change over time, KPIs change. Corporate objectives drive the definition and use of KPIs—remember how the sustainability objective quickly became an increasingly important metric? But, it’s important to follow good KPI definition practices, otherwise interoperability will suffer throughout your supply chain. 

KPI lifecycle element 2: collection

The second element of the lifecycle is KPI collection. Collection consists largely of excluding obvious outlier KPIs from consideration like irrelevant KPIs. Still, one can easily end up with far too many candidate KPIs. 

Keep in mind that humans typically monitor KPIs, but humans can only comprehend and process five to nine distinct items simultaneously (the “seven plus or minus two” rule from psychologist George Miller). Therefore, we have a need for KPI set composition, our next step in the lifecycle.

KPI lifecycle element 3: set composition

The third element of the lifecycle is KPI set composition, which is substantially more complicated than KPI collection. The following guidelines should be followed: 

  • Select appropriate KPI performance criteria (ISO 22400 Part 1).
  • Follow the “seven plus or minus two” rule for the number of KPIs selected.
  • Find the sweet spot between detailed versus aggregate KPIs. 
  • Ensure that the chosen KPIs satisfy all the stated critical objectives of the process.

A structured criteria-based method to satisfy these guidelines has been generated at the National Institute of Standards and Technology. It enables a group of stakeholders to form an effective subset of KPIs from a larger set of candidate KPIs, whether the KPIs are currently in use or not. It also employs value-based decision-making for accurate stakeholder elicitation. 

The criteria chosen constitute a comprehensive, unambiguous and independent set. Along with the criteria, user-defined critical objectives are used to guide KPI set composition. The particular decision-making approach was selected to keep the number of process stakeholder measurements manageable while allowing the maximum number of relevant and independent criteria. The method has been tested at a chemical process plant on the environment, health and safety process. One of the benefits of KPI set composition is that it may reveal that new KPIs need to be generated. 

KPI lifecycle element 4: implementation

Implementation starts with a selected set of KPIs that will keep the process operating optimally in the face of variation. These chosen KPIs can now be properly implemented within the target process. In this fourth element of the lifecycle, the stakeholders need to:

  • Ensure that the KPIs implemented are accurate, actionable, aligned, documented, independent, inexpensive, predictive, quantifiable, relevant, standardized, timely, traceable, understandable, verified and have buy-in from stakeholders.
  • Ensure that candidate KPI sets satisfy critical objectives and that set size is kept small.
  • Define and implement stakeholder training.
  • Define and conduct process-performance assessments, examining KPI values and trends periodically.
  • Define procedures for handling changing circumstances, such as customer requirements, machine health, critical objectives, KPI definitions, new stakeholders, etc.
  • Define procedures for using knowledge about KPI-to-KPI relationships and dependencies and for describing action plans for improving process control from KPI values.

KPI lifecycle element 5: assessment

The final activity in the lifecycle is KPI assessment. This is when stakeholders take time to examine how relevant the KPIs are performing (different than process performance). It is also the time to examine how well have the KPIs been implemented. KPI assessment is typically done over longer time spans as compared with assessment of KPI values. The following are the key elements in the assessment: 

  • Determine how well the KPIs align with current performance objectives for the process. 
  • Determine how well the KPIs perform with respect to the criteria.

Take these results and generate a prioritized list of action items by KPI, criterion  pairs formed by measuring the importance of the KPI to the process. And then list how well the KPI performs with respect to the criteria. Plot the KPI, criterion performance with the KPI, critical objective performance and assess ways to improve the performance of the KPIs. 

— John Horst, MESA member, National Institute of Standards and Technology (NIST) and Barry Ezell, Virginia Modeling, Analysis and Simulation Center (VMASC). This article originally appeared on MESA’s blog. MESA is a CFE Media content partner. Edited by Erin Dunne, production coordinator, CFE Media, edunne@cfemedia.com.



Top Plant
The Top Plant program honors outstanding manufacturing facilities in North America.
Product of the Year
The Product of the Year program recognizes products newly released in the manufacturing industries.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
July/Aug
GAMS preview, 2018 Mid-Year Report, EAM and Safety
June 2018
2018 Lubrication Guide, Motor and maintenance management, Control system migration
May 2018
Electrical standards, robots and Lean manufacturing, and how an aluminum packaging plant is helping community growth.
April 2018
2017 Product of the Year winners, retrofitting a press, IMTS and Hannover Messe preview, natural refrigerants, testing steam traps
August 2018
SCADA standardization, capital expenditures, data-driven drilling and execution
June 2018
Machine learning, produced water benefits, programming cavity pumps
April 2018
ROVs, rigs, and the real time; wellsite valve manifolds; AI on a chip; analytics use for pipelines
Spring 2018
Burners for heat-treating furnaces, CHP, dryers, gas humidification, and more
August 2018
Choosing an automation controller, Lean manufacturing
February 2018
Setting internal automation standards

Annual Salary Survey

After two years of economic concerns, manufacturing leaders once again have homed in on the single biggest issue facing their operations:

It's the workers—or more specifically, the lack of workers.

The 2017 Plant Engineering Salary Survey looks at not just what plant managers make, but what they think. As they look across their plants today, plant managers say they don’t have the operational depth to take on the new technologies and new challenges of global manufacturing.

Read more: 2017 Salary Survey

The Maintenance and Reliability Coach's blog
Maintenance and reliability tips and best practices from the maintenance and reliability coaches at Allied Reliability Group.
One Voice for Manufacturing
The One Voice for Manufacturing blog reports on federal public policy issues impacting the manufacturing sector. One Voice is a joint effort by the National Tooling and Machining...
The Maintenance and Reliability Professionals Blog
The Society for Maintenance and Reliability Professionals an organization devoted...
Machine Safety
Join this ongoing discussion of machine guarding topics, including solutions assessments, regulatory compliance, gap analysis...
Research Analyst Blog
IMS Research, recently acquired by IHS Inc., is a leading independent supplier of market research and consultancy to the global electronics industry.
Marshall on Maintenance
Maintenance is not optional in manufacturing. It’s a profit center, driving productivity and uptime while reducing overall repair costs.
Lachance on CMMS
The Lachance on CMMS blog is about current maintenance topics. Blogger Paul Lachance is president and chief technology officer for Smartware Group.
Material Handling
This digital report explains how everything from conveyors and robots to automatic picking systems and digital orders have evolved to keep pace with the speed of change in the supply chain.
Electrical Safety Update
This digital report explains how plant engineers need to take greater care when it comes to electrical safety incidents on the plant floor.
IIoT: Machines, Equipment, & Asset Management
Articles in this digital report highlight technologies that enable Industrial Internet of Things, IIoT-related products and strategies.
Randy Steele
Maintenance Manager; California Oils Corp.
Matthew J. Woo, PE, RCDD, LEED AP BD+C
Associate, Electrical Engineering; Wood Harbinger
Randy Oliver
Control Systems Engineer; Robert Bosch Corp.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
click me