How to find value in a KPI lifecycle

Key Performance Indicators (KPIs) are part of a lifecycle because KPIs are continuously defined, redefined, and are even sometimes abandoned. Explicitly defining a KPI lifecycle provides an impetus for the development of methods and tools that enhance performance.


Key Performance Indicators (KPIs) are part of a lifecycle because KPIs are continuously defined, redefined, and are even sometimes abandoned. Explicitly defining a KPI lifecycle provides an impetus for the development of methods and tools that enhance performance.  


The National Institute of Standards and Technology and Virginia Modeling, Analysis and Simulation Center have designed two methods to define KPI lifecycle: one for performing KPI set composition and the other for KPI assessment.  

Both methods need to produce accurate results. But how can we know that the methods are producing accurate results—thereby, providing real value to the manufacturer?

Testing, not simulation

Given the nature of the models, KPI set composition and KPI assessment cannot be effectively modeled via simulation software. Therefore, to verify the efficacy of both methods, live tests with process stakeholders need to be conducted. And, the tests must be performed at real plant operations with dedicated involvement of process stakeholders.

To date, we have conducted three tests on three target processes at three separate plants. Two out of three tests involved the KPI assessment method only.

We did this because all three organizations are mature in their use of KPIs in the chosen target processes. Two are chemical plants (one large and one small) and one is a microchip-fabrication plant. Each testing event took less than one day to perform and included full involvement from expert stakeholders.Note that KPI set composition was never fully tested because the majority of KPIs examined by the methods were already implemented in the target processes that were tested. In the future, we will examine a process and test the KPI set composition method on a target process that currently has no KPIs assigned to it.

KPI scores for 10 candidate KPIs. Courtesy: MESA

Goals for KPI assessment method

  1. The first goal for testing events using the KPI assessment method is to generate a measurement of the general effectiveness of each KPI with respect to a set of KPI performance criteria from ISO 22400 Part.
  2. The second goal is to generate KPI/criterion pairs and rank them based on the level of priority that the KPIs need to be improved in the domain of the criterion.
  3. The third goal is to examine how well the KPIs satisfy the critical objectives. For example, scores were generated in answer to the question, “How well is the KPI performing with respect to having buy-in from the process stakeholders?”

Results for KPI assessment method

Example test results for KPI effectiveness and KPI criterion priorities are shown in the table labeled “Output of KPI Assessment Method.” The scores for the 10 candidate KPIs give a general effectiveness score across all the criteria. The improvement scores for KPI/criterion pairs are high when the KPI is important to the process but is performing poorly with respect to the criterion

— John Horst, MESA member, National Institute of Standards and Technology (NIST)and Barry Ezell, Virginia Modeling, Analysis and Simulation Center (VMASC). This article originally appeared on MESA ’s blog. MESA is a CFE Media content partner. Edited by Erin Dunne, production coordinator, CFE Media,

No comments
The Top Plant program honors outstanding manufacturing facilities in North America. View the 2015 Top Plant.
The Product of the Year program recognizes products newly released in the manufacturing industries.
The Engineering Leaders Under 40 program identifies and gives recognition to young engineers who...
Safer human-robot collaboration; 2017 Maintenance Survey; Digital Training; Converting your lighting system
IIoT grows up; Six ways to lower IIoT costs; Six mobile safety strategies; 2017 Salary Survey
2016 Top Plant; 2016 Best Practices on manufacturing progress, efficiency, safety
Mobility as the means to offshore innovation; Preventing another Deepwater Horizon; ROVs as subsea robots; SCADA and the radio spectrum
Future of oil and gas projects; Reservoir models; The importance of SCADA to oil and gas
Big Data and bigger solutions; Tablet technologies; SCADA developments
Automation modernization; Predictive analytics enable open connectivity; System integration success; Automation turns home brewer into brew house
Commissioning electrical systems; Designing emergency and standby generator systems; Paralleling switchgear generator systems
Natural gas for tomorrow's fleets; Colleges and universities moving to CHP; Power and steam and frozen foods

Annual Salary Survey

Before the calendar turned, 2016 already had the makings of a pivotal year for manufacturing, and for the world.

There were the big events for the year, including the United States as Partner Country at Hannover Messe in April and the 2016 International Manufacturing Technology Show in Chicago in September. There's also the matter of the U.S. presidential elections in November, which promise to shape policy in manufacturing for years to come.

But the year started with global economic turmoil, as a slowdown in Chinese manufacturing triggered a worldwide stock hiccup that sent values plummeting. The continued plunge in world oil prices has resulted in a slowdown in exploration and, by extension, the manufacture of exploration equipment.

Read more: 2015 Salary Survey

Maintenance and reliability tips and best practices from the maintenance and reliability coaches at Allied Reliability Group.
The One Voice for Manufacturing blog reports on federal public policy issues impacting the manufacturing sector. One Voice is a joint effort by the National Tooling and Machining...
The Society for Maintenance and Reliability Professionals an organization devoted...
Join this ongoing discussion of machine guarding topics, including solutions assessments, regulatory compliance, gap analysis...
IMS Research, recently acquired by IHS Inc., is a leading independent supplier of market research and consultancy to the global electronics industry.
Maintenance is not optional in manufacturing. It’s a profit center, driving productivity and uptime while reducing overall repair costs.
The Lachance on CMMS blog is about current maintenance topics. Blogger Paul Lachance is president and chief technology officer for Smartware Group.
This digital report will explore several aspects of how IIoT will transform manufacturing in the coming years.
Motion control advances and solutions can help with machine control, automated control on assembly lines, integration of robotics and automation, and machine safety.
Compressed air plays a vital role in most manufacturing plants, and availability of compressed air is crucial to a wide variety of operations.
Maintenance Manager; California Oils Corp.
Associate, Electrical Engineering; Wood Harbinger
Control Systems Engineer; Robert Bosch Corp.
click me