Improve cost estimating accuracy

How many times have you used the term "plus or minus 10%" in reference to a cost estimate? Most of us who are in the project world have. Have you ever stopped to think what it really means? In its common engineering usage, "plus or minus X%" is a nearly meaningless phrase inserted after a dollar amount to meet some company criteria.

07/01/2005


How many times have you used the term "plus or minus 10%" in reference to a cost estimate? Most of us who are in the project world have. Have you ever stopped to think what it really means? In its common engineering usage, "plus or minus X%" is a nearly meaningless phrase inserted after a dollar amount to meet some company criteria. Understanding the true meaning of estimating accuracy, and having a method to make more useful estimates, is valuable to bring meaning to real costs.

The confidence conundrum

If you state that an estimate is accurate to any particular level without a corresponding confidence level, either written with the accuracy statement or part of policy, renders the term truly meaningless. A $1 million estimate accurate to

In manufacturing, each project is unique, and we have relatively few projects. This includes both the smaller projects typically handled by plant engineering organizations as well as the larger projects (in contrast, for example, to a fast food chain that churns out many copies of the same thing every year). We just don't have a sufficient amount of reliable data to allow a statistically valid analysis to be done.

This is a "Catch 22" if there ever was one. On one hand, our estimate accuracies are invalid without stating confidence, and on the other, we cannot determine confidence. This situation tends to confirm the point made earlier that "in its common engineering usage, 'plus or minus X%' is a nearly meaningless phrase inserted after a dollar amount." The question then becomes how to deal with this conundrum. Here are four suggestions:

1. Accept the inevitable

Let's face it; we are not going to get rid of the terms. Accountants and managers are often not statisticians, and a term like "plus or minus 10%" is just verbal shorthand, and needs to be viewed in that way.

2. Establish standard accuracies

By establishing two or three standard, stated accuracies, we can assign expected deliverables and degrees of due diligence that will mark acceptance of the stated accuracy. A typical spread would look something like this, but your company can establish any values it wishes and is willing to accept the risks for it.

  • Rough Order of Magnitude:

  • Conceptual:

  • Capital Grade:

    • 3. Establish deliverable standards

      While we can't establish a meaningful confidence level, we can establish a list of required deliverables and an expected level of due diligence done on each of those deliverables for each level of estimating accuracy. Various estimating books have suggestions for what deliverables and to what level they are required, but that should be merely a starting point.

      In your company, engineering and management must work together to define both the list and the level of due diligence. The basic statement is: "Do these things, do them well, and the project manager will be confident in the estimate, and management will be willing to accept the attendant risk.

      There are some tradeoffs that are inescapable. For example, more deliverables and more due diligence mean more time and more upfront cost. Fewer deliverables and less due diligence translate directly to higher risk that the financial goals will not be met, but have a lower expense to estimate.

      Done properly, there is an alignment between the requirements set forth and the accuracy claimed. It is also possible (and all to frequent) to have a misalignment. Typically, it is in the form of too little work for too much stated accuracy in the cause of cost reduction (i.e., keeping estimating expenditures to a minimum).

      4. Help them understand

      We have all used this verbal shorthand so long and so loosely that true understanding of what we mean has become lost. We need to clearly communicate to everyone who sees and uses one of our estimates that 50% of our projects will overrun (the plus side) and 50% underrun (the minus side). Also some percentage will exceed the limits.

      In the "confidence" discussion earlier, we talked about a

      We should do "lessons learned," especially on projects outside the limits, but barring excessive percentages or demonstrable poor performance, we can accept it as a natural part of the cycle.

      Let's look at what happens using these basic assumptions for the same project being run in two different environments. Alignments between funding guidelines and estimating for the two cases are shown in Fig. 2.

      The project's base cost estimate is $1,000,000 in both cases.

      Also in both cases there is a personal performance issue for the project manager if there is an overage of more than 10%.

      In Company A, the due diligence and deliverables align with the stated

      In Company B, the due diligence aligns with

      Let's dissect what happened. We started at the same point — a million dollar job. Project manager A spent 5% of the "real cost" for a "true"project manager B will be able to spend his way into compliance with company financial guidelines and a good performance review.

      Contingency vs. accuracy

      Contingency and estimate accuracy are often confused. In our example, it looks like project manager B is "double dipping." In fact, he is not. Contingency is added to an estimate to account for unknowns. The more you know, the more confident you are you have your bases covered, and the lower the contingency. In these cases, both project managers honestly evaluated the risks, and B assigned a contingency accordingly larger. Contingency is a risk modifier used to bring the cost estimate to the range midpoint.

      Estimate accuracy reflects the statistical probability that the estimate will come within stated parameters. It reflects the width of the bell curve around the midpoint. In PM A's case A need not add anything; required accuracy and confidence in the estimate are aligned. If B's requirement were +/-25% nothing would need to be added there.

      However there is a misalignment of accuracy as supported by the deliverables and the requirements of the company. So money is added to make the estimate a +10% (in guideline) -40% (but we won't talk about that). In fact, we move the estimate off from the mid point to secure the high end.

      Alignment between deliverables and diligence with stated accuracy must be maintained for optimum cost performance. Since we don't have statistical proof to back this up, project managers must believe it to be true (project manager B was really acting on perception of reality in adding the extra 15%), and management must be willing to either support the effort or accept the risk.

      Following these types of steps should improve estimating and cost performance. But after implementation, you will need to assess both the required deliverables and the required level of due diligence. Some deliverables may need to be added. Others will prove of little or no value and should be dropped. The degree of due diligence in creating the deliverables should be adjusted based on experience. In all of this, we are dealing with estimates which by their nature are inaccurate.

      We cannot eliminate the uncertainties, but we can manage them. And by managing them, we assure successful projects and, by extension, successful project managers.

      More Info:

      Randall Lund can be reached for more information on capital project management at 269-372-9240 or rdlund@ix.netcom.com . Article edited by Executive Editor Richard L. Dunn, 815-236-2196, or dunncomm@comcast.net .



Top Plant
The Top Plant program honors outstanding manufacturing facilities in North America.
Product of the Year
The Product of the Year program recognizes products newly released in the manufacturing industries.
System Integrator of the Year
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
September 2018
2018 Engineering Leaders under 40, Women in Engineering, Six ways to reduce waste in manufacturing, and Four robot implementation challenges.
July/Aug
GAMS preview, 2018 Mid-Year Report, EAM and Safety
June 2018
2018 Lubrication Guide, Motor and maintenance management, Control system migration
August 2018
SCADA standardization, capital expenditures, data-driven drilling and execution
June 2018
Machine learning, produced water benefits, programming cavity pumps
April 2018
ROVs, rigs, and the real time; wellsite valve manifolds; AI on a chip; analytics use for pipelines
Spring 2018
Burners for heat-treating furnaces, CHP, dryers, gas humidification, and more
August 2018
Choosing an automation controller, Lean manufacturing
September 2018
Effective process analytics; Four reasons why LTE networks are not IIoT ready

Annual Salary Survey

After two years of economic concerns, manufacturing leaders once again have homed in on the single biggest issue facing their operations:

It's the workers—or more specifically, the lack of workers.

The 2017 Plant Engineering Salary Survey looks at not just what plant managers make, but what they think. As they look across their plants today, plant managers say they don’t have the operational depth to take on the new technologies and new challenges of global manufacturing.

Read more: 2017 Salary Survey

The Maintenance and Reliability Coach's blog
Maintenance and reliability tips and best practices from the maintenance and reliability coaches at Allied Reliability Group.
One Voice for Manufacturing
The One Voice for Manufacturing blog reports on federal public policy issues impacting the manufacturing sector. One Voice is a joint effort by the National Tooling and Machining...
The Maintenance and Reliability Professionals Blog
The Society for Maintenance and Reliability Professionals an organization devoted...
Machine Safety
Join this ongoing discussion of machine guarding topics, including solutions assessments, regulatory compliance, gap analysis...
Research Analyst Blog
IMS Research, recently acquired by IHS Inc., is a leading independent supplier of market research and consultancy to the global electronics industry.
Marshall on Maintenance
Maintenance is not optional in manufacturing. It’s a profit center, driving productivity and uptime while reducing overall repair costs.
Lachance on CMMS
The Lachance on CMMS blog is about current maintenance topics. Blogger Paul Lachance is president and chief technology officer for Smartware Group.
Material Handling
This digital report explains how everything from conveyors and robots to automatic picking systems and digital orders have evolved to keep pace with the speed of change in the supply chain.
Electrical Safety Update
This digital report explains how plant engineers need to take greater care when it comes to electrical safety incidents on the plant floor.
IIoT: Machines, Equipment, & Asset Management
Articles in this digital report highlight technologies that enable Industrial Internet of Things, IIoT-related products and strategies.
Randy Steele
Maintenance Manager; California Oils Corp.
Matthew J. Woo, PE, RCDD, LEED AP BD+C
Associate, Electrical Engineering; Wood Harbinger
Randy Oliver
Control Systems Engineer; Robert Bosch Corp.
Data Centers: Impacts of Climate and Cooling Technology
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
Safety First: Arc Flash 101
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
Critical Power: Hospital Electrical Systems
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.
Design of Safe and Reliable Hydraulic Systems for Subsea Applications
This eGuide explains how the operation of hydraulic systems for subsea applications requires the user to consider additional aspects because of the unique conditions that apply to the setting
click me