# Improve cost estimating accuracy

## How many times have you used the term "plus or minus 10%" in reference to a cost estimate? Most of us who are in the project world have. Have you ever stopped to think what it really means? In its common engineering usage, "plus or minus X%" is a nearly meaningless phrase inserted after a dollar amount to meet some company criteria.

07/01/2005

How many times have you used the term "plus or minus 10%" in reference to a cost estimate? Most of us who are in the project world have. Have you ever stopped to think what it really means? In its common engineering usage, "plus or minus X%" is a nearly meaningless phrase inserted after a dollar amount to meet some company criteria. Understanding the true meaning of estimating accuracy, and having a method to make more useful estimates, is valuable to bring meaning to real costs.

## The confidence conundrum

If you state that an estimate is accurate to any particular level without a corresponding confidence level, either written with the accuracy statement or part of policy, renders the term truly meaningless. A \$1 million estimate accurate to

In manufacturing, each project is unique, and we have relatively few projects. This includes both the smaller projects typically handled by plant engineering organizations as well as the larger projects (in contrast, for example, to a fast food chain that churns out many copies of the same thing every year). We just don't have a sufficient amount of reliable data to allow a statistically valid analysis to be done.

This is a "Catch 22" if there ever was one. On one hand, our estimate accuracies are invalid without stating confidence, and on the other, we cannot determine confidence. This situation tends to confirm the point made earlier that "in its common engineering usage, 'plus or minus X%' is a nearly meaningless phrase inserted after a dollar amount." The question then becomes how to deal with this conundrum. Here are four suggestions:

## 1. Accept the inevitable

Let's face it; we are not going to get rid of the terms. Accountants and managers are often not statisticians, and a term like "plus or minus 10%" is just verbal shorthand, and needs to be viewed in that way.

## 2. Establish standard accuracies

By establishing two or three standard, stated accuracies, we can assign expected deliverables and degrees of due diligence that will mark acceptance of the stated accuracy. A typical spread would look something like this, but your company can establish any values it wishes and is willing to accept the risks for it.

• Rough Order of Magnitude:

• Conceptual:

• ## 3. Establish deliverable standards

While we can't establish a meaningful confidence level, we can establish a list of required deliverables and an expected level of due diligence done on each of those deliverables for each level of estimating accuracy. Various estimating books have suggestions for what deliverables and to what level they are required, but that should be merely a starting point.

In your company, engineering and management must work together to define both the list and the level of due diligence. The basic statement is: "Do these things, do them well, and the project manager will be confident in the estimate, and management will be willing to accept the attendant risk.

There are some tradeoffs that are inescapable. For example, more deliverables and more due diligence mean more time and more upfront cost. Fewer deliverables and less due diligence translate directly to higher risk that the financial goals will not be met, but have a lower expense to estimate.

Done properly, there is an alignment between the requirements set forth and the accuracy claimed. It is also possible (and all to frequent) to have a misalignment. Typically, it is in the form of too little work for too much stated accuracy in the cause of cost reduction (i.e., keeping estimating expenditures to a minimum).

## 4. Help them understand

We have all used this verbal shorthand so long and so loosely that true understanding of what we mean has become lost. We need to clearly communicate to everyone who sees and uses one of our estimates that 50% of our projects will overrun (the plus side) and 50% underrun (the minus side). Also some percentage will exceed the limits.

In the "confidence" discussion earlier, we talked about a

We should do "lessons learned," especially on projects outside the limits, but barring excessive percentages or demonstrable poor performance, we can accept it as a natural part of the cycle.

Let's look at what happens using these basic assumptions for the same project being run in two different environments. Alignments between funding guidelines and estimating for the two cases are shown in Fig. 2.

The project's base cost estimate is \$1,000,000 in both cases.

Also in both cases there is a personal performance issue for the project manager if there is an overage of more than 10%.

In Company A, the due diligence and deliverables align with the stated

In Company B, the due diligence aligns with

Let's dissect what happened. We started at the same point — a million dollar job. Project manager A spent 5% of the "real cost" for a "true"project manager B will be able to spend his way into compliance with company financial guidelines and a good performance review.

## Contingency vs. accuracy

Contingency and estimate accuracy are often confused. In our example, it looks like project manager B is "double dipping." In fact, he is not. Contingency is added to an estimate to account for unknowns. The more you know, the more confident you are you have your bases covered, and the lower the contingency. In these cases, both project managers honestly evaluated the risks, and B assigned a contingency accordingly larger. Contingency is a risk modifier used to bring the cost estimate to the range midpoint.

Estimate accuracy reflects the statistical probability that the estimate will come within stated parameters. It reflects the width of the bell curve around the midpoint. In PM A's case A need not add anything; required accuracy and confidence in the estimate are aligned. If B's requirement were +/-25% nothing would need to be added there.

However there is a misalignment of accuracy as supported by the deliverables and the requirements of the company. So money is added to make the estimate a +10% (in guideline) -40% (but we won't talk about that). In fact, we move the estimate off from the mid point to secure the high end.

Alignment between deliverables and diligence with stated accuracy must be maintained for optimum cost performance. Since we don't have statistical proof to back this up, project managers must believe it to be true (project manager B was really acting on perception of reality in adding the extra 15%), and management must be willing to either support the effort or accept the risk.

Following these types of steps should improve estimating and cost performance. But after implementation, you will need to assess both the required deliverables and the required level of due diligence. Some deliverables may need to be added. Others will prove of little or no value and should be dropped. The degree of due diligence in creating the deliverables should be adjusted based on experience. In all of this, we are dealing with estimates which by their nature are inaccurate.

We cannot eliminate the uncertainties, but we can manage them. And by managing them, we assure successful projects and, by extension, successful project managers.

Randall Lund can be reached for more information on capital project management at 269-372-9240 or rdlund@ix.netcom.com . Article edited by Executive Editor Richard L. Dunn, 815-236-2196, or dunncomm@comcast.net .

The Top Plant program honors outstanding manufacturing facilities in North America. View the 2017 Top Plant.
The Product of the Year program recognizes products newly released in the manufacturing industries.
Each year, a panel of Control Engineering and Plant Engineering editors and industry expert judges select the System Integrator of the Year Award winners in three categories.
SCCR, 2018 Maintenance study, and VFDs in a washdown environment.
Welding ergonomics, 2017 Salary Survey, and surge protection
2017 Top Plant winner, Best practices, Plant Engineering at 70, Top 10 stories of 2017
Product of the Year winners, Pattern recognition, Engineering analytics, Revitalize older pump installations
Control room technology innovation; Practical approaches to corrosion protection; Pipeline regulator revises quality programs
The cloud, mobility, and remote operations; SCADA and contextual mobility; Custom UPS empowering a secure pipeline
Setting internal automation standards
Knowing how and when to use parallel generators

### Annual Salary Survey

Before the calendar turned, 2016 already had the makings of a pivotal year for manufacturing, and for the world.

There were the big events for the year, including the United States as Partner Country at Hannover Messe in April and the 2016 International Manufacturing Technology Show in Chicago in September. There's also the matter of the U.S. presidential elections in November, which promise to shape policy in manufacturing for years to come.

But the year started with global economic turmoil, as a slowdown in Chinese manufacturing triggered a worldwide stock hiccup that sent values plummeting. The continued plunge in world oil prices has resulted in a slowdown in exploration and, by extension, the manufacture of exploration equipment.

Maintenance and reliability tips and best practices from the maintenance and reliability coaches at Allied Reliability Group.
The One Voice for Manufacturing blog reports on federal public policy issues impacting the manufacturing sector. One Voice is a joint effort by the National Tooling and Machining...
The Society for Maintenance and Reliability Professionals an organization devoted...
Join this ongoing discussion of machine guarding topics, including solutions assessments, regulatory compliance, gap analysis...
IMS Research, recently acquired by IHS Inc., is a leading independent supplier of market research and consultancy to the global electronics industry.
Maintenance is not optional in manufacturing. It’s a profit center, driving productivity and uptime while reducing overall repair costs.
The Lachance on CMMS blog is about current maintenance topics. Blogger Paul Lachance is president and chief technology officer for Smartware Group.
The maintenance journey has been a long, slow trek for most manufacturers and has gone from preventive maintenance to predictive maintenance.
This digital report explains how plant engineers and subject matter experts (SME) need support for time series data and its many challenges.
This digital report will explore several aspects of how IIoT will transform manufacturing in the coming years.
Maintenance Manager; California Oils Corp.
Associate, Electrical Engineering; Wood Harbinger
Control Systems Engineer; Robert Bosch Corp.
This course focuses on climate analysis, appropriateness of cooling system selection, and combining cooling systems.
This course will help identify and reveal electrical hazards and identify the solutions to implementing and maintaining a safe work environment.
This course explains how maintaining power and communication systems through emergency power-generation systems is critical.