EIA-748 guidelines, as interpreted for major U.S. Government projects, require that project managers develop and maintain bottoms-up estimates of the cost and schedule outcomes of their projects. There is a requirement for a comprehensive bottoms-up forecast to be done at least annually. That is supported by a requirement for a monthly update to the forecast, including best-case, worst-case, and most-likely outcomes for the project estimated final total cost.
This webinar covers these requirements and common associated processes and methods for developing the forecasts.
Included in the discussion are the topics of risk and opportunities management and their relationship to the EVMS; especially focused on the development of the risk/opportunities informed forecasts.
Rather than the development of three potential outcomes for the project timeline, the schedule portion of the discussion focuses on building and maintaining an Integrated Master Schedule (IMS) that meets the Generally Accepted Scheduling Principles (GASP) and the use of that IMS in establishing the probability of meeting the end date based on Schedule Risk Analysis (SRA) techniques.
The discussion ends with the topic of independent evaluations of the forecast using the Independent Estimate-at-Complete (IEAC) analysis process.
Download the presentation to learn more or visit us at www.unanet.com.
Welcome everyone to our webcast on Project Forecasting from the Perspective of an Earned Value Management Systems ands EIA-748. In prior webinars we have covered the basics of Earned Value and today we’re going a little deeper into project forecasting.
I am Richard Hayden with Unanet and am here today with Paul Bollinger, Engagement Director with Humphreys and Associates. Humphreys and Associates have been recognized as leading experts in EVMS for over three decades. I think I first met and worked with Gary Humphries, President and CEO of Humphries & Associates in about 1990.
Paul is going to present the content here today, but before we get started I wanted to cover a couple of housekeeping items. We want you to submit any questions you have throughout the webcast via the gotowebinar dialog on the right of the screen. We will answer those questions if we have time at the end or via follow up email afterwards. Also you will receive a copy of this presentation and the recording within 48 hours.
To start we’d like to get a sense of how many of you are exposed to formal earned value according to EIA-748
Earned Value Management (EVM) is based upon some widely accepted guidelines. These guidelines evolved from government mandated specifications for management systems, to the government’s set of Guidelines a management system had to meet to be considered acceptable to the government, and finally to an industry-wide set of standards for earned value management systems – the EIA-748-D Standard for EVMS.
The EVMS Guidelines are intended to serve as standards for measuring the adequacy of a management control system. Contractors are free to organize in the manner best suited to their individual environments and management philosophies, and may select the internal methods and procedures of their choice.
In other words, there are probably as many ways to design a system to satisfy these guidelines as there are organizations that use them. However, the resulting system must provide the data and possess the capabilities specified in the guidelines in order to be acceptable.
Subcontractors may also be required by their prime contractors to satisfy the guidelines and provide reports that directly support prime contractor reports with similar data.
Based on our research we generated this list of reasons for project failure. Let’s talk about them and out them in perspective. If you have had any experiences with these, please share with the other attendees as the instructor covers them.
As we go through the workshop, we will periodically refer back to the causes of failure pointing out how a properly implemented and managed EVMS can help mitigate or eliminate failure.
The instructor should cover each bullet. Note that two following charts deep dive into communications and scope creep.
The feedback loops are the important aspects of this process map. The manager does not organize once, does not plan once, and does not direct just once. Those steps are on-going and result from the control step.
Discuss – if we see a failure or weakness in communications then we do…..
Discuss – if we detect scope creep then we do….
And so on….with the issues of project failures.
The manager spends most of his time in the control mode or step. The actions that can be taken are re-organizing, re-planning, and re-directing so those steps are repeated as needed. But each period during the project we take measurements, decide what they mean, and take action to correct our efforts to get back on plan.
The EVMS is perfect for this step because it provide large amounts of project information about plans progress in terms of budgets, accomplishments, and actual costs. It requires forecasts also. It is in the area of planning and forecasting where most decisions are made.
Each time we detect a movement toward failure then we act.
This is a common architecture for an EVMS. The Integrated Master Schedule (IMS) is built in a tool like Primavera, Open Plan, or Microsoft Project. The information about plans, progress, and forecasts begins in the IMS. The EV engine is where budget rates and forecast rates are kept and where all the informational elements are brought together to generate the management information.
The ERP system of the company is the source of information on actual costs and things like material receipts and issues as well as manufacturing.
Many companies use a viewer/analyzer tool to help them go through the data and see the significant issues.
There are special topic tools used along side the main tolls to do things schedule risk analysis. It is in these adjunct tools where computer simulations of the decisions and outcome will usually be done.
EAC is graphically displayed in a picture is like this.
This chart shows resources on the vertical axis, time on the horizontal axis, and a vertical line extending from the Time axis to represent Time Now. This shows that actual costs have been collected through Time Now. Next is to figure out what the EAC is. So what needs to be done? The answer is to figure out how much work is remaining to be done and then estimate how much that work is going to cost.
Now the difference between what has been spent already and the EAC is called the Estimate To Complete. People have a tendency to get the two terms Estimate At Complete and Estimate To Complete confused.
The real meat of the exercise is to figure what remains to be done and then re-estimate it just as was done at the beginning of the project. And of course, once the ETC is determined, by adding it to what was already spent (ACWP), the end result is the EAC. The BCWP value is a key element in evaluating the remaining effort to be completed.
This chart shows the EAC picture. Note how it shows that the Estimate At Completion is a dollar value at a point in time and is composed of the actual costs to date plus the estimated cost to complete the work.
This is the picture of what we have been saying. Vertical is resources, horizontal is time. Here is the full plan, the BAC, and this is the original expected (contractual) completion date. Our earned value has not quite been what we had hoped some are - SV. And our actual cost has exceeded our work completed by a significant amount. The Contractor project manager has to provide the best case, worst case, and most likely case EACs. Then the customer project manager calculates the straight-line IEAC and puts that in here. That’s where the project is projected to operate in the future as it has operated in the past. If that is how the project operates, this is where it will be at the end.
Here is an expanded illustration of the WBS/RAM and the resultant Control Account, which exists to capture scope of work measured in effort; materials; equipment; or any other resource consuming work. However, the control account is not the lowest level at which planning takes place. A control account is further divided into work packages and planning packages. Work packages are near term efforts that can be planned in sufficient detail to enable meaningful performance measurement. Planning packages represent work in the future about which not enough is known to do detail planning. (More on Planning Packages later.) Both work packages and planning packages contain a scope of work and time-phased budgets that sum to the control account’s time-phased budget. Work Packages are usually decomposed to measurable activities, each of which consumes time and resources as we already defined them. Level of detail parameters--also a product of the planning process we already defined--will govern the size of each Control Account's resources, both in time and monetary units. You and your company--working with the customer--will decide on the size of the Control Accounts.
Data Item Description DI-MGMT-81334C places the Work Breakdown Structure and the associated dictionary on contract. As stated previously, the first three levels of the WBS are usually fixed by the procuring agency. The contractor is then required to further refine the Work Breakdown Structure and develop definitions for each WBS element by compiling the dictionary.
The data item description for earned value reporting has some very specific requirements earning the estimate at complete.
This is one area where the data item description demands that risks and opportunities be considered the development of the project forecast.
In fact, the use of risks and opportunities in developing these forecasts should be explained in the project report
This is the Integrated Program Management Report (IPMR) Format 1. It is delivered monthly and is essentially the same as the CPR Format 1. Some of the block sizes are different such as Block 5.h. and Block 6. Column (1).
There are four responses or strategies to risk:
Some risks are part of doing business. We have a lot of experience in our company and we know how to be prepared for most events we encounter because we have seen them before. Having a detailed plan and schedule is a risk acceptance strategy.
The risk may be more consequential than project funding can absorb. Therefore, we purchase insurance for certain risk events. If the event occurs, we have the resources to cope with the event. Likewise, engaging a specialty contractor to perform a specific function (like X-rays of welds) is also a risk reduction tactic: engage the organization that does the specialty task for a living.
Some risks require a specific plan that may include active participation by other organizations. Jobsite accidents or breaches of security can be catastrophic, so an aggressive safety and security program can minimize risks and lost time associated with those types of events.
Excluding the risk includes contract language like Force Majeure. The massive tornado, the earthquake, a wildfire, etc., are classified in Contract language as Force Majeure events for which schedule relief is provided if the event occurs.
One of the requirements the integrated Master schedule data item description is that efforts identified in the risk mitigation planning area of the risk management register should be contained in the integrated Master schedule and identified with their relationship to the risk management register.
This example shows coding the integrated Master schedule that provides that relationship back the risk management register.
Is coding by the way for the schedule to be grouped and sorted by risk items instead of the normal sort by to ask or date or other structure such as the work breakdown structure. Having a schedule group and sorted and displayed by risk item is a powerful way to be able to communicate the project risk situation and plans for mitigation.
As a project progresses and actual events and costs do not follow plan (the third certainty after death and taxes), funding requirement’s will change if the desire is to complete the scope of work within the original schedule.
As the situation changes, companies must continually monitor the elements that make up the funds requirement. If material commitment are falling behind schedule, funds may not be needed as soon as planned. If actual costs are exceeding the budget plan, funds may be needed sooner than planned. Note that we did NOT say “actual costs are exceeding earned value” – this is the only instance in earned value management where expenditure variance (actuals versus budget) is important.
The project’s Estimate To Complete considers these possibilities and replaces the budget profile as the basis for forecasting funding requirements. In the example, the red line depicts a revised funding forecast based on the actual costs to date, the ETC, and the other factors previously mentioned that exceeds the current authorized funding. If the customer can support the revised profile, the ETC/EAC process is complete. However, if the customer cannot support this profile, a new ETC plan must be developed to bring the funding requirements within the customer’s capability. Usually, this results in a schedule delay because the customer cannot get the required additional funds until a following year.
What it is basically saying is this. Cumulative to date, from the inception of the project to the present reporting period, the project has been operating at an efficiency of .875 (87½% efficiency). For every dollar spent, 87.5 cents of earned value was accomplished. The To Complete Performance Index (TCPI) says to bring the job in for 230,000, for every dollar spent, $.93 of work must be accomplished (earned value).
What information is required before answering that question?
Well, one important question is how much work is there left to do? How far along is the project? What is the % complete? In this example, the work remaining is about 140,000. So, for the first third of the project, the cost efficiency was about 87.5%. For the last two thirds, the project will have to operate at about .93% cost efficiency to bring the job in on budget at 230,000 dollars spent.
Government studies of over 500 contracts indicate that the CPIe almost never improves after a contract is 20% complete. Dr. David Christensen, who was then at the Air Force Institute of Technology, found in a study of 155 contracts between 1971 and 1991 that the cumulative CPIe stabilizes at the 20% complete point. At the 50% complete point, variances from the efficiency at the 20% complete point were found to be only +/- 8%. Common reasons for this are front loading of budget and depletion of management reserve in early phases of the contract. On production contracts the receipt of firm fixed price material can give artificially favorable contract CPIe’s in early contract stages. On R&D efforts, costs accelerate after early contract stages when testing problems occur and the pressure of behind schedule delivery situations start to impact costs.
So how can this newfound information (that the CPI never gets better after the project is 20% complete) be used? It can be used to calculate an IEAC.
As Paul showed on an earlier slide, an EVMS comprises different elements when it comes to supporting software tools. A fundamental piece is the ERP system that does cost collection, procurement, finance & billings and feeds these actuals to the EV engine. Unanet provides all the capabilities shown here managing projects people and financials to support this. Covering planning, execution, monitoring, invoicing and accounting.
Where our customers have a formal EVMS requirement we have worked with forProject that delivers all the capabilities needed in an EV Engine in conjunction with Unanet in order to satisfy EIA 748 requirements, including schedule integration with leading scheduling tools, and additional reporting as needed.
And before we get to answer any questions that have been submitted, here is one public service announcement: every year we publish an industry benchmark working with a leading accounting firm. We’d appreciate it if you can complete our survey at the link shown here, and also we welcome you to visit Unanet.com where you can download the 2019 report from the website home page. It’s packed with great metrics and trends to help you manage your business.
On behalf of Unanet and Humphreys Associates we thank you so much for attending our webcast and please reach out to Paul or myself if you have any questions that were not covered today. We hope you all have a great day.