SlideShare ist ein Scribd-Unternehmen logo
1 von 25
Downloaden Sie, um offline zu lesen
MANAGING COST,
SCHEDULE, AND
TECHNICAL PERFORMANCE
RISK AT Y-12
Increasing the Probability of Program Success
1
Niwot Ridge
Consulting
Starting with DOE Guidance
2
The DOE Risk Management Lifecycle
3
DOE G 413.3-7A Risk Process
4
DOE G 413.3-7A, page 9
Connecting the Dots Between the Elements
of the Performance Measurement Baseline
5
Risk
SOW
Cost
WBS
Schedule
TPM
PMB
There are two types of Uncertainty
Uncertainty about the
functional and performance
aspects of the program’s
technology that impacts the
produceability of the product
or creates delays in the
schedule
Uncertainty about the
duration and cost of the
activities that deliver the
functional and performance
elements of the program
independent of the technical
risk
6
Technical Programmatic
Risk Assessment and Management
Techniques Vary with Maturity†
7
Add a Risk Factor or Percentage to the critical paths
A “bottom line” Monte Carlo or Range analysis
Detailed Monte Carlo for each WBS element
Expert Opinions in a Database with assessment
Detailed Bayesian Network Analysis
Increasing Detail and Difficulty
IncreasingPrecisionandValue
¨ There are several approaches to building a Risk Tolerant
Performance Measurement Baseline
¤ First recognize where you are on the curve
¤ Then recognize there is value in moving further up the curve
† Ron Coleman Litton TASC, 33rd
ADoDDCAS, Williamsburg, VA
Risk is Different from Uncertainty
Knowing this Difference is Critical to Success
¨ Cost estimating methodology
risk resulting from improper
models of cost
¨ Cost factors such as inflation,
labor rates, labor rate burdens,
etc
¨ Configuration risk (variation in
the technical inputs)
¨ Schedule and technical risk
coupling
¨ Correlation between risk
distributions
¨ Requirements change impacts
¨ Budget Perturbations
¨ Re–work, and re–test
phenomena
¨ Contractual arrangements
(contract type, prime/sub
relationships, etc)
¨ Potential for disaster (labor
troubles, shuttle loss, satellite
“falls over”, war, hurricanes,
etc.)
¨ Probability that if a discrete
event occurs it will invoke a
project delay
8
Risk stems from known probability
distributions
Uncertainty stems from unknown
probability distributions
Schedule Risk Management …
¨ Seeks to anticipate and address uncertainties that threaten the
goals and timetables of a project
¨ Recognizes unmitigated risks lead rapidly to delays in delivery
dates and budget overages that undermine confidence in the
schedule and in the project manager
¨ Is process oriented, guided by DOE G 413.3-7
¨ Accepts a certain level of risk, regular and rigorous risk
analysis and risk management techniques serve to defuse
problems before they arise
¨ Defines an Integrated Master Plan that reflects the
development phases and the hierarchical structure of the
system.
: Risk Based Planning
A sample Risk Management System at
Johnson Space Flight Center
10
Connecting the Dots, Again
11
Risk
SOW
Cost
WBS
Schedule
TPM
PMB
Named
Deliverables
defined in the WBS
BCWS at the Work
Package, rolled to the
Control Account
TPMs attached to each
critical deliverables in the
WBS and identified in
each Work Package in the
IMS, used to assess
maturity in the IMP
The Products and
Processes that produce
them in a “well structured”
decomposition in the WBS
Schedule contains
all the Work
Packages, BCWS,
Risk mitigation
plans, and rolls to
the Integrated
Master Plan to
measure
increasing maturity
Technical and Programmatic
Risks Connected to the WBS
and IMS
The Basics of Probabilistic Schedule12
All Schedule Activities Are Random
Variables, with Probability Distributions
13
Cost does not have a linear relationship with
schedule.
Basic Principles of Probabilistic Cost14
Keys to Cost Estimating Success
15
¨ Start with guidance on
cost estimating.
¨ Tailor the guidance to fit
the problem domain.
¨ Verify the processes work
and add value.
¨ Improve the fidelity of
estimates with feedback.
¨ Adjust estimating
parameters to match
actuals.
Basic Principles with Probabilistic Cost
Estimating Relationships (CER)
16
¨ Cost estimates involve many CERs
¤ Each of these CERs has uncertainty (standard error)
¤ CER input variables have uncertainty (technical uncertainty)
¨ Combine CER uncertainty with technical uncertainty for many
CERs in an estimate
¤ Usually cannot be done arithmetically; must use simulation to roll
up costs derived from Monte Carlo samples
n Add and multiply probability distributions rather than numbers
n Statistically combining many uncertain, or randomly varying, numbers
¤ Monte Carlo simulation
n Take random sample from each CER and input parameter, add and
multiply as necessary, then record total system cost as a single sample
n Repeat the procedure thousands of times to develop a frequency
histogram of the total system cost samples
n This becomes the probability distribution of total system cost
The Cost Probability Distributions as a
function of the weighted cost drivers
17
$
Cost Driver (Weight)
Cost = a + bXc
Cost
Estimate
Historical data point
Cost estimating relationship
Standard percent error boundsTechnical Uncertainty
Combined Cost Modeling
and Technical Uncertainty
Cost Modeling Uncertainty
Basic Principles of connecting cost
models with the IMS involve three steps
18
¨ Step 1: Define “likely–to–be” program
¤ Using deterministic inputs from the Independent Technical
Assessment (ITA)
¨ Step 2: Quantify the probability distributions describing the
modeling uncertainty of all CERs, cost factors, and other
estimating methods
¤ Specifically, the type of distribution (normal, triangular,
lognormal, beta, etc.)
¤ The mean and variance of the distribution
¨ Step 3: Quantify the correlation between all WBS elements
that are estimated using CERs and other methods
¤ If unknown, assess whether No correlation, Mild correlation, or
High correlation, for example:
n None: r = 0, Mild: r = ±0.2, High: r = ± 0.6
¤ Correlation affects the overall cost variance
Basic Principles
19
¨ Step 4: Set up and run the cost estimate in a Monte Carlo
framework (e.g., Crystal Ball, @RISK), resulting in a
“baseline” estimate
¤ This will provide a probability distribution of the cost based on
cost estimating model uncertainty only
¤ Report the MEAN as the baseline expected cost
¨ Step 5: Now incorporate technical uncertainty and discrete
risks
¤ Step 5a: Set up a new estimate which also contains any “discrete
risk” events that are to be guarded against
n Quantify appropriate modeling uncertainties and correlations, as in
Steps 2 and 3, for these discrete risks
¤ Step 5b: Define the probability distributions for all CER input
variables
n Also may need to quantify correlation between CER input variables
Basic Principles of connecting cost
models with the IMS involve three steps
20
¨ Step 6: Re–run the Monte Carlo simulation with random CER
input variables and discrete risk events, resulting in a final
“risk–adjusted” estimate
¤ Results in a new risk–adjusted cost probability distribution.
¤ Wider and shifted to the right Baseline vs. Risk-Adjusted Estimates
0 50 100 150 200 250 300 350
FY$M
Likelihood
Baseline versus Risk Adjusted Cost Estimates
Almost Always Shows an Increase In Cost
21
Baseline vs. Risk-Adjusted Estimates
0 50 100 150 200 250 300 350
FY$M
Likelihood
S-Curve for Cost Modeling
22
Cumulative Distribution Function
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
$60 $80 $100 $120 $140 $160 $180 $200
FY00$M
CumulativeProbability
Schedule Management
23
Risk Management
24
Connecting the Dots
25

Weitere ähnliche Inhalte

Was ist angesagt?

Capabilities based planning
Capabilities based planningCapabilities based planning
Capabilities based planningGlen Alleman
 
Cure for cost and schedule growth
Cure for cost and schedule growthCure for cost and schedule growth
Cure for cost and schedule growthGlen Alleman
 
Principles of Risk Management
Principles of Risk ManagementPrinciples of Risk Management
Principles of Risk ManagementGlen Alleman
 
Establishing schedule margin using monte carlo simulation
Establishing schedule margin using monte carlo simulation Establishing schedule margin using monte carlo simulation
Establishing schedule margin using monte carlo simulation Glen Alleman
 
Agile Project Management Procedures
Agile Project Management ProceduresAgile Project Management Procedures
Agile Project Management ProceduresGlen Alleman
 
Project Performance Measurement Earned Value A Starter
Project Performance Measurement   Earned Value   A StarterProject Performance Measurement   Earned Value   A Starter
Project Performance Measurement Earned Value A StarterSimonRobertson
 
Establishing the performance measurement baseline (pmi northern utah)(v1)
Establishing the performance measurement baseline (pmi northern utah)(v1)Establishing the performance measurement baseline (pmi northern utah)(v1)
Establishing the performance measurement baseline (pmi northern utah)(v1)Glen Alleman
 
Increasing the Probability of Project Success with Five Principles and Practices
Increasing the Probability of Project Success with Five Principles and PracticesIncreasing the Probability of Project Success with Five Principles and Practices
Increasing the Probability of Project Success with Five Principles and PracticesGlen Alleman
 
Managing risk as Opportunity
Managing risk as OpportunityManaging risk as Opportunity
Managing risk as OpportunityGlen Alleman
 
Deliverables based planning handbook
Deliverables based planning handbookDeliverables based planning handbook
Deliverables based planning handbookGlen Alleman
 
5 Immutable Principles of Capital Project SUccess
5 Immutable Principles of Capital Project SUccess5 Immutable Principles of Capital Project SUccess
5 Immutable Principles of Capital Project SUccessGlen Alleman
 
Integrating Risk With Earned Value
Integrating Risk With Earned ValueIntegrating Risk With Earned Value
Integrating Risk With Earned ValueGlen Alleman
 
Integrated Master Plan and Integrated Master Schedule
Integrated Master Plan and Integrated Master ScheduleIntegrated Master Plan and Integrated Master Schedule
Integrated Master Plan and Integrated Master ScheduleGlen Alleman
 
SOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERP
SOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERPSOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERP
SOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERPKevin West
 
Heliotropic Abundance
Heliotropic AbundanceHeliotropic Abundance
Heliotropic AbundanceGlen Alleman
 
Establishing the Performance Measurement Baseline
Establishing the Performance Measurement BaselineEstablishing the Performance Measurement Baseline
Establishing the Performance Measurement BaselineGlen Alleman
 
EDM/PDM Implementation
EDM/PDM ImplementationEDM/PDM Implementation
EDM/PDM ImplementationGlen Alleman
 
Stephen bowerman professional curriculum vitae 2016
Stephen bowerman professional curriculum vitae 2016Stephen bowerman professional curriculum vitae 2016
Stephen bowerman professional curriculum vitae 2016Stephen Bowerman
 
What Makes a Good Concept of Operations?
What Makes a Good Concept of Operations?What Makes a Good Concept of Operations?
What Makes a Good Concept of Operations?Glen Alleman
 
From WBS to Integrated Master Schedule
From WBS to Integrated Master ScheduleFrom WBS to Integrated Master Schedule
From WBS to Integrated Master ScheduleGlen Alleman
 

Was ist angesagt? (20)

Capabilities based planning
Capabilities based planningCapabilities based planning
Capabilities based planning
 
Cure for cost and schedule growth
Cure for cost and schedule growthCure for cost and schedule growth
Cure for cost and schedule growth
 
Principles of Risk Management
Principles of Risk ManagementPrinciples of Risk Management
Principles of Risk Management
 
Establishing schedule margin using monte carlo simulation
Establishing schedule margin using monte carlo simulation Establishing schedule margin using monte carlo simulation
Establishing schedule margin using monte carlo simulation
 
Agile Project Management Procedures
Agile Project Management ProceduresAgile Project Management Procedures
Agile Project Management Procedures
 
Project Performance Measurement Earned Value A Starter
Project Performance Measurement   Earned Value   A StarterProject Performance Measurement   Earned Value   A Starter
Project Performance Measurement Earned Value A Starter
 
Establishing the performance measurement baseline (pmi northern utah)(v1)
Establishing the performance measurement baseline (pmi northern utah)(v1)Establishing the performance measurement baseline (pmi northern utah)(v1)
Establishing the performance measurement baseline (pmi northern utah)(v1)
 
Increasing the Probability of Project Success with Five Principles and Practices
Increasing the Probability of Project Success with Five Principles and PracticesIncreasing the Probability of Project Success with Five Principles and Practices
Increasing the Probability of Project Success with Five Principles and Practices
 
Managing risk as Opportunity
Managing risk as OpportunityManaging risk as Opportunity
Managing risk as Opportunity
 
Deliverables based planning handbook
Deliverables based planning handbookDeliverables based planning handbook
Deliverables based planning handbook
 
5 Immutable Principles of Capital Project SUccess
5 Immutable Principles of Capital Project SUccess5 Immutable Principles of Capital Project SUccess
5 Immutable Principles of Capital Project SUccess
 
Integrating Risk With Earned Value
Integrating Risk With Earned ValueIntegrating Risk With Earned Value
Integrating Risk With Earned Value
 
Integrated Master Plan and Integrated Master Schedule
Integrated Master Plan and Integrated Master ScheduleIntegrated Master Plan and Integrated Master Schedule
Integrated Master Plan and Integrated Master Schedule
 
SOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERP
SOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERPSOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERP
SOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERP
 
Heliotropic Abundance
Heliotropic AbundanceHeliotropic Abundance
Heliotropic Abundance
 
Establishing the Performance Measurement Baseline
Establishing the Performance Measurement BaselineEstablishing the Performance Measurement Baseline
Establishing the Performance Measurement Baseline
 
EDM/PDM Implementation
EDM/PDM ImplementationEDM/PDM Implementation
EDM/PDM Implementation
 
Stephen bowerman professional curriculum vitae 2016
Stephen bowerman professional curriculum vitae 2016Stephen bowerman professional curriculum vitae 2016
Stephen bowerman professional curriculum vitae 2016
 
What Makes a Good Concept of Operations?
What Makes a Good Concept of Operations?What Makes a Good Concept of Operations?
What Makes a Good Concept of Operations?
 
From WBS to Integrated Master Schedule
From WBS to Integrated Master ScheduleFrom WBS to Integrated Master Schedule
From WBS to Integrated Master Schedule
 

Ähnlich wie Integrating cost, schedule, and technical performance

Earning Value from Earned Value Management
Earning Value from Earned Value ManagementEarning Value from Earned Value Management
Earning Value from Earned Value ManagementGlen Alleman
 
Earning value from risk (v4 full charts)
Earning value from risk (v4 full charts)Earning value from risk (v4 full charts)
Earning value from risk (v4 full charts)Glen Alleman
 
Measurement News Webinar
Measurement News WebinarMeasurement News Webinar
Measurement News WebinarGlen Alleman
 
Integrating cost schedule and technical performance
Integrating cost schedule and technical performanceIntegrating cost schedule and technical performance
Integrating cost schedule and technical performanceGlen Alleman
 
Primavera Monte Carlo[1]
Primavera Monte Carlo[1]Primavera Monte Carlo[1]
Primavera Monte Carlo[1]Mihai Buta
 
Assessing Project Performance Beyond CPI/SPI
Assessing Project Performance Beyond CPI/SPIAssessing Project Performance Beyond CPI/SPI
Assessing Project Performance Beyond CPI/SPIGlen Alleman
 
Earned Value Management Essentials
Earned Value Management EssentialsEarned Value Management Essentials
Earned Value Management EssentialsGlen Alleman
 
Building a Credible Performance Measurement Baseline
Building a Credible Performance Measurement BaselineBuilding a Credible Performance Measurement Baseline
Building a Credible Performance Measurement BaselineGlen Alleman
 
Forecasting cost and schedule performance
Forecasting cost and schedule performanceForecasting cost and schedule performance
Forecasting cost and schedule performanceGlen Alleman
 
Building a Credible Performance Measurement Baseline
Building a Credible Performance Measurement BaselineBuilding a Credible Performance Measurement Baseline
Building a Credible Performance Measurement BaselineGlen Alleman
 
Building a risk tolerant integrated master schedule
Building a risk tolerant integrated master scheduleBuilding a risk tolerant integrated master schedule
Building a risk tolerant integrated master scheduleGlen Alleman
 
112 risk- metrics for risk reduction
112 risk- metrics for risk reduction112 risk- metrics for risk reduction
112 risk- metrics for risk reductionDr Fereidoun Dejahang
 
Earned Value Managed Services
Earned Value Managed ServicesEarned Value Managed Services
Earned Value Managed ServicesGlen Alleman
 
Earned Value Management Essentials
Earned Value Management EssentialsEarned Value Management Essentials
Earned Value Management EssentialsGlen Alleman
 
Using Technical Performance Progress
Using Technical Performance ProgressUsing Technical Performance Progress
Using Technical Performance ProgressGlen Alleman
 
Probabilistic Schedule and Cost Analysis
Probabilistic Schedule and Cost AnalysisProbabilistic Schedule and Cost Analysis
Probabilistic Schedule and Cost AnalysisGlen Alleman
 
Acumen Risk Workshops Overview
Acumen Risk Workshops OverviewAcumen Risk Workshops Overview
Acumen Risk Workshops OverviewAcumen
 
Building a Credible Performance Measurement Baseline (PM Journal)
Building a Credible Performance Measurement Baseline (PM Journal)Building a Credible Performance Measurement Baseline (PM Journal)
Building a Credible Performance Measurement Baseline (PM Journal)Glen Alleman
 
Notes on IT programmatic risk in 5 not so easy pieces
Notes on IT programmatic risk in 5 not so easy piecesNotes on IT programmatic risk in 5 not so easy pieces
Notes on IT programmatic risk in 5 not so easy piecesGlen Alleman
 

Ähnlich wie Integrating cost, schedule, and technical performance (20)

Earning Value from Earned Value Management
Earning Value from Earned Value ManagementEarning Value from Earned Value Management
Earning Value from Earned Value Management
 
Earning value from risk (v4 full charts)
Earning value from risk (v4 full charts)Earning value from risk (v4 full charts)
Earning value from risk (v4 full charts)
 
Measurement News Webinar
Measurement News WebinarMeasurement News Webinar
Measurement News Webinar
 
Costing
CostingCosting
Costing
 
Integrating cost schedule and technical performance
Integrating cost schedule and technical performanceIntegrating cost schedule and technical performance
Integrating cost schedule and technical performance
 
Primavera Monte Carlo[1]
Primavera Monte Carlo[1]Primavera Monte Carlo[1]
Primavera Monte Carlo[1]
 
Assessing Project Performance Beyond CPI/SPI
Assessing Project Performance Beyond CPI/SPIAssessing Project Performance Beyond CPI/SPI
Assessing Project Performance Beyond CPI/SPI
 
Earned Value Management Essentials
Earned Value Management EssentialsEarned Value Management Essentials
Earned Value Management Essentials
 
Building a Credible Performance Measurement Baseline
Building a Credible Performance Measurement BaselineBuilding a Credible Performance Measurement Baseline
Building a Credible Performance Measurement Baseline
 
Forecasting cost and schedule performance
Forecasting cost and schedule performanceForecasting cost and schedule performance
Forecasting cost and schedule performance
 
Building a Credible Performance Measurement Baseline
Building a Credible Performance Measurement BaselineBuilding a Credible Performance Measurement Baseline
Building a Credible Performance Measurement Baseline
 
Building a risk tolerant integrated master schedule
Building a risk tolerant integrated master scheduleBuilding a risk tolerant integrated master schedule
Building a risk tolerant integrated master schedule
 
112 risk- metrics for risk reduction
112 risk- metrics for risk reduction112 risk- metrics for risk reduction
112 risk- metrics for risk reduction
 
Earned Value Managed Services
Earned Value Managed ServicesEarned Value Managed Services
Earned Value Managed Services
 
Earned Value Management Essentials
Earned Value Management EssentialsEarned Value Management Essentials
Earned Value Management Essentials
 
Using Technical Performance Progress
Using Technical Performance ProgressUsing Technical Performance Progress
Using Technical Performance Progress
 
Probabilistic Schedule and Cost Analysis
Probabilistic Schedule and Cost AnalysisProbabilistic Schedule and Cost Analysis
Probabilistic Schedule and Cost Analysis
 
Acumen Risk Workshops Overview
Acumen Risk Workshops OverviewAcumen Risk Workshops Overview
Acumen Risk Workshops Overview
 
Building a Credible Performance Measurement Baseline (PM Journal)
Building a Credible Performance Measurement Baseline (PM Journal)Building a Credible Performance Measurement Baseline (PM Journal)
Building a Credible Performance Measurement Baseline (PM Journal)
 
Notes on IT programmatic risk in 5 not so easy pieces
Notes on IT programmatic risk in 5 not so easy piecesNotes on IT programmatic risk in 5 not so easy pieces
Notes on IT programmatic risk in 5 not so easy pieces
 

Mehr von Glen Alleman

Managing risk with deliverables planning
Managing risk with deliverables planningManaging risk with deliverables planning
Managing risk with deliverables planningGlen Alleman
 
A Gentle Introduction to the IMP/IMS
A Gentle Introduction to the IMP/IMSA Gentle Introduction to the IMP/IMS
A Gentle Introduction to the IMP/IMSGlen Alleman
 
Increasing the Probability of Project Success
Increasing the Probability of Project SuccessIncreasing the Probability of Project Success
Increasing the Probability of Project SuccessGlen Alleman
 
Process Flow and Narrative for Agile+PPM
Process Flow and Narrative for Agile+PPMProcess Flow and Narrative for Agile+PPM
Process Flow and Narrative for Agile+PPMGlen Alleman
 
Practices of risk management
Practices of risk managementPractices of risk management
Practices of risk managementGlen Alleman
 
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...Glen Alleman
 
From Principles to Strategies for Systems Engineering
From Principles to Strategies for Systems EngineeringFrom Principles to Strategies for Systems Engineering
From Principles to Strategies for Systems EngineeringGlen Alleman
 
NAVAIR Integrated Master Schedule Guide guide
NAVAIR Integrated Master Schedule Guide guideNAVAIR Integrated Master Schedule Guide guide
NAVAIR Integrated Master Schedule Guide guideGlen Alleman
 
Integrated master plan methodology (v2)
Integrated master plan methodology (v2)Integrated master plan methodology (v2)
Integrated master plan methodology (v2)Glen Alleman
 
IMP / IMS Step by Step
IMP / IMS Step by StepIMP / IMS Step by Step
IMP / IMS Step by StepGlen Alleman
 
DHS - Using functions points to estimate agile development programs (v2)
DHS - Using functions points to estimate agile development programs (v2)DHS - Using functions points to estimate agile development programs (v2)
DHS - Using functions points to estimate agile development programs (v2)Glen Alleman
 
Making the impossible possible
Making the impossible possibleMaking the impossible possible
Making the impossible possibleGlen Alleman
 
Process Flow and Narrative for Agile
Process Flow and Narrative for AgileProcess Flow and Narrative for Agile
Process Flow and Narrative for AgileGlen Alleman
 
Program Management Office Lean Software Development and Six Sigma
Program Management Office Lean Software Development and Six SigmaProgram Management Office Lean Software Development and Six Sigma
Program Management Office Lean Software Development and Six SigmaGlen Alleman
 
Policy and Procedure Rollout
Policy and Procedure RolloutPolicy and Procedure Rollout
Policy and Procedure RolloutGlen Alleman
 
Integrated Master Plan Development
Integrated Master Plan DevelopmentIntegrated Master Plan Development
Integrated Master Plan DevelopmentGlen Alleman
 
Project Management Theory
Project Management TheoryProject Management Theory
Project Management TheoryGlen Alleman
 
Seven Habits of a Highly Effective agile project manager
Seven Habits of a Highly Effective agile project managerSeven Habits of a Highly Effective agile project manager
Seven Habits of a Highly Effective agile project managerGlen Alleman
 
Paradigm of agile project management (update)
Paradigm of agile project management (update)Paradigm of agile project management (update)
Paradigm of agile project management (update)Glen Alleman
 
The 5 Immutable principles of project management
The 5 Immutable principles of project managementThe 5 Immutable principles of project management
The 5 Immutable principles of project managementGlen Alleman
 

Mehr von Glen Alleman (20)

Managing risk with deliverables planning
Managing risk with deliverables planningManaging risk with deliverables planning
Managing risk with deliverables planning
 
A Gentle Introduction to the IMP/IMS
A Gentle Introduction to the IMP/IMSA Gentle Introduction to the IMP/IMS
A Gentle Introduction to the IMP/IMS
 
Increasing the Probability of Project Success
Increasing the Probability of Project SuccessIncreasing the Probability of Project Success
Increasing the Probability of Project Success
 
Process Flow and Narrative for Agile+PPM
Process Flow and Narrative for Agile+PPMProcess Flow and Narrative for Agile+PPM
Process Flow and Narrative for Agile+PPM
 
Practices of risk management
Practices of risk managementPractices of risk management
Practices of risk management
 
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
 
From Principles to Strategies for Systems Engineering
From Principles to Strategies for Systems EngineeringFrom Principles to Strategies for Systems Engineering
From Principles to Strategies for Systems Engineering
 
NAVAIR Integrated Master Schedule Guide guide
NAVAIR Integrated Master Schedule Guide guideNAVAIR Integrated Master Schedule Guide guide
NAVAIR Integrated Master Schedule Guide guide
 
Integrated master plan methodology (v2)
Integrated master plan methodology (v2)Integrated master plan methodology (v2)
Integrated master plan methodology (v2)
 
IMP / IMS Step by Step
IMP / IMS Step by StepIMP / IMS Step by Step
IMP / IMS Step by Step
 
DHS - Using functions points to estimate agile development programs (v2)
DHS - Using functions points to estimate agile development programs (v2)DHS - Using functions points to estimate agile development programs (v2)
DHS - Using functions points to estimate agile development programs (v2)
 
Making the impossible possible
Making the impossible possibleMaking the impossible possible
Making the impossible possible
 
Process Flow and Narrative for Agile
Process Flow and Narrative for AgileProcess Flow and Narrative for Agile
Process Flow and Narrative for Agile
 
Program Management Office Lean Software Development and Six Sigma
Program Management Office Lean Software Development and Six SigmaProgram Management Office Lean Software Development and Six Sigma
Program Management Office Lean Software Development and Six Sigma
 
Policy and Procedure Rollout
Policy and Procedure RolloutPolicy and Procedure Rollout
Policy and Procedure Rollout
 
Integrated Master Plan Development
Integrated Master Plan DevelopmentIntegrated Master Plan Development
Integrated Master Plan Development
 
Project Management Theory
Project Management TheoryProject Management Theory
Project Management Theory
 
Seven Habits of a Highly Effective agile project manager
Seven Habits of a Highly Effective agile project managerSeven Habits of a Highly Effective agile project manager
Seven Habits of a Highly Effective agile project manager
 
Paradigm of agile project management (update)
Paradigm of agile project management (update)Paradigm of agile project management (update)
Paradigm of agile project management (update)
 
The 5 Immutable principles of project management
The 5 Immutable principles of project managementThe 5 Immutable principles of project management
The 5 Immutable principles of project management
 

Kürzlich hochgeladen

Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????blackmambaettijean
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 

Kürzlich hochgeladen (20)

Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 

Integrating cost, schedule, and technical performance

  • 1. MANAGING COST, SCHEDULE, AND TECHNICAL PERFORMANCE RISK AT Y-12 Increasing the Probability of Program Success 1 Niwot Ridge Consulting
  • 2. Starting with DOE Guidance 2
  • 3. The DOE Risk Management Lifecycle 3
  • 4. DOE G 413.3-7A Risk Process 4 DOE G 413.3-7A, page 9
  • 5. Connecting the Dots Between the Elements of the Performance Measurement Baseline 5 Risk SOW Cost WBS Schedule TPM PMB
  • 6. There are two types of Uncertainty Uncertainty about the functional and performance aspects of the program’s technology that impacts the produceability of the product or creates delays in the schedule Uncertainty about the duration and cost of the activities that deliver the functional and performance elements of the program independent of the technical risk 6 Technical Programmatic
  • 7. Risk Assessment and Management Techniques Vary with Maturity† 7 Add a Risk Factor or Percentage to the critical paths A “bottom line” Monte Carlo or Range analysis Detailed Monte Carlo for each WBS element Expert Opinions in a Database with assessment Detailed Bayesian Network Analysis Increasing Detail and Difficulty IncreasingPrecisionandValue ¨ There are several approaches to building a Risk Tolerant Performance Measurement Baseline ¤ First recognize where you are on the curve ¤ Then recognize there is value in moving further up the curve † Ron Coleman Litton TASC, 33rd ADoDDCAS, Williamsburg, VA
  • 8. Risk is Different from Uncertainty Knowing this Difference is Critical to Success ¨ Cost estimating methodology risk resulting from improper models of cost ¨ Cost factors such as inflation, labor rates, labor rate burdens, etc ¨ Configuration risk (variation in the technical inputs) ¨ Schedule and technical risk coupling ¨ Correlation between risk distributions ¨ Requirements change impacts ¨ Budget Perturbations ¨ Re–work, and re–test phenomena ¨ Contractual arrangements (contract type, prime/sub relationships, etc) ¨ Potential for disaster (labor troubles, shuttle loss, satellite “falls over”, war, hurricanes, etc.) ¨ Probability that if a discrete event occurs it will invoke a project delay 8 Risk stems from known probability distributions Uncertainty stems from unknown probability distributions
  • 9. Schedule Risk Management … ¨ Seeks to anticipate and address uncertainties that threaten the goals and timetables of a project ¨ Recognizes unmitigated risks lead rapidly to delays in delivery dates and budget overages that undermine confidence in the schedule and in the project manager ¨ Is process oriented, guided by DOE G 413.3-7 ¨ Accepts a certain level of risk, regular and rigorous risk analysis and risk management techniques serve to defuse problems before they arise ¨ Defines an Integrated Master Plan that reflects the development phases and the hierarchical structure of the system. : Risk Based Planning
  • 10. A sample Risk Management System at Johnson Space Flight Center 10
  • 11. Connecting the Dots, Again 11 Risk SOW Cost WBS Schedule TPM PMB Named Deliverables defined in the WBS BCWS at the Work Package, rolled to the Control Account TPMs attached to each critical deliverables in the WBS and identified in each Work Package in the IMS, used to assess maturity in the IMP The Products and Processes that produce them in a “well structured” decomposition in the WBS Schedule contains all the Work Packages, BCWS, Risk mitigation plans, and rolls to the Integrated Master Plan to measure increasing maturity Technical and Programmatic Risks Connected to the WBS and IMS
  • 12. The Basics of Probabilistic Schedule12
  • 13. All Schedule Activities Are Random Variables, with Probability Distributions 13
  • 14. Cost does not have a linear relationship with schedule. Basic Principles of Probabilistic Cost14
  • 15. Keys to Cost Estimating Success 15 ¨ Start with guidance on cost estimating. ¨ Tailor the guidance to fit the problem domain. ¨ Verify the processes work and add value. ¨ Improve the fidelity of estimates with feedback. ¨ Adjust estimating parameters to match actuals.
  • 16. Basic Principles with Probabilistic Cost Estimating Relationships (CER) 16 ¨ Cost estimates involve many CERs ¤ Each of these CERs has uncertainty (standard error) ¤ CER input variables have uncertainty (technical uncertainty) ¨ Combine CER uncertainty with technical uncertainty for many CERs in an estimate ¤ Usually cannot be done arithmetically; must use simulation to roll up costs derived from Monte Carlo samples n Add and multiply probability distributions rather than numbers n Statistically combining many uncertain, or randomly varying, numbers ¤ Monte Carlo simulation n Take random sample from each CER and input parameter, add and multiply as necessary, then record total system cost as a single sample n Repeat the procedure thousands of times to develop a frequency histogram of the total system cost samples n This becomes the probability distribution of total system cost
  • 17. The Cost Probability Distributions as a function of the weighted cost drivers 17 $ Cost Driver (Weight) Cost = a + bXc Cost Estimate Historical data point Cost estimating relationship Standard percent error boundsTechnical Uncertainty Combined Cost Modeling and Technical Uncertainty Cost Modeling Uncertainty
  • 18. Basic Principles of connecting cost models with the IMS involve three steps 18 ¨ Step 1: Define “likely–to–be” program ¤ Using deterministic inputs from the Independent Technical Assessment (ITA) ¨ Step 2: Quantify the probability distributions describing the modeling uncertainty of all CERs, cost factors, and other estimating methods ¤ Specifically, the type of distribution (normal, triangular, lognormal, beta, etc.) ¤ The mean and variance of the distribution ¨ Step 3: Quantify the correlation between all WBS elements that are estimated using CERs and other methods ¤ If unknown, assess whether No correlation, Mild correlation, or High correlation, for example: n None: r = 0, Mild: r = ±0.2, High: r = ± 0.6 ¤ Correlation affects the overall cost variance
  • 19. Basic Principles 19 ¨ Step 4: Set up and run the cost estimate in a Monte Carlo framework (e.g., Crystal Ball, @RISK), resulting in a “baseline” estimate ¤ This will provide a probability distribution of the cost based on cost estimating model uncertainty only ¤ Report the MEAN as the baseline expected cost ¨ Step 5: Now incorporate technical uncertainty and discrete risks ¤ Step 5a: Set up a new estimate which also contains any “discrete risk” events that are to be guarded against n Quantify appropriate modeling uncertainties and correlations, as in Steps 2 and 3, for these discrete risks ¤ Step 5b: Define the probability distributions for all CER input variables n Also may need to quantify correlation between CER input variables
  • 20. Basic Principles of connecting cost models with the IMS involve three steps 20 ¨ Step 6: Re–run the Monte Carlo simulation with random CER input variables and discrete risk events, resulting in a final “risk–adjusted” estimate ¤ Results in a new risk–adjusted cost probability distribution. ¤ Wider and shifted to the right Baseline vs. Risk-Adjusted Estimates 0 50 100 150 200 250 300 350 FY$M Likelihood
  • 21. Baseline versus Risk Adjusted Cost Estimates Almost Always Shows an Increase In Cost 21 Baseline vs. Risk-Adjusted Estimates 0 50 100 150 200 250 300 350 FY$M Likelihood
  • 22. S-Curve for Cost Modeling 22 Cumulative Distribution Function 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% $60 $80 $100 $120 $140 $160 $180 $200 FY00$M CumulativeProbability