SlideShare a Scribd company logo
1 of 77
Metrics
3 flavors

 Software metrics
 Agile Project metrics
 Organizational metrics
before we get to them….
a warning (or three)
how many of you have an in car GPS
system?
metrics satisfy our inquisitive nature
and can easily become a
distraction
steering with numbers is the wrong
metaphor
metrics are your guide and can help you make
decisions
make sure your metrics support the decisions you need to
make…
1. Construct metrics for root cause decision
making…
Or use GQM

GOAL    QUESTION   METRIC
WERNER HEISENBERG (1901 - 1976)
‘The more precisely the POSITION is
determined, the less precisely the
MOMENTUM is known’
detrimentally affecting software project
teams ability to adapt to circumstance is a
key mistake.
every project team should be ruthless in its
adaption to situational circumstance.
2. Don’t restrict a teams ability to maximize
their effectiveness through over zealous or
bureaucratic reporting practices…
In order for metrics to be useful they have to
be accepted.
3. don’t build
metrics that are
too complicated
to understand.
So….
back to metrics…
3 flavors

 Software metrics
 Agile Project metrics
 Organizational metrics
The primary metric for agile
software development is whether
software exists and is demonstrably
suitable for use in its intended
purpose.
This key metric is tested by
demonstration at the end of every
iteration and release.
Individual metrics

 Defects
 Complexity
 Conformance
 Coverage
 Object Orientation
 Volatility
Much more useful when correlated…
Goal: I’d like to reduce defects.
Question: Where do defects come from and
why?
Panopticode shows the hot spots in code
where there are intersections between low
test coverage, high volatility and high
complexity.
In the end code metrics can help remove
uncertainty from delivery and build a
system with a longer life span, lower cost
of change.
Metrics smorgasboard
   Velocity: Number of story points completed in any given iteration.      % Unit Test coverage.

    Number of story points started in a given iteration.                     Acceptance Tests
    Total Number of Story points remaining in the project.                   Total number of Acceptance tests per iteration.
    Total Number of 'new' story points in project.                             Automated
                                                                               Non Automated.
    Number of stories added to the project in a given iteration.
    Number of story points added to the project in a given iteration.
                                                                             Total Acceptance tests passing per iteration.
    Total number of stories in project.                                      Total acceptance tests failing per iteration.
    Total number of story points in project.                                 Total acceptance tests ignored per iteration.

    Resources:                                                               Total automated Acceptance tests in project.
                                                                             Total non automated Acceptance tests in project.
    Planned man days available per iteration.                                % Automated.
    Actual man days used per iteration.
                                                                             Defects (Bugs identified post development).
    Total man days accrued on project to date.                               Total number of defects per iteration.
    Total man days remaining on budget.                                      Total number of defects by severity.

    Total Man days lost to non project work.
                                                                            Quality.

    Financials:                                                              Unit Tests
                                                                             Total number of unit tests per iteration.
    Cost per iteration.                                                      Total Unit tests passing per iteration.
    Cost per release.                                                        Total Unit tests failing per iteration.
                                                                             Total Unit tests ignored per iteration.
    Total days worked on Project.
    Total days worked by resource type.
    Monthly spend.
    Total Monthly spend.

    Total Cost to date
    Total Cost to complete.
    Estimated Cost at complete.
Uh oh.
We just broke golden rule #1.
So, lets figure out what we need first…
Goal, Question, Metric.
here are some common Goals, questions and
examples of how metrics support them…
Goal: I want predictability.

Q: Is my project team converging on a
solution that meets the outcomes for my
business?
Total Effort       Work com pl eted   Work Added
                      remaining          this              thi s         Total effort                   Estim ated         Actual            Accrued
Iteration             at start.          iteration         iteration.          remaining   End Date.           Cost.                Cost.          Costs.

Iteration 7-8                 49                 10                 +0                39      01 Sept            34, 650            34,650          34,650

                                                                                                                                    30,800
Iteration 9                   39                 12                 +0                27      15 Sept            30,800                            65, 450

                                                                                                                                    31,350
Iteration 10                  27                 10                 +5                22      29 Sept            31,350                             96,800

                                                                                                                                    31,900
Iteration 11                  22                 11                 +0                11       13 Oct            31,900                            128,700

                                                                                                                                    22,000
Iteration 12                  11                 11                 +0                 0       21 Oct            22,000                            150,700
100% of Outcomes met
Goal: I want to understand the capacity of
the team and how it changes.

Q: Will defects affect the predictability of
delivery?
Hypothesis: we can use yesterdays weather
to predict how much we can get done next
time.
Velocity is simply the number of Story points
delivered last time used as a predictor for
next time…
Goal: I want to reduce waste in my process
and deliver value to the customer as often as
possible.

Q: Where are the bottle necks in my
development process?
Goal: I don’t want any nasty surprises late in
the project that will affect the predictability
of delivery.

Q: Will defects affect the predictability of
delivery?
90


                         80


                         70


                         60
# of working Acc Tests




                         50
                                                                                                         Not wor k ing
                                                                                                         Wor k ing
                         40


                         30


                         20


                         10


                         0
                          Mon   Tue Wed Thur   Fri   Mon Tue Wed Thur   Fri   Mon Tue   Wed Thur   Fri
                                                             Date
At this point things can become less
quantitative and more qualitative…
Goal: I want to build capabilities that allow
me to repeatably deliver high value
products/services.

Q: Are my teams developing repeatable
capabilities?
Design Storming


           Retrospectives                      Pairing




Re-factoring                                             TDD




                                                 ATDP
               Stand up’s

                            Cont Integration
Goal: I’m a low risk business, if one project
fails this year I don’t want it to sink the
organization!

Q: What is the risk profile of my project
portfolio?
Cost



Potential Value




                  Risk
Goal: I want to maximize the value from my
workforce ensuring smooth transition
between projects….

Q: When will I need capacity?
Be careful with this one…
Don’t break golden rule
number 2….
Goal: To understand if our strategy in the
market place is working so that we can adapt
quickly.

Q: What do my customers think ?
Fred Reichheld
Loyalty expert


‘The ultimate
question’
(otherwise known as
NPS)
Net Promoter Score: would you recommend
us to a friend or Colleague?

P – D = NPS

The difference between the number of
Promoters and number of Detractors = Net
Promoter Score (NPS)
Goal: To leverage our strategy to make our
enterprise successful.

Q: Do our projects align with the vision of our
organization?
A Starbucks on every corner
Inspire customers to enjoy the daily pleasure
of Peet's Coffees & Teas by providing a
distinctive, superior product, superior coffee
and tea knowledge and superior service to
every customer, every day.
The balanced score card.
   Typical Key Performance indicators:

   Financial
        Cash Flow
        ROI
        Financial Result
        Return on capital employed
        Return on equity
   Customer
        Delivery Performance to Customer - by Date
        Delivery Performance to Customer - by Quantity
   Internal Business Processes
        Number of Activities
        Opportunity Success Rate
   Learning & Growth
        Investment Rate
        Illness rate
keep metrics simple
Figure out why you want to measure
something before you figure out how.
GOAL > Question > Metric
Everywhere is different . Build metrics that
make sense for YOU.
Don’t restrict team process adaptations,
adapt reporting as required
Metrics guide for goal-driven decision making
Metrics guide for goal-driven decision making

More Related Content

Viewers also liked

Quantitative Project Risk Analysis
Quantitative Project Risk AnalysisQuantitative Project Risk Analysis
Quantitative Project Risk AnalysisIntaver Insititute
 
The Metrics of Project Management Performance and PMBOK
The Metrics of Project Management Performance and PMBOKThe Metrics of Project Management Performance and PMBOK
The Metrics of Project Management Performance and PMBOKLiana Underwood
 
Quantitative approach 1
Quantitative approach 1Quantitative approach 1
Quantitative approach 1Sri Naga Ramya
 
Project performance tracking analysis and reporting
Project performance tracking analysis and reportingProject performance tracking analysis and reporting
Project performance tracking analysis and reportingCharles Cotter, PhD
 
Quantitative techniques introduction 19 pages
Quantitative techniques introduction 19 pagesQuantitative techniques introduction 19 pages
Quantitative techniques introduction 19 pagestaniyakhurana
 
The Three Things You Need to Know to Transform Any Size Organization Into an ...
The Three Things You Need to Know to Transform Any Size Organization Into an ...The Three Things You Need to Know to Transform Any Size Organization Into an ...
The Three Things You Need to Know to Transform Any Size Organization Into an ...Mike Cottmeyer
 
Budget Research Paper
Budget Research PaperBudget Research Paper
Budget Research Paperbshanebowers
 

Viewers also liked (7)

Quantitative Project Risk Analysis
Quantitative Project Risk AnalysisQuantitative Project Risk Analysis
Quantitative Project Risk Analysis
 
The Metrics of Project Management Performance and PMBOK
The Metrics of Project Management Performance and PMBOKThe Metrics of Project Management Performance and PMBOK
The Metrics of Project Management Performance and PMBOK
 
Quantitative approach 1
Quantitative approach 1Quantitative approach 1
Quantitative approach 1
 
Project performance tracking analysis and reporting
Project performance tracking analysis and reportingProject performance tracking analysis and reporting
Project performance tracking analysis and reporting
 
Quantitative techniques introduction 19 pages
Quantitative techniques introduction 19 pagesQuantitative techniques introduction 19 pages
Quantitative techniques introduction 19 pages
 
The Three Things You Need to Know to Transform Any Size Organization Into an ...
The Three Things You Need to Know to Transform Any Size Organization Into an ...The Three Things You Need to Know to Transform Any Size Organization Into an ...
The Three Things You Need to Know to Transform Any Size Organization Into an ...
 
Budget Research Paper
Budget Research PaperBudget Research Paper
Budget Research Paper
 

Similar to Metrics guide for goal-driven decision making

AddQ Testautomatiseringserfarenheter
AddQ TestautomatiseringserfarenheterAddQ Testautomatiseringserfarenheter
AddQ TestautomatiseringserfarenheterAddQ Consulting
 
How to live with agile - Aware in BugDay Bangkok 2012
How to live with agile - Aware in BugDay Bangkok 2012How to live with agile - Aware in BugDay Bangkok 2012
How to live with agile - Aware in BugDay Bangkok 2012Prathan Dansakulcharoenkit
 
Improving your Agile Process
Improving your Agile ProcessImproving your Agile Process
Improving your Agile ProcessDavid Copeland
 
Agile Testing. Risks, Uncertainty and Why It All Works
Agile Testing. Risks, Uncertainty and Why It All WorksAgile Testing. Risks, Uncertainty and Why It All Works
Agile Testing. Risks, Uncertainty and Why It All WorksAgileee
 
The road to continuous improvement - Sandrine Olivencia
The road to continuous improvement - Sandrine OlivenciaThe road to continuous improvement - Sandrine Olivencia
The road to continuous improvement - Sandrine OlivenciaAGILEMinds
 
Notes Version: Email Marketing Workshop Closing Now What
Notes Version: Email Marketing Workshop Closing Now What Notes Version: Email Marketing Workshop Closing Now What
Notes Version: Email Marketing Workshop Closing Now What Vivastream
 
Notes Version: Email Marketing Workshop Closing Now What
Notes Version: Email Marketing Workshop Closing Now What Notes Version: Email Marketing Workshop Closing Now What
Notes Version: Email Marketing Workshop Closing Now What Vivastream
 
SDPM - Lecture 2a - Project evaluation – for the buyer, and for the vendor
SDPM - Lecture 2a - Project evaluation – for the buyer, and for the vendorSDPM - Lecture 2a - Project evaluation – for the buyer, and for the vendor
SDPM - Lecture 2a - Project evaluation – for the buyer, and for the vendorOpenLearningLab
 
ALE15 The real value of a definition of done
ALE15  The real value of a definition of doneALE15  The real value of a definition of done
ALE15 The real value of a definition of doneChristian Vos
 
A Lean Tour of Lean Software Development
A Lean Tour of Lean Software DevelopmentA Lean Tour of Lean Software Development
A Lean Tour of Lean Software DevelopmentTechWell
 
Kanban i praksis hos maersk line
Kanban i praksis hos maersk line Kanban i praksis hos maersk line
Kanban i praksis hos maersk line BestBrains
 
Kanban i praksis hos maersk line
Kanban i praksis hos maersk lineKanban i praksis hos maersk line
Kanban i praksis hos maersk lineBestBrains
 
DevOPs Transformation Workshop
DevOPs Transformation WorkshopDevOPs Transformation Workshop
DevOPs Transformation WorkshopJules Pierre-Louis
 
The ROI of UX Research - Featuring Susan Weinshenk of The Team W
The ROI of UX Research - Featuring Susan Weinshenk of The Team WThe ROI of UX Research - Featuring Susan Weinshenk of The Team W
The ROI of UX Research - Featuring Susan Weinshenk of The Team WUserZoom
 
Ethan huang 全民qa
Ethan huang   全民qaEthan huang   全民qa
Ethan huang 全民qaOdd-e
 
Tdd pecha kucha_v2
Tdd pecha kucha_v2Tdd pecha kucha_v2
Tdd pecha kucha_v2Paul Boos
 
Webinar 2nd edition of the secrets of agile software development from the exe...
Webinar 2nd edition of the secrets of agile software development from the exe...Webinar 2nd edition of the secrets of agile software development from the exe...
Webinar 2nd edition of the secrets of agile software development from the exe...Belatrix Software Factory
 
Visualizing the Evolution of Working Sets
Visualizing the Evolution of Working SetsVisualizing the Evolution of Working Sets
Visualizing the Evolution of Working SetsRoberto Minelli
 

Similar to Metrics guide for goal-driven decision making (20)

AddQ Testautomatiseringserfarenheter
AddQ TestautomatiseringserfarenheterAddQ Testautomatiseringserfarenheter
AddQ Testautomatiseringserfarenheter
 
How to live with agile - Aware in BugDay Bangkok 2012
How to live with agile - Aware in BugDay Bangkok 2012How to live with agile - Aware in BugDay Bangkok 2012
How to live with agile - Aware in BugDay Bangkok 2012
 
Improving your Agile Process
Improving your Agile ProcessImproving your Agile Process
Improving your Agile Process
 
Agile Testing. Risks, Uncertainty and Why It All Works
Agile Testing. Risks, Uncertainty and Why It All WorksAgile Testing. Risks, Uncertainty and Why It All Works
Agile Testing. Risks, Uncertainty and Why It All Works
 
The road to continuous improvement - Sandrine Olivencia
The road to continuous improvement - Sandrine OlivenciaThe road to continuous improvement - Sandrine Olivencia
The road to continuous improvement - Sandrine Olivencia
 
Notes Version: Email Marketing Workshop Closing Now What
Notes Version: Email Marketing Workshop Closing Now What Notes Version: Email Marketing Workshop Closing Now What
Notes Version: Email Marketing Workshop Closing Now What
 
Notes Version: Email Marketing Workshop Closing Now What
Notes Version: Email Marketing Workshop Closing Now What Notes Version: Email Marketing Workshop Closing Now What
Notes Version: Email Marketing Workshop Closing Now What
 
SDPM - Lecture 2a - Project evaluation – for the buyer, and for the vendor
SDPM - Lecture 2a - Project evaluation – for the buyer, and for the vendorSDPM - Lecture 2a - Project evaluation – for the buyer, and for the vendor
SDPM - Lecture 2a - Project evaluation – for the buyer, and for the vendor
 
ALE15 The real value of a definition of done
ALE15  The real value of a definition of doneALE15  The real value of a definition of done
ALE15 The real value of a definition of done
 
A Lean Tour of Lean Software Development
A Lean Tour of Lean Software DevelopmentA Lean Tour of Lean Software Development
A Lean Tour of Lean Software Development
 
How to Introduce Continuous Delivery
How to Introduce Continuous DeliveryHow to Introduce Continuous Delivery
How to Introduce Continuous Delivery
 
Kanban i praksis hos maersk line
Kanban i praksis hos maersk line Kanban i praksis hos maersk line
Kanban i praksis hos maersk line
 
Kanban i praksis hos maersk line
Kanban i praksis hos maersk lineKanban i praksis hos maersk line
Kanban i praksis hos maersk line
 
DevOPs Transformation Workshop
DevOPs Transformation WorkshopDevOPs Transformation Workshop
DevOPs Transformation Workshop
 
The ROI of UX Research - Featuring Susan Weinshenk of The Team W
The ROI of UX Research - Featuring Susan Weinshenk of The Team WThe ROI of UX Research - Featuring Susan Weinshenk of The Team W
The ROI of UX Research - Featuring Susan Weinshenk of The Team W
 
Ethan huang 全民qa
Ethan huang   全民qaEthan huang   全民qa
Ethan huang 全民qa
 
LEARNING CURVE
LEARNING CURVELEARNING CURVE
LEARNING CURVE
 
Tdd pecha kucha_v2
Tdd pecha kucha_v2Tdd pecha kucha_v2
Tdd pecha kucha_v2
 
Webinar 2nd edition of the secrets of agile software development from the exe...
Webinar 2nd edition of the secrets of agile software development from the exe...Webinar 2nd edition of the secrets of agile software development from the exe...
Webinar 2nd edition of the secrets of agile software development from the exe...
 
Visualizing the Evolution of Working Sets
Visualizing the Evolution of Working SetsVisualizing the Evolution of Working Sets
Visualizing the Evolution of Working Sets
 

Recently uploaded

Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilV3cube
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 

Recently uploaded (20)

Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 

Metrics guide for goal-driven decision making

  • 2. 3 flavors  Software metrics  Agile Project metrics  Organizational metrics
  • 3. before we get to them….
  • 4. a warning (or three)
  • 5. how many of you have an in car GPS system?
  • 6. metrics satisfy our inquisitive nature
  • 7. and can easily become a distraction
  • 8. steering with numbers is the wrong metaphor
  • 9. metrics are your guide and can help you make decisions
  • 10. make sure your metrics support the decisions you need to make…
  • 11. 1. Construct metrics for root cause decision making…
  • 12. Or use GQM GOAL QUESTION METRIC
  • 14. ‘The more precisely the POSITION is determined, the less precisely the MOMENTUM is known’
  • 15. detrimentally affecting software project teams ability to adapt to circumstance is a key mistake.
  • 16. every project team should be ruthless in its adaption to situational circumstance.
  • 17. 2. Don’t restrict a teams ability to maximize their effectiveness through over zealous or bureaucratic reporting practices…
  • 18. In order for metrics to be useful they have to be accepted.
  • 19. 3. don’t build metrics that are too complicated to understand.
  • 22. 3 flavors  Software metrics  Agile Project metrics  Organizational metrics
  • 23. The primary metric for agile software development is whether software exists and is demonstrably suitable for use in its intended purpose.
  • 24. This key metric is tested by demonstration at the end of every iteration and release.
  • 25.
  • 26. Individual metrics  Defects  Complexity  Conformance  Coverage  Object Orientation  Volatility
  • 27. Much more useful when correlated…
  • 28. Goal: I’d like to reduce defects.
  • 29. Question: Where do defects come from and why?
  • 30. Panopticode shows the hot spots in code where there are intersections between low test coverage, high volatility and high complexity.
  • 31.
  • 32. In the end code metrics can help remove uncertainty from delivery and build a system with a longer life span, lower cost of change.
  • 33.
  • 34. Metrics smorgasboard  Velocity: Number of story points completed in any given iteration.  % Unit Test coverage. Number of story points started in a given iteration. Acceptance Tests Total Number of Story points remaining in the project. Total number of Acceptance tests per iteration. Total Number of 'new' story points in project. Automated Non Automated. Number of stories added to the project in a given iteration. Number of story points added to the project in a given iteration. Total Acceptance tests passing per iteration. Total number of stories in project. Total acceptance tests failing per iteration. Total number of story points in project. Total acceptance tests ignored per iteration. Resources: Total automated Acceptance tests in project. Total non automated Acceptance tests in project. Planned man days available per iteration. % Automated. Actual man days used per iteration. Defects (Bugs identified post development). Total man days accrued on project to date. Total number of defects per iteration. Total man days remaining on budget. Total number of defects by severity. Total Man days lost to non project work.  Quality. Financials: Unit Tests Total number of unit tests per iteration. Cost per iteration. Total Unit tests passing per iteration. Cost per release. Total Unit tests failing per iteration. Total Unit tests ignored per iteration. Total days worked on Project. Total days worked by resource type. Monthly spend. Total Monthly spend. Total Cost to date Total Cost to complete. Estimated Cost at complete.
  • 36. We just broke golden rule #1.
  • 37. So, lets figure out what we need first…
  • 39. here are some common Goals, questions and examples of how metrics support them…
  • 40. Goal: I want predictability. Q: Is my project team converging on a solution that meets the outcomes for my business?
  • 41.
  • 42. Total Effort Work com pl eted Work Added remaining this thi s Total effort Estim ated Actual Accrued Iteration at start. iteration iteration. remaining End Date. Cost. Cost. Costs. Iteration 7-8 49 10 +0 39 01 Sept 34, 650 34,650 34,650 30,800 Iteration 9 39 12 +0 27 15 Sept 30,800 65, 450 31,350 Iteration 10 27 10 +5 22 29 Sept 31,350 96,800 31,900 Iteration 11 22 11 +0 11 13 Oct 31,900 128,700 22,000 Iteration 12 11 11 +0 0 21 Oct 22,000 150,700
  • 44. Goal: I want to understand the capacity of the team and how it changes. Q: Will defects affect the predictability of delivery?
  • 45. Hypothesis: we can use yesterdays weather to predict how much we can get done next time.
  • 46. Velocity is simply the number of Story points delivered last time used as a predictor for next time…
  • 47.
  • 48. Goal: I want to reduce waste in my process and deliver value to the customer as often as possible. Q: Where are the bottle necks in my development process?
  • 49.
  • 50.
  • 51. Goal: I don’t want any nasty surprises late in the project that will affect the predictability of delivery. Q: Will defects affect the predictability of delivery?
  • 52. 90 80 70 60 # of working Acc Tests 50 Not wor k ing Wor k ing 40 30 20 10 0 Mon Tue Wed Thur Fri Mon Tue Wed Thur Fri Mon Tue Wed Thur Fri Date
  • 53.
  • 54. At this point things can become less quantitative and more qualitative…
  • 55. Goal: I want to build capabilities that allow me to repeatably deliver high value products/services. Q: Are my teams developing repeatable capabilities?
  • 56. Design Storming Retrospectives Pairing Re-factoring TDD ATDP Stand up’s Cont Integration
  • 57. Goal: I’m a low risk business, if one project fails this year I don’t want it to sink the organization! Q: What is the risk profile of my project portfolio?
  • 59. Goal: I want to maximize the value from my workforce ensuring smooth transition between projects…. Q: When will I need capacity?
  • 60.
  • 61. Be careful with this one…
  • 62. Don’t break golden rule number 2….
  • 63. Goal: To understand if our strategy in the market place is working so that we can adapt quickly. Q: What do my customers think ?
  • 64. Fred Reichheld Loyalty expert ‘The ultimate question’ (otherwise known as NPS)
  • 65. Net Promoter Score: would you recommend us to a friend or Colleague? P – D = NPS The difference between the number of Promoters and number of Detractors = Net Promoter Score (NPS)
  • 66. Goal: To leverage our strategy to make our enterprise successful. Q: Do our projects align with the vision of our organization?
  • 67. A Starbucks on every corner
  • 68. Inspire customers to enjoy the daily pleasure of Peet's Coffees & Teas by providing a distinctive, superior product, superior coffee and tea knowledge and superior service to every customer, every day.
  • 69. The balanced score card. Typical Key Performance indicators: Financial Cash Flow ROI Financial Result Return on capital employed Return on equity Customer Delivery Performance to Customer - by Date Delivery Performance to Customer - by Quantity Internal Business Processes Number of Activities Opportunity Success Rate Learning & Growth Investment Rate Illness rate
  • 70.
  • 72. Figure out why you want to measure something before you figure out how.
  • 73. GOAL > Question > Metric
  • 74. Everywhere is different . Build metrics that make sense for YOU.
  • 75. Don’t restrict team process adaptations, adapt reporting as required

Editor's Notes

  1. Lean