Presentation at Music City Agile (9/7/19) on Measuring Flow: Metrics that Matter

1. Measuring Flow
Metrics that Matter
Julie Wyman & Hunter Tammaro
excella.com | @excellaco

2. excella.com | @excellaco
Agenda
• Why is flow
so important?
• How do we
measure flow?
• Practice!

3. excella.com | @excellaco
Utilization vs. Flow
What’s the difference?

4. excella.com | @excellaco
Prioritizing
Utilization
Fully utilized, but spend most
of the time waiting
Slow flow through
the system
Slow to respond to change

5. excella.com | @excellaco
Prioritizing
Flow
Work almost always moving
Rapid flow through
the system
Short response time reduces
effect of impediments

6. excella.com | @excellaco
Measuring Flow

7. excella.com | @excellaco
Throughput
How much fits?

8. excella.com | @excellaco
What it measures
What:
Number of work items
completed in a given
length of time
Why:
Predict how long to complete
a given set of work
Get a sense of team stability0
2
4
6
8
10
12
14
16
18
20
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
#ofWorkItemsCompleted
Week

9. excella.com | @excellaco
Throughput
0
2
4
6
8
10
12
14
16
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
#ofWorkItemsCompleted
Week

10. excella.com | @excellaco
Comparison to Velocity
Similarities
• Team delivery
over time
• Provides predictability
Differences
• Independent of work
item size
• Not tied to a sprint
• Simplicity of collection

11. excella.com | @excellaco
Lead and Cycle Time
How long will it take?

12. excella.com | @excellaco
What it measures
Backlog Ready Develop Validate Done
Doing Done
Lead
Time

13. excella.com | @excellaco
What it measures
Backlog Ready Develop Validate Done
Doing Done
Development
Cycle Time
Validation
Cycle Time

14. excella.com | @excellaco
What it measures
Backlog Ready Develop Validate Done
Doing Done
Work-item
Cycle Time*

15. excella.com | @excellaco
How to collect
Backlog Ready Develop Validate Done
Doing Done
Work-item
Cycle Time

16. excella.com | @excellaco
Average Cycle Time
What:
The arithmetic mean of
cycle time tracked over
time
Why:
Helps visualize trends
and provides data for
predicting delivery
0
1
2
3
4
5
6
7
8
1 2 3 4 5
CycleTime(days)
Sprint

17. excella.com | @excellaco
Average Cycle Time
0
1
2
3
4
5
6
7
8
1 2 3 4 5
CycleTime(days)
Sprint
Stories Bugs Overall
What:
The arithmetic mean of
cycle time tracked over
time
Why:
Helps visualize trends
and provides data for
predicting delivery

18. excella.com | @excellaco
Cycle Time Distribution
0
2
4
6
8
10
12
14
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
#ofoccurrences
(oftheparticularcycletime)
Cycle Time (days)
median
average
85% confidence
95% confidence
What:
Shows how
often each cycle
time occurs
Why:
Differentiate
between trends
and outliers

19. excella.com | @excellaco
0
2
4
6
8
10
12
14
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
#ofoccurrences
(oftheparticularcycletime)
Cycle Time (days)
Cycle Time Distribution
median
average
85% confidence
95% confidence

20. excella.com | @excellaco
Use in Scrum & Kanban
• Central to Kanban
to show progress
• Useful in Scrum to
promote flow
within a sprint to
avoid “hockey stick”
shaped burndown
0
2
4
6
8
10
12
14
16
18
20
StoryPointsRemaining Day

21. excella.com | @excellaco
Cumulative Flow Diagram
How is work moving along?

22. excella.com | @excellaco
What it measures
What:
Number of work items in a given
status over time
Why:
Highlights bottlenecks, visualizes
amount of work in progress and
cycle time, shows end-to-end flow
through system0
10
20
30
40
50
60
70
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49
NumberofItems
Days
Done Validate Develop Ready Backlog
Cycle Time
WIP

23. excella.com | @excellaco
How to collect
Day Backlog Ready Develop Validate Done
1 4 5 2 0 0
2 4 4 3 0 0
3 4 4 3 0 0
4 8 4 3 0 0
5 7 5 2 2 0
6 7 5 2 2 0
7 6 6 1 1 2
8 4 8 0 1 3
9 5 8 0 1 3
10 5 4 3 2 4
TestBacklog Validate

24. excella.com | @excellaco
Look out for dips
0
5
10
15
20
25
1 2 3 4 5 6 7 8 9 10NumberofItems
Days
Done Validate Develop Ready Backlog
• All lines should
always increase
• Decreasing lines can
indicate problems
with flow

25. excella.com | @excellaco
Cumulative Flow Diagram
0
5
10
15
20
25
30
35
40
45
50
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49
NumberofItems
Days
Backlog
Ready
Develop
Validate
Done

26. excella.com | @excellaco
0
10
20
30
40
50
60
70
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49
NumberofItems
Days
Done Validate Develop Ready Backlog
Comparison to Burndown Chart
• Independent of work item size
and iteration
• Gives insight into bottlenecks
on intermediate steps
• Accounts for changes
in scope
• Shows WIP and cycle time
in context
StoryPointsRemaining
Day

27. excella.com | @excellaco
Benefits of Improving Flow

28. excella.com | @excellaco
By delivering some
stories earlier
Reduce
risk
Improving ability to
make adjustments
Increase
feedback
Across the team and
throughout the Sprint
Smooth
workload
Improve flow to…

29. excella.com | @excellaco
Visualize flow
regardless of Agile approach used
Flow metrics…
• Are simple to collect
• Can be used for predictability and
planning purposes
• Provide richer insights into a team’s
bottlenecks and improvement areas

30. excella.com | @excellaco
Wrapping It Up
and some additional resources

31. excella.com | @excellaco
Additional
Resources
• How’s Your Team’s Flow? Measure It to
Master It!
• Burndown Charts vs Cumulative Flow
Diagrams
• 7 Lean Metrics to Improve Flow
• Lean Metrics: Measure Predictability with
Facts over Estimates
• Using Flow Metrics to Deliver Faster
• More Cumulative Flow Diagrams

32. excella.com | @excellaco
How to
connect with us
Julie Wyman
julie.wyman@excella.com
https://www.linkedin.com/in/julie-wyman/
Hunter Tammaro
hunter.tammaro@excella.com
@htammaro
https://www.linkedin.com/in/wmhunter/
Excella Consulting
@excellaconsulting
@excellaco

33. excella.com | @excellaco