2. User Story
As an IT Head,
I need to measure the performance of my group
so that I can understand how Agile methods are aligning
with my organizational goals
2
3. Acceptance Criteria
1. The framework should look at measuring the
Knowledge , Skills and Abilities needed to ….. Build
efficiencies to….. Effectively deliver services to….the
client
2. Periodic reporting should be enabled by the
framework
3. The framework should consist of leading and lagging
performance indicators based on IT goals
3
4. Fulfilling ATDD - 1
Deliver Services To the client
Customer
Finance
Value
Internal Learning &
Processes Development
Build Efficiencies Knowledge skills
and abilities
4
5. Tasks for BSC User Story
# User Story Tasks
1 Create the Strategy Map
2 Understand what do you mean by performance
3 Highlight the key initiatives
4 Identify the targets
5 Identify the 5 Ws – Why, What, Where, When, Who, How
5
6. Strategy Map: Goal to Objectives
Strategic Goal: Improve Project Performance
Service value
Finance
delivered
Customer Customer
Value Intimacy and
Satisfaction
On Time Decrease in
Internal
Process Project Production
Delivery Defect
Learning and Enable Agile
Development Transformation
6
7. 1. Create the strategy map
2. Now identify the different performance
measures that you would track for each
of the objective
3. Fill in the 5W template
7
8. Fulfilling ATDD-2: The 5 W’s
Title What to achieve (Target)
When (Frequency) Who reviews Who Collects
Why (Purpose) How (Initiative) Where (Source of Data)
8
9. Match the following
Velocity
CSAT
Customer
Finance
De-scoping Index
Value
Feature Burn-up
Agile Utilization
Retrospective
Index Internal Learning &
Processes Development
Build Success Rate
9
10. Sample Balance Score Card created with Agile Focus
Strategy Strategic Performance Measures Initiatives Targets
Map Objectives
Financial Service Value 1. Margin Contribution (Cost) • Measure IT contribution to Cost 1. 20%
Compliance delivered 2. Earned Value/Release – Feature Burn-up • Enable operations to release value every month to 2. 1 release
production / month
Customer Customer 1. Customer Satisfaction –CSAT • Implement CSAT for end users of software 1. >6/qtr
Value Intimacy
Internal On Time 1. Velocity • Ensure operational measures are collected and 1. Team sp.
Process Project Delivery 2. Avg Project Request Cycle Time - collated every sprint, by every sprint team. 2. #prr/days
Requested • SM to help teams track during the release 3. #prr/days
3. Avg Project Request Cycle Time - 4. <10%
Scheduled
4. Sprint & Release Burndown performance
trend deviation
Decrease 1. Defects in a sprint • Ensure consistent defect management 1. 0 P1,P2
Defect in 2. Test Coverage • Measure coverage every sprint 2. >90%
Production 3. Production Defects • Measure running tested features 3. 0 P1, P2
4. Build Success Rate 4. >90%
Increase % of 1. Story de-scoping index • IT and Business measure needed. Indication of 1. <10%
agreed scope 2. User Story Volatility partnership. Ensure collection and review. 2. <5%
Learning Enable Agile 1. Agile Utilization • Transformation team proactively working the 1. >15 QoQ
and Transformation 2. Retrospective index roadmap to work toward 100% (of goal) 2. > 80%
Growth • Retrospective Actions to be tracked every sprint
Enable People 1. Agile Academy Compliance • Define and formalize the Agile training program and 1. >80%
& Culture participation opportunities and guidelines.
Note: This is a sample representation 10
11. Fulfilling ATDD-3
Performance Measures Leading / Lagging
1. Margin Contribution (Cost) 1. Leading
2. Earned Value/Release – Feature Burn-up 2. Lagging
1. Customer Satisfaction –CSAT 1. Lagging
Cause and Effect
1. Velocity 1. Leading
2. Avg Project Request Cycle Time - 2. Lagging
Requested
3. Avg Project Request Cycle Time - 3. Lagging
Scheduled
4. Sprint & Release Burndown performance 4. Leading With leading
trend deviation indicators you
1. Defects in a sprint 1. Leading
2. Test Coverage 2. Leading should be able to
3.
4.
Production Defects
Build Success Rate
3.
4.
Lagging
Leading
correlate how
1. Story de-scoping index 1. Leading
lagging
2. User Story Volatility 2. Leading indicators will
1. Increase Agile Utilization 1. Lagging
shape up
2. Retrospective index 2. Leading
1. Increase Agile Academy Compliance 1. Leading
11
12. Acceptance Criteria
1. The framework should look at measuring the
Knowledge , Skills and Abilities needed to ….. Build
efficiencies to….. Effectively deliver services to….the
client
2. Periodic reporting should be enabled by the
framework
3. The framework should consist of leading and lagging
performance indicators based on IT goals
12
13. Always remember
“Not everything
that can be counted
counts
&
Not everything that
counts can be
counted”
Thank You
Archana Joshi
Sr. Manager, Wipro Technologies
Email: archana.p.joshi@gmail.com
Archana.joshi@wipro.com
