2. 2
User Story
As an IT Head,
I need to measure the performance of my group
so that I can understand how Agile methods are aligning
with my organizational goals
3. 3
Acceptance Criteria
1. The framework should look at measuring the
Knowledge , Skills and Abilities needed to ….. Build
efficiencies to….. Effectively deliver services to….the
client
2. Periodic reporting should be enabled by the
framework
3. The framework should consist of leading and lagging
performance indicators based on IT goals
4. 4
Fulfilling ATDD - 1
Finance
Customer
Value
Internal
Processes
Learning &
Development
Deliver Services
Knowledge skills
and abilities
Build Efficiencies
To the client
5. 5
Tasks for BSC User Story
# User Story Tasks
1 Create the Strategy Map
2 Understand what do you mean by performance
3 Highlight the key initiatives
4 Identify the targets
5 Identify the 5 Ws – Why, What, Where, When, Who, How
7. 7
1. Create the strategy map
2. Now identify the different performance
measures that you would track for each
of the objective
3. Fill in the 5W template
8. 8
Fulfilling ATDD-2: The 5 W’s
Who reviewsWhen (Frequency)
Where (Source of Data)
Title What to achieve (Target)
Who Collects
Why (Purpose) How (Initiative)
10. 10
Sample Balance Score Card created with Agile Focus
Strategy
Map
Financial
Compliance
Customer
Value
Internal
Process
Learning
and
Growth
Strategic
Objectives
Service Value
delivered
Customer
Intimacy
On Time
Project Delivery
Decrease
Defect in
Production
Increase % of
agreed scope
Enable Agile
Transformation
Enable People
& Culture
Performance Measures
1. Margin Contribution (Cost)
2. Earned Value/Release – Feature Burn-up
1. Customer Satisfaction –CSAT
1. Velocity
2. Avg Project Request Cycle Time -
Requested
3. Avg Project Request Cycle Time -
Scheduled
4. Sprint & Release Burndown performance
trend deviation
1. Defects in a sprint
2. Test Coverage
3. Production Defects
4. Build Success Rate
1. Story de-scoping index
2. User Story Volatility
1. Agile Utilization
2. Retrospective index
1. Agile Academy Compliance
Initiatives
• Measure IT contribution to Cost
• Enable operations to release value every month to
production
• Implement CSAT for end users of software
• Ensure operational measures are collected and
collated every sprint, by every sprint team.
• SM to help teams track during the release
• Ensure consistent defect management
• Measure coverage every sprint
• Measure running tested features
• IT and Business measure needed. Indication of
partnership. Ensure collection and review.
• Transformation team proactively working the
roadmap to work toward 100% (of goal)
• Retrospective Actions to be tracked every sprint
• Define and formalize the Agile training program and
participation opportunities and guidelines.
Targets
1. 20%
2. 1 release
/ month
1. >6/qtr
1. Team sp.
2. #prr/days
3. #prr/days
4. <10%
1. 0 P1,P2
2. >90%
3. 0 P1, P2
4. >90%
1. <10%
2. <5%
1. >15 QoQ
2. > 80%
1. >80%
Note: This is a sample representation
11. 11
Fulfilling ATDD-3
Performance Measures
1. Margin Contribution (Cost)
2. Earned Value/Release – Feature Burn-up
1. Customer Satisfaction –CSAT
1. Velocity
2. Avg Project Request Cycle Time -
Requested
3. Avg Project Request Cycle Time -
Scheduled
4. Sprint & Release Burndown performance
trend deviation
1. Defects in a sprint
2. Test Coverage
3. Production Defects
4. Build Success Rate
1. Story de-scoping index
2. User Story Volatility
1. Increase Agile Utilization
2. Retrospective index
1. Increase Agile Academy Compliance
Leading / Lagging
1. Leading
2. Lagging
1. Lagging
1. Leading
2. Lagging
3. Lagging
4. Leading
1. Leading
2. Leading
3. Lagging
4. Leading
1. Leading
2. Leading
1. Lagging
2. Leading
1. Leading
Cause and Effect
With leading
indicators you
should be able to
correlate how
lagging
indicators will
shape up
12. 12
Acceptance Criteria
1. The framework should look at measuring the
Knowledge , Skills and Abilities needed to ….. Build
efficiencies to….. Effectively deliver services to….the
client
2. Periodic reporting should be enabled by the
framework
3. The framework should consist of leading and lagging
performance indicators based on IT goals
13. Always remember
Thank You
“Not everything
that can be counted
counts
&
Not everything that
counts can be
counted”
Archana Joshi
Sr. Manager, Wipro Technologies
Email: archana.p.joshi@gmail.com
Archana.joshi@wipro.com