Jeff Zwier presents best practices for developing metrics for financial shared services. He discusses defining objectives and audiences, focusing on the basics, and designing metrics around clearly defined inputs, outputs, and impacts. Zwier recommends dashboards for executive reporting, scorecards to guide operations, and reports for tactical analysis. Metrics should be based on consistent data, inexpensive to collect, quantitative, and drive actions to change behavior.
1. Developing Metrics for Financial
Shared Services:
Best Practices, Tips and Traps
Jeff Zwier
Manager IS Communications,
Team Lead CISO Audit & Metrics Analysis
ABN AMRO Services IT
Presented at:
IQPC / Finance IQ Shared Services for Finance and Accounting Conference
The Driskill Hotel, Austin, TX
June 23-25, 2007
2. Metrics for Shared Services Jeff Zwier 2
Presentation at a Glance
• Some Definitions
• Before you Begin
• Getting Started
• Designing your Metrics
• Visualization & Presentation
• Resources
3. Metrics for Shared Services Jeff Zwier 3
Some Definitions
• What is a ‘Metric?’
• Why do we use metrics?
4. Metrics for Shared Services Jeff Zwier 4
Metrics Design:
Before you Begin
• As financial professionals, we
are expected to take a
thorough, analytical approach
to our work.
• Depending upon your
audience and objectives, this
expectation can lead to
somewhat less than ideal
results.
5. Metrics for Shared Services Jeff Zwier 5
Incredibly detailed, unfocused
reporting
Most of your stakeholders don’t care about
the details of your operations!
A cautionary tale. . .
6. Metrics for Shared Services Jeff Zwier 6
Metrics Design:
Before you Begin (2)
To avoid the trap:
• Set your reporting objectives
• Focus on the basics
• Define your audience
• Start a dialog
7. Metrics for Shared Services Jeff Zwier 7
Getting the Right Response:
Reporting Objectives and Types of Metrics
Metrics can be used for. . .
• Executive Reporting
– steer enterprise-level decision making, direct investment and
demonstrate value
• Strategic Reporting
– provide a “reality check” for your shared services on whether it is
really delivering its intended value
• Operational Reporting
– measure the performance of your staff when executing key
operational processes
• Tactical Reporting
– create a snapshot of performance for use in special projects
8. Metrics for Shared Services Jeff Zwier 8
Focusing on the Basics
• Good metrics are:
– Based upon consistent, measurable data
– Inexpensive (in terms of time and money)
to collect
– Expressed in unambiguous, quantitative
terms that are objectively defined
– “Actionable” – there are no ‘FYI’ metrics!
9. Metrics for Shared Services Jeff Zwier 9
Defining your Audience:
Questions to Ask
• Who wants to know?
• What do they want to know?
• How often do they need to
know?
• Why do they want to know it?
• What channel is the most
effective way to reach your
audience?
• What will they do with your
information?
• What behavioral change(s) do
you expect as a result?
10. Metrics for Shared Services Jeff Zwier 10
They Don’t Know What they Want, so I
Have to Give them Everything
There’s always a way to find out more about what your internal or external stakeholders
really need. Ask your internal communications or training department to help you create
a survey of potential recipients for your report.
Creating good metrics is a collaborative process – if you don’t already have a good rapport
with your customers or managers, your metrics development will be a struggle.
11. Metrics for Shared Services Jeff Zwier 11
Ways to Start a Dialog with your
Reporting Audience
• Focus groups
• Performance objective setting / SLAs
• Budgeting
• Surveys
• User communities / forums
• Reactions to industry benchmarks or
commonly referenced research
• Account managers / client
engagement professionals
12. Metrics for Shared Services Jeff Zwier 12
Designing Your Metrics:
Best Practices
• Guiding principles that will help you create the
right metrics for the right objectives:
– Focus on information, not data
– Isolate processes to select the right level of
analysis for your metric
– Resist the temptation select metrics based upon
business intelligence tooling requirements or
‘instant dashboard’ solutions
– Select metrics that have clearly defined inputs,
outputs and impacts
– Set rating criteria based upon the impact of a
metric hitting a certain value, not historic trends
13. Metrics for Shared Services Jeff Zwier 13
Data versus Information
• Data
– The operational details that
collectively describe the
activities of your service.
• Information
– Metrics that describe the data
you have available with the
context necessary to make
good decisions about what
your service has been doing.
14. Metrics for Shared Services Jeff Zwier 14
In Other Words. . .
• Remember:
ACTIVITY
Does not
equal
ACHIEVEMENT
15. Metrics for Shared Services Jeff Zwier 15
Isolate your Process to Find
the Right Metrics
• Measure within processes to avoid mixing
levels of detail or introducing intervening
variables.
– Avoid metrics that draw data from across
processes unless you are creating
executive reporting.
– Is there a single cause of a metric’s value moving
in a positive or negative direction?
16. Metrics for Shared Services Jeff Zwier 16
Avoid Tool-specific Metrics
• Would you change the planned layout of your
home in order to take advantage of using a
particular hammer?
17. Metrics for Shared Services Jeff Zwier 17
Inputs, Outputs and Impacts:
Use “IOI” for Higher ROI
• Inputs
– Clearly defined, objective and stable – both over
time and across actors
• Outputs
– Predictable based upon variations of inputs plus
the environment in general
• Impacts
– What real change happens to the business (the
bottom line, availability, or other factors) when the
value of a metric moves?
18. Metrics for Shared Services Jeff Zwier 18
Setting Rating Criteria
• Popular Rating Schemes
– Red/Amber/Green
– Report Cards
• (A, B, C, D, F)
– Percentage of Perfection
• (0-100%)
• How do you determine
your rating thresholds?
19. Metrics for Shared Services Jeff Zwier 19
Setting Rating Criteria (2)
• History is not often a good
baseline for future
performance measurement
• Look for objective impacts in
order to determine what “red”
or “green” status should be
• Stay quantitative
– Presence or absence
– Volumes, variable costs
– Losses, gains, rejections
"History is more or less bunk. It's tradition. We don't want tradition. We want to live in the present, and
the only history that is worth a tinker's damn is the history that we make today."
(Henry Ford, quoted in the Chicago Tribune, 1916).
TRAP: Don’t use history to set
the standard for future
performance
20. Metrics for Shared Services Jeff Zwier 20
Visualization and Presentation
• Dashboards
– One to three pages of discrete, clearly defined
indicators.
• Scorecards
– Balanced Scorecard summaries across defined
performance dimensions.
• Reports
– Operational detail designed for comprehensive
views of service data.
21. Metrics for Shared Services Jeff Zwier 21
Dashboards
• Dashboards provide indicators,
gauges and simple charts to help
senior leaders make strategic
decisions
– Design principle: Simple
is better!
• Use your car as a model
– Make most critical information most
prominent
– Many good (and exceptionally
bad) examples to choose
from online
– Can often be automatically
generated from business intelligence
tool platforms.
22. Metrics for Shared Services Jeff Zwier 22
A Typical Corporate Services
Dashboard
23. Metrics for Shared Services Jeff Zwier 23
What your COO Would Like to See
26. Metrics for Shared Services Jeff Zwier 26
Traditional Reports
• Helpful for tactical reporting,
operational effectiveness analysis
• Not the best solution for
changing behavior
• Common reporting traps
– ‘Executive Summary’
– Often mistaken for service
marketing tools
– Data density
– Jargon
– Produced by subject matter
experts, rather than
communicators
27. Metrics for Shared Services Jeff Zwier 27
Using Dashboards, Scorecards
and Reports
If you want to. . . Then consider. . .
…steer enterprise-level or CXO
decision making, direct
investment, or generally
demonstrate value
…executive communication tools
such as dashboards, monthly
update presentations.
…provide a ‘reality check’ for
your shared service management
team to guide efficient and
effective operations
…balanced scorecard, guiding
principle tables, operational
process descriptions with
progress indicators.
…create a snapshot of
performance for use in projects
or long term analytics
…traditional tactical or operations
reporting formats.
28. Metrics for Shared Services Jeff Zwier 28
Resources:
For More Information
• Dashboard Designs and Data Visualization
– The Dashboard Spy
• www.dashboardspy.com
– Instant Cognition Blog
• http://blog.instantcognition.com/category/visualization/
– Edward Tufte Q&A Forums
• http://www.edwardtufte.com/bboard/q-and-a?topic_id=1
• Reporting and Metrics
– Article on Reporting for Shared Services (Shared Services Network News)
• www.jeffzwier.com/articles
– Techweb article on KPI development
• http://www.intelligententerprise.com/showArticle.jhtml?articleID=51201364
• Balanced Scorecard
– What is the Balanced Scorecard?
• http://www.balancedscorecard.org/basics/bsc1.html
29. Developing Metrics for Financial
Shared Services:
Best Practices, Tips and Traps
Jeff Zwier
Manager IS Communications,
Team Lead CISO Audit & Metrics Analysis
ABN AMRO Services IT
Jeff Zwier
jeff@zwier.net
Jeff Zwier
jeff@zwier.net
Editor's Notes
About the author:
Jeff Zwier is a communications and performance management professional specializing in jump-starting productivity through effective metrics design, reporting and communication. At the time of this presentation, he was Vice President and Team Lead, Audit and Metrics Analysis for ABN AMROs global information security shared service. In previous roles, Jeff has consulted with Fortune 1000 companies to help them improve their employee communication, leadership, internal marketing and performance measurement programs. He served as a member of the Shared Services Network News Editorial board, and is author of several articles on communication strategy, marketing and reporting for shared services and past workshop presenter at IQPCs Shared Services Week, Shared Services Summit West and other professional conferences.
For current contact information, Please see Jeff’s LinkedIn profile: http://www.linkedin.com/in/jeffzwier
Definition of metric as a system for measurement
We use metrics for a variety of purposes, but for the most part what they are about is making the output of invisible, “black box” processes visible to key stakeholders.
It’s tempting to do a deep dive into the data so you can very thoroughly describe exactly where you are and how well you are doing. Unfortunately, this is often the exact OPPOSITE of what your stakeholders need!
CASE STUDY: “It’s in the executive summary…”
executive reporting tools
e.g. dashboards or monthly update presentations
strategic reporting tools
progress maps and guiding principle tables
operational reporting
unit cost, defect rates and other
productivity indicators
tactical reports
Performance data
Consistent measurable data = anyone should be able to collect this, not just an expert in your field
Inexpensive – if you are spending money to gather data in the information age, STOP and examine your processes. You have something to fix there first before you start
Unambiguous, quantitative terms – this is as simple as saying, “the temperature is 87 degrees” rather than, “it’s warm in here.”
Actionable – if your report does not stimulate action on the part of the reader, why are you creating it?
CASE STUDY: “It’s in the executive summary…”
There’s an old saying that goes, “when you have a hammer, every problem looks like a nail.” Unfortunately, this is often how we choose what data or metrics to use – even if the fit with our organization’s needs isn’t quite there. Just because you have a particular set of data in your hands does not mean it will be the most suitable tool to persuade your target audience to take action appropriately.
This is actually the cockpit of the Space Shuttle Atlantis, but you get the idea.