2. Who am I?
⢠ORNL operations staďŹ
⢠LOPSA Technical StaďŹ
⢠Generalist IT engineer for ~10 years
Friday, May 3, 13
3. Who am I?
⢠ORNL operations staďŹ
⢠LOPSA Technical StaďŹ
⢠Generalist IT engineer for ~10 years
⢠I am obsessed with monitoring.
Friday, May 3, 13
4. Who am I?
⢠ORNL operations staďŹ
⢠LOPSA Technical StaďŹ
⢠Generalist IT engineer for ~10 years
Friday, May 3, 13
5. Who am I?
⢠ORNL operations staďŹ
⢠LOPSA Technical StaďŹ
⢠Generalist IT engineer for ~10 years
⢠I am obsessed with data.
Friday, May 3, 13
6. A dashboard is a visual display
of the most important
information needed to
achieve one or more
objectives; consolidated and
arranged on a single screen so
the information can be
monitored at a glance.
What is a dashboard?
* Stephen Few, Intelligent Enterprise
Friday, May 3, 13
The highlighted bits are what I think are the most important points to remember.
7. But ďŹrst...
You need some data!
Friday, May 3, 13
Visualization is a lot of fun, but itâs no use if you donât have the right data to display. Finding the data is even more fun, and
potentially much more challenging.
So, what data should you get. That depends on what you need to show.
8. Letâs say you wanted
to show...
⢠Bandwidth usage: border router(s), SNMP
query
⢠Peak usage hours: databases, network
traďŹc, VPN usage
⢠User demographics: lots of database work.
⢠Thereâs always the case that the data may
not exist.
Friday, May 3, 13
These are just a couple examples of information you might want to show, and where you might ďŹnd the data for them.
9. Your data is all over
the place
⢠ERP, CRM
⢠Your ticket system
⢠Product databases
⢠Google Analytics
⢠Operational monitoring systems (eg,
Nagios)
Friday, May 3, 13
Your data is stored in lots of places. Google Analytics, your operational monitoring systems, various databases...
This is where the engineer in you shines: use your language of choice, SQL, and knowledge of your infrastructure to ďŹnd the
data and do the necessary magic on it to turn it into meaningful information.
10. Building information dashboards: an
exercise in not thinking like an ops
engineer.
An exercise in not thinking Ops
Friday, May 3, 13
11. âWhat gets measured, gets managed.â
- Peter Drucker, management guru
Friday, May 3, 13
12. Key Performance Indicator (KPI)
A way to measure the progress
of a service, program, or initiative
towards the goals.
Friday, May 3, 13
The purpose of the KPI is to drive change.
How do you know youâre doing better or worse without the numbers?
KPIs differ depending on use. Bandwidth utilization is a KPI for a datacenter, but perhaps not for a doctorâs office.
In fact, they differ within companies. New customer acquisitions is a KPI for marketing and sales, but not for IT. Likewise,
Finance doesnât care about utilization metrics of the ERP system.
14. You are the CEO of a web hosting
company. What are your KPIs?
KPI examples
Friday, May 3, 13
15. You are the CEO of a web hosting
company. What are your KPIs?
â˘Total sales (dollar amount)
â˘Total expenses (dollar amount)
â˘ProďŹt margin (percentage)
â˘Number of new customers
â˘Number of cancellations
KPI examples
Friday, May 3, 13
16. You are the CEO of a web hosting
company. What are your KPIs?
â˘Total sales (dollar amount)
â˘Total expenses (dollar amount)
â˘ProďŹt margin (percentage)
â˘Number of new customers
â˘Number of cancellations
You are the customer service
manager for a call center.
What are your KPIs?
KPI examples
Friday, May 3, 13
17. You are the CEO of a web hosting
company. What are your KPIs?
â˘Total sales (dollar amount)
â˘Total expenses (dollar amount)
â˘ProďŹt margin (percentage)
â˘Number of new customers
â˘Number of cancellations
You are the customer service
manager for a call center.
What are your KPIs?
â˘Call volume
â˘Call length
â˘Queue wait time
â˘Number of call abandons
KPI examples
Friday, May 3, 13
19. Letâs build a dashboard!
LOPSA Board of Directors Dashboard
Friday, May 3, 13
20. Letâs build a dashboard!
LOPSA Board of Directors Dashboard
KPIs
Friday, May 3, 13
21. Letâs build a dashboard!
LOPSA Board of Directors Dashboard
Membership
â˘New members
â˘Lapsed members
â˘Member satisfaction
KPIs
Friday, May 3, 13
22. Letâs build a dashboard!
LOPSA Board of Directors Dashboard
Membership
â˘New members
â˘Lapsed members
â˘Member satisfaction
Financial
â˘Program income
â˘Contribution income
â˘Program expenses
â˘Operating expenses
KPIs
Friday, May 3, 13
23. Letâs build a dashboard!
LOPSA Board of Directors Dashboard
Membership
â˘New members
â˘Lapsed members
â˘Member satisfaction
Financial
â˘Program income
â˘Contribution income
â˘Program expenses
â˘Operating expenses
Locals Program
â˘Chapter attendance
â˘New chapters
â˘Conversions
KPIs
Friday, May 3, 13
24. Letâs build a dashboard!
LOPSA Board of Directors Dashboard
Membership
â˘New members
â˘Lapsed members
â˘Member satisfaction
Financial
â˘Program income
â˘Contribution income
â˘Program expenses
â˘Operating expenses
Locals Program
â˘Chapter attendance
â˘New chapters
â˘Conversions
Mentorship Program
â˘Pairing requests
â˘Pairing assignments
â˘Pair ratings
KPIs
Friday, May 3, 13
25. Dashboard design tips
⢠Know your audience
⢠Only display relevant data
⢠Both to your audience and your topic
⢠Watch your granularity
⢠Keep it simple
Friday, May 3, 13
Your audiences care about different things. Even among IT teams, different metrics matter. Keep this in mind.
Granularity: a dashboard is high-level. Look for the balance between showing enough information and too much information.
Keep it simple. Eye-candy is great, but donât overdo it: the purpose of a dashboard is to answer questions quickly.
26. (numbers used not actual values)
Friday, May 3, 13
Visualization was done with D3.js
28. Letâs try another...
Friday, May 3, 13
KPIs do not have to be quantitative. Sometimes theyâre qualitative.
Think of things this way: what information would your boss wish he had in a staff meeting with other managers? What
information shows how well your department is doing?
29. Letâs try another...
An IT Managerâs dashboard
Friday, May 3, 13
KPIs do not have to be quantitative. Sometimes theyâre qualitative.
Think of things this way: what information would your boss wish he had in a staff meeting with other managers? What
information shows how well your department is doing?
30. KPIs:
â˘Support request volume
â˘Incident resolution time
â˘Customer satisfaction (survey)
â˘Infrastructure availability %
â˘SigniďŹcant system events
â˘Upcoming changes
Letâs try another...
An IT Managerâs dashboard
Friday, May 3, 13
KPIs do not have to be quantitative. Sometimes theyâre qualitative.
Think of things this way: what information would your boss wish he had in a staff meeting with other managers? What
information shows how well your department is doing?
31. Thatâs cool and all, but weâre
engineers...
Friday, May 3, 13
But Mike, weâre engineers! What has all this got to do with us?
32. No problem!
Friday, May 3, 13
Itâs got everything to do with you!
This has given you some insight into how your boss and executives think. If you start answering their questions before they can
even ask them, what do you think theyâre going to do? Youâve just become more valuable to them, and youâve developed a
crucial skill.
Remember, IT supports the business.
33. While youâre there...
(or: interesting data)
What else is in your data that no one has
thought to ask about?
Friday, May 3, 13
In the course of working on LOPSA projects, I realized an interesting project could be built.
34. LOPSA Membership Heatmap
* No PII was used in the
creation of this map
Friday, May 3, 13
Donât worry, no personally identiďŹable information was used in the creation of this map.
This map is fairly obvious: a heat map of active LOPSA members. Itâs done in the Google Maps API. On the live version, you can
zoom in and see more granularity. At this zoom level, LA and San Diego are just one blob, while they are clearly distinct at a
closer zoom.
I just used a SQL query, Python, and Javascript for this.
35. Resources
⢠Information Dashboard Design by Stephen Few
⢠Actually, anything by Stephen Few.
⢠What Your CEO Wants You to Know by Ram Charan
⢠For learning how to think like management
⢠A Practical Intro to Data Science - ZipďŹan Academy blog
⢠Deep intro into data science--for those who really want to get
into it
⢠D3.js (d3js.org)
⢠Awesome visualization library
Friday, May 3, 13
37. Thank You for Attending LOPSA-East '13
Please ďŹll out the Trainer Evaluation
http://lopsa-east.org/2013/training-survey
Rate LOPSA-East '13
http://www.lopsa-east.org/2013/rate-lopsa-east-13
Friday, May 3, 13