SlideShare ist ein Scribd-Unternehmen logo
1 von 37
Downloaden Sie, um offline zu lesen
Monitoring for the
Public Good
Mike Julian
Friday, May 3, 13
Who am I?
• ORNL operations staff
• LOPSA Technical Staff
• Generalist IT engineer for ~10 years
Friday, May 3, 13
Who am I?
• ORNL operations staff
• LOPSA Technical Staff
• Generalist IT engineer for ~10 years
• I am obsessed with monitoring.
Friday, May 3, 13
Who am I?
• ORNL operations staff
• LOPSA Technical Staff
• Generalist IT engineer for ~10 years
Friday, May 3, 13
Who am I?
• ORNL operations staff
• LOPSA Technical Staff
• Generalist IT engineer for ~10 years
• I am obsessed with data.
Friday, May 3, 13
A dashboard is a visual display
of the most important
information needed to
achieve one or more
objectives; consolidated and
arranged on a single screen so
the information can be
monitored at a glance.
What is a dashboard?
* Stephen Few, Intelligent Enterprise
Friday, May 3, 13
The highlighted bits are what I think are the most important points to remember.
But rst...
You need some data!
Friday, May 3, 13
Visualization is a lot of fun, but it’s no use if you don’t have the right data to display. Finding the data is even more fun, and
potentially much more challenging.
So, what data should you get. That depends on what you need to show.
Let’s say you wanted
to show...
• Bandwidth usage: border router(s), SNMP
query
• Peak usage hours: databases, network
trac, VPN usage
• User demographics: lots of database work.
• There’s always the case that the data may
not exist.
Friday, May 3, 13
These are just a couple examples of information you might want to show, and where you might nd the data for them.
Your data is all over
the place
• ERP, CRM
• Your ticket system
• Product databases
• Google Analytics
• Operational monitoring systems (eg,
Nagios)
Friday, May 3, 13
Your data is stored in lots of places. Google Analytics, your operational monitoring systems, various databases...
This is where the engineer in you shines: use your language of choice, SQL, and knowledge of your infrastructure to nd the
data and do the necessary magic on it to turn it into meaningful information.
Building information dashboards: an
exercise in not thinking like an ops
engineer.
An exercise in not thinking Ops
Friday, May 3, 13
“What gets measured, gets managed.”
- Peter Drucker, management guru
Friday, May 3, 13
Key Performance Indicator (KPI)
A way to measure the progress
of a service, program, or initiative
towards the goals.
Friday, May 3, 13
The purpose of the KPI is to drive change.
How do you know you’re doing better or worse without the numbers?
KPIs differ depending on use. Bandwidth utilization is a KPI for a datacenter, but perhaps not for a doctor’s office.
In fact, they differ within companies. New customer acquisitions is a KPI for marketing and sales, but not for IT. Likewise,
Finance doesn’t care about utilization metrics of the ERP system.
KPI examples
Friday, May 3, 13
You are the CEO of a web hosting
company. What are your KPIs?
KPI examples
Friday, May 3, 13
You are the CEO of a web hosting
company. What are your KPIs?
•Total sales (dollar amount)
•Total expenses (dollar amount)
•Profit margin (percentage)
•Number of new customers
•Number of cancellations
KPI examples
Friday, May 3, 13
You are the CEO of a web hosting
company. What are your KPIs?
•Total sales (dollar amount)
•Total expenses (dollar amount)
•Profit margin (percentage)
•Number of new customers
•Number of cancellations
You are the customer service
manager for a call center.
What are your KPIs?
KPI examples
Friday, May 3, 13
You are the CEO of a web hosting
company. What are your KPIs?
•Total sales (dollar amount)
•Total expenses (dollar amount)
•Profit margin (percentage)
•Number of new customers
•Number of cancellations
You are the customer service
manager for a call center.
What are your KPIs?
•Call volume
•Call length
•Queue wait time
•Number of call abandons
KPI examples
Friday, May 3, 13
Let’s build a dashboard!
Friday, May 3, 13
Let’s build a dashboard!
LOPSA Board of Directors Dashboard
Friday, May 3, 13
Let’s build a dashboard!
LOPSA Board of Directors Dashboard
KPIs
Friday, May 3, 13
Let’s build a dashboard!
LOPSA Board of Directors Dashboard
Membership
•New members
•Lapsed members
•Member satisfaction
KPIs
Friday, May 3, 13
Let’s build a dashboard!
LOPSA Board of Directors Dashboard
Membership
•New members
•Lapsed members
•Member satisfaction
Financial
•Program income
•Contribution income
•Program expenses
•Operating expenses
KPIs
Friday, May 3, 13
Let’s build a dashboard!
LOPSA Board of Directors Dashboard
Membership
•New members
•Lapsed members
•Member satisfaction
Financial
•Program income
•Contribution income
•Program expenses
•Operating expenses
Locals Program
•Chapter attendance
•New chapters
•Conversions
KPIs
Friday, May 3, 13
Let’s build a dashboard!
LOPSA Board of Directors Dashboard
Membership
•New members
•Lapsed members
•Member satisfaction
Financial
•Program income
•Contribution income
•Program expenses
•Operating expenses
Locals Program
•Chapter attendance
•New chapters
•Conversions
Mentorship Program
•Pairing requests
•Pairing assignments
•Pair ratings
KPIs
Friday, May 3, 13
Dashboard design tips
• Know your audience
• Only display relevant data
• Both to your audience and your topic
• Watch your granularity
• Keep it simple
Friday, May 3, 13
Your audiences care about different things. Even among IT teams, different metrics matter. Keep this in mind.
Granularity: a dashboard is high-level. Look for the balance between showing enough information and too much information.
Keep it simple. Eye-candy is great, but don’t overdo it: the purpose of a dashboard is to answer questions quickly.
(numbers used not actual values)
Friday, May 3, 13
Visualization was done with D3.js
What does YOUR boss care about?
Friday, May 3, 13
Let’s try another...
Friday, May 3, 13
KPIs do not have to be quantitative. Sometimes they’re qualitative.
Think of things this way: what information would your boss wish he had in a staff meeting with other managers? What
information shows how well your department is doing?
Let’s try another...
An IT Manager’s dashboard
Friday, May 3, 13
KPIs do not have to be quantitative. Sometimes they’re qualitative.
Think of things this way: what information would your boss wish he had in a staff meeting with other managers? What
information shows how well your department is doing?
KPIs:
•Support request volume
•Incident resolution time
•Customer satisfaction (survey)
•Infrastructure availability %
•Significant system events
•Upcoming changes
Let’s try another...
An IT Manager’s dashboard
Friday, May 3, 13
KPIs do not have to be quantitative. Sometimes they’re qualitative.
Think of things this way: what information would your boss wish he had in a staff meeting with other managers? What
information shows how well your department is doing?
That’s cool and all, but we’re
engineers...
Friday, May 3, 13
But Mike, we’re engineers! What has all this got to do with us?
No problem!
Friday, May 3, 13
It’s got everything to do with you!
This has given you some insight into how your boss and executives think. If you start answering their questions before they can
even ask them, what do you think they’re going to do? You’ve just become more valuable to them, and you’ve developed a
crucial skill.
Remember, IT supports the business.
While you’re there...
(or: interesting data)
What else is in your data that no one has
thought to ask about?
Friday, May 3, 13
In the course of working on LOPSA projects, I realized an interesting project could be built.
LOPSA Membership Heatmap
* No PII was used in the
creation of this map
Friday, May 3, 13
Don’t worry, no personally identifiable information was used in the creation of this map.
This map is fairly obvious: a heat map of active LOPSA members. It’s done in the Google Maps API. On the live version, you can
zoom in and see more granularity. At this zoom level, LA and San Diego are just one blob, while they are clearly distinct at a
closer zoom.
I just used a SQL query, Python, and Javascript for this.
Resources
• Information Dashboard Design by Stephen Few
• Actually, anything by Stephen Few.
• What Your CEO Wants You to Know by Ram Charan
• For learning how to think like management
• A Practical Intro to Data Science - Zipfian Academy blog
• Deep intro into data science--for those who really want to get
into it
• D3.js (d3js.org)
• Awesome visualization library
Friday, May 3, 13
That’s all, folks.
mike@mikejulian.com
Friday, May 3, 13
Thank You for Attending LOPSA-East '13
Please ll out the Trainer Evaluation
http://lopsa-east.org/2013/training-survey
Rate LOPSA-East '13
http://www.lopsa-east.org/2013/rate-lopsa-east-13
Friday, May 3, 13

Weitere ähnliche Inhalte

Ähnlich wie LOPSA East 2013 - Monitoring for the Public Good

How tech startups can leverage data analytics and visualization
How tech startups can leverage data analytics and visualizationHow tech startups can leverage data analytics and visualization
How tech startups can leverage data analytics and visualizationVishanth Bala
 
Keep a Pulse: Turning Data into Relationship Insights and (Automated) Action ...
Keep a Pulse: Turning Data into Relationship Insights and (Automated) Action ...Keep a Pulse: Turning Data into Relationship Insights and (Automated) Action ...
Keep a Pulse: Turning Data into Relationship Insights and (Automated) Action ...TALiNT Partners
 
Keep a Pulse: Turning Data into Relationship Insights and (Automated) Action
Keep a Pulse: Turning Data into Relationship Insights and (Automated) ActionKeep a Pulse: Turning Data into Relationship Insights and (Automated) Action
Keep a Pulse: Turning Data into Relationship Insights and (Automated) ActionTALiNT Partners
 
D92-198gstindspdx
D92-198gstindspdxD92-198gstindspdx
D92-198gstindspdxThinkful
 
Top 7 Reasons why Maintenance Work Orders are Closed Out Accurately
Top 7 Reasons why Maintenance Work Orders are Closed Out AccuratelyTop 7 Reasons why Maintenance Work Orders are Closed Out Accurately
Top 7 Reasons why Maintenance Work Orders are Closed Out AccuratelyRicky Smith CMRP, CMRT
 
Evgeniy Tsvetukhin ITEM 2018
Evgeniy Tsvetukhin ITEM 2018Evgeniy Tsvetukhin ITEM 2018
Evgeniy Tsvetukhin ITEM 2018ITEM
 
data science and business analytics
data science and business analyticsdata science and business analytics
data science and business analyticssunnypatil1778
 
Startds9.19.17sd
Startds9.19.17sdStartds9.19.17sd
Startds9.19.17sdThinkful
 
Data Driven Product Management - ProductTank Boston Feb '14
Data Driven Product Management - ProductTank Boston Feb '14Data Driven Product Management - ProductTank Boston Feb '14
Data Driven Product Management - ProductTank Boston Feb '14Quantopian
 
How to Scale your Analytics in a Maturing Organization
How to Scale your Analytics in a Maturing OrganizationHow to Scale your Analytics in a Maturing Organization
How to Scale your Analytics in a Maturing OrganizationKissmetrics on SlideShare
 
Analytics and Big Data Analytics
Analytics and Big Data AnalyticsAnalytics and Big Data Analytics
Analytics and Big Data AnalyticsInside Analysis
 
Data sci sd-11.6.17
Data sci sd-11.6.17Data sci sd-11.6.17
Data sci sd-11.6.17Thinkful
 
Big data for small businesses
Big data for small businessesBig data for small businesses
Big data for small businessesTabor Consulting
 
How to succeed at data without even trying!
How to succeed at data without even trying!How to succeed at data without even trying!
How to succeed at data without even trying!Dylan
 
Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016Looker
 
Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016Looker
 
5 Inside Secrets of Data-Driven U.S. Companies
5 Inside Secrets of Data-Driven U.S. Companies5 Inside Secrets of Data-Driven U.S. Companies
5 Inside Secrets of Data-Driven U.S. CompaniesJanessa Lantz
 
What Is Data Science? | Introduction to Data Science | Data Science For Begin...
What Is Data Science? | Introduction to Data Science | Data Science For Begin...What Is Data Science? | Introduction to Data Science | Data Science For Begin...
What Is Data Science? | Introduction to Data Science | Data Science For Begin...Simplilearn
 
Thinkful - Intro to Data Science - Washington DC
Thinkful - Intro to Data Science - Washington DCThinkful - Intro to Data Science - Washington DC
Thinkful - Intro to Data Science - Washington DCTJ Stalcup
 
1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptx
1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptx1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptx
1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptxarpit206900
 

Ähnlich wie LOPSA East 2013 - Monitoring for the Public Good (20)

How tech startups can leverage data analytics and visualization
How tech startups can leverage data analytics and visualizationHow tech startups can leverage data analytics and visualization
How tech startups can leverage data analytics and visualization
 
Keep a Pulse: Turning Data into Relationship Insights and (Automated) Action ...
Keep a Pulse: Turning Data into Relationship Insights and (Automated) Action ...Keep a Pulse: Turning Data into Relationship Insights and (Automated) Action ...
Keep a Pulse: Turning Data into Relationship Insights and (Automated) Action ...
 
Keep a Pulse: Turning Data into Relationship Insights and (Automated) Action
Keep a Pulse: Turning Data into Relationship Insights and (Automated) ActionKeep a Pulse: Turning Data into Relationship Insights and (Automated) Action
Keep a Pulse: Turning Data into Relationship Insights and (Automated) Action
 
D92-198gstindspdx
D92-198gstindspdxD92-198gstindspdx
D92-198gstindspdx
 
Top 7 Reasons why Maintenance Work Orders are Closed Out Accurately
Top 7 Reasons why Maintenance Work Orders are Closed Out AccuratelyTop 7 Reasons why Maintenance Work Orders are Closed Out Accurately
Top 7 Reasons why Maintenance Work Orders are Closed Out Accurately
 
Evgeniy Tsvetukhin ITEM 2018
Evgeniy Tsvetukhin ITEM 2018Evgeniy Tsvetukhin ITEM 2018
Evgeniy Tsvetukhin ITEM 2018
 
data science and business analytics
data science and business analyticsdata science and business analytics
data science and business analytics
 
Startds9.19.17sd
Startds9.19.17sdStartds9.19.17sd
Startds9.19.17sd
 
Data Driven Product Management - ProductTank Boston Feb '14
Data Driven Product Management - ProductTank Boston Feb '14Data Driven Product Management - ProductTank Boston Feb '14
Data Driven Product Management - ProductTank Boston Feb '14
 
How to Scale your Analytics in a Maturing Organization
How to Scale your Analytics in a Maturing OrganizationHow to Scale your Analytics in a Maturing Organization
How to Scale your Analytics in a Maturing Organization
 
Analytics and Big Data Analytics
Analytics and Big Data AnalyticsAnalytics and Big Data Analytics
Analytics and Big Data Analytics
 
Data sci sd-11.6.17
Data sci sd-11.6.17Data sci sd-11.6.17
Data sci sd-11.6.17
 
Big data for small businesses
Big data for small businessesBig data for small businesses
Big data for small businesses
 
How to succeed at data without even trying!
How to succeed at data without even trying!How to succeed at data without even trying!
How to succeed at data without even trying!
 
Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016
 
Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016
 
5 Inside Secrets of Data-Driven U.S. Companies
5 Inside Secrets of Data-Driven U.S. Companies5 Inside Secrets of Data-Driven U.S. Companies
5 Inside Secrets of Data-Driven U.S. Companies
 
What Is Data Science? | Introduction to Data Science | Data Science For Begin...
What Is Data Science? | Introduction to Data Science | Data Science For Begin...What Is Data Science? | Introduction to Data Science | Data Science For Begin...
What Is Data Science? | Introduction to Data Science | Data Science For Begin...
 
Thinkful - Intro to Data Science - Washington DC
Thinkful - Intro to Data Science - Washington DCThinkful - Intro to Data Science - Washington DC
Thinkful - Intro to Data Science - Washington DC
 
1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptx
1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptx1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptx
1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptx
 

KĂźrzlich hochgeladen

Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 

KĂźrzlich hochgeladen (20)

Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 

LOPSA East 2013 - Monitoring for the Public Good

  • 1. Monitoring for the Public Good Mike Julian Friday, May 3, 13
  • 2. Who am I? • ORNL operations staff • LOPSA Technical Staff • Generalist IT engineer for ~10 years Friday, May 3, 13
  • 3. Who am I? • ORNL operations staff • LOPSA Technical Staff • Generalist IT engineer for ~10 years • I am obsessed with monitoring. Friday, May 3, 13
  • 4. Who am I? • ORNL operations staff • LOPSA Technical Staff • Generalist IT engineer for ~10 years Friday, May 3, 13
  • 5. Who am I? • ORNL operations staff • LOPSA Technical Staff • Generalist IT engineer for ~10 years • I am obsessed with data. Friday, May 3, 13
  • 6. A dashboard is a visual display of the most important information needed to achieve one or more objectives; consolidated and arranged on a single screen so the information can be monitored at a glance. What is a dashboard? * Stephen Few, Intelligent Enterprise Friday, May 3, 13 The highlighted bits are what I think are the most important points to remember.
  • 7. But rst... You need some data! Friday, May 3, 13 Visualization is a lot of fun, but it’s no use if you don’t have the right data to display. Finding the data is even more fun, and potentially much more challenging. So, what data should you get. That depends on what you need to show.
  • 8. Let’s say you wanted to show... • Bandwidth usage: border router(s), SNMP query • Peak usage hours: databases, network trac, VPN usage • User demographics: lots of database work. • There’s always the case that the data may not exist. Friday, May 3, 13 These are just a couple examples of information you might want to show, and where you might nd the data for them.
  • 9. Your data is all over the place • ERP, CRM • Your ticket system • Product databases • Google Analytics • Operational monitoring systems (eg, Nagios) Friday, May 3, 13 Your data is stored in lots of places. Google Analytics, your operational monitoring systems, various databases... This is where the engineer in you shines: use your language of choice, SQL, and knowledge of your infrastructure to nd the data and do the necessary magic on it to turn it into meaningful information.
  • 10. Building information dashboards: an exercise in not thinking like an ops engineer. An exercise in not thinking Ops Friday, May 3, 13
  • 11. “What gets measured, gets managed.” - Peter Drucker, management guru Friday, May 3, 13
  • 12. Key Performance Indicator (KPI) A way to measure the progress of a service, program, or initiative towards the goals. Friday, May 3, 13 The purpose of the KPI is to drive change. How do you know you’re doing better or worse without the numbers? KPIs differ depending on use. Bandwidth utilization is a KPI for a datacenter, but perhaps not for a doctor’s office. In fact, they differ within companies. New customer acquisitions is a KPI for marketing and sales, but not for IT. Likewise, Finance doesn’t care about utilization metrics of the ERP system.
  • 14. You are the CEO of a web hosting company. What are your KPIs? KPI examples Friday, May 3, 13
  • 15. You are the CEO of a web hosting company. What are your KPIs? •Total sales (dollar amount) •Total expenses (dollar amount) •Prot margin (percentage) •Number of new customers •Number of cancellations KPI examples Friday, May 3, 13
  • 16. You are the CEO of a web hosting company. What are your KPIs? •Total sales (dollar amount) •Total expenses (dollar amount) •Prot margin (percentage) •Number of new customers •Number of cancellations You are the customer service manager for a call center. What are your KPIs? KPI examples Friday, May 3, 13
  • 17. You are the CEO of a web hosting company. What are your KPIs? •Total sales (dollar amount) •Total expenses (dollar amount) •Prot margin (percentage) •Number of new customers •Number of cancellations You are the customer service manager for a call center. What are your KPIs? •Call volume •Call length •Queue wait time •Number of call abandons KPI examples Friday, May 3, 13
  • 18. Let’s build a dashboard! Friday, May 3, 13
  • 19. Let’s build a dashboard! LOPSA Board of Directors Dashboard Friday, May 3, 13
  • 20. Let’s build a dashboard! LOPSA Board of Directors Dashboard KPIs Friday, May 3, 13
  • 21. Let’s build a dashboard! LOPSA Board of Directors Dashboard Membership •New members •Lapsed members •Member satisfaction KPIs Friday, May 3, 13
  • 22. Let’s build a dashboard! LOPSA Board of Directors Dashboard Membership •New members •Lapsed members •Member satisfaction Financial •Program income •Contribution income •Program expenses •Operating expenses KPIs Friday, May 3, 13
  • 23. Let’s build a dashboard! LOPSA Board of Directors Dashboard Membership •New members •Lapsed members •Member satisfaction Financial •Program income •Contribution income •Program expenses •Operating expenses Locals Program •Chapter attendance •New chapters •Conversions KPIs Friday, May 3, 13
  • 24. Let’s build a dashboard! LOPSA Board of Directors Dashboard Membership •New members •Lapsed members •Member satisfaction Financial •Program income •Contribution income •Program expenses •Operating expenses Locals Program •Chapter attendance •New chapters •Conversions Mentorship Program •Pairing requests •Pairing assignments •Pair ratings KPIs Friday, May 3, 13
  • 25. Dashboard design tips • Know your audience • Only display relevant data • Both to your audience and your topic • Watch your granularity • Keep it simple Friday, May 3, 13 Your audiences care about different things. Even among IT teams, different metrics matter. Keep this in mind. Granularity: a dashboard is high-level. Look for the balance between showing enough information and too much information. Keep it simple. Eye-candy is great, but don’t overdo it: the purpose of a dashboard is to answer questions quickly.
  • 26. (numbers used not actual values) Friday, May 3, 13 Visualization was done with D3.js
  • 27. What does YOUR boss care about? Friday, May 3, 13
  • 28. Let’s try another... Friday, May 3, 13 KPIs do not have to be quantitative. Sometimes they’re qualitative. Think of things this way: what information would your boss wish he had in a staff meeting with other managers? What information shows how well your department is doing?
  • 29. Let’s try another... An IT Manager’s dashboard Friday, May 3, 13 KPIs do not have to be quantitative. Sometimes they’re qualitative. Think of things this way: what information would your boss wish he had in a staff meeting with other managers? What information shows how well your department is doing?
  • 30. KPIs: •Support request volume •Incident resolution time •Customer satisfaction (survey) •Infrastructure availability % •Signicant system events •Upcoming changes Let’s try another... An IT Manager’s dashboard Friday, May 3, 13 KPIs do not have to be quantitative. Sometimes they’re qualitative. Think of things this way: what information would your boss wish he had in a staff meeting with other managers? What information shows how well your department is doing?
  • 31. That’s cool and all, but we’re engineers... Friday, May 3, 13 But Mike, we’re engineers! What has all this got to do with us?
  • 32. No problem! Friday, May 3, 13 It’s got everything to do with you! This has given you some insight into how your boss and executives think. If you start answering their questions before they can even ask them, what do you think they’re going to do? You’ve just become more valuable to them, and you’ve developed a crucial skill. Remember, IT supports the business.
  • 33. While you’re there... (or: interesting data) What else is in your data that no one has thought to ask about? Friday, May 3, 13 In the course of working on LOPSA projects, I realized an interesting project could be built.
  • 34. LOPSA Membership Heatmap * No PII was used in the creation of this map Friday, May 3, 13 Don’t worry, no personally identiable information was used in the creation of this map. This map is fairly obvious: a heat map of active LOPSA members. It’s done in the Google Maps API. On the live version, you can zoom in and see more granularity. At this zoom level, LA and San Diego are just one blob, while they are clearly distinct at a closer zoom. I just used a SQL query, Python, and Javascript for this.
  • 35. Resources • Information Dashboard Design by Stephen Few • Actually, anything by Stephen Few. • What Your CEO Wants You to Know by Ram Charan • For learning how to think like management • A Practical Intro to Data Science - Zipan Academy blog • Deep intro into data science--for those who really want to get into it • D3.js (d3js.org) • Awesome visualization library Friday, May 3, 13
  • 37. Thank You for Attending LOPSA-East '13 Please ll out the Trainer Evaluation http://lopsa-east.org/2013/training-survey Rate LOPSA-East '13 http://www.lopsa-east.org/2013/rate-lopsa-east-13 Friday, May 3, 13