Managing with Data: Using ACRLMetrics and PLAmetrics Webinar
1. Managing with Data:
Using ACRLMetrics and PLAmetrics
Peter Hernon, Robert E. Dugan,
and Joseph R. Matthews
2016 February 12
2/12/2016
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
2. What Are
• ACRLMetrics
• PLAmetrics
• Why are they important?
– Accountability
– Evidence-based management and planning
• What can you do with them?
– Provide a foundation for a management information
system
– Add new data
– Make comparisons to other libraries –benchmark and
best practices
2/12/2016
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
3. Benefits from the Use of the Datasets
• Create customized reports
• Use a subset of all data based upon locally-
selected measures and institutions – filters
• Create graphs
• Combine ACRL and IPEDS data sets when
doing a report
• Export data to Excel
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
4. Other Benefits
• Set up templates so that you are pulling the
same data elements from year to year
• Timely availability of data for access; expect to
be available months sooner than Academic
Library component through IPEDS
• Easy enough for many to use; especially if you
are using available or locally-created custom
templates
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
5. The Book
• Why we wrote the book
• Eleven chapters
– How to use ACRLMetrics and PLAmetrics for
collections, services, staffing, benchmarking, best
practices, outcomes assessment and use.
– Discussion of current issues such as return on
investment analysis and presenting findings.
– Each chapter has a set of exercises; an appendix
provides answers to each set of questions.
• Companion website:
ManagingwithDataandMetrics.org
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
6. Useful Input and Output Measures
from the Datasets
• Expenditures
• Collection size and type of material (e.g., e-
books)
• Usage of materials, such as circulation and
interlibrary loan
• Staffing levels and patterns (e.g., professional;
support)
• Services (e.g., reference transactions; visitors)
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
7. Application of Measures
• Derived ratios (e.g., expenditures per capita;
percentage of total expenditures on staff,
collections and other operating)
• Benchmarking with peers and aspirants
• Discovering best practices – which libraries are
doing what your would like to be doing?
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
8. Example from Collections’ Chapter:
Report Settings (LIVE)
• Collection
• Period
• Report name shows up in the Reports Tab;
helps you find a report or template
• Description -- use this to describe the
collection, period and filters which also shows
up when reviewing a tab.
• Title
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
9. Option Tab (LIVE)
• Average
• Maximum
• Minimum
• Median
• 25th percentile
• 75th percentile
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
10. Example of Collections Benchmarking:
ACRLMetrics (LIVE)
• Summary holdings for print titles, volumes
and e-books (based upon the book, chapter 3,
question 1 on page 41)
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
11. Report from Collection Benchmark
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
FY2014 Peers: Library Holdingsper
Enrolled FT Student
Sorted on Print TitlesHeld
Print
Titles
Held
Print
Volumes
Held
Electronic
Books
Held
Full-time students,
undergraduate &
graduate
TitlesHeld
per Enrolled
FT Student
VolumesHeld
per Enrolled
FT Student
E-booksHeld
per Enrolled
FT Student
Stephen F Austin State University 1,857,017 2,145,022 175,815 9,888 187.81 216.93 17.8
Western Carolina University 1,287,977 1,237,459 625,226 8,038 160.24 153.95 77.8
East Tennessee State University 847,561 943,297 234,419 11,581 73.19 81.45 20.2
Average 799,130 970,566 177,378 8,827 93.36 115.69 20.1
University of South Dakota 754,041 1,220,245 16,038 6,031 125.03 202.33 2.7
University of West Florida 668,344 1,105,277 148,673 8,183 81.67 135.07 18.2
Median 668,344 943,297 146,225 8,369 79.71 101.28 17.5
Valdosta State University 558,372 605,498 37,907 8,964 62.29 67.55 4.2
University of Arkansasat Little Rock 528,669 671,711 37,170 6,632 79.71 101.28 5.6
Rowan University 352,565 399,534 N/A 11,753 30.00 33.99 N/A
University of West Georgia 337,624 407,055 143,776 8,369 40.34 48.64 17.2
Missing peers: Indiana State University and University of Massachusetts - Lowell
12. Example of Collections Benchmarking:
PLAmetrics (LIVE)
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
13. Report from Collection Benchmark
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
14. Example of Best Practices:
ACRLMetrics (LIVE)
• How do I find an academic library that is open
more hours than mine with comparable FTE
staffing levels?
– Hours open and comparable FTE staff levels
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
15. Exporting, Formatting and
Presenting Data (LIVE)
• Export from Excel, and then rearrange the
exported data to meet your needs
• Visual
– Tables
– Bar and other charts
• Create a Metrics report, and then embed a
URL for the data into a report for one or more
stakeholder audiences
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
16. Additional Supporting Resources
• Counting Opinions
– support@countingopinions.com
• The book’s portal:
ManagingwithDataandMetrics.org
• Email one of the authors
Robert.Dugan AT gmail.com
Joe AT JoeMatthews.Org
Managing with Data Webinar with Peter Hernon, Robert E. Dugan, and Joseph R. Matthews
Hinweis der Redaktion
Peter, Bob and I are delighted to share with you the value that you can derive from the use of either ACRLMetrics or PLAmetrics
We worked hard to show you the step-by-step process you can use to extract data from either online service to accomplish a variety of tasks
The three of us would like to thank you for participating today and please share any questions you might have as we proceed
And we would also like to thank the kind folks at ALA for organizing today’s Webinar
So, without further ado, let’s proceed
ACRLMetrics – provides access to academic library statistics that libraries supplied to the annual ACRL survey since 2000
and the National Center for Education Statistics or NCES – a part of the US Dept of education
PLUS a subset of data from the Integrated Postsecondary Education Data System often referred to as iPEDS
PLAmetrics – covers the annual PLA Public Library Data Service survey since 2002 PLUS data on public libraries from IMLS since 2000
It should be noted that data is not available for every library every year – due to a lack of responses from a library to a survey
Pricing for each service is quite affordable – ACRLMetrics – cost ranges from $220 to $320 –depending on if your library participated in this year’s survey and if you are an ACRL member library
PLAmetircs pricing varies from $200 to $300 per year – this is a great deal
These services are important as there are increasing calls for libraries to demonstrate value and accountability
Funding decision makers want to know the ways in which the library is contributing to priorities and mission of the organization
These folks want proof that your library is operating efficiently (compared to others) and want reports demonstrating progress in achieving goals and objectives.
Oversight decision makers often ask such questions as:
What evidence does the library use to demonstrate value?
Where does evidence come from?
Does the evidence apply across time and locations?
How do library managers use the data to make important decisions?
What can you do with this data?
Provide a foundation for a management information system
Add new data
Make comparisons to other libraries –benchmark and best practices
Both of these data services are available 24/7 as long as you have access to a Web browser
Each data set provides access to data about general information, expenditures, source of income, technology in the library, library collections, reference service, use of collections and services including electronic resources, Website features, staffing
The data includes input data (budget, staff) as well as output data – counts of activities. Each data service also provides process data (cost per activity)
The important thing to remember is that YOU are in control. YOU can
Number of academic library studies have examined the impact of library input measures and some output measures
Study in the UK (Graham Stone and Bryony Ramsden) found a statistical correlation between student attainment (grades) and use of library collections and downloading eResources
But not visits to the library
Might be interesting to combine library data with IPEDS data
The platform provided by Counting Opinions for both data services is quite powerful and flexible
You can save reports and re-run them on a quarterly or annual basis, you can set up templates so you pull the same data elements year after year (with no additional work)
You can make some of your report public so others can benefit from the formatting of reports that you have created or keep your reports private
In short, both data services provide real value for their very low annual subscription cost
And now over to Peter
What I have done here is put together a report for California based public libraries that have similar size populations
Since I live in Carlsbad, I found 9 other cities (I excluded County library systems) that meet the criteria
But notice the great deal of variability in total expenditures, the acquisitions budgets, and use of the libraries
Thus, to make sure I had an apples-to-apples comparison I excluded some of the libraries that have lower SES characteristics as seen on the next slide
Here we can see that there are now 4 other libraries of comparable size and SES characteristics
And while Carlsbad is doing fairly well, after all per capita expenditures of $88 is not bad, other comparable PLs are doing better and 2 are doing much better
Go LIVE – show the Excel export, differences between Tables and charts, metrics report – embed the unique URL to share with others
And now back to PEter