This presentation describes a prototype web service (RAMP) that accurately counts file downloads from institutional repositories (IR). The slides begin with the problems associated with current web analytics methods such as page tagging and log file analysis, and describes how the reporting from four IR dramatically improved through the use of RAMP. Research conducted for this study was funded by IMLS, and partners include Montana State University, OCLC Research, the University of New Mexico, and the Association of Research Libraries (ARL). The presentation was given at the ARL Assessment Forum at the American Library Association 2017 midwinter conference in Atlanta, GA.
Call Girls In Bellandur â 7737669865 đ„” Book Your One night Stand
Â
RAMP: Repository Analytics and Metrics Portal
1. Kenning Arlitsch, Dean @kenning_msu
Patrick OBrien, Semantic Web Research Director @sempob
RAMP:
Repository Analytics and Metrics Portal
Accurately measuring use of institutional repositories
ARL Assessment Forum
Atlanta, GA, January 20, 2017
2. Agenda
1. A New Reporting Model
2. Accuracy of Analytics Reporting Tools
Page Tagging
Log file
3. RAMP
New Prototype Web Service for IR reporting
3. A New Reporting Model
Page Type Definition Examples
Citable Content
Downloads
Non-HTML scholarly content
that may be formally cited in
the research process
â Publication (.pdf)
â Presentation (.ppt)
â Data Sets (.csv)
Item Summary
HTML pages to help user
decide to download the full
publication
â Title & Abstract
â Item Metadata
Ancillary
HTML pages that provide
general information or
navigation
â Search Results
â Browse by Author
â Statistics
12. Google Analytics use in academic libraries
ï§ Tested 279 academic library websites
ï§ ARL
ï§ DLF
ï§ OCLC-RLP
ï§ 90% US libraries contained Google tracking code
13. 51%
54%
52%
63%
35%
27%
20%
20%
14%
19%
28%
17%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
~51% to 63% of Citable IR Activity is Unreported by Google Analytics
01/05/16 - 05/17/16 (days=134)
Citable Content Downloads Item Sumary PV Ancillary PV
Most IR activity is Citable Content Downloads
14. 54.3%
46.2%
47.9%
42.5%
45.7%
53.8%
52.1%
57.5%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Most IR Activity is Unreported by Google Analytics
01/05/16 - 05/17/16 (days=134)
Reported Invisible
Most IR Activity Unreported by Google Analytics
15. Web Analytics Accuracy Risks
Risks Analytics Method
Area Types Page Tagging Log Files
OverCount
Visits Low High
Downloads Low High
Page Views Low Low
UnderCount
Visits Medium Medium
Downloads High Low
Page Views Low Low
16. Data set: Jan 5 - May 17, 2016 (n = 134 days)
Study Participant IR Platform URL
Montana State University ScholarWorks DSpace scholarworks.montana.edu
McMaster University MacSphere DSpace macsphere.mcmaster.ca
University of New Mexico LoboVault DSpace repository.unm.edu
University of Utah USpace CONTENTdm uspace.utah.edu
17. Page Tagging does not track non-HTML
Citable Content Downloads
Non-HTML
Search Analytics
Does!
24. RAMP - Repository Analytics and Metrics Portal
ï§ Cloud Web service
ï§ Currently accessible and free
ï§ During grant period (through November 2017)
ï§ No training or configuration required
ï§ Consistent method and terminology
ï§ Benchmarking across time and organization
ï§ Request access - mixterj@oclc.org
25.
26.
27. Publications
Published:
Patrick OBrien, Kenning Arlitsch, Leila Sterman, Jeff Mixter, Jonathan Wheeler,
and Susan Borda. âUndercounting File Downloads from Institutional Repositories,â
Journal of Library Administration, vol. 56, no. 7, 2016
Forthcoming:
Patrick OBrien, Kenning Arlitsch, Leila Sterman, Jeff Mixter, Jonathan Wheeler,
and Susan Borda. âRAMP: Repository Analytics and Metrics Portal: A Prototype
Web Service that Accurately Counts Item Downloads from Institutional
Repositories,â Accepted by Library Hi Tech, expected early 2017
Proposal funded by IMLS:
âMeasuring Up: Assessing Accuracy of Reported Use and Impact of Digital
Repositoriesâ - scholarworks.montana.edu/xmlui/handle/1/8924
28. Undercounting Research Team
âMontana State University
âKenning Arlitsch, Dean @kenning_msu
âPatrick OBrien, Semantic Web Research Director @sempob
âLeila Sterman, Scholarly Communication Librarian @calamityleila
âSusan Borda, Digital Technologies Librarian @mutanthumb
âOCLC Research
âJeff Mixter, Software Engineer @jeffmixter
âUniversity of New Mexico
âJonathan Wheeler, Data Curation Librarian