Kathleen Keating, Professor, University of New Mexico Libraries, presentation from VRA 28 Atlanta. "Click It, No More Tic It: Online Reference Statistics" for the "By the Numbers" session.
Panel presentation describing development of on-line reference statistics gathering tool; includes information for download via Creative Commons licensing. (March 18, 2010)
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
By The Numbers Click It No More Tic It
1. Click it, no more tic it: Online Reference Statistics Kathleen Keating [email_address] Paulita Aguilar [email_address] Dr. Sue Swanback [email_address]
Currently, the primary factor behind gathering usage data at the University Libraries (UL) at the University of New Mexico (UNM) is the necessity of its contribution to the annual Association of Research Libraries (ARL) report. Other reasons for statistical gathering, such information needed for better-informed budgetary decisions, exist but are not addressed in a consistent manner by UL. Each year, many people in the libraries spend hours compiling statistics for the ARL report. While this results in a comprehensive collection of data, it is not always accurate or efficient. Data gathering methods are not consistently recorded, resulting in varying methods for data collection each year. Additionally, data are often not reviewed for trends analysis. The current data gathering methods do not provide the UL with a good understanding of user needs and behaviors as they relate to the libraries.
Reference statistics are gathered in each branch and many, but not all, departments of the UL. Gathering and analysis techniques vary between departments and branches. Reference statistics do not always include interactions resulting from email directly to subject specialists or email from the web site. Not all departments report interactions which could be considered reference. For instance, LIT does not record or report their interactions with the public in cases where they provide technological assistance.
Designate a committee to review and set standards for collecting reference statistics. This includes which departments should report statistics, what needs to be reported, and how it should be reported. Other issues that need to be addressed are how to report chat interactions, interactions with subject specialists outside of the reference desk, and email from the web site. Addressing these issues will provide more accurate statistics for the UL as a whole. While it is important to know how many people we help at the UL, it is equally important to know if our interactions were useful to the patrons. This type of information will not be acquired through counting numbers. After chat reference is up and running, I suggest conducting short surveys and focus groups, similar to the process performed at the University of Illinois (Jacoby 2005). This will provide insight into the usefulness of our interactions, whether in person, via email or via chat. Once standards for reference statistics are set, expand the proposed LIRIC database to include a section for reference interactions. This will centralize reference statistics among all the branches.
What does the UL want to measure and collect from reference statistics? How will these statistics be used/analyzed? Is there a standardized form that we can all agree to use? Do we need to identify the patrons? e.g. UNM Faculty, staff, student, Community, etc.
Approval plans: While approval plans can takes less time and identifies quality books, it doesn’t reflect the current research interests of our students. Book catalogs: some presses like UNM Press, U of Ok press, U of Nebraska Press publish high numbers of NA materials. Book reviews: reviews help to identify quality books All good, but…approval plans and book catalogs deal with the major presses and deal with topics that aren’t as timely (ie. Deal with more NA history than with present day problems faced by NA);
Cons – can be time consuming – you will have to select title by title – sometimes difficult to find a publisher or purchasing information Pros – reflects the current research interests of patrons – Up-to-date collection – using current reference questions will areas used in the collection and identify areas that require weeding or attention. May help in identifying research trends – some of the topics may be cutting edge and reviewing questions through the course of several semesters may indicate research trends and help the selector identify areas to “beef up.” Assist in collecting appropriate formats – this will help students with learning or physical disabilities, and students with particular types of learning styles (visual, audio, etc.). Additionally, many students commute or take classes virtually and need access to e-resources Analyzing reference questions will assist in meeting the various needs of today’s students
Reviewed all NA questions from the database: The selector for this area reviewed all questions and there were many. She then categorized them into broad topics. She searched for materials in various sources: Amazon, Google, publishers catalogs, _The Small Press Index_, organizations that publish specifically for their membership ( for example, National Indian Gaming Association, Native American Rights Fund, Catching the Dream-Native American Scholarship Fund, Alaska Native Knowledge Network). Another excellent source for available materials are flyers received from various organizations announcing lectures or visiting scholars. Contact Paulita Aguilar on specific publishers.
Native American Research topics: Many of the topics deal with present day problems/solutions faced by NA communities on reservations and urban areas. Some of the topics include: indigenous knowledge, language revitalization, health—diabetes, sexual abuse, indigenous foodways, indigenous criminal justice systems, indigenous curriculum, Indian gaming, economic development on tribal lands, and tribal planning. Topics are covered in books that are multicultural: for example, the research topic is covered in a book that is discussing Curriculum development and one chapter is devoted to NA. Topics are covered in books that deal with a particular topic: like coverage in multicultural books, the researcher will find a chapter in a book devoted to Diabetes, for example, with a chapter on indigenous peoples Need for more visual materials – many timely topics about NA peoples are addressed in visual materials. For example, NA identity and teenagers, political involvement in mining or other land issues. Students find visual materials to be excellent sources for getting an overall perspective of a topic as well. Involving Catalogers: at UL a cataloging team is devoted to helping the UL Research Programs (INLP, CHIPTOLE, DILARES) to include local subject headings or in creating bibliographic notes accurately describing book content.