Reinventing Discovery: An Analysis of Big Data
•
1 gefällt mir•1,726 views
As the late Steve Jobs would say, don’t listen to your customers, they don’t know what they want. Usability studies and live user analysis provide valuable feedback about your product or web site in terms of how the tool is used, but listening to the users about what they want out of the tool can result in a “whack-a-mole” scenario where you solve a problem for one user, but create new problems for other users. Analyzing usage data can provide a very different perspective on how live users actually use the tool and allow you to identify different personas and use cases. This talk will share how Serials Solutions collects and analyzes a dataset of queries and clicks generated by millions of users at hundreds of libraries around the world to find behaviors, patterns, successes and failures in the interface design and search algorithms and then how we leverage that to improve and redesign. We will share the details of our custom developed data warehouse system and how we leverage these tools to perform our analysis. We will also share with you before-and-afters that were developed based on the results of the ongoing analysis.
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (20)
Andere mochten auch
Ähnlich wie Reinventing Discovery: An Analysis of Big Data
Ähnlich wie Reinventing Discovery: An Analysis of Big Data (20)
Mehr von Andrew Nagy
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
Reinventing Discovery: An Analysis of Big Data
- 1. ANDREW NAGY Sr. Product Manager ProQuest | Serials Solutions Re-inventing Discovery An Analysis of Big Data
- 2. “The reality is user expectations have evolved and library systems have not kept up.”
- 3. World Wide Web (1990?) Amazon (1995) Google (1998) Wikipedia (2001) Facebook (2004) YouTube (2005) Twitter (2006) Amazon Kindle (2006/2007) iPhone (2007) iPad (2010) Instagram (2010) Pinterest (2011)
- 4. The product’s design changed more in the last two years than it had in the previous decade. Jon Wiley, head designer of Google Search
- 5. It starts with users in mind Want to be self-sufficient They do not ask questions They want to be anonymous Expect everything to be online and searchable Moving to mobile computing as primary device
- 6. Usability Studies One on one interviews Use of open ended questions Don’t force them into unfamiliar territory Provides valuable feedback about: Experience How its used Facial and body reactions
- 7. Some Findings Start with broad topical searches and add words until they find something they like – then they begin to engage with filters Students highly value the abstracts within the discovery experience as it helps them to determine if an item is “click worthy” Students did not find subject terms particularly useful but did like the disciplines
- 8. Matching User Expectations… “…the test subjects criticised the fact that the location of the saved entries and the „save‟ icon do not correspond with their experience of other systems. Thus a different icon and the location of the saved entries in the top right corner, as is the case with most shopping baskets on various websites, would correspond more closely to the experience of the users” Helena Luca – University of Konstanz
- 9. Usability Studies Problem: Users actually think during usability studies
- 10. BIG DATA Monitor usage of real-time activity Where is your data? How do you mine your data? Do you even keep your data?
- 11. Big Data Warehouse Open Source Schema Free Data Versioning Fast/Safe Writing Built on Lucene
- 12. Number of terms per query 0 10 20 30 40 50 60 70 80
- 13. Number of terms per query 1 10 100 45% of Searches 3 words or less
- 14. Abandonment Rate: Terms in Query 0 2 4 6 8 10 12
- 15. Top search terms Jstor Pubmed Leadership Global warming Diabetes Marketing Obesity Psychology Depression
- 16. Long tail search terms Branding in the Digital Age: You’re Spending Your Money in All the Wrong Places Towards an Ethnographic Approach to Art Therapy Research: People with Psychiatric Disability as Collaborators A method for bias-reduction of sample-based MLE of the autologistic model group therapy native american women effectivness endocrinology prolactin childhood obesity organic baby food
- 19. Filters per query in sequence 1 2 3 4 5
- 20. Number of Queries in a Session 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39
- 21. Queries/Sessions per Language 1 10 100 1000 10000 100000 1000000 10000000 10000000 1E+09 en sv za es de ko fr jp nl tu br pl zh it he ca ar cs th gb da no gr fa ru mi ms pt fi Total Sessions Total Queries 93% of Users Work in English
Hinweis der Redaktion
- Despite the positive impact that Summon is having, we know that libraries continue to face challenges. This statement from Project Information Literacy highlights the real challenge that library’s are facing. And, that’s the fact that users’ expectations have evolved – and are ever-changing – so how can libraries possibly keep up?
- Technology changes rapidly, so it’s no wonder that libraries can’t keep pace. As technology changes so do user expectations. Four years is an eternity in technology terms. Think for a moment that the iPad was not even invented when we introduced Summon and what a profound impact it has had on how users seek and interact with information.
- And take a look at what Google has done lately. For better or worse, Google sets the bar for what users think of as discovery. This quote comes from Google’s lead interface designer who explains that Google has changed more in the last 2 years than in the previous decade. Why that matters is because if Google makes a change, your users’ expectations change right along with it. Their expectations can change almost overnight.
- Millennials will text the reference desk even if they are in the library
- 1.1 Billion Items600 Active Clients40 Countries17 Languages40 Queries per Second
- Here you can see the behaviors of users. We can easily group them into two main areas:The broad topical queriesThe known item queries
- Lets put this chart into perspective using a logarithmic scale so you can see.Majority of searches are 1, 2, and 3 word queries.
- You will see here that there are lots of known item queries and also lots of subject terms grouped together.
- Here you can see the number of queries in a session. This shows great success. Its not sharp like the last graph – we have a large amount of users who are using the system and working with it – staying in the environment running lots of queries.
- Note: This is in a logarithmic scale so you can see the chart. Without the log scale, all you would see is a spike for english
- The result is a redesigned interface that’s more streamlined and modern, faster and even easier to use with new functionality designed to provide more guidance and information to the user to help them determine the right results for them.
- The result is a redesigned interface that’s more streamlined and modern, faster and even easier to use with new functionality designed to provide more guidance and information to the user to help them determine the right results for them.