SlideShare ist ein Scribd-Unternehmen logo
1 von 37
IFLA Wrocław • 22 August 2017
Capturing the Behaviors of the Elusive User:
Strategies for Library Ethnography
Lynn Silipigni Connaway, PhD
Senior Research Scientist & Director of User Research, OCLC
connawal@oclc.org
@LynnConnaway
Ethnographic Research
“…a way of seeing how individuals interact and behave in
situations by utilizing different qualitative data collection and
analysis methods.”
(Connaway and Radford 2017, 263)
Qualitative Research Definition
A type of scientific research that:
• Seeks answers to a question
• Systematically uses predefined set of
procedures to answer question
• Collects evidence
• Produces findings that:
• Are not determined in advance
• Apply beyond immediate boundaries of
study
What is Qualitative Research?
“…a situated activity that locates the observer in the world. It consists of a
set of interpretive, material practices that make the world visible. These
practices transform the world. They turn the world into a series of
representations, including field notes, interviews, conversations,
photographs, recordings, & memos to the self.
At this level, qualitative research involves an interpretive, naturalistic
approach to the world. This means that qualitative researchers study
things in their natural settings, attempting to make sense of, or to
interpret, phenomena in terms of the meanings people bring to them.”
(Denzin and Lincoln 2005)
ETHNOGRAPHIC DATA
COLLECTION TOOLS AND
METHODS
Interviews Diaries
Observation Usability Testing
Ethnographic
Data Collection
Ethnographic Interviews
• Incredibly detailed data
• Time consuming
– Establishing rapport
– Selecting research participants
– Transcribing observations &
conversations
Conducting the Interview
1. Thematizing: Clarifying the interview’s purpose
2. Designing: Defining the interview’s purpose
3. Interviewing: Conducting the interview
4. Transcribing: Creating a written verbatim text of the interview
5. Analyzing: Figuring out the meaning of data
6. Verifying: Determining the reliability & validity of the data
7. Reporting: Telling others about the findings
(Connaway and Radford 2017, 244)
V&R Semi-Structured Interview Questions
5. Have there been times when you were told to
use a library or virtual learning environment
(or learning platform), and used other
source(s) instead?
6. If you had a magic wand, what would your
ideal way of getting information be? How
would you go about using the systems and
services? When? Where? How?
Diaries
• Keep directions minimal and open
• Offer participants a variety of ways to report
• Written
• Photo
• Video
• Audio
• Data can be rich and detailed, but is self-reported
• Does not require researcher presence
(Connaway and Radford, 2017)
V&R Diary Template
1. Explain a time in the past month when you
were SUCCESSFUL in completing an
ACADEMIC assignment. What steps did you
take?
2. Think of a time fairly recently when you
struggled to find appropriate resources to
help you complete an ACADEMIC assignment.
What happened?
Example: Digital Visitors and Residents Diaries
“Perhaps the most convenient method of
studying the consequences of this law will
be to follow the reader from the moment
he enters the library to the moment he
leaves it…”
(Ranganathan 1931, 337)
Participant/Immersive Observations
• Move into the setting as deeply as
possible
• Disturb participants as little as
possible
• Participant observation
• Open, direct interaction &
observation as part of the group
(Connaway and Radford 2017)
Participant/Immersive Observations
• Unstructured observation
• No predetermined categories of behavior
• Flexible, exploratory
• Notes should be recorded as soon as possible
• Structured observation
• Predeveloped observational categories
• Rating scales and/or checklists
• Audio and/or video recording
(Connaway and Radford, 2017)
WebJunction Observations
Scenario and Task 1
You are interested in taking free courses from the WebJunction course catalog.
Please go to the first task.
Please go to webjunction.org before proceeding
You are interested in participating in free courses and webinars offered by
WebJunction.
A. Find where you can enroll in free library-specific courses and webinars.
(Connaway and Radford, 2017, p. 274)
Mapping
Visitors and Residents Sample Maps
Cognitive Mapping
• Participant draws a map of the
area of interest
• Fast and easy to conduct
• Small time commitment from
participants
• Can be ambiguous or difficult to
interpret
Mapping Diaries
• Give participants a map
& ask them to record
their movements
• Can use maps as basis
for individual interviews
From Clark (2007), “Mapping Diaries, or Where Do They Go All Day?”, p. 49
Usability Testing
• Degree to which a user can successfully learn
& use a product to achieve a goal
• Evaluation research methodology
• Observation & analysis of user behavior while
users use a product or product prototype to
achieve a goal
(Dumas and Redish 1993, 22)
Usability Testing: Components
Comprised of three parts:
1. Pre-session interview
2. Scenario and task
structured test
3. Post-session survey
(Tang 2017, 278)
V&R Mapping App Usability Testing
TASK
• Think of around 10 websites you use or online activities that you
regularly perform. Place each of these websites or activities on
the map in a way that represents how you feel you use them (as
a 'Visitor' or as a 'Resident') and the typical context in which you
use them ('Personal' or 'Institutional’).
PROCEDURE
1. Read the task aloud
2. Using the app, complete the task while thinking aloud
3. Indicate when they felt they had completed the task
Usability Testing: Methodology
• Artificial environment
(laboratory)
• Maintain more control
• May provide more
specific data on a
particular feature
• Natural environment
• Better holistic
representation of real
people doing real work
(Tang 2017, 278)
ETHNOGRAPHIC DATA ANALYSIS
TOOLS AND METHODS
Ethnographic Analysis
• Use people’s own categories
• Avoid assuming what one will find
• Complementary to quantitative methods
• Retain ‘richness’/‘thick description’
• Numerous compatibility
(Asher 2017, 264)
(Connaway and Radford 2017, 282)
• Contain all data sources
• Creating & applying codes
• Queries
• Visualizations
• Reports
(Connaway and Radford 2017)
Computer-Assisted Qualitative Data Analysis
Software (CAQDAS)
• Draw on data...in service of
developing new conceptual
categories
• Develop inductive abstract analytic
categories through systematic data
analysis
• Emphasize theory construction
rather than description or
application of current theories
(Connaway and Radford 2017)
Grounded Theory
“A major strategy for analysis of
qualitative data is the use of the
constant comparative method, which
embraces ‘constant comparisons’
defined as ‘the analytic process of
comparing different pieces of data
against each other for similarities
and differences.’”
(Connaway and Radford 2017, 298)
Conversation Analysis
• Context & social conduct
Discourse Analysis
• The library within a larger social
& cultural context
(Connaway and Radford 2017)
Challenges: Ethnographic Research
• Data collection & analysis
• Costs and time
• Bias
• Sampling
• Not generalizable
Opportunities: Ethnographic Research
• Rich data and thick description
• Can answer why and how questions
• Provides information to support decisions
about resources and services
• Can help motivate and increase buy-in for
change
• Provides the opportunity to build
relationships
(Connaway and Radford, 2017; Asher and Miller, 2011)
“The creative process is not like a situation
where you get struck by a single lightning
bolt. You have ongoing discoveries, and
there are ongoing creative revelations. Yes,
it's really helpful to be marching toward a
specific destination, but, along the way, you
must allow yourself room for your ideas to
blossom, take root, and grow.”
–Carlton Cuse
References
Asher, Andrew. 2017. “On Ethnographic Research: How do Students Find the Information They Need?” In
Research Methods for Library and Information Science, 6th ed., edited by Lynn Silipigni Connaway and
Marie L. Radford, 264. Westport, CT: Libraries Unlimited.
Asher, Andrew and Miller, Susan. 2011. So You Want to Do Anthropology in Your Library? Or a Practical
Guide to Ethnographic Research in Academic Libraries. Chicago: The ERIAL Project.
Budd, John M. 2006. “Discourse Analysis and the Study of Communication in LIS.” Library Trends 55, no. 1:
65-82.
Clark, K. (2007). Mapping Diaries, or Where Do They Go All Day? In N. Foster & S. Gibbons (Eds.), Studying
Students: The Undergraduate Research Project at the University of Rochester. Chicago: Association College
and Research Libraries.
Connaway, Lynn Silipigni, and Ixchel M. Faniel. 2014. Reordering Ranganathan: Shifting user behaviors,
shifting priorities. Dublin, OH: OCLC Research.
http://www.oclc.org/content/dam/research/publications/library/2014/oclcresearch-reordering-ranganathan-
2014.pdf.
Connaway, Lynn Silipigni, and Marie L. Radford. 2017. Research Methods for Library and Information
Science, 6th ed. Westport, CT: Libraries Unlimited.
References
Denzin, Norman K., and Yvonna S. Lincoln. 2005. The Sage Handbook of Qualitative Research, 4th ed.
Thousand Oaks, CA: Sage Publications.
Dumas, Joseph S., and Janice C. Redish. 1993. A Practical Guide to Usability Testing. Portland, OR: Intellect
Books.
Khoo, Michael, Lily Rozaklis, and Catherine Hall. 2012. “A Survey of the Use of Ethnographic Methods in the
Study of Libraries and Library Users.” Library and Information Science Research 34, no. 2: 82-91.
Ranganathan, Shiyali Ramamrita. 1931. The five laws of library science. London: Edward Goldston, Ltd.
Tang, Rong. 2017. “Usability Research.” In Research Methods for Library and Information Science, 6th ed.,
edited by Lynn Silipigni Connaway and Marie L. Radford, 277-278. Westport, CT: Libraries Unlimited.
White, David S., and Lynn Silipigni Connaway. 2011-2014. Visitors & Residents: What Motivates Engagement
with the Digital Information Environment. Funded by JISC, OCLC, and Oxford University.
http://www.oclc.org/research/activities/vandr/.
Image Attribution
Slide 2: Image: https://www.flickr.com/photos/pmillera4/13570027834/ by Peter Miller / CC BY-NC-ND 2.0
Slide 3: Image: https://www.flickr.com/photos/katesheets/5772901616/ by katesheets / CC BY-NC 2.0
Slide 4: Image: https://www.flickr.com/photos/ddrmaxgt37/387453140/ by Arun Venkatesan / CC BY-NC 2.0
Slide 6: Image: https://www.flickr.com/photos/28481088@N00/3091698923/ by tanakawho / CC BY-NC 2.0
Slide 7: Image: https://www.flickr.com/photos/nordforsk/32225539214/ by NordForsk / CC BY-NC-ND 2.0
Slide 8: Image: https://www.flickr.com/photos/meanestindian/903380690/ by Meena Kadri / CC BY 2.0
Slide 9: Image: https://www.flickr.com/photos/photophilde/4353228184 by photophilde / CC BY-SA 2.0
Slide 11: Image: https://www.flickr.com/photos/elliotmar/8913124849 by Elliot Margolies / CC BY-NC-ND 2.0
Slide 12: Image: https://www.flickr.com/photos/dancingpapa2007/3674686528 by Naoki Tomeno / CC BY 2.0
Slide 14: Image: https://www.flickr.com/photos/njla/3306454031/ by NJLA: New Jersey Library Association / CC
BY-NC-ND 2.0
Slide 15: Image: https://www.flickr.com/photos/dawncreations/2894171562 by I am just Dawn Marie / CC BY-NC-ND
2.0
Slide 16: Image: https://www.flickr.com/photos/larrywkoester/21500417954 by Larry Koester / CC BY 2.0
Image Attribution
Slide 18: Image: https://www.flickr.com/photos/dutchsimba/15704925354 by Dutch Simba / CC BY-NC-ND 2.0
Slide 20: Image: https://www.flickr.com/photos/deanhochman/14481958642/ by Dean Hochman / CC BY 2.0
Slide 21: Image: https://www.flickr.com/photos/78428166@N00/8120708019/ by Tony Alter / CC BY 2.0
Slide 22: Image: https://www.flickr.com/photos/marcelxxl/14217231657/ by M.G.N. – Marcel / CC BY-NC-ND 2.0
Slide 23: Image: https://www.flickr.com/photos/carnesaurus/32160924864/ by Stinson Beach Playground / CC BY-
NC-ND 2.0
Slide 25: Image: https://www.flickr.com/photos/respres/6041698098/ by Jeff Turner / CC BY 2.0
Slide 26: Image: https://www.flickr.com/photos/flakepardigm/4687752030/ by Tyler Nienhouse / CC BY 2.0
Slide 27: Image: https://www.flickr.com/photos/adambindslev/4727853016/ by Adam Bindslev / CC BY-NC 2.0
Slide 28: Image: https://www.flickr.com/photos/carleycomartin/4030726428/ by Carley Comartin / CC BY-NC 2.0
Slide 29: Image: https://www.flickr.com/photos/juanillooo/1231088474/ by Juan Salmoral / CC BY-NC-ND 2.0
Slide 30: Image: https://www.flickr.com/photos/therichbrooks/2600080329/ by Rich Brooks / CC BY 2.0
Slide 31: Image: https://www.flickr.com/photos/dougww/2132598574 by Doug Waldron / CC BY-SA 2.0
Slide 32: Image: https://flic.kr/p/AuDyn by Pete Hunt / CC BY-NC 2.0
Questions &
Discussion
Lynn Silipigni Connaway, PhD
Senior Research Scientist & Director of User
Research
connawal@oclc.org
@LynnConnaway

Weitere ähnliche Inhalte

Was ist angesagt?

Pikas casci talk 11262013 final
Pikas casci talk 11262013 finalPikas casci talk 11262013 final
Pikas casci talk 11262013 finalChristina Pikas
 
The Role of an Information Literacy Award as part of an Undergraduate Researc...
The Role of an Information Literacy Award as part of an Undergraduate Researc...The Role of an Information Literacy Award as part of an Undergraduate Researc...
The Role of an Information Literacy Award as part of an Undergraduate Researc...sshujah
 
Building successful research collaboration
Building successful research collaborationBuilding successful research collaboration
Building successful research collaborationQSR International
 
Planning and organizing your project to ensure success with NVivo
Planning and organizing your project to ensure success with NVivoPlanning and organizing your project to ensure success with NVivo
Planning and organizing your project to ensure success with NVivoQSR International
 
Karen Sobel and Zachary Newell - Academic Libraries as Centers of Equity on C...
Karen Sobel and Zachary Newell - Academic Libraries as Centers of Equity on C...Karen Sobel and Zachary Newell - Academic Libraries as Centers of Equity on C...
Karen Sobel and Zachary Newell - Academic Libraries as Centers of Equity on C...BOBCATSSS 2017
 

Was ist angesagt? (6)

Pikas casci talk 11262013 final
Pikas casci talk 11262013 finalPikas casci talk 11262013 final
Pikas casci talk 11262013 final
 
The Role of an Information Literacy Award as part of an Undergraduate Researc...
The Role of an Information Literacy Award as part of an Undergraduate Researc...The Role of an Information Literacy Award as part of an Undergraduate Researc...
The Role of an Information Literacy Award as part of an Undergraduate Researc...
 
Demystifying open access
Demystifying open accessDemystifying open access
Demystifying open access
 
Building successful research collaboration
Building successful research collaborationBuilding successful research collaboration
Building successful research collaboration
 
Planning and organizing your project to ensure success with NVivo
Planning and organizing your project to ensure success with NVivoPlanning and organizing your project to ensure success with NVivo
Planning and organizing your project to ensure success with NVivo
 
Karen Sobel and Zachary Newell - Academic Libraries as Centers of Equity on C...
Karen Sobel and Zachary Newell - Academic Libraries as Centers of Equity on C...Karen Sobel and Zachary Newell - Academic Libraries as Centers of Equity on C...
Karen Sobel and Zachary Newell - Academic Libraries as Centers of Equity on C...
 

Ähnlich wie Capturing the Behaviors of the Elusive User: Strategies for Library Ethnography

Qualitative Research Methods in LIS
Qualitative Research Methods in LISQualitative Research Methods in LIS
Qualitative Research Methods in LISLynn Connaway
 
Qualitative Research Methods in LIS
Qualitative Research Methods in LISQualitative Research Methods in LIS
Qualitative Research Methods in LISOCLC
 
Studying information behavior: The Many Faces of Digital Visitors and Residents
Studying information behavior: The Many Faces of Digital Visitors and ResidentsStudying information behavior: The Many Faces of Digital Visitors and Residents
Studying information behavior: The Many Faces of Digital Visitors and ResidentsOCLC
 
Studying information behavior: The Many Faces of Digital Visitors and Residents
Studying information behavior: The Many Faces of Digital Visitors and ResidentsStudying information behavior: The Many Faces of Digital Visitors and Residents
Studying information behavior: The Many Faces of Digital Visitors and ResidentsLynn Connaway
 
Research Methods in Library and Information Science: Trends and Tips for Rese...
Research Methods in Library and Information Science: Trends and Tips for Rese...Research Methods in Library and Information Science: Trends and Tips for Rese...
Research Methods in Library and Information Science: Trends and Tips for Rese...OCLC
 
Research Methods in Library and Information Science: Trends and Tips for Rese...
Research Methods in Library and Information Science: Trends and Tips for Rese...Research Methods in Library and Information Science: Trends and Tips for Rese...
Research Methods in Library and Information Science: Trends and Tips for Rese...Lynn Connaway
 
Engaging students through user experience (UX) at UAL
Engaging students through user experience (UX) at UALEngaging students through user experience (UX) at UAL
Engaging students through user experience (UX) at UALSandra Reed
 
Why UX in libraries is a thing now
Why UX in libraries is a thing nowWhy UX in libraries is a thing now
Why UX in libraries is a thing nowAndy Priestner
 
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...TimelessFuture
 
LocWeb 2014 Workshop at CIKM
LocWeb 2014 Workshop at CIKMLocWeb 2014 Workshop at CIKM
LocWeb 2014 Workshop at CIKMDirk Ahlers
 
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopUsing Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopLynn Connaway
 
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopUsing Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopOCLC
 
Getting on with it (research support at an academic library) presented at Uni...
Getting on with it (research support at an academic library) presented at Uni...Getting on with it (research support at an academic library) presented at Uni...
Getting on with it (research support at an academic library) presented at Uni...Reed Elsevier
 
Digital Dissertation Overview - Dissertation Top Gun
Digital Dissertation Overview - Dissertation Top GunDigital Dissertation Overview - Dissertation Top Gun
Digital Dissertation Overview - Dissertation Top GunLifeAfterTelevisionInc
 
Towards Research Engines: Supporting Search Stages in Web Archives (2015)
Towards Research Engines: Supporting Search Stages in Web Archives (2015)Towards Research Engines: Supporting Search Stages in Web Archives (2015)
Towards Research Engines: Supporting Search Stages in Web Archives (2015)TimelessFuture
 
Abqla 20130507 j mc kenna assessment of library space posting
Abqla 20130507 j mc kenna assessment of library space postingAbqla 20130507 j mc kenna assessment of library space posting
Abqla 20130507 j mc kenna assessment of library space postingABQLA2013
 
Tina Phillips (Cornell Lab of Ornithology) - the DEVISE project
Tina Phillips (Cornell Lab of Ornithology) - the DEVISE projectTina Phillips (Cornell Lab of Ornithology) - the DEVISE project
Tina Phillips (Cornell Lab of Ornithology) - the DEVISE projectCitizenCyberlab
 
Data-Informed Decision Making for Libraries - Athenaeum21
Data-Informed Decision Making for Libraries - Athenaeum21Data-Informed Decision Making for Libraries - Athenaeum21
Data-Informed Decision Making for Libraries - Athenaeum21Megan Hurst
 

Ähnlich wie Capturing the Behaviors of the Elusive User: Strategies for Library Ethnography (20)

Qualitative Research Methods in LIS
Qualitative Research Methods in LISQualitative Research Methods in LIS
Qualitative Research Methods in LIS
 
Qualitative Research Methods in LIS
Qualitative Research Methods in LISQualitative Research Methods in LIS
Qualitative Research Methods in LIS
 
Studying information behavior: The Many Faces of Digital Visitors and Residents
Studying information behavior: The Many Faces of Digital Visitors and ResidentsStudying information behavior: The Many Faces of Digital Visitors and Residents
Studying information behavior: The Many Faces of Digital Visitors and Residents
 
Studying information behavior: The Many Faces of Digital Visitors and Residents
Studying information behavior: The Many Faces of Digital Visitors and ResidentsStudying information behavior: The Many Faces of Digital Visitors and Residents
Studying information behavior: The Many Faces of Digital Visitors and Residents
 
Research Methods in Library and Information Science: Trends and Tips for Rese...
Research Methods in Library and Information Science: Trends and Tips for Rese...Research Methods in Library and Information Science: Trends and Tips for Rese...
Research Methods in Library and Information Science: Trends and Tips for Rese...
 
Research Methods in Library and Information Science: Trends and Tips for Rese...
Research Methods in Library and Information Science: Trends and Tips for Rese...Research Methods in Library and Information Science: Trends and Tips for Rese...
Research Methods in Library and Information Science: Trends and Tips for Rese...
 
Digital Art History
Digital Art HistoryDigital Art History
Digital Art History
 
Engaging students through user experience (UX) at UAL
Engaging students through user experience (UX) at UALEngaging students through user experience (UX) at UAL
Engaging students through user experience (UX) at UAL
 
Why UX in libraries is a thing now
Why UX in libraries is a thing nowWhy UX in libraries is a thing now
Why UX in libraries is a thing now
 
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
Supporting the Interpretation of Enriched Audiovisual Sources through Tempora...
 
LocWeb 2014 Workshop at CIKM
LocWeb 2014 Workshop at CIKMLocWeb 2014 Workshop at CIKM
LocWeb 2014 Workshop at CIKM
 
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopUsing Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
 
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive WorkshopUsing Qualitative Methods for Library Evaluation: An Interactive Workshop
Using Qualitative Methods for Library Evaluation: An Interactive Workshop
 
Getting on with it (research support at an academic library) presented at Uni...
Getting on with it (research support at an academic library) presented at Uni...Getting on with it (research support at an academic library) presented at Uni...
Getting on with it (research support at an academic library) presented at Uni...
 
Overview of the dissertation process. Tools, techniques by phase.
Overview of the dissertation process. Tools, techniques by phase.Overview of the dissertation process. Tools, techniques by phase.
Overview of the dissertation process. Tools, techniques by phase.
 
Digital Dissertation Overview - Dissertation Top Gun
Digital Dissertation Overview - Dissertation Top GunDigital Dissertation Overview - Dissertation Top Gun
Digital Dissertation Overview - Dissertation Top Gun
 
Towards Research Engines: Supporting Search Stages in Web Archives (2015)
Towards Research Engines: Supporting Search Stages in Web Archives (2015)Towards Research Engines: Supporting Search Stages in Web Archives (2015)
Towards Research Engines: Supporting Search Stages in Web Archives (2015)
 
Abqla 20130507 j mc kenna assessment of library space posting
Abqla 20130507 j mc kenna assessment of library space postingAbqla 20130507 j mc kenna assessment of library space posting
Abqla 20130507 j mc kenna assessment of library space posting
 
Tina Phillips (Cornell Lab of Ornithology) - the DEVISE project
Tina Phillips (Cornell Lab of Ornithology) - the DEVISE projectTina Phillips (Cornell Lab of Ornithology) - the DEVISE project
Tina Phillips (Cornell Lab of Ornithology) - the DEVISE project
 
Data-Informed Decision Making for Libraries - Athenaeum21
Data-Informed Decision Making for Libraries - Athenaeum21Data-Informed Decision Making for Libraries - Athenaeum21
Data-Informed Decision Making for Libraries - Athenaeum21
 

Mehr von Lynn Connaway

The Evolving Collection and Shift to Open
The Evolving Collection and Shift to OpenThe Evolving Collection and Shift to Open
The Evolving Collection and Shift to OpenLynn Connaway
 
Speaking on the Record: Combining Interviews with Search Log Analysis in User...
Speaking on the Record: Combining Interviews with Search Log Analysis in User...Speaking on the Record: Combining Interviews with Search Log Analysis in User...
Speaking on the Record: Combining Interviews with Search Log Analysis in User...Lynn Connaway
 
Researching Students’ Information Choices (RSIC): Determining Identity and Ju...
Researching Students’ Information Choices (RSIC): Determining Identity and Ju...Researching Students’ Information Choices (RSIC): Determining Identity and Ju...
Researching Students’ Information Choices (RSIC): Determining Identity and Ju...Lynn Connaway
 
How Research and Community Inputs Fuel the Library On-Demand.
How Research and Community Inputs Fuel the Library On-Demand.How Research and Community Inputs Fuel the Library On-Demand.
How Research and Community Inputs Fuel the Library On-Demand.Lynn Connaway
 
OCLC delivery services: The library on-demand.
OCLC delivery services: The library on-demand.OCLC delivery services: The library on-demand.
OCLC delivery services: The library on-demand.Lynn Connaway
 
Speaking on the record: Combining interviews with search log analysis in user...
Speaking on the record: Combining interviews with search log analysis in user...Speaking on the record: Combining interviews with search log analysis in user...
Speaking on the record: Combining interviews with search log analysis in user...Lynn Connaway
 
Interdisciplinary approaches to research methods in information behavior stu...
 Interdisciplinary approaches to research methods in information behavior stu... Interdisciplinary approaches to research methods in information behavior stu...
Interdisciplinary approaches to research methods in information behavior stu...Lynn Connaway
 
Take action: Using and presenting research findings to make your case.
Take action: Using and presenting research findings to make your case.Take action: Using and presenting research findings to make your case.
Take action: Using and presenting research findings to make your case.Lynn Connaway
 
Digging into assessment data: Tips, tricks, and tools of the trade.
Digging into assessment data: Tips, tricks, and tools of the trade.Digging into assessment data: Tips, tricks, and tools of the trade.
Digging into assessment data: Tips, tricks, and tools of the trade.Lynn Connaway
 
User-centered assessment: Leveraging what you know and filling in the gaps.
User-centered assessment: Leveraging what you know and filling in the gaps. User-centered assessment: Leveraging what you know and filling in the gaps.
User-centered assessment: Leveraging what you know and filling in the gaps. Lynn Connaway
 
There is a method to it: Making meaning in information research through a mix...
There is a method to it: Making meaning in information research through a mix...There is a method to it: Making meaning in information research through a mix...
There is a method to it: Making meaning in information research through a mix...Lynn Connaway
 
Public libraries respond to the opioid crisis in collaboration with their com...
Public libraries respond to the opioid crisis in collaboration with their com...Public libraries respond to the opioid crisis in collaboration with their com...
Public libraries respond to the opioid crisis in collaboration with their com...Lynn Connaway
 
"I like interlibrary loans a lot. I don’t that three- or four-day turnaround...
 "I like interlibrary loans a lot. I don’t that three- or four-day turnaround... "I like interlibrary loans a lot. I don’t that three- or four-day turnaround...
"I like interlibrary loans a lot. I don’t that three- or four-day turnaround...Lynn Connaway
 
"That little bit of information can go a long way." The importance of library...
"That little bit of information can go a long way." The importance of library..."That little bit of information can go a long way." The importance of library...
"That little bit of information can go a long way." The importance of library...Lynn Connaway
 
“From Discovery to Fulfillment: Improving the User Experience at Every Stage.”
 “From Discovery to Fulfillment: Improving the User Experience at Every Stage.” “From Discovery to Fulfillment: Improving the User Experience at Every Stage.”
“From Discovery to Fulfillment: Improving the User Experience at Every Stage.”Lynn Connaway
 
From research to reality: Transforming libraries for a global information world.
From research to reality: Transforming libraries for a global information world.From research to reality: Transforming libraries for a global information world.
From research to reality: Transforming libraries for a global information world.Lynn Connaway
 
Authority, context, and containers: Student perceptions and judgments when us...
Authority, context, and containers: Student perceptions and judgments when us...Authority, context, and containers: Student perceptions and judgments when us...
Authority, context, and containers: Student perceptions and judgments when us...Lynn Connaway
 
“It [library tour] wasn’t what do you do when you need to make a literature r...
“It [library tour] wasn’t what do you do when you need to make a literature r...“It [library tour] wasn’t what do you do when you need to make a literature r...
“It [library tour] wasn’t what do you do when you need to make a literature r...Lynn Connaway
 
OCLC Research update: Active engagement.
OCLC Research update: Active engagement.OCLC Research update: Active engagement.
OCLC Research update: Active engagement.Lynn Connaway
 
Demystifying assessment: Crafting a message to communicate results that addr...
 Demystifying assessment: Crafting a message to communicate results that addr... Demystifying assessment: Crafting a message to communicate results that addr...
Demystifying assessment: Crafting a message to communicate results that addr...Lynn Connaway
 

Mehr von Lynn Connaway (20)

The Evolving Collection and Shift to Open
The Evolving Collection and Shift to OpenThe Evolving Collection and Shift to Open
The Evolving Collection and Shift to Open
 
Speaking on the Record: Combining Interviews with Search Log Analysis in User...
Speaking on the Record: Combining Interviews with Search Log Analysis in User...Speaking on the Record: Combining Interviews with Search Log Analysis in User...
Speaking on the Record: Combining Interviews with Search Log Analysis in User...
 
Researching Students’ Information Choices (RSIC): Determining Identity and Ju...
Researching Students’ Information Choices (RSIC): Determining Identity and Ju...Researching Students’ Information Choices (RSIC): Determining Identity and Ju...
Researching Students’ Information Choices (RSIC): Determining Identity and Ju...
 
How Research and Community Inputs Fuel the Library On-Demand.
How Research and Community Inputs Fuel the Library On-Demand.How Research and Community Inputs Fuel the Library On-Demand.
How Research and Community Inputs Fuel the Library On-Demand.
 
OCLC delivery services: The library on-demand.
OCLC delivery services: The library on-demand.OCLC delivery services: The library on-demand.
OCLC delivery services: The library on-demand.
 
Speaking on the record: Combining interviews with search log analysis in user...
Speaking on the record: Combining interviews with search log analysis in user...Speaking on the record: Combining interviews with search log analysis in user...
Speaking on the record: Combining interviews with search log analysis in user...
 
Interdisciplinary approaches to research methods in information behavior stu...
 Interdisciplinary approaches to research methods in information behavior stu... Interdisciplinary approaches to research methods in information behavior stu...
Interdisciplinary approaches to research methods in information behavior stu...
 
Take action: Using and presenting research findings to make your case.
Take action: Using and presenting research findings to make your case.Take action: Using and presenting research findings to make your case.
Take action: Using and presenting research findings to make your case.
 
Digging into assessment data: Tips, tricks, and tools of the trade.
Digging into assessment data: Tips, tricks, and tools of the trade.Digging into assessment data: Tips, tricks, and tools of the trade.
Digging into assessment data: Tips, tricks, and tools of the trade.
 
User-centered assessment: Leveraging what you know and filling in the gaps.
User-centered assessment: Leveraging what you know and filling in the gaps. User-centered assessment: Leveraging what you know and filling in the gaps.
User-centered assessment: Leveraging what you know and filling in the gaps.
 
There is a method to it: Making meaning in information research through a mix...
There is a method to it: Making meaning in information research through a mix...There is a method to it: Making meaning in information research through a mix...
There is a method to it: Making meaning in information research through a mix...
 
Public libraries respond to the opioid crisis in collaboration with their com...
Public libraries respond to the opioid crisis in collaboration with their com...Public libraries respond to the opioid crisis in collaboration with their com...
Public libraries respond to the opioid crisis in collaboration with their com...
 
"I like interlibrary loans a lot. I don’t that three- or four-day turnaround...
 "I like interlibrary loans a lot. I don’t that three- or four-day turnaround... "I like interlibrary loans a lot. I don’t that three- or four-day turnaround...
"I like interlibrary loans a lot. I don’t that three- or four-day turnaround...
 
"That little bit of information can go a long way." The importance of library...
"That little bit of information can go a long way." The importance of library..."That little bit of information can go a long way." The importance of library...
"That little bit of information can go a long way." The importance of library...
 
“From Discovery to Fulfillment: Improving the User Experience at Every Stage.”
 “From Discovery to Fulfillment: Improving the User Experience at Every Stage.” “From Discovery to Fulfillment: Improving the User Experience at Every Stage.”
“From Discovery to Fulfillment: Improving the User Experience at Every Stage.”
 
From research to reality: Transforming libraries for a global information world.
From research to reality: Transforming libraries for a global information world.From research to reality: Transforming libraries for a global information world.
From research to reality: Transforming libraries for a global information world.
 
Authority, context, and containers: Student perceptions and judgments when us...
Authority, context, and containers: Student perceptions and judgments when us...Authority, context, and containers: Student perceptions and judgments when us...
Authority, context, and containers: Student perceptions and judgments when us...
 
“It [library tour] wasn’t what do you do when you need to make a literature r...
“It [library tour] wasn’t what do you do when you need to make a literature r...“It [library tour] wasn’t what do you do when you need to make a literature r...
“It [library tour] wasn’t what do you do when you need to make a literature r...
 
OCLC Research update: Active engagement.
OCLC Research update: Active engagement.OCLC Research update: Active engagement.
OCLC Research update: Active engagement.
 
Demystifying assessment: Crafting a message to communicate results that addr...
 Demystifying assessment: Crafting a message to communicate results that addr... Demystifying assessment: Crafting a message to communicate results that addr...
Demystifying assessment: Crafting a message to communicate results that addr...
 

Kürzlich hochgeladen

What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPCeline George
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Celine George
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersSabitha Banu
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...Postal Advocate Inc.
 
Q4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptxQ4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptxnelietumpap1
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPCeline George
 
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Celine George
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceSamikshaHamane
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Celine George
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)lakshayb543
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptxmary850239
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatYousafMalik24
 
Grade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptxGrade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptxChelloAnnAsuncion2
 
Choosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for ParentsChoosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for Parentsnavabharathschool99
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...JhezDiaz1
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxHumphrey A Beña
 

Kürzlich hochgeladen (20)

What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERP
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginners
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
 
Q4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptxQ4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptx
 
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERP
 
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in Pharmacovigilance
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
 
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx
 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice great
 
Grade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptxGrade 9 Q4-MELC1-Active and Passive Voice.pptx
Grade 9 Q4-MELC1-Active and Passive Voice.pptx
 
Choosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for ParentsChoosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for Parents
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
 

Capturing the Behaviors of the Elusive User: Strategies for Library Ethnography

  • 1. IFLA Wrocław • 22 August 2017 Capturing the Behaviors of the Elusive User: Strategies for Library Ethnography Lynn Silipigni Connaway, PhD Senior Research Scientist & Director of User Research, OCLC connawal@oclc.org @LynnConnaway
  • 2. Ethnographic Research “…a way of seeing how individuals interact and behave in situations by utilizing different qualitative data collection and analysis methods.” (Connaway and Radford 2017, 263)
  • 3. Qualitative Research Definition A type of scientific research that: • Seeks answers to a question • Systematically uses predefined set of procedures to answer question • Collects evidence • Produces findings that: • Are not determined in advance • Apply beyond immediate boundaries of study
  • 4. What is Qualitative Research? “…a situated activity that locates the observer in the world. It consists of a set of interpretive, material practices that make the world visible. These practices transform the world. They turn the world into a series of representations, including field notes, interviews, conversations, photographs, recordings, & memos to the self. At this level, qualitative research involves an interpretive, naturalistic approach to the world. This means that qualitative researchers study things in their natural settings, attempting to make sense of, or to interpret, phenomena in terms of the meanings people bring to them.” (Denzin and Lincoln 2005)
  • 6. Interviews Diaries Observation Usability Testing Ethnographic Data Collection
  • 7. Ethnographic Interviews • Incredibly detailed data • Time consuming – Establishing rapport – Selecting research participants – Transcribing observations & conversations
  • 8. Conducting the Interview 1. Thematizing: Clarifying the interview’s purpose 2. Designing: Defining the interview’s purpose 3. Interviewing: Conducting the interview 4. Transcribing: Creating a written verbatim text of the interview 5. Analyzing: Figuring out the meaning of data 6. Verifying: Determining the reliability & validity of the data 7. Reporting: Telling others about the findings (Connaway and Radford 2017, 244)
  • 9. V&R Semi-Structured Interview Questions 5. Have there been times when you were told to use a library or virtual learning environment (or learning platform), and used other source(s) instead? 6. If you had a magic wand, what would your ideal way of getting information be? How would you go about using the systems and services? When? Where? How?
  • 10. Diaries • Keep directions minimal and open • Offer participants a variety of ways to report • Written • Photo • Video • Audio • Data can be rich and detailed, but is self-reported • Does not require researcher presence (Connaway and Radford, 2017)
  • 11. V&R Diary Template 1. Explain a time in the past month when you were SUCCESSFUL in completing an ACADEMIC assignment. What steps did you take? 2. Think of a time fairly recently when you struggled to find appropriate resources to help you complete an ACADEMIC assignment. What happened?
  • 12. Example: Digital Visitors and Residents Diaries
  • 13. “Perhaps the most convenient method of studying the consequences of this law will be to follow the reader from the moment he enters the library to the moment he leaves it…” (Ranganathan 1931, 337)
  • 14. Participant/Immersive Observations • Move into the setting as deeply as possible • Disturb participants as little as possible • Participant observation • Open, direct interaction & observation as part of the group (Connaway and Radford 2017)
  • 15. Participant/Immersive Observations • Unstructured observation • No predetermined categories of behavior • Flexible, exploratory • Notes should be recorded as soon as possible • Structured observation • Predeveloped observational categories • Rating scales and/or checklists • Audio and/or video recording (Connaway and Radford, 2017)
  • 16. WebJunction Observations Scenario and Task 1 You are interested in taking free courses from the WebJunction course catalog. Please go to the first task. Please go to webjunction.org before proceeding You are interested in participating in free courses and webinars offered by WebJunction. A. Find where you can enroll in free library-specific courses and webinars. (Connaway and Radford, 2017, p. 274)
  • 18. Cognitive Mapping • Participant draws a map of the area of interest • Fast and easy to conduct • Small time commitment from participants • Can be ambiguous or difficult to interpret
  • 19. Mapping Diaries • Give participants a map & ask them to record their movements • Can use maps as basis for individual interviews From Clark (2007), “Mapping Diaries, or Where Do They Go All Day?”, p. 49
  • 20. Usability Testing • Degree to which a user can successfully learn & use a product to achieve a goal • Evaluation research methodology • Observation & analysis of user behavior while users use a product or product prototype to achieve a goal (Dumas and Redish 1993, 22)
  • 21. Usability Testing: Components Comprised of three parts: 1. Pre-session interview 2. Scenario and task structured test 3. Post-session survey (Tang 2017, 278)
  • 22. V&R Mapping App Usability Testing TASK • Think of around 10 websites you use or online activities that you regularly perform. Place each of these websites or activities on the map in a way that represents how you feel you use them (as a 'Visitor' or as a 'Resident') and the typical context in which you use them ('Personal' or 'Institutional’). PROCEDURE 1. Read the task aloud 2. Using the app, complete the task while thinking aloud 3. Indicate when they felt they had completed the task
  • 23. Usability Testing: Methodology • Artificial environment (laboratory) • Maintain more control • May provide more specific data on a particular feature • Natural environment • Better holistic representation of real people doing real work (Tang 2017, 278)
  • 25. Ethnographic Analysis • Use people’s own categories • Avoid assuming what one will find • Complementary to quantitative methods • Retain ‘richness’/‘thick description’ • Numerous compatibility (Asher 2017, 264) (Connaway and Radford 2017, 282)
  • 26. • Contain all data sources • Creating & applying codes • Queries • Visualizations • Reports (Connaway and Radford 2017) Computer-Assisted Qualitative Data Analysis Software (CAQDAS)
  • 27. • Draw on data...in service of developing new conceptual categories • Develop inductive abstract analytic categories through systematic data analysis • Emphasize theory construction rather than description or application of current theories (Connaway and Radford 2017) Grounded Theory
  • 28. “A major strategy for analysis of qualitative data is the use of the constant comparative method, which embraces ‘constant comparisons’ defined as ‘the analytic process of comparing different pieces of data against each other for similarities and differences.’” (Connaway and Radford 2017, 298)
  • 29. Conversation Analysis • Context & social conduct Discourse Analysis • The library within a larger social & cultural context (Connaway and Radford 2017)
  • 30. Challenges: Ethnographic Research • Data collection & analysis • Costs and time • Bias • Sampling • Not generalizable
  • 31. Opportunities: Ethnographic Research • Rich data and thick description • Can answer why and how questions • Provides information to support decisions about resources and services • Can help motivate and increase buy-in for change • Provides the opportunity to build relationships (Connaway and Radford, 2017; Asher and Miller, 2011)
  • 32. “The creative process is not like a situation where you get struck by a single lightning bolt. You have ongoing discoveries, and there are ongoing creative revelations. Yes, it's really helpful to be marching toward a specific destination, but, along the way, you must allow yourself room for your ideas to blossom, take root, and grow.” –Carlton Cuse
  • 33. References Asher, Andrew. 2017. “On Ethnographic Research: How do Students Find the Information They Need?” In Research Methods for Library and Information Science, 6th ed., edited by Lynn Silipigni Connaway and Marie L. Radford, 264. Westport, CT: Libraries Unlimited. Asher, Andrew and Miller, Susan. 2011. So You Want to Do Anthropology in Your Library? Or a Practical Guide to Ethnographic Research in Academic Libraries. Chicago: The ERIAL Project. Budd, John M. 2006. “Discourse Analysis and the Study of Communication in LIS.” Library Trends 55, no. 1: 65-82. Clark, K. (2007). Mapping Diaries, or Where Do They Go All Day? In N. Foster & S. Gibbons (Eds.), Studying Students: The Undergraduate Research Project at the University of Rochester. Chicago: Association College and Research Libraries. Connaway, Lynn Silipigni, and Ixchel M. Faniel. 2014. Reordering Ranganathan: Shifting user behaviors, shifting priorities. Dublin, OH: OCLC Research. http://www.oclc.org/content/dam/research/publications/library/2014/oclcresearch-reordering-ranganathan- 2014.pdf. Connaway, Lynn Silipigni, and Marie L. Radford. 2017. Research Methods for Library and Information Science, 6th ed. Westport, CT: Libraries Unlimited.
  • 34. References Denzin, Norman K., and Yvonna S. Lincoln. 2005. The Sage Handbook of Qualitative Research, 4th ed. Thousand Oaks, CA: Sage Publications. Dumas, Joseph S., and Janice C. Redish. 1993. A Practical Guide to Usability Testing. Portland, OR: Intellect Books. Khoo, Michael, Lily Rozaklis, and Catherine Hall. 2012. “A Survey of the Use of Ethnographic Methods in the Study of Libraries and Library Users.” Library and Information Science Research 34, no. 2: 82-91. Ranganathan, Shiyali Ramamrita. 1931. The five laws of library science. London: Edward Goldston, Ltd. Tang, Rong. 2017. “Usability Research.” In Research Methods for Library and Information Science, 6th ed., edited by Lynn Silipigni Connaway and Marie L. Radford, 277-278. Westport, CT: Libraries Unlimited. White, David S., and Lynn Silipigni Connaway. 2011-2014. Visitors & Residents: What Motivates Engagement with the Digital Information Environment. Funded by JISC, OCLC, and Oxford University. http://www.oclc.org/research/activities/vandr/.
  • 35. Image Attribution Slide 2: Image: https://www.flickr.com/photos/pmillera4/13570027834/ by Peter Miller / CC BY-NC-ND 2.0 Slide 3: Image: https://www.flickr.com/photos/katesheets/5772901616/ by katesheets / CC BY-NC 2.0 Slide 4: Image: https://www.flickr.com/photos/ddrmaxgt37/387453140/ by Arun Venkatesan / CC BY-NC 2.0 Slide 6: Image: https://www.flickr.com/photos/28481088@N00/3091698923/ by tanakawho / CC BY-NC 2.0 Slide 7: Image: https://www.flickr.com/photos/nordforsk/32225539214/ by NordForsk / CC BY-NC-ND 2.0 Slide 8: Image: https://www.flickr.com/photos/meanestindian/903380690/ by Meena Kadri / CC BY 2.0 Slide 9: Image: https://www.flickr.com/photos/photophilde/4353228184 by photophilde / CC BY-SA 2.0 Slide 11: Image: https://www.flickr.com/photos/elliotmar/8913124849 by Elliot Margolies / CC BY-NC-ND 2.0 Slide 12: Image: https://www.flickr.com/photos/dancingpapa2007/3674686528 by Naoki Tomeno / CC BY 2.0 Slide 14: Image: https://www.flickr.com/photos/njla/3306454031/ by NJLA: New Jersey Library Association / CC BY-NC-ND 2.0 Slide 15: Image: https://www.flickr.com/photos/dawncreations/2894171562 by I am just Dawn Marie / CC BY-NC-ND 2.0 Slide 16: Image: https://www.flickr.com/photos/larrywkoester/21500417954 by Larry Koester / CC BY 2.0
  • 36. Image Attribution Slide 18: Image: https://www.flickr.com/photos/dutchsimba/15704925354 by Dutch Simba / CC BY-NC-ND 2.0 Slide 20: Image: https://www.flickr.com/photos/deanhochman/14481958642/ by Dean Hochman / CC BY 2.0 Slide 21: Image: https://www.flickr.com/photos/78428166@N00/8120708019/ by Tony Alter / CC BY 2.0 Slide 22: Image: https://www.flickr.com/photos/marcelxxl/14217231657/ by M.G.N. – Marcel / CC BY-NC-ND 2.0 Slide 23: Image: https://www.flickr.com/photos/carnesaurus/32160924864/ by Stinson Beach Playground / CC BY- NC-ND 2.0 Slide 25: Image: https://www.flickr.com/photos/respres/6041698098/ by Jeff Turner / CC BY 2.0 Slide 26: Image: https://www.flickr.com/photos/flakepardigm/4687752030/ by Tyler Nienhouse / CC BY 2.0 Slide 27: Image: https://www.flickr.com/photos/adambindslev/4727853016/ by Adam Bindslev / CC BY-NC 2.0 Slide 28: Image: https://www.flickr.com/photos/carleycomartin/4030726428/ by Carley Comartin / CC BY-NC 2.0 Slide 29: Image: https://www.flickr.com/photos/juanillooo/1231088474/ by Juan Salmoral / CC BY-NC-ND 2.0 Slide 30: Image: https://www.flickr.com/photos/therichbrooks/2600080329/ by Rich Brooks / CC BY 2.0 Slide 31: Image: https://www.flickr.com/photos/dougww/2132598574 by Doug Waldron / CC BY-SA 2.0 Slide 32: Image: https://flic.kr/p/AuDyn by Pete Hunt / CC BY-NC 2.0
  • 37. Questions & Discussion Lynn Silipigni Connaway, PhD Senior Research Scientist & Director of User Research connawal@oclc.org @LynnConnaway