SlideShare ist ein Scribd-Unternehmen logo
1 von 20
From 3x5 to LCD*
 Considerations and how-tos for
  conducting online card sort
            studies



                                                     Emily Ford
                               Urban & Public Affairs Librarian
                                      Portland State University
                                                 forder@pdx.edu

        *This presentation is based on an article forthcoming in College &
           Research Libraries News titled - Is Digital Better than Analog?
                               Considerations for Online Card Sort Studies
What is a card sort study?




             http://www.flickr.com/photos/rosenfeldmedia/3343504093
Open Card Sort




       http://www.flickr.com/photos/rosenfeldmedia/3344343842/
Closed Card Sort




        http://www.flickr.com/photos/rosenfeldmedia/3344341528/
3x5 Card Sort
Get IRB waiver or approval
Make cards
Recruit and schedule participants
Observe talking out loud
Ask questions/interview subjects
Transfer analog data to digital
Crunch data
Make sense of data
Plan and implement
    design/organization/changes
3x5 Card Sort

Pro
• Rich qualitative
  and quantitative
  data
• Inexpensive
• Complements data
  from other
  usability testing
  methods
3x5 Card Sort
     Con

     • Time intensive
     • Margins for error
     • Participant
       comfort/nerves
The Mission

• Create a LibGuide for OMPH
  students.

• Share it between PSU and OHSU.
The Partner
Laura Zeigen
User Experience Librarian
Oregon Health & Science
University

Oregon Master of Public
Health Student
The Students
The Method



    +
=
Optimal Sort
The Set Up
Drag,
Drop,
  &
Label
The Output
The Result
LCD Card Sort
Get IRB waiver or approval
Make cards
Recruit and schedule participants
Observe talking out loud
Ask questions/interview subjects
Transfer analog data to digital
Crunch data
Make sense of data
Plan and implement
    design/organization/changes
LCD Card Sort

Pro
• Non-traditional
  students/subjects
• Asynchronous
• Automated outputs
LCD Card Sort
     Con

     • No “think out loud”
       data
     • Potential interface
       issues with online
       product
     • Potential online
       product functionality
       issues
     • Tracking discarded
       cards
3x5 or LCD?
Considerations:
• How many cards are in our set?
• What other methods are being used
  for this project?
• What kind of users are our
  subjects?
• Does the online product do what
  we need?
• Do we want perfection or will
  good enough suffice?
LCD Card Sort
How-to:
1.Choose your software.
2.Design and set up your study
3.Collect data
4.Marvel at the results

Weitere ähnliche Inhalte

Ähnlich wie From 3x5 to LCD: Considerations and How-tos for Online Card Sort Studies

BYOD Planning and Implementation
BYOD Planning and ImplementationBYOD Planning and Implementation
BYOD Planning and ImplementationErfan Mojaddam
 
CLP Presentation - Experiential Learning in Practice - 2-17-15
CLP Presentation - Experiential Learning in Practice - 2-17-15CLP Presentation - Experiential Learning in Practice - 2-17-15
CLP Presentation - Experiential Learning in Practice - 2-17-15Sean Gallagan, Ph.D.
 
Data Science Curriculum at Indiana University
Data Science Curriculum at Indiana UniversityData Science Curriculum at Indiana University
Data Science Curriculum at Indiana UniversityGeoffrey Fox
 
Blended learning and flipped classrooms for data science at Dallas Startup Week
Blended learning and flipped classrooms for data science at Dallas Startup WeekBlended learning and flipped classrooms for data science at Dallas Startup Week
Blended learning and flipped classrooms for data science at Dallas Startup WeekStartupWeekDallas
 
Informatics Orientation Presentation 2
Informatics Orientation Presentation 2Informatics Orientation Presentation 2
Informatics Orientation Presentation 2Teri Slick
 
YU Connect student affairs symposium july 11
YU Connect student affairs symposium july 11YU Connect student affairs symposium july 11
YU Connect student affairs symposium july 11TEDx Adventure Catalyst
 
Research data management: a brief introduction
Research data management: a brief introductionResearch data management: a brief introduction
Research data management: a brief introductionDeborah Fitchett
 
Faculty Research Support Needs Survey
Faculty Research Support Needs SurveyFaculty Research Support Needs Survey
Faculty Research Support Needs SurveyKathryn Crowe
 
Visualizing communication at scad school of design
Visualizing communication at scad school of designVisualizing communication at scad school of design
Visualizing communication at scad school of designSAAD ALZAROONI, CM
 
Data Science Meets Biomedicine, Does Anything Change
Data Science Meets Biomedicine, Does Anything ChangeData Science Meets Biomedicine, Does Anything Change
Data Science Meets Biomedicine, Does Anything ChangePhilip Bourne
 
Exploring basic skills and talents for digital opportunities
Exploring basic skills and talents for digital opportunities Exploring basic skills and talents for digital opportunities
Exploring basic skills and talents for digital opportunities David Nzoputa Ofili
 
Creating Interactive Dashboards with Microsoft Excel
Creating Interactive Dashboards with Microsoft ExcelCreating Interactive Dashboards with Microsoft Excel
Creating Interactive Dashboards with Microsoft ExcelAACRAO
 
Card Sort Report
Card Sort ReportCard Sort Report
Card Sort Report宇轩 谢
 
Cloud solution to educational organization
Cloud solution to educational organizationCloud solution to educational organization
Cloud solution to educational organizationKaustubh Joshi
 
2011.10.10 Multi-Disciplinary Research Themes and Training
2011.10.10 Multi-Disciplinary Research Themes and Training2011.10.10 Multi-Disciplinary Research Themes and Training
2011.10.10 Multi-Disciplinary Research Themes and TrainingNUI Galway
 
Learning Analytics - CET Seminar 2012
Learning Analytics - CET Seminar 2012Learning Analytics - CET Seminar 2012
Learning Analytics - CET Seminar 2012Andrew Deacon
 

Ähnlich wie From 3x5 to LCD: Considerations and How-tos for Online Card Sort Studies (20)

BYOD Planning and Implementation
BYOD Planning and ImplementationBYOD Planning and Implementation
BYOD Planning and Implementation
 
CLP Presentation - Experiential Learning in Practice - 2-17-15
CLP Presentation - Experiential Learning in Practice - 2-17-15CLP Presentation - Experiential Learning in Practice - 2-17-15
CLP Presentation - Experiential Learning in Practice - 2-17-15
 
Data Science Curriculum at Indiana University
Data Science Curriculum at Indiana UniversityData Science Curriculum at Indiana University
Data Science Curriculum at Indiana University
 
Blended learning and flipped classrooms for data science at Dallas Startup Week
Blended learning and flipped classrooms for data science at Dallas Startup WeekBlended learning and flipped classrooms for data science at Dallas Startup Week
Blended learning and flipped classrooms for data science at Dallas Startup Week
 
Informatics Orientation Presentation 2
Informatics Orientation Presentation 2Informatics Orientation Presentation 2
Informatics Orientation Presentation 2
 
YU Connect student affairs symposium july 11
YU Connect student affairs symposium july 11YU Connect student affairs symposium july 11
YU Connect student affairs symposium july 11
 
Research data management: a brief introduction
Research data management: a brief introductionResearch data management: a brief introduction
Research data management: a brief introduction
 
Faculty Research Support Needs Survey
Faculty Research Support Needs SurveyFaculty Research Support Needs Survey
Faculty Research Support Needs Survey
 
Visualizing communication at scad school of design
Visualizing communication at scad school of designVisualizing communication at scad school of design
Visualizing communication at scad school of design
 
Data Science Meets Biomedicine, Does Anything Change
Data Science Meets Biomedicine, Does Anything ChangeData Science Meets Biomedicine, Does Anything Change
Data Science Meets Biomedicine, Does Anything Change
 
Exploring basic skills and talents for digital opportunities
Exploring basic skills and talents for digital opportunities Exploring basic skills and talents for digital opportunities
Exploring basic skills and talents for digital opportunities
 
I teach
I teachI teach
I teach
 
Coursera r9 xpydfcpt4k
Coursera r9 xpydfcpt4kCoursera r9 xpydfcpt4k
Coursera r9 xpydfcpt4k
 
Creating Interactive Dashboards with Microsoft Excel
Creating Interactive Dashboards with Microsoft ExcelCreating Interactive Dashboards with Microsoft Excel
Creating Interactive Dashboards with Microsoft Excel
 
DMP & DMPonline
DMP & DMPonlineDMP & DMPonline
DMP & DMPonline
 
Card Sort Report
Card Sort ReportCard Sort Report
Card Sort Report
 
Big Data - IBA.pptx
Big Data - IBA.pptxBig Data - IBA.pptx
Big Data - IBA.pptx
 
Cloud solution to educational organization
Cloud solution to educational organizationCloud solution to educational organization
Cloud solution to educational organization
 
2011.10.10 Multi-Disciplinary Research Themes and Training
2011.10.10 Multi-Disciplinary Research Themes and Training2011.10.10 Multi-Disciplinary Research Themes and Training
2011.10.10 Multi-Disciplinary Research Themes and Training
 
Learning Analytics - CET Seminar 2012
Learning Analytics - CET Seminar 2012Learning Analytics - CET Seminar 2012
Learning Analytics - CET Seminar 2012
 

Mehr von Emily Ford

To Badge or Not? Towards an intersection of neoliberalism and information lit...
To Badge or Not? Towards an intersection of neoliberalism and information lit...To Badge or Not? Towards an intersection of neoliberalism and information lit...
To Badge or Not? Towards an intersection of neoliberalism and information lit...Emily Ford
 
Open Peer Review
Open Peer ReviewOpen Peer Review
Open Peer ReviewEmily Ford
 
ACRL 2015 Scholarship Breakfast
ACRL 2015 Scholarship BreakfastACRL 2015 Scholarship Breakfast
ACRL 2015 Scholarship BreakfastEmily Ford
 
Digital Badges: A Tool for Embedded Library Instruction
Digital Badges: A Tool for Embedded Library InstructionDigital Badges: A Tool for Embedded Library Instruction
Digital Badges: A Tool for Embedded Library InstructionEmily Ford
 
Badge it! Using Digital Badges to Certify Information Literacy Skills withing...
Badge it! Using Digital Badges to Certify Information Literacy Skills withing...Badge it! Using Digital Badges to Certify Information Literacy Skills withing...
Badge it! Using Digital Badges to Certify Information Literacy Skills withing...Emily Ford
 
Achievement Unlocked! A Digital Badge Primer & Workshop
Achievement Unlocked! A Digital Badge Primer & WorkshopAchievement Unlocked! A Digital Badge Primer & Workshop
Achievement Unlocked! A Digital Badge Primer & WorkshopEmily Ford
 
Digital Badges in Libraries: Skills-based Instruction, Code-shifting, and Col...
Digital Badges in Libraries: Skills-based Instruction, Code-shifting, and Col...Digital Badges in Libraries: Skills-based Instruction, Code-shifting, and Col...
Digital Badges in Libraries: Skills-based Instruction, Code-shifting, and Col...Emily Ford
 
Open Peer Review: Directions and Challenges
Open Peer Review: Directions and ChallengesOpen Peer Review: Directions and Challenges
Open Peer Review: Directions and ChallengesEmily Ford
 
Does Oregon Need a Librar* Revolution?
Does Oregon Need a Librar* Revolution?Does Oregon Need a Librar* Revolution?
Does Oregon Need a Librar* Revolution?Emily Ford
 
Supporting OMPH Students & Professionals: The case of the research guide
Supporting OMPH Students & Professionals: The case of the research guideSupporting OMPH Students & Professionals: The case of the research guide
Supporting OMPH Students & Professionals: The case of the research guideEmily Ford
 
Reap What You Sow. A &!@*# [millennial] perspective on mentoring
Reap What You Sow. A &!@*# [millennial] perspective on mentoringReap What You Sow. A &!@*# [millennial] perspective on mentoring
Reap What You Sow. A &!@*# [millennial] perspective on mentoringEmily Ford
 
What do we do and why do we do it?
What do we do and why do we do it?What do we do and why do we do it?
What do we do and why do we do it?Emily Ford
 
What's in your filter bubble? Or, how has the internet censored you today?
What's in your filter bubble? Or, how has the internet censored you today?What's in your filter bubble? Or, how has the internet censored you today?
What's in your filter bubble? Or, how has the internet censored you today?Emily Ford
 
What Libraries can Learn from Kanye
What Libraries can Learn from KanyeWhat Libraries can Learn from Kanye
What Libraries can Learn from KanyeEmily Ford
 

Mehr von Emily Ford (14)

To Badge or Not? Towards an intersection of neoliberalism and information lit...
To Badge or Not? Towards an intersection of neoliberalism and information lit...To Badge or Not? Towards an intersection of neoliberalism and information lit...
To Badge or Not? Towards an intersection of neoliberalism and information lit...
 
Open Peer Review
Open Peer ReviewOpen Peer Review
Open Peer Review
 
ACRL 2015 Scholarship Breakfast
ACRL 2015 Scholarship BreakfastACRL 2015 Scholarship Breakfast
ACRL 2015 Scholarship Breakfast
 
Digital Badges: A Tool for Embedded Library Instruction
Digital Badges: A Tool for Embedded Library InstructionDigital Badges: A Tool for Embedded Library Instruction
Digital Badges: A Tool for Embedded Library Instruction
 
Badge it! Using Digital Badges to Certify Information Literacy Skills withing...
Badge it! Using Digital Badges to Certify Information Literacy Skills withing...Badge it! Using Digital Badges to Certify Information Literacy Skills withing...
Badge it! Using Digital Badges to Certify Information Literacy Skills withing...
 
Achievement Unlocked! A Digital Badge Primer & Workshop
Achievement Unlocked! A Digital Badge Primer & WorkshopAchievement Unlocked! A Digital Badge Primer & Workshop
Achievement Unlocked! A Digital Badge Primer & Workshop
 
Digital Badges in Libraries: Skills-based Instruction, Code-shifting, and Col...
Digital Badges in Libraries: Skills-based Instruction, Code-shifting, and Col...Digital Badges in Libraries: Skills-based Instruction, Code-shifting, and Col...
Digital Badges in Libraries: Skills-based Instruction, Code-shifting, and Col...
 
Open Peer Review: Directions and Challenges
Open Peer Review: Directions and ChallengesOpen Peer Review: Directions and Challenges
Open Peer Review: Directions and Challenges
 
Does Oregon Need a Librar* Revolution?
Does Oregon Need a Librar* Revolution?Does Oregon Need a Librar* Revolution?
Does Oregon Need a Librar* Revolution?
 
Supporting OMPH Students & Professionals: The case of the research guide
Supporting OMPH Students & Professionals: The case of the research guideSupporting OMPH Students & Professionals: The case of the research guide
Supporting OMPH Students & Professionals: The case of the research guide
 
Reap What You Sow. A &!@*# [millennial] perspective on mentoring
Reap What You Sow. A &!@*# [millennial] perspective on mentoringReap What You Sow. A &!@*# [millennial] perspective on mentoring
Reap What You Sow. A &!@*# [millennial] perspective on mentoring
 
What do we do and why do we do it?
What do we do and why do we do it?What do we do and why do we do it?
What do we do and why do we do it?
 
What's in your filter bubble? Or, how has the internet censored you today?
What's in your filter bubble? Or, how has the internet censored you today?What's in your filter bubble? Or, how has the internet censored you today?
What's in your filter bubble? Or, how has the internet censored you today?
 
What Libraries can Learn from Kanye
What Libraries can Learn from KanyeWhat Libraries can Learn from Kanye
What Libraries can Learn from Kanye
 

Kürzlich hochgeladen

Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 

Kürzlich hochgeladen (20)

Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 

From 3x5 to LCD: Considerations and How-tos for Online Card Sort Studies

  • 1. From 3x5 to LCD* Considerations and how-tos for conducting online card sort studies Emily Ford Urban & Public Affairs Librarian Portland State University forder@pdx.edu *This presentation is based on an article forthcoming in College & Research Libraries News titled - Is Digital Better than Analog? Considerations for Online Card Sort Studies
  • 2. What is a card sort study? http://www.flickr.com/photos/rosenfeldmedia/3343504093
  • 3. Open Card Sort http://www.flickr.com/photos/rosenfeldmedia/3344343842/
  • 4. Closed Card Sort http://www.flickr.com/photos/rosenfeldmedia/3344341528/
  • 5. 3x5 Card Sort Get IRB waiver or approval Make cards Recruit and schedule participants Observe talking out loud Ask questions/interview subjects Transfer analog data to digital Crunch data Make sense of data Plan and implement design/organization/changes
  • 6. 3x5 Card Sort Pro • Rich qualitative and quantitative data • Inexpensive • Complements data from other usability testing methods
  • 7. 3x5 Card Sort Con • Time intensive • Margins for error • Participant comfort/nerves
  • 8. The Mission • Create a LibGuide for OMPH students. • Share it between PSU and OHSU.
  • 9. The Partner Laura Zeigen User Experience Librarian Oregon Health & Science University Oregon Master of Public Health Student
  • 11. The Method + =
  • 16. LCD Card Sort Get IRB waiver or approval Make cards Recruit and schedule participants Observe talking out loud Ask questions/interview subjects Transfer analog data to digital Crunch data Make sense of data Plan and implement design/organization/changes
  • 17. LCD Card Sort Pro • Non-traditional students/subjects • Asynchronous • Automated outputs
  • 18. LCD Card Sort Con • No “think out loud” data • Potential interface issues with online product • Potential online product functionality issues • Tracking discarded cards
  • 19. 3x5 or LCD? Considerations: • How many cards are in our set? • What other methods are being used for this project? • What kind of users are our subjects? • Does the online product do what we need? • Do we want perfection or will good enough suffice?
  • 20. LCD Card Sort How-to: 1.Choose your software. 2.Design and set up your study 3.Collect data 4.Marvel at the results

Hinweis der Redaktion

  1. In a card sort study, subjects arrange a list of items or concepts (usually written on index cards) into logical organizational categories. Researchers typically encourage participants to “talk aloud” during the study to hear their thought process. The end result is a rich set of data in terms of how users organize information, but also how they think about doing it. In libs: web sites, infrastructure, research guides, RDA
  2. Good because you get ideas about how users will label stuff
  3. Good because you can figure out organizational structures of existing things
  4. The components of what it means to do a 3x5 card sort
  5. Lots of good data!Cheap to doWorks in conjunction with other kinds of usability testing, such as task oriented, etc.
  6. Data entryHow many cards x number of participants (Jakob Nielsen says 15 is ideal)Error margins, what if you drop the cards? What if you lose them?Strange environment with strangers looking on for participant
  7. Oregon MPH studentsDeceptively simple:WifiDifferent course of studyDifferent resources
  8. FamiliesJobsSchool at nightPart-timeDifferent school experiences/different needs
  9. Email input as to needs to understand between two libraries and research, then put that into cards and card sort, the rest was magic
  10. Integrated a short survey so we could collect demographic data from subjects; easy to use interface; 30 cards and ten users for free although Jakob Nielsen says we should have 15
  11. The interface looked like this, we also had demographic data from participants; auto shut off after 10 completed the study
  12. And it spit out a csv file for us, too!Dendograms, participant agreement, similarity matrix, and coded csv file
  13. This is what we made. Yes, we have two instances and have to email back and forth about changes
  14. 10 participants x 30 cards = 300 rows of data
  15. Comfort of their own homesDistance students
  16. Masking of label name inputsLoss of discarded cardsWhat if they don’t work in browsers or users have tech problems at home?
  17. How to decide if it’s right for you
  18. 4 easy steps