SlideShare ist ein Scribd-Unternehmen logo
1 von 16
Downloaden Sie, um offline zu lesen
Conducting User/Usability Studies with Remote Participants,[object Object],Uma Murthy,[object Object],http://umurthy.com,[object Object],@umurthy,[object Object],InfoCamp Seattle,[object Object],9 October, 2011,[object Object]
We’ll talk about …,[object Object],My remote user study experience,[object Object],Discussion,[object Object]
A qualitative study of subimage and SuperIDR use,[object Object],How do people use subimages in fish identification?,[object Object],Characteristics of subimages and related information,[object Object],Contexts and strategies of working with subimages in fish identification,[object Object],How does SuperIDR support that use?,[object Object],3,[object Object]
Study procedures,[object Object],- Study overview,[object Object],- Informed consent,[object Object],- SuperIDR setup,[object Object],- SuperIDR training,[object Object],- Pre-study interview,[object Object],SuperIDR use in work/study (diary),[object Object],Unknown specimen identification tasks,[object Object],SuperIDR use in work/study (diary),[object Object],Unknown specimen identification tasks,[object Object],SuperIDR use in work/study (diary),[object Object],Post-study interview,[object Object],4,[object Object]
Study procedures,[object Object],- Study overview,[object Object],- Informed consent,[object Object],- SuperIDR setup,[object Object],- SuperIDR training,[object Object],- Pre-study interview,[object Object],SuperIDR use in work/study (diary),[object Object],Unknown specimen identification tasks,[object Object],SuperIDR use in work/study (diary),[object Object],Unknown specimen identification tasks,[object Object],SuperIDR use in work/study (diary),[object Object],Post-study interview,[object Object],5,[object Object]
Qualitative study procedures,[object Object],- Study overview,[object Object],- Informed consent,[object Object],- SuperIDR setup,[object Object],- SuperIDR training,[object Object],- Pre-study interview,[object Object],SuperIDR use in work/study (diary),[object Object],Unknown specimen identification tasks,[object Object],SuperIDR use in work/study (diary),[object Object],Unknown specimen identification tasks,[object Object],SuperIDR use in work/study (diary),[object Object],Post-study interview,[object Object],6,[object Object]
Qualitative study procedures,[object Object],- Study overview,[object Object],- Informed consent,[object Object],- SuperIDR setup,[object Object],- SuperIDR training,[object Object],- Pre-study interview,[object Object],SuperIDR use in work/study (diary),[object Object],Unknown specimen identification tasks,[object Object],SuperIDR use in work/study (diary),[object Object],Unknown specimen identification tasks,[object Object],SuperIDR use in work/study (diary),[object Object],Post-study interview,[object Object],7,[object Object]
Study setup,[object Object],8,[object Object]
Data analysis was informed by Grounded Theory	,[object Object],9,[object Object],Interview responses,[object Object],Screen captures & spoken thoughts,[object Object],Diary entries,[object Object],SuperIDR logs,[object Object],Species ID materials,[object Object],Species ID responses,[object Object],Database image,[object Object]
Murthy, U., Tzy Li, Lin, Hallerman, E., Fox, E. A., Pérez-Quiñones, M. A., Delcambre, L. M., and Torres, R. da S. Use of Subimages in Fish Species Identification: A Qualitative Study. In Proceedings of the 11th ACM/IEEE Joint Conference on Digital Libraries, Ottawa, 2011.,[object Object]
Discussion notes,[object Object],The ever-evolving notes document is on Googls docs. Email me if you would like to contribute to it.,[object Object]
Challenges,[object Object],Finding participants, who can give time. Eg. It is harder to recruit faculty than grad students than undergrads,[object Object],Hard to get the attention of transient users, who visit your site briefly<,[object Object],Hard to work with participants who may not be tech savvy,[object Object],Real-time recruitment of users (while they use technology) and having an interaction at the same time can be challenging,[object Object]
Ideas to enable studies,[object Object],Grab a user's attention to recruit them,[object Object],Recruit people who use that or similar technology as part of their job,[object Object],Have a help/FAQ page for users to refer to,[object Object],Have Live meeting/Skype link on the side (not as a pop-up),[object Object],Make connecting with them personal - use your blog, twitter, linkedIn,[object Object],Ask users what features to build,[object Object]
Remote usability/user studies tool recommendations,[object Object],Morae – capture user data remotely,[object Object],Adobe Connect, GoToMeeting: screen share/capture,[object Object],Skype: screen sharing,[object Object],QuickTime: screen capture,[object Object],QuickTime: Audio capture as a separate file,[object Object],Camtasia facial/screen capture,[object Object],meet.webex.com share screen, video camera,[object Object],WebEx save files to computer or server,[object Object],Phone to PC audio adapter,[object Object],Google Docs - share documentation, scripts, and other information,[object Object],Mechanical Turk - do repeatable, simple, tasks,[object Object],Twitter - connect with participants,[object Object],TeamViewer - remote screen sharing and presentation tool,[object Object]
Resources,[object Object],http://www.slideshare.net/EdChi/tutorial-on-using-amazon-mechanical-turk-mturk-for-hci-research,[object Object]
Upcoming panel at Grace Hopper Conference,[object Object],http://umurthy.com/research/ghc2011-panel/,[object Object]

Weitere ähnliche Inhalte

Ähnlich wie User studies and usability testing with remote participants

Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Carol Smith
 
International Business User Research: Methods and Tools
International Business User Research: Methods and ToolsInternational Business User Research: Methods and Tools
International Business User Research: Methods and ToolsYong Zhang
 
User Research Techniques by Vikram Rao, RSA
User Research Techniques by Vikram Rao, RSAUser Research Techniques by Vikram Rao, RSA
User Research Techniques by Vikram Rao, RSASTC India UX SIG
 
Learning Hands-on and by Trial & Error with Data Curation Profiles
Learning Hands-on and by Trial & Error with Data Curation ProfilesLearning Hands-on and by Trial & Error with Data Curation Profiles
Learning Hands-on and by Trial & Error with Data Curation ProfilesDigCurV
 
H E D C Research Seminar Presentation
H E D C  Research  Seminar  PresentationH E D C  Research  Seminar  Presentation
H E D C Research Seminar PresentationUniversity of Otago
 
Learning From Users in their Natural Habitat -
Learning From Users in their Natural Habitat - Learning From Users in their Natural Habitat -
Learning From Users in their Natural Habitat - UXPA International
 
Agile User Studies (Agile & Beyond 2012)
Agile User Studies (Agile & Beyond 2012)Agile User Studies (Agile & Beyond 2012)
Agile User Studies (Agile & Beyond 2012)Derek Poppink CXA CUA
 
TLF2012 Engaging microblogging in lectures and large classes
TLF2012 Engaging microblogging in lectures and large classesTLF2012 Engaging microblogging in lectures and large classes
TLF2012 Engaging microblogging in lectures and large classesKim Flintoff
 
Designing to save lives: Government technical documentation
Designing  to save  lives: Government technical documentation Designing  to save  lives: Government technical documentation
Designing to save lives: Government technical documentation Laurian Vega
 
Elder Abuse Research
Elder Abuse ResearchElder Abuse Research
Elder Abuse ResearchLaura Torres
 
What Users Want
What Users WantWhat Users Want
What Users Wanthollyster
 
Planning and conducting remote usability studies for accessibility - Rosenfel...
Planning and conducting remote usability studies for accessibility - Rosenfel...Planning and conducting remote usability studies for accessibility - Rosenfel...
Planning and conducting remote usability studies for accessibility - Rosenfel...Rebecca Topps
 
Users, Usability & User Experience - at PodCamp Cleveland 2011
Users, Usability & User Experience - at PodCamp Cleveland 2011Users, Usability & User Experience - at PodCamp Cleveland 2011
Users, Usability & User Experience - at PodCamp Cleveland 2011Carol Smith
 
Conole Prie Workshop
Conole Prie WorkshopConole Prie Workshop
Conole Prie Workshopgrainne
 
Qualitative Research Methods in UX design - Markus Heberlein
Qualitative Research Methods in UX design - Markus HeberleinQualitative Research Methods in UX design - Markus Heberlein
Qualitative Research Methods in UX design - Markus Heberleinuxtalktokyo
 
Job Shadow
Job ShadowJob Shadow
Job ShadowKerncomm
 
Usability and Accessibility Have a Conversation: How Accessibility and UI/UX ...
Usability and Accessibility Have a Conversation: How Accessibility and UI/UX ...Usability and Accessibility Have a Conversation: How Accessibility and UI/UX ...
Usability and Accessibility Have a Conversation: How Accessibility and UI/UX ...3Play Media
 
Going Mobile
Going MobileGoing Mobile
Going MobileLTatUoN
 
Faster Usability Testing in an Agile World presented at Agile2011
Faster Usability Testing in an Agile World presented at Agile2011Faster Usability Testing in an Agile World presented at Agile2011
Faster Usability Testing in an Agile World presented at Agile2011Carol Smith
 

Ähnlich wie User studies and usability testing with remote participants (20)

Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
 
International Business User Research: Methods and Tools
International Business User Research: Methods and ToolsInternational Business User Research: Methods and Tools
International Business User Research: Methods and Tools
 
User Research Techniques by Vikram Rao, RSA
User Research Techniques by Vikram Rao, RSAUser Research Techniques by Vikram Rao, RSA
User Research Techniques by Vikram Rao, RSA
 
Learning Hands-on and by Trial & Error with Data Curation Profiles
Learning Hands-on and by Trial & Error with Data Curation ProfilesLearning Hands-on and by Trial & Error with Data Curation Profiles
Learning Hands-on and by Trial & Error with Data Curation Profiles
 
H E D C Research Seminar Presentation
H E D C  Research  Seminar  PresentationH E D C  Research  Seminar  Presentation
H E D C Research Seminar Presentation
 
Learning From Users in their Natural Habitat -
Learning From Users in their Natural Habitat - Learning From Users in their Natural Habitat -
Learning From Users in their Natural Habitat -
 
Agile User Studies (Agile & Beyond 2012)
Agile User Studies (Agile & Beyond 2012)Agile User Studies (Agile & Beyond 2012)
Agile User Studies (Agile & Beyond 2012)
 
TLF2012 Engaging microblogging in lectures and large classes
TLF2012 Engaging microblogging in lectures and large classesTLF2012 Engaging microblogging in lectures and large classes
TLF2012 Engaging microblogging in lectures and large classes
 
Designing to save lives: Government technical documentation
Designing  to save  lives: Government technical documentation Designing  to save  lives: Government technical documentation
Designing to save lives: Government technical documentation
 
Elder Abuse Research
Elder Abuse ResearchElder Abuse Research
Elder Abuse Research
 
What Users Want
What Users WantWhat Users Want
What Users Want
 
Planning and conducting remote usability studies for accessibility - Rosenfel...
Planning and conducting remote usability studies for accessibility - Rosenfel...Planning and conducting remote usability studies for accessibility - Rosenfel...
Planning and conducting remote usability studies for accessibility - Rosenfel...
 
Users, Usability & User Experience - at PodCamp Cleveland 2011
Users, Usability & User Experience - at PodCamp Cleveland 2011Users, Usability & User Experience - at PodCamp Cleveland 2011
Users, Usability & User Experience - at PodCamp Cleveland 2011
 
Conole Prie Workshop
Conole Prie WorkshopConole Prie Workshop
Conole Prie Workshop
 
Qualitative Research Methods in UX design - Markus Heberlein
Qualitative Research Methods in UX design - Markus HeberleinQualitative Research Methods in UX design - Markus Heberlein
Qualitative Research Methods in UX design - Markus Heberlein
 
Job Shadow
Job ShadowJob Shadow
Job Shadow
 
Job Shadow
Job ShadowJob Shadow
Job Shadow
 
Usability and Accessibility Have a Conversation: How Accessibility and UI/UX ...
Usability and Accessibility Have a Conversation: How Accessibility and UI/UX ...Usability and Accessibility Have a Conversation: How Accessibility and UI/UX ...
Usability and Accessibility Have a Conversation: How Accessibility and UI/UX ...
 
Going Mobile
Going MobileGoing Mobile
Going Mobile
 
Faster Usability Testing in an Agile World presented at Agile2011
Faster Usability Testing in an Agile World presented at Agile2011Faster Usability Testing in an Agile World presented at Agile2011
Faster Usability Testing in an Agile World presented at Agile2011
 

Kürzlich hochgeladen

Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Brian Pichman
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...Aggregage
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarPrecisely
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 

Kürzlich hochgeladen (20)

20150722 - AGV
20150722 - AGV20150722 - AGV
20150722 - AGV
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
201610817 - edge part1
201610817 - edge part1201610817 - edge part1
201610817 - edge part1
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 

User studies and usability testing with remote participants

  • 1.
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.

Hinweis der Redaktion

  1. Our study spanned over three weeks.At the beginning of the study, for each participant, we provided an overview of study, got their consent, setup SuperIDR on their personal computers &lt;CLICK&gt; and trained them to use it, including having them complete a set of training tasks.Then, we conducted a pre-study interview, asking participants about their fish ID practices and their fish ID background and experience.