SlideShare a Scribd company logo
1 of 16
Download to read offline
Analysing the EBI User Experience29.07.20161
Why didn’t
you click on
the obvious
one ?
Jenny Cham
User Experience (UX) Analyst
So why did you
click there ?
Analysing the EBI User Experience29.07.2016
17 sites
>70 scientists
May to Oct
Example of usability testing
3
Design changes
to interface
design
Judgment calls
Group decision
Usability
testing
Analysis
Benefits
Obvious
Discover unknown/unexpected problems
Video footage as ‘proof’/objectivity (dilemmas get sorted)
Cheap and quick, fix early e.g. during agile
29.07.20164
Not so obvious…
Easy to use software = warm fuzzy feelings
Awareness of the new software with participants
Which features are not necessary?
Records progress
Analysing the EBI User Experience
Don’t call it testing
Get their boss or local
contact person to send
named invite around
Incentives + lunch
Formal and informal –
credibility but not too
daunting
Try to recruit for your personas
– use a ‘screener’
29.07.20166
6
Persona: Debra, Drug Discovery
What is the reaction chemistry?
Are there any known genes? etc…
Is he is a
‘Debra’?
(SurveyMonkey.net)
Plenty of buffer
time esp. if a
website3 or so sessions
is plenty/day
Ideally 30 min
turnaround for
analysis time
Schmooze with
management, let
them have a go too
Go to the
users’ site
Analysing the EBI User Experience
29.07.201
8
Get the user to
read ALOUD
Pick scenarios as
relevant as possible:
pre-test screenerSeveral to do
same one if poss
Love thy
user
We are not
testing you
Outline
the plan
clearly
You can
leave at any
timeThere is no
such thing
as ‘wrong’
We really
value
your input
Do you
have any
questions?
No, we won’t
put the video
on YouTube
Analysing the EBI User Experience
29.07.201
10
Supersticky
post-its,
different
colours
Decent wall
space for
analysis
Nice drinks
Laptop height & set
up mouse for
left/right handed
Facilitator – say as
little as you can
(cringe)
Consent form
for video
Quiet room
Grid to fill
in notes
Get user’s
background info on
tape (1st few mins)
http://silverbackapp.com/
Takes preparation
- each screen
layout ready
Have blanks for
‘under
construction’/
user sketches
Avoid users with
a software dev.
background
End the test early
if it’s going no
where
The user says… Over to you….(think therapist!)
I want to find the contact
details so should I go here?
Where do you think it
should go?
…(silence)… What are you thinking
now?
Oooh…I didn’t expect
that
What did you expect to
happen?
Obvious
May need to sell the idea to management – suggest doing it
‘guerrilla’ style anyway
Dependent on the sample, not statistically significant
Doesn’t tell you how to fix issues
Not so obvious
Developers think you are giving them extra work
You will want to test everything!
Drawbacks/
challenges
Analysing the EBI User Experience
29.07.201
15
Usability testing
would be great for
our project
And ours…
Now have a go yourself…
29.07.201
16
Thanks for listening The end

More Related Content

Viewers also liked

A UX Journey into the World of Early Drug Discovery
A UX Journey into the World of Early Drug DiscoveryA UX Journey into the World of Early Drug Discovery
A UX Journey into the World of Early Drug Discovery
Jennifer Cham
 
Good Design Faster at UX Sofia
Good Design Faster at UX SofiaGood Design Faster at UX Sofia
Good Design Faster at UX Sofia
Peter Boersma
 

Viewers also liked (14)

Are we burying our heads in the sand? Exploring issues around intellectual pr...
Are we burying our heads in the sand? Exploring issues around intellectual pr...Are we burying our heads in the sand? Exploring issues around intellectual pr...
Are we burying our heads in the sand? Exploring issues around intellectual pr...
 
Designing with the user in mind: how user-centred design (UCD) can work for ...
Designing with the user in mind: how user-centred design (UCD) can work for ...Designing with the user in mind: how user-centred design (UCD) can work for ...
Designing with the user in mind: how user-centred design (UCD) can work for ...
 
User Experience at the European Bioinformatics Institute
User Experience at the European Bioinformatics Institute User Experience at the European Bioinformatics Institute
User Experience at the European Bioinformatics Institute
 
A Survival Guide for Complex UX
A Survival Guide for Complex UXA Survival Guide for Complex UX
A Survival Guide for Complex UX
 
A UX Journey into the World of Early Drug Discovery
A UX Journey into the World of Early Drug DiscoveryA UX Journey into the World of Early Drug Discovery
A UX Journey into the World of Early Drug Discovery
 
Tips for Workshop Facilitation
Tips for Workshop FacilitationTips for Workshop Facilitation
Tips for Workshop Facilitation
 
Using sketching to emphasise and elaborate on HCI research
Using sketching to emphasise and elaborate on HCI researchUsing sketching to emphasise and elaborate on HCI research
Using sketching to emphasise and elaborate on HCI research
 
Good Design Faster at UX Sofia
Good Design Faster at UX SofiaGood Design Faster at UX Sofia
Good Design Faster at UX Sofia
 
Sketching workshop for Google London
Sketching workshop for Google LondonSketching workshop for Google London
Sketching workshop for Google London
 
Sketching & Prototyping UX (starting with stories)
Sketching & Prototyping UX (starting with stories)Sketching & Prototyping UX (starting with stories)
Sketching & Prototyping UX (starting with stories)
 
Introduction to Storyboarding for User Experience Design
Introduction to Storyboarding for User Experience DesignIntroduction to Storyboarding for User Experience Design
Introduction to Storyboarding for User Experience Design
 
Welcome to User Experience (UX) Design at EMBL-EBI
Welcome to User Experience (UX) Design at EMBL-EBI Welcome to User Experience (UX) Design at EMBL-EBI
Welcome to User Experience (UX) Design at EMBL-EBI
 
Sketching Interfaces Workshop - Interactions12 (Dublin)
Sketching Interfaces Workshop - Interactions12 (Dublin)Sketching Interfaces Workshop - Interactions12 (Dublin)
Sketching Interfaces Workshop - Interactions12 (Dublin)
 
Users' Story: UX Storyboarding
Users' Story: UX StoryboardingUsers' Story: UX Storyboarding
Users' Story: UX Storyboarding
 

Similar to How to run 1-to-1 usability testing (with life scientists)

Usability engineeringHow to conduct User testing Week 4.docx
Usability engineeringHow to conduct User testing Week 4.docxUsability engineeringHow to conduct User testing Week 4.docx
Usability engineeringHow to conduct User testing Week 4.docx
jessiehampson
 
Informing SoTL using playtesting techniques
Informing SoTL using playtesting techniquesInforming SoTL using playtesting techniques
Informing SoTL using playtesting techniques
Katrin Becker
 
User Research for Startups
User Research for StartupsUser Research for Startups
User Research for Startups
Diane Loviglio
 
Conducting User Research for Startups - part 2
Conducting User Research for Startups - part 2Conducting User Research for Startups - part 2
Conducting User Research for Startups - part 2
Diane Loviglio
 

Similar to How to run 1-to-1 usability testing (with life scientists) (20)

Usability Testing Foundation
Usability Testing FoundationUsability Testing Foundation
Usability Testing Foundation
 
User Experience Basics for Product Management
User Experience Basics for Product ManagementUser Experience Basics for Product Management
User Experience Basics for Product Management
 
Voice usability testing with WOZ methodology - UX SCOT 2019
Voice usability testing with WOZ methodology - UX SCOT 2019Voice usability testing with WOZ methodology - UX SCOT 2019
Voice usability testing with WOZ methodology - UX SCOT 2019
 
Ux scot voice usability testing with woz - ar and sf - june 2019
Ux scot   voice usability testing with woz - ar and sf  - june 2019Ux scot   voice usability testing with woz - ar and sf  - june 2019
Ux scot voice usability testing with woz - ar and sf - june 2019
 
Podcamp11: DIY Usability Testing
Podcamp11: DIY Usability TestingPodcamp11: DIY Usability Testing
Podcamp11: DIY Usability Testing
 
User Experience 6: Qualitative Methods, Playtesting and Interviews
User Experience 6: Qualitative Methods, Playtesting and InterviewsUser Experience 6: Qualitative Methods, Playtesting and Interviews
User Experience 6: Qualitative Methods, Playtesting and Interviews
 
Questioning Picture-in-Picture: Why Showing the Participant May Not Be Such a...
Questioning Picture-in-Picture: Why Showing the Participant May Not Be Such a...Questioning Picture-in-Picture: Why Showing the Participant May Not Be Such a...
Questioning Picture-in-Picture: Why Showing the Participant May Not Be Such a...
 
Usability engineeringHow to conduct User testing Week 4.docx
Usability engineeringHow to conduct User testing Week 4.docxUsability engineeringHow to conduct User testing Week 4.docx
Usability engineeringHow to conduct User testing Week 4.docx
 
Usability Testing On A Digital Product
Usability Testing On A Digital ProductUsability Testing On A Digital Product
Usability Testing On A Digital Product
 
Hacking UX: Product Design Thinking for Techies
Hacking UX: Product Design Thinking for TechiesHacking UX: Product Design Thinking for Techies
Hacking UX: Product Design Thinking for Techies
 
Workshop user checks_3jun2015
Workshop user checks_3jun2015Workshop user checks_3jun2015
Workshop user checks_3jun2015
 
Informing SoTL using playtesting techniques
Informing SoTL using playtesting techniquesInforming SoTL using playtesting techniques
Informing SoTL using playtesting techniques
 
User Research for Startups
User Research for StartupsUser Research for Startups
User Research for Startups
 
Intro to Games User Research Methods - March 2013
Intro to Games User Research Methods - March 2013Intro to Games User Research Methods - March 2013
Intro to Games User Research Methods - March 2013
 
UX camp ams-2015- User Checks
UX camp ams-2015- User ChecksUX camp ams-2015- User Checks
UX camp ams-2015- User Checks
 
Uwe usability evaluation
Uwe usability evaluationUwe usability evaluation
Uwe usability evaluation
 
Conducting User Research for Startups - part 2
Conducting User Research for Startups - part 2Conducting User Research for Startups - part 2
Conducting User Research for Startups - part 2
 
Make Your Games Play, Teach, and Socialize Better: Usability & Playability Te...
Make Your Games Play, Teach, and Socialize Better: Usability & Playability Te...Make Your Games Play, Teach, and Socialize Better: Usability & Playability Te...
Make Your Games Play, Teach, and Socialize Better: Usability & Playability Te...
 
Interviewing Users: Spinning Data Into Gold
Interviewing Users: Spinning Data Into GoldInterviewing Users: Spinning Data Into Gold
Interviewing Users: Spinning Data Into Gold
 
SXSW - Diving Deep: Best Practices For Interviewing Users
SXSW - Diving Deep: Best Practices For Interviewing UsersSXSW - Diving Deep: Best Practices For Interviewing Users
SXSW - Diving Deep: Best Practices For Interviewing Users
 

Recently uploaded

Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
gindu3009
 
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Sérgio Sacani
 
Disentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTDisentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOST
Sérgio Sacani
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
PirithiRaju
 
GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...
GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...
GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...
Lokesh Kothari
 
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
PirithiRaju
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disks
Sérgio Sacani
 

Recently uploaded (20)

Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
 
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
 
Disentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTDisentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOST
 
Zoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdfZoology 4th semester series (krishna).pdf
Zoology 4th semester series (krishna).pdf
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
 
Animal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptxAnimal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptx
 
GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...
GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...
GUIDELINES ON SIMILAR BIOLOGICS Regulatory Requirements for Marketing Authori...
 
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
Vip profile Call Girls In Lonavala 9748763073 For Genuine Sex Service At Just...
 
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bNightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
 
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
 
Botany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfBotany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdf
 
Forensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdfForensic Biology & Its biological significance.pdf
Forensic Biology & Its biological significance.pdf
 
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)
 
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdfPests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
Pests of cotton_Borer_Pests_Binomics_Dr.UPR.pdf
 
SAMASTIPUR CALL GIRL 7857803690 LOW PRICE ESCORT SERVICE
SAMASTIPUR CALL GIRL 7857803690  LOW PRICE  ESCORT SERVICESAMASTIPUR CALL GIRL 7857803690  LOW PRICE  ESCORT SERVICE
SAMASTIPUR CALL GIRL 7857803690 LOW PRICE ESCORT SERVICE
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disks
 
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCRStunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
 
Nanoparticles synthesis and characterization​ ​
Nanoparticles synthesis and characterization​  ​Nanoparticles synthesis and characterization​  ​
Nanoparticles synthesis and characterization​ ​
 
Botany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdfBotany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdf
 

How to run 1-to-1 usability testing (with life scientists)

  • 1. Analysing the EBI User Experience29.07.20161 Why didn’t you click on the obvious one ? Jenny Cham User Experience (UX) Analyst So why did you click there ?
  • 2. Analysing the EBI User Experience29.07.2016 17 sites >70 scientists May to Oct Example of usability testing
  • 3. 3 Design changes to interface design Judgment calls Group decision Usability testing Analysis
  • 4. Benefits Obvious Discover unknown/unexpected problems Video footage as ‘proof’/objectivity (dilemmas get sorted) Cheap and quick, fix early e.g. during agile 29.07.20164 Not so obvious… Easy to use software = warm fuzzy feelings Awareness of the new software with participants Which features are not necessary? Records progress
  • 5. Analysing the EBI User Experience Don’t call it testing Get their boss or local contact person to send named invite around Incentives + lunch Formal and informal – credibility but not too daunting Try to recruit for your personas – use a ‘screener’
  • 6. 29.07.20166 6 Persona: Debra, Drug Discovery What is the reaction chemistry? Are there any known genes? etc… Is he is a ‘Debra’? (SurveyMonkey.net)
  • 7. Plenty of buffer time esp. if a website3 or so sessions is plenty/day Ideally 30 min turnaround for analysis time Schmooze with management, let them have a go too Go to the users’ site
  • 8. Analysing the EBI User Experience 29.07.201 8 Get the user to read ALOUD Pick scenarios as relevant as possible: pre-test screenerSeveral to do same one if poss
  • 9. Love thy user We are not testing you Outline the plan clearly You can leave at any timeThere is no such thing as ‘wrong’ We really value your input Do you have any questions? No, we won’t put the video on YouTube
  • 10. Analysing the EBI User Experience 29.07.201 10 Supersticky post-its, different colours Decent wall space for analysis Nice drinks Laptop height & set up mouse for left/right handed Facilitator – say as little as you can (cringe) Consent form for video Quiet room Grid to fill in notes Get user’s background info on tape (1st few mins)
  • 12. Takes preparation - each screen layout ready Have blanks for ‘under construction’/ user sketches Avoid users with a software dev. background End the test early if it’s going no where
  • 13. The user says… Over to you….(think therapist!) I want to find the contact details so should I go here? Where do you think it should go? …(silence)… What are you thinking now? Oooh…I didn’t expect that What did you expect to happen?
  • 14. Obvious May need to sell the idea to management – suggest doing it ‘guerrilla’ style anyway Dependent on the sample, not statistically significant Doesn’t tell you how to fix issues Not so obvious Developers think you are giving them extra work You will want to test everything! Drawbacks/ challenges
  • 15. Analysing the EBI User Experience 29.07.201 15 Usability testing would be great for our project And ours… Now have a go yourself…