SlideShare ist ein Scribd-Unternehmen logo
1 von 28
Usability Testing

Ami Rotter
User Experience Design Team Leader
DG Mediamind

©2013 Digital Generation Inc. All rights reserved

1/13/2014

1
©2013 Digital Generation Inc. All rights reserved

1/13/2014

2
©2013 Digital Generation Inc. All rights reserved

1/13/2014

3
©2013 Digital Generation Inc. All rights reserved

1/13/2014

4
©2013 Digital Generation Inc. All rights reserved

1/13/2014

5
Don‟t Guess- Test!
• Find users

• Ask them to drill down to inner pages
• Ask them to get back to the homepage
• See what they do

©2013 Digital Generation Inc. All rights reserved

1/13/2014

6
Lean UX by Jeff Gothelf
©2013 Digital Generation Inc. All rights reserved

7
Lean UX by Jeff Gothelf
©2013 Digital Generation Inc. All rights reserved

8
©2013 Digital Generation Inc. All rights reserved

1/13/2014

9
Usability Testing Methods
• In person, face to face

• Remote
• Un-moderated

©2013 Digital Generation Inc. All rights reserved

1/13/2014

10
In-Person Usability Testing

©2013 Digital Generation Inc. All rights reserved

Photo: http://vator.tv/news/2011-05-23-guidelines-for-product-usability-testing
In-Person Usability Testing
Pros

Cons

See and hear the users reactions

You or participants have to travel to meet up

When you visit users you can see their
workspace

Sometimes recording the sessions maybe be
difficult
Limited number of team members could join

©2013 Digital Generation Inc. All rights reserved

1/13/2014

12
Photo: Luca Mascaro
The 10 Steps
1.

Plan the tasks and scenario, try it yourself or with a colleague

2.

Find users (preferably from you target audience).

3.

Introduce yourself.

4.

Explain you are looking for problems in a new product, that if they have trouble, it‟s the product‟s fault,
not theirs, that they shouldn‟t feel bad. Let them know it‟s OK to quit any time.

5.

Explain how to “think out loud”.

6.

Let them know you will not provide any help.

7.

Describe the tasks and introduce the product, ask if there are any questions, then begin the test.

8.

When they are done ask any additional questions you might have.

9.

Conclude test be thanking them and asking for questions.

10. Apply the results and test again.
Thinking Out Loud

https://www.usertesting.com
Thinking Out Loud
You might say to subject
•

We‟ve learned we get a lot more information from these observations if we ask people to “think out loud”

•

As you move through the application, please give a running commentary on what you are doing and
how you are feeling

•

For example: “Oh, I pressed the blue button because I thought it would take me to the restaurant page.
Now I‟m lost… Wait, let me try to get back…”

•

If you forgot to talk, I‟ll gently remind you
Live Usability Test: 2 tickets to see „Michael‟

1.

2 Tickets to see „Michael‟ in Tel Aviv, you want to sit together and the sooner the better.

2.

If you have any trouble, it‟s the product‟s fault, not yours, don‟t feel bad.

3.

Remember to “think out loud”.

©2013 Digital Generation Inc. All rights reserved

1/13/2014

16
Live Usability Test: Sell this Iphone5 on craigslist TLV

32 G. 1 year old, great condition- $500

©2013 Digital Generation Inc. All rights reserved

1/13/2014

17
Where can you find users?
• Start with anyone who is not on the team.
• Later on, you will want some people from your specific target audience.

• Existing users: beginners, experienced & power users.
• General Public: Craigslist, Universities, Rothschild Av.
• Use 3-6 subjects per round. Jacob Nielson says 5 user testing session
will cover 80% of major usability issues.

©2013 Digital Generation Inc. All rights reserved

Photo: http://www.flickr.com/photos/rosenfeldmedia/

19
Remote Usability Testing

Photo: http://www.flickr.com/photos/rosenfeldmedia/
©2013 Digital Generation Inc. All rights reserved

1/13/2014

20
Remote Usability Testing
Axure

©2013 Digital Generation Inc. All rights reserved

Go to Meeting

1/13/2014

21
Remote Usability Testing
Pros

Cons

Conduct the sessions from your office
with anyone anywhere anytime

Can’t see the user’s facial expressions

Any number of team members could
participate

Difficult technical problems might accrue

Can easily record the sessions

©2013 Digital Generation Inc. All rights reserved

1/13/2014

22
Un-moderated Usability Testing

©2013 Digital Generation Inc. All rights reserved

Photo: http://www.flickr.com/photos/rosenfeldmedia/
Un-moderated Usability Testing
• Usertesting.com demo
• Userlytics.com- demo
• Userzoom.com
• loop11.com

• Openhallway.com
• Easyusability.com

©2013 Digital Generation Inc. All rights reserved

24
Photo: Mario Carvajal
More Un-moderated Testing
• Usabilityhub.com (five second test)
• Verify app: Click Test Preference Test Results
• Usabilla.com

• Testing mobile apps: uxrecorder.com plunkapp.com/

©2013 Digital Generation Inc. All rights reserved

25
Photo: Verify app
Un-moderated Usability Testing
Pros

Cons

Users could do it whenever it’s
convenient for them

Can’t ask follow up questions

Have access to users who live anywhere
in the world

Sometimes you can’t hear the users think
out loud

Recorded sessions

Sometimes you can’t see the users
reactions

©2013 Digital Generation Inc. All rights reserved

1/13/2014

26
Why We Avoid Testing
• We forget.
• It takes a few days.

• Fear of criticism or not getting the feedbacks you want.
• Fear of having to do complex or complete redesigns or code over.
• Instead, keep it simple:





Don‟t agonize over best choice. Try them all!
Use low-fidelity prototypes
Correct earlier problems before testing more people.
Whole process takes half the time of the old way.

• You will come to fear NOT testing

©2013 Digital Generation Inc. All rights reserved
Nordstrom Innovation Lab: Sunglass iPad App Case Study
Thanks. Your turn
Ami.Rotter@gmail.com

©2013 Digital Generation Inc. All rights reserved

1/13/2014

29

Weitere ähnliche Inhalte

Kürzlich hochgeladen

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Kürzlich hochgeladen (20)

Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 

Empfohlen

How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
ThinkNow
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
 

Empfohlen (20)

How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 

Usability Testing

  • 1. Usability Testing Ami Rotter User Experience Design Team Leader DG Mediamind ©2013 Digital Generation Inc. All rights reserved 1/13/2014 1
  • 2. ©2013 Digital Generation Inc. All rights reserved 1/13/2014 2
  • 3. ©2013 Digital Generation Inc. All rights reserved 1/13/2014 3
  • 4. ©2013 Digital Generation Inc. All rights reserved 1/13/2014 4
  • 5. ©2013 Digital Generation Inc. All rights reserved 1/13/2014 5
  • 6. Don‟t Guess- Test! • Find users • Ask them to drill down to inner pages • Ask them to get back to the homepage • See what they do ©2013 Digital Generation Inc. All rights reserved 1/13/2014 6
  • 7. Lean UX by Jeff Gothelf ©2013 Digital Generation Inc. All rights reserved 7
  • 8. Lean UX by Jeff Gothelf ©2013 Digital Generation Inc. All rights reserved 8
  • 9. ©2013 Digital Generation Inc. All rights reserved 1/13/2014 9
  • 10. Usability Testing Methods • In person, face to face • Remote • Un-moderated ©2013 Digital Generation Inc. All rights reserved 1/13/2014 10
  • 11. In-Person Usability Testing ©2013 Digital Generation Inc. All rights reserved Photo: http://vator.tv/news/2011-05-23-guidelines-for-product-usability-testing
  • 12. In-Person Usability Testing Pros Cons See and hear the users reactions You or participants have to travel to meet up When you visit users you can see their workspace Sometimes recording the sessions maybe be difficult Limited number of team members could join ©2013 Digital Generation Inc. All rights reserved 1/13/2014 12 Photo: Luca Mascaro
  • 13. The 10 Steps 1. Plan the tasks and scenario, try it yourself or with a colleague 2. Find users (preferably from you target audience). 3. Introduce yourself. 4. Explain you are looking for problems in a new product, that if they have trouble, it‟s the product‟s fault, not theirs, that they shouldn‟t feel bad. Let them know it‟s OK to quit any time. 5. Explain how to “think out loud”. 6. Let them know you will not provide any help. 7. Describe the tasks and introduce the product, ask if there are any questions, then begin the test. 8. When they are done ask any additional questions you might have. 9. Conclude test be thanking them and asking for questions. 10. Apply the results and test again.
  • 15. Thinking Out Loud You might say to subject • We‟ve learned we get a lot more information from these observations if we ask people to “think out loud” • As you move through the application, please give a running commentary on what you are doing and how you are feeling • For example: “Oh, I pressed the blue button because I thought it would take me to the restaurant page. Now I‟m lost… Wait, let me try to get back…” • If you forgot to talk, I‟ll gently remind you
  • 16. Live Usability Test: 2 tickets to see „Michael‟ 1. 2 Tickets to see „Michael‟ in Tel Aviv, you want to sit together and the sooner the better. 2. If you have any trouble, it‟s the product‟s fault, not yours, don‟t feel bad. 3. Remember to “think out loud”. ©2013 Digital Generation Inc. All rights reserved 1/13/2014 16
  • 17. Live Usability Test: Sell this Iphone5 on craigslist TLV 32 G. 1 year old, great condition- $500 ©2013 Digital Generation Inc. All rights reserved 1/13/2014 17
  • 18. Where can you find users? • Start with anyone who is not on the team. • Later on, you will want some people from your specific target audience. • Existing users: beginners, experienced & power users. • General Public: Craigslist, Universities, Rothschild Av. • Use 3-6 subjects per round. Jacob Nielson says 5 user testing session will cover 80% of major usability issues. ©2013 Digital Generation Inc. All rights reserved Photo: http://www.flickr.com/photos/rosenfeldmedia/ 19
  • 19. Remote Usability Testing Photo: http://www.flickr.com/photos/rosenfeldmedia/ ©2013 Digital Generation Inc. All rights reserved 1/13/2014 20
  • 20. Remote Usability Testing Axure ©2013 Digital Generation Inc. All rights reserved Go to Meeting 1/13/2014 21
  • 21. Remote Usability Testing Pros Cons Conduct the sessions from your office with anyone anywhere anytime Can’t see the user’s facial expressions Any number of team members could participate Difficult technical problems might accrue Can easily record the sessions ©2013 Digital Generation Inc. All rights reserved 1/13/2014 22
  • 22. Un-moderated Usability Testing ©2013 Digital Generation Inc. All rights reserved Photo: http://www.flickr.com/photos/rosenfeldmedia/
  • 23. Un-moderated Usability Testing • Usertesting.com demo • Userlytics.com- demo • Userzoom.com • loop11.com • Openhallway.com • Easyusability.com ©2013 Digital Generation Inc. All rights reserved 24 Photo: Mario Carvajal
  • 24. More Un-moderated Testing • Usabilityhub.com (five second test) • Verify app: Click Test Preference Test Results • Usabilla.com • Testing mobile apps: uxrecorder.com plunkapp.com/ ©2013 Digital Generation Inc. All rights reserved 25 Photo: Verify app
  • 25. Un-moderated Usability Testing Pros Cons Users could do it whenever it’s convenient for them Can’t ask follow up questions Have access to users who live anywhere in the world Sometimes you can’t hear the users think out loud Recorded sessions Sometimes you can’t see the users reactions ©2013 Digital Generation Inc. All rights reserved 1/13/2014 26
  • 26. Why We Avoid Testing • We forget. • It takes a few days. • Fear of criticism or not getting the feedbacks you want. • Fear of having to do complex or complete redesigns or code over. • Instead, keep it simple:     Don‟t agonize over best choice. Try them all! Use low-fidelity prototypes Correct earlier problems before testing more people. Whole process takes half the time of the old way. • You will come to fear NOT testing ©2013 Digital Generation Inc. All rights reserved
  • 27. Nordstrom Innovation Lab: Sunglass iPad App Case Study
  • 28. Thanks. Your turn Ami.Rotter@gmail.com ©2013 Digital Generation Inc. All rights reserved 1/13/2014 29