SlideShare ist ein Scribd-Unternehmen logo
1 von 42
Downloaden Sie, um offline zu lesen
Lean Startup Baltimore

Usability Testing as Validation


Amy Rubino                 November 26, 2012
@Amy_Rubino
About Me
                                                     Amy Rubino
                                                     User Experience Consultant, Systems
                                                     Alliance

                                                     •    15 years of design experience as a
                                                          print and web designer, information
                                                          architect and user experience
                                                          advocate.

 arubino@systemsalliance.com                         •    Worked with universities,
 linkedin.com/pub/amy-rubino/13/837/31b                   corporations and non-profits.
 @amy_rubino

                                                     •    Master’s degree in Interaction Design
                                                          and Information Architecture.


                   Usability Testing as Validation                                                2
What We’ll Cover
Usability
    
   Users
    
   Learn About Users
    
   Learn From Users
Usability Testing
    
   How to Do It
    
   What You Can Test
    
   Why You Should Do It
Usability Testing and Lean Startup
Demo
Resources
                                                  Photo credit: Amy Rubino




                Usability Testing as Validation                              3
Usability




            Photo credit: http://www.flickr.com/photos/reticulating   4
User Experience Honeycomb




                                          Photo credit: http://semanticstudios.com/


        Usability Testing as Validation                                               5
Usability

    Creating products that are easy to use
      
   Require less mental effort to use
      
   Decrease frequency of mistakes and mistakes are less disastrous
      
   Can be used to do more or do it faster
      
   Can be figured out quicker




                   Usability Testing as Validation                          6
Usability




                                              Photo credit: http://impossibleobjects.com


            Usability Testing as Validation                                                7
Usability

    Based on human behavior
    Focus on people who will use
     it or users




                                                   Photo credit: sanjaykumarux.blogspot.com




                 Usability Testing as Validation                                              8
Users = Real people

 
  Use your website or app
 
  Part of your target
  audience
 
  Not directly affiliated with
  your company




                                   Photo credit: http://www.leveltendesign.com/   9
You Are NOT Like Your Users

                       You                   Your Users
          Know a lot about                   Know little or nothing about
 your product and company                    your product or company

      Are passionate about                   Just want to get things
             what you offer                  done

    Have ideas on how your                   May use your website or
 website or app will be used                 app differently than was
  based on being an insider                  intended



           Usability Testing as Validation                                  10
Learn About Users
 
   Surveys
 
   Focus groups
 
   Web analytics




                     Photo credit: http://www.flickr.com/photos/scottandsarah   11
Learn From Users
 
   Talk to them
 
   Observe them in their own
   environment
 
   Usability testing




                                 Photo credit: http://www.flickr.com/photos/blesseurope   12
Usability Testing




                    Photo credit: http://www.openroad.ca   13
“   … If you want to know whether your software…
is easy enough to use, watch some people while
they try to use it and note where they run into
trouble. Then fix it, and test it again.”



           Steve Krug
           Author, “Don’t Make Me Think” and “Rocket
           Surgery Made Easy”


         Usability Testing as Validation               14
Traditional Process
 
   Develop a test plan
 
   Choose a testing environment
 
   Find and select participants
 
   Prepare test materials
 
   Conduct the sessions
 
   Debrief with participants and
     observers
 
   Analyze data and observations
 
   Create findings and
     recommendations



                                     Photo credit: http://www.flickr.com/photos/doos/3050195096   15
Photo credit: http://vator.tv/news/2011-05-23-guidelines-for-product-usability-testing 16
Photo credit: http://vator.tv/news/2011-05-23-guidelines-for-product-usability-testing 17   17
Photo credit: http://vator.tv/news/2011-05-23-guidelines-for-product-usability-testing 18   18
Photo credit: http://vator.tv/news/2011-05-23-guidelines-for-product-usability-testing 19   19
In-Person Usability Testing
    Invite people to see a beta version and
     watch them complete tasks
    Pros
      
   See and hear participants’ reactions
      
   Can record conversation and click path
      
   Your stakeholders and team can
        participate
    Cons
      
   You or participants have to travel to meet
        up
                                                       Photo credit: http://www.flickr.com/photos/curiouslee/

      
   May not have access to participants who
        live outside of this region


                  Usability Testing as Validation                                                               20
Remote Usability Testing
    Use screen sharing software to
     watch participants complete tasks
     in another location
    Pros
      
   Don’t have to travel to participants
      
   Have access to participants who live
          outside of this region
      
   Can record conversation and click
          path
      
   Your stakeholders and team can
          participate
    Cons                                           Photo credit: http://www.flickr.com/photos/rosenfeldmedia/




      
   Don’t see participants’ reactions



                  Usability Testing as Validation                                                                21
Unmoderated Usability Testing
    Use a service that allows participants to complete the tasks
     on their one time without you moderating
    Pros
      
   Participants can do it when it’s convenient for them
      
   Have access to participants who live outside of this region

    Cons
      
   Can’t ask follow up questions
      
   Don’t hear participants think out loud
      
   Don’t see participants’ reactions




                  Usability Testing as Validation                       22
What You Can Test

 
  Real products
 
  Digital prototypes
 
  Paper prototypes




                         Photo credit: http://www.jamesjpierce.com/energy_challenge_08.html   23
DO

    Do test the site NOT the participants
    Do note participant’s success in              “I would open
     completing each task                          Goggle and search
    Do ask open-ended follow up                   for the website.”
     questions                                     Quote from usability testing
                                                   participant
    Do compensate participants




                 Usability Testing as Validation                                  24
DON’T

                                                 Don’t give participants tasks that
“Do you really                                    can not be completed
think people will                                Don’t guide participants
use this?”                                       Don’t answer questions until the
Quote from usability testing
                                                  end
participant
                                                 Don’t take it personally




                    Usability Testing as Validation                                    25
Why You Should Do It
    Reduce costs                                                    Fix Errors
     Once a piece of software                             $120

     makes it into the field,                             $100
     the cost of fixing an error
                                                           $80
     can be 100 times as
     high as it would have                                 $60
     been during the                                       $40
     development stage.
                                                           $20

     Source:
                                                            $0
     IEEE (Institute of Electrical and Electronics                  During          After
     Engineers)
     http://spectrum.ieee.org/computing/software/
                                                                 Development      Completion
     why-software-fails/




                        Usability Testing as Validation                                        26
Why You Should Do It
    Increase revenue
      
   Increase sales, applications, memberships or donations
      
   Increase retention
      
   Remain competitive




                  Usability Testing as Validation                  27
Why You Should Do It
    Improve effectiveness
      
   Reduce user error
      
   Increase efficiency
      
   Increase user satisfaction




                                                    Photo credit: http://www.flickr.com/photos/terryfreedman




                  Usability Testing as Validation                                                              28
Usability Testing and Lean Startup




                      Photo credit: http://thebln.com   29
Lean Startup




                                          Photo credit: http://lean.st/



        Usability Testing as Validation                                   30
Traditional Process
 
   Develop a test plan
 
   Choose a testing environment
 
   Find and select participants
 
   Prepare test materials
 
   Conduct the sessions
 
   Debrief with participants and
     observers
 
   Analyze data and observations
 
   Create findings and
     recommendations



                                     Photo credit: http://www.flickr.com/photos/doos/3050195096   31
Lean Process
 
   Develop a test plan
 
   Choose a testing environment
 
   Prepare test materials
 
   Find and select participants
 
   Conduct the sessions
 
   Debrief with participants and
     observers
 
   Analyze data and observations
 
   Create findings and
     recommendations



                                     Photo credit: http://www.flickr.com/photos/adactio/   32
Guerilla Usability Testing
    Go to a public place and ask customers
     to complete tasks
    Pros
      
   See and hear participants’ reactions
      
   See participants use product on different
        devices
    Cons
      
   Might need to get manager’s approval
      
   Customers may not be your target
        audience
      
   Your stakeholders and team can’t            Photo credit: http://www.flickr.com/photos/_dchri

        participate


                   Usability Testing as Validation                                                        33
“  … The best results come from testing no more
than 5 users and running as many small tests as
you can afford.”




           Jakob Nielsen
           principal, Nielsen Norman Group



         Usability Testing as Validation          34
Demo




       Photo credit: http://www.flickr.com/photos/vaniercollege   35
Try it Yourself!
    Join Baltimore Lean Startup on Facebook:
     https://www.facebook.com/groups/BaltimoreLeanStartup
    Do some guerrilla testing
    Post your results




                Usability Testing as Validation             36
Resources




            Photo credit: http://www.flickr.com/photos/rodrigogalindez/ 37
Books
    “Don’t Make Me Think: A Common
     Sense Approach to Web Usability”
     by Steve Krug

    “Handbook of Usability Testing:
     How to Plan, Design, and Conduct
     Effective Tests”
     by Jeffrey Rubin and Dana Chisnell

    “Remote Research: Real Users,
     Real Time, Real Research”                   Photo credit: amazon.com


     by Nate Bolt and Tony
     Tulathimutte

               Usability Testing as Validation                              38
Websites
    sensible.com
    useit.com
    usability.gov
    alistapart.com
    uie.com




                                                   Photo credit: http://usability.gov/




                 Usability Testing as Validation                                         39
Testing Tools
    Morae
    Optimal Workshop
    UserTesting.com
    Loop11
    GoToMeeting
    Skype


                                             Photo credit: http://beta.skype.com/en/




               Usability Testing as Validation                                         40
Questions?




     Photo credit: http://en.wikipedia.org/wiki/On_the_Internet,_nobody_knows_you%27re_a_dog



            Usability Testing as Validation                                                    41
Contact
                                                   Amy Rubino
                                                   arubino@systemsalliance.com




Stay in touch:
   www.systemsalliance.com
   @systemsalliance
   info@systemsalliance.com




                 Usability Testing as Validation                                 42

Weitere ähnliche Inhalte

Ähnlich wie Usability Testing Validation

Axa Hackathon: User Centric Guide to Application Prototyping
Axa Hackathon: User Centric Guide to Application PrototypingAxa Hackathon: User Centric Guide to Application Prototyping
Axa Hackathon: User Centric Guide to Application PrototypingJay Suthar
 
Usability Show+Tell
Usability Show+TellUsability Show+Tell
Usability Show+Tellgcotrell
 
User Testing talk by Chris Rourke of User Vision
User Testing talk by Chris Rourke of User VisionUser Testing talk by Chris Rourke of User Vision
User Testing talk by Chris Rourke of User Visiontechmeetup
 
Stop guessing, start testing – mobile testing done right - Timo Euteneuer
Stop guessing, start testing – mobile testing done right - Timo EuteneuerStop guessing, start testing – mobile testing done right - Timo Euteneuer
Stop guessing, start testing – mobile testing done right - Timo EuteneuerJAXLondon_Conference
 
Usability
UsabilityUsability
Usabilityclonq
 
Usability Testing On A Digital Product
Usability Testing On A Digital ProductUsability Testing On A Digital Product
Usability Testing On A Digital ProductKyle Soucy
 
Measuring and Testing Website Usability
Measuring and Testing Website UsabilityMeasuring and Testing Website Usability
Measuring and Testing Website UsabilityUserWorks
 
How to do usability testing and eye tracking
How to do usability testing and eye trackingHow to do usability testing and eye tracking
How to do usability testing and eye trackingObjective Experience
 
Usabilitydraft
UsabilitydraftUsabilitydraft
UsabilitydraftKimGriggs
 
Web Usability: Making Your Sites More Awesomer
Web Usability: Making Your Sites More AwesomerWeb Usability: Making Your Sites More Awesomer
Web Usability: Making Your Sites More AwesomerJennifer Riehle McFarland
 
Evaluation methods
Evaluation methodsEvaluation methods
Evaluation methodsEva Durall
 
Usability testing – Just Do It. Five methods for improving usability in-house
Usability testing – Just Do It. Five methods for improving usability in-houseUsability testing – Just Do It. Five methods for improving usability in-house
Usability testing – Just Do It. Five methods for improving usability in-houseVolkside
 
Usability Testing for People w/ Disabilities
Usability Testing for People w/ DisabilitiesUsability Testing for People w/ Disabilities
Usability Testing for People w/ DisabilitiesInteractive Accessibility
 
Selling UX in Your Organization - Stir Trek 2012
Selling UX in Your Organization - Stir Trek 2012Selling UX in Your Organization - Stir Trek 2012
Selling UX in Your Organization - Stir Trek 2012Carol Smith
 
User-Testing, Testing, 1,2,3
User-Testing, Testing, 1,2,3User-Testing, Testing, 1,2,3
User-Testing, Testing, 1,2,3BusinessOnline
 
Unobtrusive Usability Testing: Creating Measurable Goals to Evaluate a Website
Unobtrusive Usability Testing: Creating Measurable Goals to Evaluate a WebsiteUnobtrusive Usability Testing: Creating Measurable Goals to Evaluate a Website
Unobtrusive Usability Testing: Creating Measurable Goals to Evaluate a WebsiteTabby Farney
 
Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018Jagriti Pande
 
User Experience Measurement and Analysis: Usability Testing
User Experience Measurement and Analysis: Usability TestingUser Experience Measurement and Analysis: Usability Testing
User Experience Measurement and Analysis: Usability TestingElementive
 

Ähnlich wie Usability Testing Validation (20)

Axa Hackathon: User Centric Guide to Application Prototyping
Axa Hackathon: User Centric Guide to Application PrototypingAxa Hackathon: User Centric Guide to Application Prototyping
Axa Hackathon: User Centric Guide to Application Prototyping
 
Usability Show+Tell
Usability Show+TellUsability Show+Tell
Usability Show+Tell
 
User Research 101
User Research 101User Research 101
User Research 101
 
User Testing talk by Chris Rourke of User Vision
User Testing talk by Chris Rourke of User VisionUser Testing talk by Chris Rourke of User Vision
User Testing talk by Chris Rourke of User Vision
 
Stop guessing, start testing – mobile testing done right - Timo Euteneuer
Stop guessing, start testing – mobile testing done right - Timo EuteneuerStop guessing, start testing – mobile testing done right - Timo Euteneuer
Stop guessing, start testing – mobile testing done right - Timo Euteneuer
 
Usability
UsabilityUsability
Usability
 
Usability Testing On A Digital Product
Usability Testing On A Digital ProductUsability Testing On A Digital Product
Usability Testing On A Digital Product
 
Measuring and Testing Website Usability
Measuring and Testing Website UsabilityMeasuring and Testing Website Usability
Measuring and Testing Website Usability
 
How to do usability testing and eye tracking
How to do usability testing and eye trackingHow to do usability testing and eye tracking
How to do usability testing and eye tracking
 
Usabilitydraft
UsabilitydraftUsabilitydraft
Usabilitydraft
 
Web Usability: Making Your Sites More Awesomer
Web Usability: Making Your Sites More AwesomerWeb Usability: Making Your Sites More Awesomer
Web Usability: Making Your Sites More Awesomer
 
Evaluation methods
Evaluation methodsEvaluation methods
Evaluation methods
 
Usability testing – Just Do It. Five methods for improving usability in-house
Usability testing – Just Do It. Five methods for improving usability in-houseUsability testing – Just Do It. Five methods for improving usability in-house
Usability testing – Just Do It. Five methods for improving usability in-house
 
Usability Testing for People w/ Disabilities
Usability Testing for People w/ DisabilitiesUsability Testing for People w/ Disabilities
Usability Testing for People w/ Disabilities
 
Selling UX in Your Organization - Stir Trek 2012
Selling UX in Your Organization - Stir Trek 2012Selling UX in Your Organization - Stir Trek 2012
Selling UX in Your Organization - Stir Trek 2012
 
User-Testing, Testing, 1,2,3
User-Testing, Testing, 1,2,3User-Testing, Testing, 1,2,3
User-Testing, Testing, 1,2,3
 
Unobtrusive Usability Testing: Creating Measurable Goals to Evaluate a Website
Unobtrusive Usability Testing: Creating Measurable Goals to Evaluate a WebsiteUnobtrusive Usability Testing: Creating Measurable Goals to Evaluate a Website
Unobtrusive Usability Testing: Creating Measurable Goals to Evaluate a Website
 
Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018
 
Usability Testing
Usability TestingUsability Testing
Usability Testing
 
User Experience Measurement and Analysis: Usability Testing
User Experience Measurement and Analysis: Usability TestingUser Experience Measurement and Analysis: Usability Testing
User Experience Measurement and Analysis: Usability Testing
 

Mehr von Baltimore Lean Startup

2013-09-24: Media Industry In The Digital Age
2013-09-24: Media Industry In The Digital Age2013-09-24: Media Industry In The Digital Age
2013-09-24: Media Industry In The Digital AgeBaltimore Lean Startup
 
2013-07-17: MedStar Health & Innovation
2013-07-17: MedStar Health & Innovation2013-07-17: MedStar Health & Innovation
2013-07-17: MedStar Health & InnovationBaltimore Lean Startup
 
2013-07-17: Incorporating Personalized Medicine in Community Hospital Systems
2013-07-17: Incorporating Personalized Medicine in Community Hospital Systems2013-07-17: Incorporating Personalized Medicine in Community Hospital Systems
2013-07-17: Incorporating Personalized Medicine in Community Hospital SystemsBaltimore Lean Startup
 
2013-06-26: Two Approaches To Product Development For Lean Startups
2013-06-26: Two Approaches To Product Development For Lean Startups2013-06-26: Two Approaches To Product Development For Lean Startups
2013-06-26: Two Approaches To Product Development For Lean StartupsBaltimore Lean Startup
 
2013-04-17: The Promise, Current State, And Future of Personalized Medicine
2013-04-17: The Promise, Current State, And Future of Personalized Medicine2013-04-17: The Promise, Current State, And Future of Personalized Medicine
2013-04-17: The Promise, Current State, And Future of Personalized MedicineBaltimore Lean Startup
 
2013-04-17: Reactive vs. Proactive Innovation
2013-04-17: Reactive vs. Proactive Innovation2013-04-17: Reactive vs. Proactive Innovation
2013-04-17: Reactive vs. Proactive InnovationBaltimore Lean Startup
 
2013-04-17: Enterprise vs. Lean Startup - Lessons from the Battlefield
2013-04-17: Enterprise vs. Lean Startup - Lessons from the Battlefield2013-04-17: Enterprise vs. Lean Startup - Lessons from the Battlefield
2013-04-17: Enterprise vs. Lean Startup - Lessons from the BattlefieldBaltimore Lean Startup
 
2013-03-11: Leveraging social media to recruit
2013-03-11: Leveraging social media to recruit2013-03-11: Leveraging social media to recruit
2013-03-11: Leveraging social media to recruitBaltimore Lean Startup
 
2012-09-24 Workshop: Wireframe mockups
2012-09-24 Workshop: Wireframe mockups2012-09-24 Workshop: Wireframe mockups
2012-09-24 Workshop: Wireframe mockupsBaltimore Lean Startup
 
2012-07-24: Object Lab @ Towson University
2012-07-24: Object Lab @ Towson University2012-07-24: Object Lab @ Towson University
2012-07-24: Object Lab @ Towson UniversityBaltimore Lean Startup
 

Mehr von Baltimore Lean Startup (20)

2013-09-24: Online Marketing
2013-09-24: Online Marketing2013-09-24: Online Marketing
2013-09-24: Online Marketing
 
2013-09-24: Media Industry In The Digital Age
2013-09-24: Media Industry In The Digital Age2013-09-24: Media Industry In The Digital Age
2013-09-24: Media Industry In The Digital Age
 
2013-07-17: MedStar Health & Innovation
2013-07-17: MedStar Health & Innovation2013-07-17: MedStar Health & Innovation
2013-07-17: MedStar Health & Innovation
 
2013-07-17: Incorporating Personalized Medicine in Community Hospital Systems
2013-07-17: Incorporating Personalized Medicine in Community Hospital Systems2013-07-17: Incorporating Personalized Medicine in Community Hospital Systems
2013-07-17: Incorporating Personalized Medicine in Community Hospital Systems
 
2013-06-26: Two Approaches To Product Development For Lean Startups
2013-06-26: Two Approaches To Product Development For Lean Startups2013-06-26: Two Approaches To Product Development For Lean Startups
2013-06-26: Two Approaches To Product Development For Lean Startups
 
2013-06-26: Meet The Blinky Tape
2013-06-26: Meet The Blinky Tape2013-06-26: Meet The Blinky Tape
2013-06-26: Meet The Blinky Tape
 
2013-04-17: The Promise, Current State, And Future of Personalized Medicine
2013-04-17: The Promise, Current State, And Future of Personalized Medicine2013-04-17: The Promise, Current State, And Future of Personalized Medicine
2013-04-17: The Promise, Current State, And Future of Personalized Medicine
 
2013-04-17: Reactive vs. Proactive Innovation
2013-04-17: Reactive vs. Proactive Innovation2013-04-17: Reactive vs. Proactive Innovation
2013-04-17: Reactive vs. Proactive Innovation
 
2013-04-17: Enterprise vs. Lean Startup - Lessons from the Battlefield
2013-04-17: Enterprise vs. Lean Startup - Lessons from the Battlefield2013-04-17: Enterprise vs. Lean Startup - Lessons from the Battlefield
2013-04-17: Enterprise vs. Lean Startup - Lessons from the Battlefield
 
2013-03-11: Leveraging social media to recruit
2013-03-11: Leveraging social media to recruit2013-03-11: Leveraging social media to recruit
2013-03-11: Leveraging social media to recruit
 
2012-11-26: User Experience Strategy
2012-11-26: User Experience Strategy2012-11-26: User Experience Strategy
2012-11-26: User Experience Strategy
 
2012-11-26: It’s Design Time, Baby!
2012-11-26: It’s Design Time, Baby!2012-11-26: It’s Design Time, Baby!
2012-11-26: It’s Design Time, Baby!
 
2012-11-13: ToolLibrary pitch
2012-11-13:  ToolLibrary pitch2012-11-13:  ToolLibrary pitch
2012-11-13: ToolLibrary pitch
 
2012-11-13: Cognoto pitch
2012-11-13: Cognoto pitch2012-11-13: Cognoto pitch
2012-11-13: Cognoto pitch
 
2012-11-13: RosterBuddy pitch
2012-11-13: RosterBuddy pitch2012-11-13: RosterBuddy pitch
2012-11-13: RosterBuddy pitch
 
2012-09-24 Workshop: Wireframe mockups
2012-09-24 Workshop: Wireframe mockups2012-09-24 Workshop: Wireframe mockups
2012-09-24 Workshop: Wireframe mockups
 
2012-09-19: TeamGantt
2012-09-19: TeamGantt2012-09-19: TeamGantt
2012-09-19: TeamGantt
 
2012-08-21: Sheridan Technology Labs
2012-08-21: Sheridan Technology Labs2012-08-21: Sheridan Technology Labs
2012-08-21: Sheridan Technology Labs
 
2012-07-24: Object Lab @ Towson University
2012-07-24: Object Lab @ Towson University2012-07-24: Object Lab @ Towson University
2012-07-24: Object Lab @ Towson University
 
2012-07-24: Accessibility On The Web
2012-07-24: Accessibility On The Web2012-07-24: Accessibility On The Web
2012-07-24: Accessibility On The Web
 

Kürzlich hochgeladen

Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?XfilesPro
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAndikSusilo4
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 

Kürzlich hochgeladen (20)

Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & Application
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 

Usability Testing Validation

  • 1. Lean Startup Baltimore Usability Testing as Validation Amy Rubino November 26, 2012 @Amy_Rubino
  • 2. About Me Amy Rubino User Experience Consultant, Systems Alliance •  15 years of design experience as a print and web designer, information architect and user experience advocate. arubino@systemsalliance.com •  Worked with universities, linkedin.com/pub/amy-rubino/13/837/31b corporations and non-profits. @amy_rubino •  Master’s degree in Interaction Design and Information Architecture. Usability Testing as Validation 2
  • 3. What We’ll Cover Usability   Users   Learn About Users   Learn From Users Usability Testing   How to Do It   What You Can Test   Why You Should Do It Usability Testing and Lean Startup Demo Resources Photo credit: Amy Rubino Usability Testing as Validation 3
  • 4. Usability Photo credit: http://www.flickr.com/photos/reticulating 4
  • 5. User Experience Honeycomb Photo credit: http://semanticstudios.com/ Usability Testing as Validation 5
  • 6. Usability   Creating products that are easy to use   Require less mental effort to use   Decrease frequency of mistakes and mistakes are less disastrous   Can be used to do more or do it faster   Can be figured out quicker Usability Testing as Validation 6
  • 7. Usability Photo credit: http://impossibleobjects.com Usability Testing as Validation 7
  • 8. Usability   Based on human behavior   Focus on people who will use it or users Photo credit: sanjaykumarux.blogspot.com Usability Testing as Validation 8
  • 9. Users = Real people  Use your website or app  Part of your target audience  Not directly affiliated with your company Photo credit: http://www.leveltendesign.com/ 9
  • 10. You Are NOT Like Your Users You Your Users Know a lot about Know little or nothing about your product and company your product or company Are passionate about Just want to get things what you offer done Have ideas on how your May use your website or website or app will be used app differently than was based on being an insider intended Usability Testing as Validation 10
  • 11. Learn About Users   Surveys   Focus groups   Web analytics Photo credit: http://www.flickr.com/photos/scottandsarah 11
  • 12. Learn From Users   Talk to them   Observe them in their own environment   Usability testing Photo credit: http://www.flickr.com/photos/blesseurope 12
  • 13. Usability Testing Photo credit: http://www.openroad.ca 13
  • 14. … If you want to know whether your software… is easy enough to use, watch some people while they try to use it and note where they run into trouble. Then fix it, and test it again.” Steve Krug Author, “Don’t Make Me Think” and “Rocket Surgery Made Easy” Usability Testing as Validation 14
  • 15. Traditional Process   Develop a test plan   Choose a testing environment   Find and select participants   Prepare test materials   Conduct the sessions   Debrief with participants and observers   Analyze data and observations   Create findings and recommendations Photo credit: http://www.flickr.com/photos/doos/3050195096 15
  • 20. In-Person Usability Testing   Invite people to see a beta version and watch them complete tasks   Pros   See and hear participants’ reactions   Can record conversation and click path   Your stakeholders and team can participate   Cons   You or participants have to travel to meet up Photo credit: http://www.flickr.com/photos/curiouslee/   May not have access to participants who live outside of this region Usability Testing as Validation 20
  • 21. Remote Usability Testing   Use screen sharing software to watch participants complete tasks in another location   Pros   Don’t have to travel to participants   Have access to participants who live outside of this region   Can record conversation and click path   Your stakeholders and team can participate   Cons Photo credit: http://www.flickr.com/photos/rosenfeldmedia/   Don’t see participants’ reactions Usability Testing as Validation 21
  • 22. Unmoderated Usability Testing   Use a service that allows participants to complete the tasks on their one time without you moderating   Pros   Participants can do it when it’s convenient for them   Have access to participants who live outside of this region   Cons   Can’t ask follow up questions   Don’t hear participants think out loud   Don’t see participants’ reactions Usability Testing as Validation 22
  • 23. What You Can Test  Real products  Digital prototypes  Paper prototypes Photo credit: http://www.jamesjpierce.com/energy_challenge_08.html 23
  • 24. DO   Do test the site NOT the participants   Do note participant’s success in “I would open completing each task Goggle and search   Do ask open-ended follow up for the website.” questions Quote from usability testing participant   Do compensate participants Usability Testing as Validation 24
  • 25. DON’T   Don’t give participants tasks that “Do you really can not be completed think people will   Don’t guide participants use this?”   Don’t answer questions until the Quote from usability testing end participant   Don’t take it personally Usability Testing as Validation 25
  • 26. Why You Should Do It   Reduce costs Fix Errors Once a piece of software $120 makes it into the field, $100 the cost of fixing an error $80 can be 100 times as high as it would have $60 been during the $40 development stage. $20 Source: $0 IEEE (Institute of Electrical and Electronics During After Engineers) http://spectrum.ieee.org/computing/software/ Development Completion why-software-fails/ Usability Testing as Validation 26
  • 27. Why You Should Do It   Increase revenue   Increase sales, applications, memberships or donations   Increase retention   Remain competitive Usability Testing as Validation 27
  • 28. Why You Should Do It   Improve effectiveness   Reduce user error   Increase efficiency   Increase user satisfaction Photo credit: http://www.flickr.com/photos/terryfreedman Usability Testing as Validation 28
  • 29. Usability Testing and Lean Startup Photo credit: http://thebln.com 29
  • 30. Lean Startup Photo credit: http://lean.st/ Usability Testing as Validation 30
  • 31. Traditional Process   Develop a test plan   Choose a testing environment   Find and select participants   Prepare test materials   Conduct the sessions   Debrief with participants and observers   Analyze data and observations   Create findings and recommendations Photo credit: http://www.flickr.com/photos/doos/3050195096 31
  • 32. Lean Process   Develop a test plan   Choose a testing environment   Prepare test materials   Find and select participants   Conduct the sessions   Debrief with participants and observers   Analyze data and observations   Create findings and recommendations Photo credit: http://www.flickr.com/photos/adactio/ 32
  • 33. Guerilla Usability Testing   Go to a public place and ask customers to complete tasks   Pros   See and hear participants’ reactions   See participants use product on different devices   Cons   Might need to get manager’s approval   Customers may not be your target audience   Your stakeholders and team can’t Photo credit: http://www.flickr.com/photos/_dchri participate Usability Testing as Validation 33
  • 34. “ … The best results come from testing no more than 5 users and running as many small tests as you can afford.” Jakob Nielsen principal, Nielsen Norman Group Usability Testing as Validation 34
  • 35. Demo Photo credit: http://www.flickr.com/photos/vaniercollege 35
  • 36. Try it Yourself!   Join Baltimore Lean Startup on Facebook: https://www.facebook.com/groups/BaltimoreLeanStartup   Do some guerrilla testing   Post your results Usability Testing as Validation 36
  • 37. Resources Photo credit: http://www.flickr.com/photos/rodrigogalindez/ 37
  • 38. Books   “Don’t Make Me Think: A Common Sense Approach to Web Usability” by Steve Krug   “Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests” by Jeffrey Rubin and Dana Chisnell   “Remote Research: Real Users, Real Time, Real Research” Photo credit: amazon.com by Nate Bolt and Tony Tulathimutte Usability Testing as Validation 38
  • 39. Websites   sensible.com   useit.com   usability.gov   alistapart.com   uie.com Photo credit: http://usability.gov/ Usability Testing as Validation 39
  • 40. Testing Tools   Morae   Optimal Workshop   UserTesting.com   Loop11   GoToMeeting   Skype Photo credit: http://beta.skype.com/en/ Usability Testing as Validation 40
  • 41. Questions? Photo credit: http://en.wikipedia.org/wiki/On_the_Internet,_nobody_knows_you%27re_a_dog Usability Testing as Validation 41
  • 42. Contact Amy Rubino arubino@systemsalliance.com Stay in touch: www.systemsalliance.com @systemsalliance info@systemsalliance.com Usability Testing as Validation 42