SlideShare ist ein Scribd-Unternehmen logo
1 von 33
Downloaden Sie, um offline zu lesen
ADD USABILITY TESTING
        TO
   YOUR SKILL SET!




#badcamp #badcampux
  @lisarex @dcmistry
Lisa Rex
@lisarex
Dharmesh Mistry
  @dcmistry
Refer a friend! Know someone 

                                 who would be perfect for one of our
                                  open positions? $2500 is yours if
                                              your referral is hired

We’re Hiring!
lisa.rex@acquia.com   dharmesh.mistry@acquia.com
And who
are you?
AGENDA


A few basics
Preparation for a study
Conducting an unmoderated usability
study
The analysis
Q&A
A FEW BASICS
WHY ARE USABILITY STUDIES IMPORTANT?




                   http://www.flickr.com/photos/0olong/479270001/
Buying a shirt for
someone...
A



http://www.flickr.com/photos/chrisinplymouth/4456434875
B



http://www.flickr.com/photos/epsos/4444576795/
C



http://www.flickr.com/photos/whistlepunch/5176579823/
WHAT THE HECK IS RAPID USABILITY TESTING?




       Observe real users doing real tasks

       Quick turnaround vs academically
       rigorous

       Simple reports
“Testing with one user is 100% better than testing
                                       with none.”
                                     - Steve Krug
FLAVOR THAT SUITS YOU

Formative vs. Summative
Moderated vs.
Unmoderated
In Person vs. Remote
The preparation
GENERAL CONSTRUCTION

1. Goals
2. Prepare
- Recruit (Moderated)
- Conduct (Moderated)
- Set up (Unmoderated)
3. Watch the videos & analyze
4. Report findings
PREP STEP 1: GOALS
Talk to stakeholders:
“What are the business goals of the study?”
“What do we need to learn?”
“What are our primary tasks & personas?”
“When do we need it?”
“What’s our budget for usability testing and fixing
problems?”
PREP STEP 2: WHAT TO TEST?

            Information
            architecture
            Prototype
            Staging site
            Production site

You can test at any point during the project
lifecycle
PREP STEP 3: PARTICIPANTS

Who to test?
New users vs. current users
Primary roles & personas

How many to test?
5 participants per study is ideal for uncovering
the major usability problems while remaining
quick and cost effective.

15+ participants for a card sort / IA study
PREP STEP 4: CHOOSING THE METHOD




         Variety of webapps
Usertesting.com, Verifyapp, Treejack,
                 etc
PREP STEP 5: STUDY OUTLINE



     Starting URL
     Scenario
     Tasks (include login details)
     Post-session questions
     Choose your participants

 http://bit.ly/views-study
PREP STEP 5a: WRITING TASKS

     Do not use words that are in the UI

   Phrase things in the way people think

           Write in plain language

Put tasks in order; dependencies between the
                     tasks?

               Include assists

     Ask them to rate their experience
PREP STEP 5: TEST SITE ENVIRONMENT

    How will they access the site?
    Content and user account setup is
    needed?
    Do you need to set up separate sites
    for each? Or re-set between sessions?


    Tip: Use can use Drush to disable and uninstall modules!

    Or, if you have a dev, stage and prod environment,
    overwrite the database on the testing environment
Starting URL: drupal.org

  Scenario: You have built sites in other
CMS, have heard of Drupal, and would like
 to know more. You work for a non-profit
 that is looking to replace it’s site with an
            open source solution.
Task 1: Explore for a couple minutes and tell me
     what you have learned about Drupal.

Task 2: You want to find Drupal experts for hire.
        Show me how you would do this.

Task 3: If you didn’t find it already, Marketplace
lists Drupal companies. Now, you want to learn
more about the Drupal community. What would
                     you do?

 Task 4: Let’s say you want to post a support
question in the forums. Tell me what steps you
                  would take.
PREP STEP 8: OBSERVATION FORM




Priority/Severity
Issue summary
Link to screenshot
Task name
Participants who had the issue (frequency)
PREP STEP 6: CHOOSE YOUR PARTICIPANTS
STEP 5: WATCH THE VIDEOS

What to note?
Things that went well

Things that did not go well

Capture quotes and annotate screenshots or get
video clips
STEP 5: ANALYSIS, cont.




Categorize things that did not go well into bugs
and usability issues
   Severity: Low/Medium/ High (or
   1-5)
   Frequency: Number of occurrences
   Scope: Local/ Global
STEP 6: THE EXECUTIVE SUMMARY

Overall: There were no Critical problems
uncovered. Overall, the response was positive
and participants could find their way towards
achieving the tasks quickly.


High severity findings
• Bulleted list
Medium severity findings
• Bulleted list

The detailed findings can be found at [URL].
Tools for testing live
sites

- Usertesting.com
- Userlytics.com
- Loop11
Tools for testing
screenshots

- Five Second Test
- Invision app
- Verifyapp
Other

- Treejack (IA studies)
- Webform.com (Diary studies)
Q&A

Weitere ähnliche Inhalte

Was ist angesagt?

System performance as usability catastrophe
System performance as usability catastropheSystem performance as usability catastrophe
System performance as usability catastropheMichael Klein
 
Higher Ed Web Conference - Web Project Management
Higher Ed Web Conference - Web Project ManagementHigher Ed Web Conference - Web Project Management
Higher Ed Web Conference - Web Project ManagementJesse Rodgers
 
How to Build More Prosocial Teams by Hadassah Mativetsky
How to Build More Prosocial Teams by Hadassah MativetskyHow to Build More Prosocial Teams by Hadassah Mativetsky
How to Build More Prosocial Teams by Hadassah MativetskyQA or the Highway
 
Continuous Delivery (The newest)
Continuous Delivery (The newest)Continuous Delivery (The newest)
Continuous Delivery (The newest)Eduards Sizovs
 
Software Craftsmanship Essentials
Software Craftsmanship EssentialsSoftware Craftsmanship Essentials
Software Craftsmanship EssentialsEduards Sizovs
 
Next.js and the pursuit of happiness (Dimitris Michalakos, Lead Developer at ...
Next.js and the pursuit of happiness (Dimitris Michalakos, Lead Developer at ...Next.js and the pursuit of happiness (Dimitris Michalakos, Lead Developer at ...
Next.js and the pursuit of happiness (Dimitris Michalakos, Lead Developer at ...GreeceJS
 
Agile testing for mere mortals
Agile testing for mere mortalsAgile testing for mere mortals
Agile testing for mere mortalsDave Haeffner
 
Effective Daily Standups
Effective Daily StandupsEffective Daily Standups
Effective Daily StandupsFadi Stephan
 
CSS Audits: Take Back Control of your CSS (Susan Robertson)
CSS Audits: Take Back Control of your CSS (Susan Robertson)CSS Audits: Take Back Control of your CSS (Susan Robertson)
CSS Audits: Take Back Control of your CSS (Susan Robertson)Future Insights
 
Visual Management: Leading With What You Can See
Visual Management: Leading With What You Can SeeVisual Management: Leading With What You Can See
Visual Management: Leading With What You Can SeeCraig Smith
 
Reliable tests with selenium web driver
Reliable tests with selenium web driverReliable tests with selenium web driver
Reliable tests with selenium web driverPawelPabich
 
Confessions of an Accidental Security Tester
Confessions of an Accidental Security TesterConfessions of an Accidental Security Tester
Confessions of an Accidental Security TesterAlan Richardson
 
Certified ScrumMaster: class desk, posters and photos
Certified ScrumMaster: class desk, posters and photosCertified ScrumMaster: class desk, posters and photos
Certified ScrumMaster: class desk, posters and photosAlexey Krivitsky
 
Native is easy. Web is essential.
Native is easy. Web is essential.Native is easy. Web is essential.
Native is easy. Web is essential.Jason Grigsby
 
Introducing Pair Programming
Introducing Pair ProgrammingIntroducing Pair Programming
Introducing Pair ProgrammingSteven Smith
 
Sprint. Don't Waterfall
Sprint. Don't WaterfallSprint. Don't Waterfall
Sprint. Don't WaterfallGiedriusTS
 
You learned JavaScript - now what?
You learned JavaScript - now what?You learned JavaScript - now what?
You learned JavaScript - now what?Christian Heilmann
 
Cf objective2014 software-craftsmanship
Cf objective2014 software-craftsmanshipCf objective2014 software-craftsmanship
Cf objective2014 software-craftsmanshipColdFusionConference
 

Was ist angesagt? (20)

System performance as usability catastrophe
System performance as usability catastropheSystem performance as usability catastrophe
System performance as usability catastrophe
 
Higher Ed Web Conference - Web Project Management
Higher Ed Web Conference - Web Project ManagementHigher Ed Web Conference - Web Project Management
Higher Ed Web Conference - Web Project Management
 
How to Build More Prosocial Teams by Hadassah Mativetsky
How to Build More Prosocial Teams by Hadassah MativetskyHow to Build More Prosocial Teams by Hadassah Mativetsky
How to Build More Prosocial Teams by Hadassah Mativetsky
 
Continuous Delivery (The newest)
Continuous Delivery (The newest)Continuous Delivery (The newest)
Continuous Delivery (The newest)
 
Software Craftsmanship Essentials
Software Craftsmanship EssentialsSoftware Craftsmanship Essentials
Software Craftsmanship Essentials
 
Next.js and the pursuit of happiness (Dimitris Michalakos, Lead Developer at ...
Next.js and the pursuit of happiness (Dimitris Michalakos, Lead Developer at ...Next.js and the pursuit of happiness (Dimitris Michalakos, Lead Developer at ...
Next.js and the pursuit of happiness (Dimitris Michalakos, Lead Developer at ...
 
Agile testing for mere mortals
Agile testing for mere mortalsAgile testing for mere mortals
Agile testing for mere mortals
 
Effective Daily Standups
Effective Daily StandupsEffective Daily Standups
Effective Daily Standups
 
CSS Audits: Take Back Control of your CSS (Susan Robertson)
CSS Audits: Take Back Control of your CSS (Susan Robertson)CSS Audits: Take Back Control of your CSS (Susan Robertson)
CSS Audits: Take Back Control of your CSS (Susan Robertson)
 
Visual Management: Leading With What You Can See
Visual Management: Leading With What You Can SeeVisual Management: Leading With What You Can See
Visual Management: Leading With What You Can See
 
Mob Testing
Mob TestingMob Testing
Mob Testing
 
Reliable tests with selenium web driver
Reliable tests with selenium web driverReliable tests with selenium web driver
Reliable tests with selenium web driver
 
Confessions of an Accidental Security Tester
Confessions of an Accidental Security TesterConfessions of an Accidental Security Tester
Confessions of an Accidental Security Tester
 
Certified ScrumMaster: class desk, posters and photos
Certified ScrumMaster: class desk, posters and photosCertified ScrumMaster: class desk, posters and photos
Certified ScrumMaster: class desk, posters and photos
 
Native is easy. Web is essential.
Native is easy. Web is essential.Native is easy. Web is essential.
Native is easy. Web is essential.
 
Introduction to agile
Introduction to agileIntroduction to agile
Introduction to agile
 
Introducing Pair Programming
Introducing Pair ProgrammingIntroducing Pair Programming
Introducing Pair Programming
 
Sprint. Don't Waterfall
Sprint. Don't WaterfallSprint. Don't Waterfall
Sprint. Don't Waterfall
 
You learned JavaScript - now what?
You learned JavaScript - now what?You learned JavaScript - now what?
You learned JavaScript - now what?
 
Cf objective2014 software-craftsmanship
Cf objective2014 software-craftsmanshipCf objective2014 software-craftsmanship
Cf objective2014 software-craftsmanship
 

Andere mochten auch

Clafis maritiem linked in
Clafis maritiem linked inClafis maritiem linked in
Clafis maritiem linked inClafis
 
Democratization of Experiences
Democratization of ExperiencesDemocratization of Experiences
Democratization of Experiencesdcmistry
 
Graded unit presentation
Graded unit presentationGraded unit presentation
Graded unit presentationrmorgan21
 
Hihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xem
Hihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xemHihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xem
Hihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xemtai_media
 
Optical nerve presentation
Optical nerve presentationOptical nerve presentation
Optical nerve presentationEsther Walker
 
HICSS 2010 Presentation
HICSS 2010 PresentationHICSS 2010 Presentation
HICSS 2010 Presentationj_tsai
 
The journey to build a more usable toolbar for Drupal 8
The journey to build a more usable toolbar for Drupal 8 The journey to build a more usable toolbar for Drupal 8
The journey to build a more usable toolbar for Drupal 8 dcmistry
 
HICSS 2009 Presentation
HICSS 2009 PresentationHICSS 2009 Presentation
HICSS 2009 Presentationj_tsai
 
Clafis maritiem linked in
Clafis maritiem linked inClafis maritiem linked in
Clafis maritiem linked inClafis
 
Input dear media voor total
Input dear media voor totalInput dear media voor total
Input dear media voor totalFlorence Pérès
 
Hihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xem
Hihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xemHihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xem
Hihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xemtai_media
 
Can "Smart Homes" change the future of how older adults live?
Can "Smart Homes" change the future of how older adults live?Can "Smart Homes" change the future of how older adults live?
Can "Smart Homes" change the future of how older adults live?dcmistry
 
Digital Detox by Florence Pérès
Digital Detox by Florence PérèsDigital Detox by Florence Pérès
Digital Detox by Florence PérèsFlorence Pérès
 
Telecommunications and its history pamela
Telecommunications and its history pamelaTelecommunications and its history pamela
Telecommunications and its history pamelaPame_98
 
Emerging Technologies: Green IT
Emerging Technologies: Green ITEmerging Technologies: Green IT
Emerging Technologies: Green ITj_tsai
 
Proyeksi penduduk indonesia_2010-2035
Proyeksi penduduk indonesia_2010-2035Proyeksi penduduk indonesia_2010-2035
Proyeksi penduduk indonesia_2010-2035Muhammad Syaipulloh
 

Andere mochten auch (17)

Clafis maritiem linked in
Clafis maritiem linked inClafis maritiem linked in
Clafis maritiem linked in
 
Democratization of Experiences
Democratization of ExperiencesDemocratization of Experiences
Democratization of Experiences
 
Graded unit presentation
Graded unit presentationGraded unit presentation
Graded unit presentation
 
Hihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xem
Hihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xemHihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xem
Hihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xem
 
Optical nerve presentation
Optical nerve presentationOptical nerve presentation
Optical nerve presentation
 
HICSS 2010 Presentation
HICSS 2010 PresentationHICSS 2010 Presentation
HICSS 2010 Presentation
 
The journey to build a more usable toolbar for Drupal 8
The journey to build a more usable toolbar for Drupal 8 The journey to build a more usable toolbar for Drupal 8
The journey to build a more usable toolbar for Drupal 8
 
HICSS 2009 Presentation
HICSS 2009 PresentationHICSS 2009 Presentation
HICSS 2009 Presentation
 
Clafis maritiem linked in
Clafis maritiem linked inClafis maritiem linked in
Clafis maritiem linked in
 
Input dear media voor total
Input dear media voor totalInput dear media voor total
Input dear media voor total
 
Hihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xem
Hihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xemHihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xem
Hihi gửi em ngày 01.06 nhé cẩn thận té ghế, yếu tim cấm xem
 
Can "Smart Homes" change the future of how older adults live?
Can "Smart Homes" change the future of how older adults live?Can "Smart Homes" change the future of how older adults live?
Can "Smart Homes" change the future of how older adults live?
 
Digital Detox by Florence Pérès
Digital Detox by Florence PérèsDigital Detox by Florence Pérès
Digital Detox by Florence Pérès
 
Telecommunications and its history pamela
Telecommunications and its history pamelaTelecommunications and its history pamela
Telecommunications and its history pamela
 
Emerging Technologies: Green IT
Emerging Technologies: Green ITEmerging Technologies: Green IT
Emerging Technologies: Green IT
 
Business Proposal
Business Proposal Business Proposal
Business Proposal
 
Proyeksi penduduk indonesia_2010-2035
Proyeksi penduduk indonesia_2010-2035Proyeksi penduduk indonesia_2010-2035
Proyeksi penduduk indonesia_2010-2035
 

Ähnlich wie Add usability testing to your skill set!

Rapid usability testing
Rapid usability testingRapid usability testing
Rapid usability testinglisarex
 
Rapid Prototyping and Usability Testing - HUXPA
Rapid Prototyping and Usability Testing - HUXPARapid Prototyping and Usability Testing - HUXPA
Rapid Prototyping and Usability Testing - HUXPADerrick Bowen
 
User Testing your Drupal Administration Process
User Testing your Drupal Administration ProcessUser Testing your Drupal Administration Process
User Testing your Drupal Administration ProcessVanessa Turke
 
Prototyping & User Testing
Prototyping & User TestingPrototyping & User Testing
Prototyping & User TestingLaura Levisay
 
Continuous Deployment and Testing Workshop from Better Software West
Continuous Deployment and Testing Workshop from Better Software WestContinuous Deployment and Testing Workshop from Better Software West
Continuous Deployment and Testing Workshop from Better Software WestCory Foy
 
How to do usability testing and eye tracking
How to do usability testing and eye trackingHow to do usability testing and eye tracking
How to do usability testing and eye trackingObjective Experience
 
More Than Usability
More Than UsabilityMore Than Usability
More Than UsabilityRazan Sadeq
 
Twelve Tips for Becoming a More Professional Tester
Twelve Tips for Becoming a More Professional TesterTwelve Tips for Becoming a More Professional Tester
Twelve Tips for Becoming a More Professional TesterTechWell
 
User Testing Doesn't Have to Be Hard
User Testing Doesn't Have to Be HardUser Testing Doesn't Have to Be Hard
User Testing Doesn't Have to Be HardShannon Leahy
 
Early Signal Testing: Designing Atlassian’s New Look
Early Signal Testing: Designing Atlassian’s New LookEarly Signal Testing: Designing Atlassian’s New Look
Early Signal Testing: Designing Atlassian’s New LookAtlassian
 
Train-the-Trainer - Enabling your team
Train-the-Trainer - Enabling your teamTrain-the-Trainer - Enabling your team
Train-the-Trainer - Enabling your teamOptimizely
 
Dual Track Agile & Data Driven Design
Dual Track Agile & Data Driven DesignDual Track Agile & Data Driven Design
Dual Track Agile & Data Driven DesignJohn Fouts
 
Designing to save lives: Government technical documentation
Designing  to save  lives: Government technical documentation Designing  to save  lives: Government technical documentation
Designing to save lives: Government technical documentation Laurian Vega
 
How Do You Know that Gal Knows Drupal? Towards an Open Source Curriculum and ...
How Do You Know that Gal Knows Drupal? Towards an Open Source Curriculum and ...How Do You Know that Gal Knows Drupal? Towards an Open Source Curriculum and ...
How Do You Know that Gal Knows Drupal? Towards an Open Source Curriculum and ...Dominik Lukes
 
Usability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupUsability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupNormanMendoza
 
"Open" includes users - Leverage their input
"Open" includes users - Leverage their input"Open" includes users - Leverage their input
"Open" includes users - Leverage their inputRandy Earl
 
How to run a pop-up lab : Innovation through rapid R&D (Emerce Retail, Holland)
How to run a pop-up lab: Innovation through rapid R&D (Emerce Retail, Holland)How to run a pop-up lab: Innovation through rapid R&D (Emerce Retail, Holland)
How to run a pop-up lab : Innovation through rapid R&D (Emerce Retail, Holland)Fergus Roche
 
Usability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter eventUsability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter eventKay Aubrey
 

Ähnlich wie Add usability testing to your skill set! (20)

Rapid usability testing
Rapid usability testingRapid usability testing
Rapid usability testing
 
Rapid Prototyping and Usability Testing - HUXPA
Rapid Prototyping and Usability Testing - HUXPARapid Prototyping and Usability Testing - HUXPA
Rapid Prototyping and Usability Testing - HUXPA
 
User Testing your Drupal Administration Process
User Testing your Drupal Administration ProcessUser Testing your Drupal Administration Process
User Testing your Drupal Administration Process
 
Prototyping & User Testing
Prototyping & User TestingPrototyping & User Testing
Prototyping & User Testing
 
Continuous Deployment and Testing Workshop from Better Software West
Continuous Deployment and Testing Workshop from Better Software WestContinuous Deployment and Testing Workshop from Better Software West
Continuous Deployment and Testing Workshop from Better Software West
 
How to do usability testing and eye tracking
How to do usability testing and eye trackingHow to do usability testing and eye tracking
How to do usability testing and eye tracking
 
Lean UX
Lean UXLean UX
Lean UX
 
More Than Usability
More Than UsabilityMore Than Usability
More Than Usability
 
Twelve Tips for Becoming a More Professional Tester
Twelve Tips for Becoming a More Professional TesterTwelve Tips for Becoming a More Professional Tester
Twelve Tips for Becoming a More Professional Tester
 
User Testing Doesn't Have to Be Hard
User Testing Doesn't Have to Be HardUser Testing Doesn't Have to Be Hard
User Testing Doesn't Have to Be Hard
 
Early Signal Testing: Designing Atlassian’s New Look
Early Signal Testing: Designing Atlassian’s New LookEarly Signal Testing: Designing Atlassian’s New Look
Early Signal Testing: Designing Atlassian’s New Look
 
Train-the-Trainer - Enabling your team
Train-the-Trainer - Enabling your teamTrain-the-Trainer - Enabling your team
Train-the-Trainer - Enabling your team
 
Dual Track Agile & Data Driven Design
Dual Track Agile & Data Driven DesignDual Track Agile & Data Driven Design
Dual Track Agile & Data Driven Design
 
Designing to save lives: Government technical documentation
Designing  to save  lives: Government technical documentation Designing  to save  lives: Government technical documentation
Designing to save lives: Government technical documentation
 
Don't Fear the User
Don't Fear the UserDon't Fear the User
Don't Fear the User
 
How Do You Know that Gal Knows Drupal? Towards an Open Source Curriculum and ...
How Do You Know that Gal Knows Drupal? Towards an Open Source Curriculum and ...How Do You Know that Gal Knows Drupal? Towards an Open Source Curriculum and ...
How Do You Know that Gal Knows Drupal? Towards an Open Source Curriculum and ...
 
Usability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupUsability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working Group
 
"Open" includes users - Leverage their input
"Open" includes users - Leverage their input"Open" includes users - Leverage their input
"Open" includes users - Leverage their input
 
How to run a pop-up lab : Innovation through rapid R&D (Emerce Retail, Holland)
How to run a pop-up lab: Innovation through rapid R&D (Emerce Retail, Holland)How to run a pop-up lab: Innovation through rapid R&D (Emerce Retail, Holland)
How to run a pop-up lab : Innovation through rapid R&D (Emerce Retail, Holland)
 
Usability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter eventUsability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter event
 

Kürzlich hochgeladen

PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServicePicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServiceRenan Moreira de Oliveira
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
Introduction to Quantum Computing
Introduction to Quantum ComputingIntroduction to Quantum Computing
Introduction to Quantum ComputingGDSC PJATK
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
Babel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxBabel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxYounusS2
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
GenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncGenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncObject Automation
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 

Kürzlich hochgeladen (20)

PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServicePicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
Introduction to Quantum Computing
Introduction to Quantum ComputingIntroduction to Quantum Computing
Introduction to Quantum Computing
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
Babel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxBabel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptx
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
GenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncGenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation Inc
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 

Add usability testing to your skill set!

  • 1. ADD USABILITY TESTING TO YOUR SKILL SET! #badcamp #badcampux @lisarex @dcmistry
  • 3. Dharmesh Mistry @dcmistry
  • 4. Refer a friend! Know someone 
 who would be perfect for one of our open positions? $2500 is yours if your referral is hired We’re Hiring! lisa.rex@acquia.com dharmesh.mistry@acquia.com
  • 6. AGENDA A few basics Preparation for a study Conducting an unmoderated usability study The analysis Q&A
  • 8. WHY ARE USABILITY STUDIES IMPORTANT? http://www.flickr.com/photos/0olong/479270001/
  • 9. Buying a shirt for someone...
  • 13. WHAT THE HECK IS RAPID USABILITY TESTING? Observe real users doing real tasks Quick turnaround vs academically rigorous Simple reports
  • 14. “Testing with one user is 100% better than testing with none.” - Steve Krug
  • 15. FLAVOR THAT SUITS YOU Formative vs. Summative Moderated vs. Unmoderated In Person vs. Remote
  • 17. GENERAL CONSTRUCTION 1. Goals 2. Prepare - Recruit (Moderated) - Conduct (Moderated) - Set up (Unmoderated) 3. Watch the videos & analyze 4. Report findings
  • 18. PREP STEP 1: GOALS Talk to stakeholders: “What are the business goals of the study?” “What do we need to learn?” “What are our primary tasks & personas?” “When do we need it?” “What’s our budget for usability testing and fixing problems?”
  • 19. PREP STEP 2: WHAT TO TEST? Information architecture Prototype Staging site Production site You can test at any point during the project lifecycle
  • 20. PREP STEP 3: PARTICIPANTS Who to test? New users vs. current users Primary roles & personas How many to test? 5 participants per study is ideal for uncovering the major usability problems while remaining quick and cost effective. 15+ participants for a card sort / IA study
  • 21. PREP STEP 4: CHOOSING THE METHOD Variety of webapps Usertesting.com, Verifyapp, Treejack, etc
  • 22. PREP STEP 5: STUDY OUTLINE Starting URL Scenario Tasks (include login details) Post-session questions Choose your participants http://bit.ly/views-study
  • 23. PREP STEP 5a: WRITING TASKS Do not use words that are in the UI Phrase things in the way people think Write in plain language Put tasks in order; dependencies between the tasks? Include assists Ask them to rate their experience
  • 24. PREP STEP 5: TEST SITE ENVIRONMENT How will they access the site? Content and user account setup is needed? Do you need to set up separate sites for each? Or re-set between sessions? Tip: Use can use Drush to disable and uninstall modules! Or, if you have a dev, stage and prod environment, overwrite the database on the testing environment
  • 25. Starting URL: drupal.org Scenario: You have built sites in other CMS, have heard of Drupal, and would like to know more. You work for a non-profit that is looking to replace it’s site with an open source solution.
  • 26. Task 1: Explore for a couple minutes and tell me what you have learned about Drupal. Task 2: You want to find Drupal experts for hire. Show me how you would do this. Task 3: If you didn’t find it already, Marketplace lists Drupal companies. Now, you want to learn more about the Drupal community. What would you do? Task 4: Let’s say you want to post a support question in the forums. Tell me what steps you would take.
  • 27. PREP STEP 8: OBSERVATION FORM Priority/Severity Issue summary Link to screenshot Task name Participants who had the issue (frequency)
  • 28. PREP STEP 6: CHOOSE YOUR PARTICIPANTS
  • 29. STEP 5: WATCH THE VIDEOS What to note? Things that went well Things that did not go well Capture quotes and annotate screenshots or get video clips
  • 30. STEP 5: ANALYSIS, cont. Categorize things that did not go well into bugs and usability issues Severity: Low/Medium/ High (or 1-5) Frequency: Number of occurrences Scope: Local/ Global
  • 31. STEP 6: THE EXECUTIVE SUMMARY Overall: There were no Critical problems uncovered. Overall, the response was positive and participants could find their way towards achieving the tasks quickly. High severity findings • Bulleted list Medium severity findings • Bulleted list The detailed findings can be found at [URL].
  • 32. Tools for testing live sites - Usertesting.com - Userlytics.com - Loop11 Tools for testing screenshots - Five Second Test - Invision app - Verifyapp Other - Treejack (IA studies) - Webform.com (Diary studies)
  • 33. Q&A

Hinweis der Redaktion

  1. LR\n
  2. Acquia product usability , I’ve been in the community for just over three years, involved with Drupal.org projects, as well as a bit of work on Drupal 7 help text, and more recently we did Views usability study and a Drupal 8 information architecture usability study\n
  3. \n
  4. http://www.acquia.com/careers\n
  5. LR\nHow many call themselves Developer/ Designer / Business Person, None of the above?)\nHow many of you have conducted usability testing before? \nHow many of you have asked for budget for usability studies?\n\n
  6. LR - odon’t read this. we want to ensure you can run a usability study by the end of this session. overview of tools and process\n
  7. \n
  8. The way we design is not always the way things are used. Find out the delta betwenen them.\nThings we could uncover: \n Visual problems (like contrast)\n Error messaging and UI text\n Content\n Navigation and findability problems\n Workflow problems\n\n
  9. \n
  10. \n
  11. DM\n
  12. \n
  13. \n
  14. \n
  15. “Usability testing is the second most used evaluation method and the method that has the most impact on making products better” \nAdvantages of unmoderated over moderated. \nUnmoderated is faster, asynchronous, less steps to cover but doesn’t offer probe and not suitable for studies that require a lot of in-time probing. \n\n
  16. DM start\nPreparation is the longest phase of the process \n
  17. \n
  18. business goals translate to UX goals \n
  19. \n
  20. Usability specialists believe it is not cost effective to run more because it only uncovers more minor \nproblems\n\n\n\n“Virtually all of the problems judged high in severity were discovered after running 5 subjects, whereas only 55% of the problems judged low in severity were found.”\n
  21. recording: Silverback Morae WebEx \nscreenshare: Skype Join.me Google+ hangout\n
  22. \n
  23. \n
  24. \n
  25. LR Start\n
  26. \n
  27. \n
  28. \n
  29. DM start\n
  30. \n
  31. \n
  32. LR start at Invision\n
  33. \n