SlideShare ist ein Scribd-Unternehmen logo
1 von 19
Usability Test- GetGlue
       Jessica Torrez-Riley
         Cassie Gooding
        Emily Kamischke
Motivation


Social media is one of the major players in interactive
media. Major social media outlets, such as Facebook
and Twitter, are setting the standards for other
iterations and opening the door for niche markets.
One of the new trends is “check-in” oriented sites.
As part of the new trend of social TV, GetGlue uses
the “check-in” feature to link users to their chosen
entertainment.
Objectives


Evaluate difficulty of site usability.
  Power social media users v. Novice social media users
  “Check-in”, navigation, search bar, and “liking”
  Indirectly, live-updating newsfeed, reward system,
  recommendation system
Evaluate attitude towards site features.
  Likelihood of continued use
  Multi-tasking while consuming entertainment
  Effect of reward system
Method
Participants


Total Number: 8
Segmentation: 4 power                Avg. TV
                                      Hours
                                               Avg. Online
                                                 Hours
                                                             Avg. Social
                                                             Media Hours
users v. 4 novice users
Selection: selected based   Power
                            Users
                                      3.5         3.0          5.75
on a combination of TV
watching habits and
social media prowess        Novice
                            Users
                                     4.25        1.25          2.25
Environment


Intended for use while entertainment consumption is
occurring, whether online or in physical form.
Testing website as it would be used on a home
computer.
Participants were tested in home-like environments.
  Individually tested
  Limited instructor involvment
Procedure


Pre-survey
  Evaluate user’s social media use and TV watching habits
Scripted tasks
  Log-in
  Navigation
  Check-in, Like, Comment
Post-survey
  Evaluate user attitude towards site interface
Tools Used


Silverback
  Recorded users test using both screen capture and face
  capture
Google Docs
  To survey user opinion and experience
Task list for participants

1.   Go to www.GetGlue.com
2.   Login to the website using the provided user name and password
      Username: eu2011user1
      Password: eu2011user1
3.   You want to learn more about the website. Look to the bottom of the page for the
     “About” button to learn more about the site. Click the button and proceed to the
     About Company page.
4.   Now that you have learned more about the site you want to “check-in” to a TV
     show you watch frequently, “The Deadliest Catch.” Please check-in to the show
     now.
5.   You are intrigued by GetGlue and want to continue using it. You also frequently
     watch “Glee”. Check-in to “Glee” and this time you leave the comment, “I love
     Rachel Berry!”
6.   After “Glee” airs you often watch “New Girl” so check-in to “New Girl” and then
     “like” “New Girl”.
7.   After you realize you can like TV shows you are interested in liking music, since this is
     your real passion. Find and like, “Muse”, “Usher”, “Madonna”, “Carrie
     Underwood”, and “Britney Spears”.
8.   Now that you are more familiar with the site go look for your favorite TV show and
     check-in. Be sure to leave a comment or like the TV show.
9.   Feel free to continue exploring GetGlue, when you are done Log Out and find your
     instructor.
Data Analysis


Task completion
  Timed each task
  Noted miss-clicks
  User expectation v. actual functionality
  Noted method of completion
    Search bar v. check-in bar

Power user v. Novice user
  Efficiency of task completion
  Attitude towards site purpose
  Attitude towards site use
Data Analysis


Task            Power Users   Novice Users   Difference
                (Avg. Time)   (Avg. Time)
About                0:57           1:25            0:28
Check-In 1           1:05           1:52            0:47
Check-In 2           0:34           1:14            1:20
Check-In 3           0:24           0:34            0:10
Fav. Check-In        0:20           0:45            0:25
Logout               0:37           0:40            0:03
Data Analysis


                 Power Users (Avg. Novice Users (Avg.
Task                                                    Difference
                 Time)             Time)
Muse                   0:10               0:39             0:29
Usher                  0:08               0:35             0:27
Madonna                0:06               0:08             0:02
Carrie
                       0:11               0:18            0:09
Underwood
Britney Spears         0:10               0:28             0:18
User
                       0:57               2:42             1:45
exploration
Implications


Auto-refreshing stream – footer obstruction
Universal comfort with search bar vs. GetGlue’s
“check-in” bar emphasis
Reward system feedback inefficiency
Logo-only navigation creates unmet expectations
Video omitted for upload




Auto-refreshing stream doesn’t allow for easy access to footer.
     • Suggestion: fixed footer or better upper navigation
Search bar is easily used by all users, whereas rest of site is directed
towards social media power users.
      • Suggestion: incorporate check-in into header and/or search bar function
Most participants did not notice and/or receive a sticker. Reward
system is not immediately impactful on user experience.
     • Suggestion: first check-in should earn first sticker and prompt user to reward
       system explanation
On logout many participants noticeably expected a hover dropdown
menu and became confused when expectations were not met.
     • Suggestion: logo navigations should be hover drop downs
Test Suggestions


User comfort with computer.
   All tests were done on Macs but some participants were not mac users.
A more controlled environment.
   Attempt at natural experience actually produced unrelated distractions.
Test could benefit from making participants use the interface while
consuming entertainment.
There were errors and room for improvement with task instructions.
   Many users didn’t follow directions fully or completed tasks out of order.
   Some tasks were completed in an unexpected manner.
Conclusion


Successfully proved that GetGlue’s                                           Novice
interface is directed towards social                            Power User
                                                                              User
media power users.
   Interestingly, novice users claim to   Ease of use              3.25       3.75
   watch more TV than power users          (5 – very easy)

   and would therefore be a better
   target audience.                        Likely to
                                           use again               2.5        1.5
While power users took less time           (5 – very likely)
to complete tasks, their attitude
towards the site was skewed by              Overall
unmet expectations leading them           Experience               3.25       3.0
to rate the site more difficult to        (5 – very positive)
use than novice users.

Weitere ähnliche Inhalte

Ähnlich wie Usability Test

Monotasker Deck
Monotasker DeckMonotasker Deck
Monotasker Deck
Dan Roge
 

Ähnlich wie Usability Test (20)

Rapid Prototyping and Usability Testing - HUXPA
Rapid Prototyping and Usability Testing - HUXPARapid Prototyping and Usability Testing - HUXPA
Rapid Prototyping and Usability Testing - HUXPA
 
Introduction to Lean UX Methods - General Assembly
Introduction to Lean UX Methods - General AssemblyIntroduction to Lean UX Methods - General Assembly
Introduction to Lean UX Methods - General Assembly
 
CSCW 2013 - Investigating the Appropriateness of Social Network Question Aski...
CSCW 2013 - Investigating the Appropriateness of Social Network Question Aski...CSCW 2013 - Investigating the Appropriateness of Social Network Question Aski...
CSCW 2013 - Investigating the Appropriateness of Social Network Question Aski...
 
2009: User experience in action
2009: User experience in action2009: User experience in action
2009: User experience in action
 
How to do usability testing and eye tracking
How to do usability testing and eye trackingHow to do usability testing and eye tracking
How to do usability testing and eye tracking
 
User Experience Design Fundamentals - Part 2: Talking with Users
User Experience Design Fundamentals - Part 2: Talking with UsersUser Experience Design Fundamentals - Part 2: Talking with Users
User Experience Design Fundamentals - Part 2: Talking with Users
 
Hci final presentation
Hci final presentationHci final presentation
Hci final presentation
 
Intro to Lean UX with UserTesting
Intro to Lean UX with UserTestingIntro to Lean UX with UserTesting
Intro to Lean UX with UserTesting
 
Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018
 
User Interface and User Experience - A Process and Strategy for Small Teams
User Interface and User Experience - A Process and Strategy for Small TeamsUser Interface and User Experience - A Process and Strategy for Small Teams
User Interface and User Experience - A Process and Strategy for Small Teams
 
Monotasker Deck
Monotasker DeckMonotasker Deck
Monotasker Deck
 
Web 2.0 Measurement: Open Government Innovations Conference
Web 2.0 Measurement: Open Government Innovations ConferenceWeb 2.0 Measurement: Open Government Innovations Conference
Web 2.0 Measurement: Open Government Innovations Conference
 
HCI Group Project Presentation
HCI Group Project PresentationHCI Group Project Presentation
HCI Group Project Presentation
 
Debugging Design [EN]
Debugging Design [EN]Debugging Design [EN]
Debugging Design [EN]
 
The Only Metric That Matters by a Partner at Greylock Partners
The Only Metric That Matters by a Partner at Greylock PartnersThe Only Metric That Matters by a Partner at Greylock Partners
The Only Metric That Matters by a Partner at Greylock Partners
 
Usability
UsabilityUsability
Usability
 
Marczewski's User Type Workshop #GWC14
Marczewski's User Type Workshop #GWC14Marczewski's User Type Workshop #GWC14
Marczewski's User Type Workshop #GWC14
 
Hci final presentation
Hci final presentationHci final presentation
Hci final presentation
 
Hci final presentation
Hci final presentationHci final presentation
Hci final presentation
 
Trends In Usability Testing - IA Summit 2010 & Maine IxDA
Trends In Usability Testing - IA Summit 2010 & Maine IxDATrends In Usability Testing - IA Summit 2010 & Maine IxDA
Trends In Usability Testing - IA Summit 2010 & Maine IxDA
 

Kürzlich hochgeladen

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 

Kürzlich hochgeladen (20)

Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 

Usability Test

  • 1. Usability Test- GetGlue Jessica Torrez-Riley Cassie Gooding Emily Kamischke
  • 2. Motivation Social media is one of the major players in interactive media. Major social media outlets, such as Facebook and Twitter, are setting the standards for other iterations and opening the door for niche markets. One of the new trends is “check-in” oriented sites. As part of the new trend of social TV, GetGlue uses the “check-in” feature to link users to their chosen entertainment.
  • 3. Objectives Evaluate difficulty of site usability. Power social media users v. Novice social media users “Check-in”, navigation, search bar, and “liking” Indirectly, live-updating newsfeed, reward system, recommendation system Evaluate attitude towards site features. Likelihood of continued use Multi-tasking while consuming entertainment Effect of reward system
  • 5. Participants Total Number: 8 Segmentation: 4 power Avg. TV Hours Avg. Online Hours Avg. Social Media Hours users v. 4 novice users Selection: selected based Power Users 3.5 3.0 5.75 on a combination of TV watching habits and social media prowess Novice Users 4.25 1.25 2.25
  • 6. Environment Intended for use while entertainment consumption is occurring, whether online or in physical form. Testing website as it would be used on a home computer. Participants were tested in home-like environments. Individually tested Limited instructor involvment
  • 7. Procedure Pre-survey Evaluate user’s social media use and TV watching habits Scripted tasks Log-in Navigation Check-in, Like, Comment Post-survey Evaluate user attitude towards site interface
  • 8. Tools Used Silverback Recorded users test using both screen capture and face capture Google Docs To survey user opinion and experience
  • 9. Task list for participants 1. Go to www.GetGlue.com 2. Login to the website using the provided user name and password Username: eu2011user1 Password: eu2011user1 3. You want to learn more about the website. Look to the bottom of the page for the “About” button to learn more about the site. Click the button and proceed to the About Company page. 4. Now that you have learned more about the site you want to “check-in” to a TV show you watch frequently, “The Deadliest Catch.” Please check-in to the show now. 5. You are intrigued by GetGlue and want to continue using it. You also frequently watch “Glee”. Check-in to “Glee” and this time you leave the comment, “I love Rachel Berry!” 6. After “Glee” airs you often watch “New Girl” so check-in to “New Girl” and then “like” “New Girl”. 7. After you realize you can like TV shows you are interested in liking music, since this is your real passion. Find and like, “Muse”, “Usher”, “Madonna”, “Carrie Underwood”, and “Britney Spears”. 8. Now that you are more familiar with the site go look for your favorite TV show and check-in. Be sure to leave a comment or like the TV show. 9. Feel free to continue exploring GetGlue, when you are done Log Out and find your instructor.
  • 10. Data Analysis Task completion Timed each task Noted miss-clicks User expectation v. actual functionality Noted method of completion Search bar v. check-in bar Power user v. Novice user Efficiency of task completion Attitude towards site purpose Attitude towards site use
  • 11. Data Analysis Task Power Users Novice Users Difference (Avg. Time) (Avg. Time) About 0:57 1:25 0:28 Check-In 1 1:05 1:52 0:47 Check-In 2 0:34 1:14 1:20 Check-In 3 0:24 0:34 0:10 Fav. Check-In 0:20 0:45 0:25 Logout 0:37 0:40 0:03
  • 12. Data Analysis Power Users (Avg. Novice Users (Avg. Task Difference Time) Time) Muse 0:10 0:39 0:29 Usher 0:08 0:35 0:27 Madonna 0:06 0:08 0:02 Carrie 0:11 0:18 0:09 Underwood Britney Spears 0:10 0:28 0:18 User 0:57 2:42 1:45 exploration
  • 13. Implications Auto-refreshing stream – footer obstruction Universal comfort with search bar vs. GetGlue’s “check-in” bar emphasis Reward system feedback inefficiency Logo-only navigation creates unmet expectations
  • 14. Video omitted for upload Auto-refreshing stream doesn’t allow for easy access to footer. • Suggestion: fixed footer or better upper navigation
  • 15. Search bar is easily used by all users, whereas rest of site is directed towards social media power users. • Suggestion: incorporate check-in into header and/or search bar function
  • 16. Most participants did not notice and/or receive a sticker. Reward system is not immediately impactful on user experience. • Suggestion: first check-in should earn first sticker and prompt user to reward system explanation
  • 17. On logout many participants noticeably expected a hover dropdown menu and became confused when expectations were not met. • Suggestion: logo navigations should be hover drop downs
  • 18. Test Suggestions User comfort with computer. All tests were done on Macs but some participants were not mac users. A more controlled environment. Attempt at natural experience actually produced unrelated distractions. Test could benefit from making participants use the interface while consuming entertainment. There were errors and room for improvement with task instructions. Many users didn’t follow directions fully or completed tasks out of order. Some tasks were completed in an unexpected manner.
  • 19. Conclusion Successfully proved that GetGlue’s Novice interface is directed towards social Power User User media power users. Interestingly, novice users claim to Ease of use 3.25 3.75 watch more TV than power users (5 – very easy) and would therefore be a better target audience. Likely to use again 2.5 1.5 While power users took less time (5 – very likely) to complete tasks, their attitude towards the site was skewed by Overall unmet expectations leading them Experience 3.25 3.0 to rate the site more difficult to (5 – very positive) use than novice users.

Hinweis der Redaktion

  1. Selection: the intent was to have a mix of power v. novice users, but that all should be TV watchers.
  2. Average time difference: 25seconds
  3. Average time difference: 25seconds
  4. ----- Meeting Notes (12/5/11 19:26) -----1/8 said they got a reward2/8 recieved stickerall recieved reward