2. Motivation
Social media is one of the major players in interactive
media. Major social media outlets, such as Facebook
and Twitter, are setting the standards for other
iterations and opening the door for niche markets.
One of the new trends is “check-in” oriented sites.
As part of the new trend of social TV, GetGlue uses
the “check-in” feature to link users to their chosen
entertainment.
3. Objectives
Evaluate difficulty of site usability.
Power social media users v. Novice social media users
“Check-in”, navigation, search bar, and “liking”
Indirectly, live-updating newsfeed, reward system,
recommendation system
Evaluate attitude towards site features.
Likelihood of continued use
Multi-tasking while consuming entertainment
Effect of reward system
5. Participants
Total Number: 8
Segmentation: 4 power Avg. TV
Hours
Avg. Online
Hours
Avg. Social
Media Hours
users v. 4 novice users
Selection: selected based Power
Users
3.5 3.0 5.75
on a combination of TV
watching habits and
social media prowess Novice
Users
4.25 1.25 2.25
6. Environment
Intended for use while entertainment consumption is
occurring, whether online or in physical form.
Testing website as it would be used on a home
computer.
Participants were tested in home-like environments.
Individually tested
Limited instructor involvment
7. Procedure
Pre-survey
Evaluate user’s social media use and TV watching habits
Scripted tasks
Log-in
Navigation
Check-in, Like, Comment
Post-survey
Evaluate user attitude towards site interface
8. Tools Used
Silverback
Recorded users test using both screen capture and face
capture
Google Docs
To survey user opinion and experience
9. Task list for participants
1. Go to www.GetGlue.com
2. Login to the website using the provided user name and password
Username: eu2011user1
Password: eu2011user1
3. You want to learn more about the website. Look to the bottom of the page for the
“About” button to learn more about the site. Click the button and proceed to the
About Company page.
4. Now that you have learned more about the site you want to “check-in” to a TV
show you watch frequently, “The Deadliest Catch.” Please check-in to the show
now.
5. You are intrigued by GetGlue and want to continue using it. You also frequently
watch “Glee”. Check-in to “Glee” and this time you leave the comment, “I love
Rachel Berry!”
6. After “Glee” airs you often watch “New Girl” so check-in to “New Girl” and then
“like” “New Girl”.
7. After you realize you can like TV shows you are interested in liking music, since this is
your real passion. Find and like, “Muse”, “Usher”, “Madonna”, “Carrie
Underwood”, and “Britney Spears”.
8. Now that you are more familiar with the site go look for your favorite TV show and
check-in. Be sure to leave a comment or like the TV show.
9. Feel free to continue exploring GetGlue, when you are done Log Out and find your
instructor.
10. Data Analysis
Task completion
Timed each task
Noted miss-clicks
User expectation v. actual functionality
Noted method of completion
Search bar v. check-in bar
Power user v. Novice user
Efficiency of task completion
Attitude towards site purpose
Attitude towards site use
12. Data Analysis
Power Users (Avg. Novice Users (Avg.
Task Difference
Time) Time)
Muse 0:10 0:39 0:29
Usher 0:08 0:35 0:27
Madonna 0:06 0:08 0:02
Carrie
0:11 0:18 0:09
Underwood
Britney Spears 0:10 0:28 0:18
User
0:57 2:42 1:45
exploration
13. Implications
Auto-refreshing stream – footer obstruction
Universal comfort with search bar vs. GetGlue’s
“check-in” bar emphasis
Reward system feedback inefficiency
Logo-only navigation creates unmet expectations
14. Video omitted for upload
Auto-refreshing stream doesn’t allow for easy access to footer.
• Suggestion: fixed footer or better upper navigation
15. Search bar is easily used by all users, whereas rest of site is directed
towards social media power users.
• Suggestion: incorporate check-in into header and/or search bar function
16. Most participants did not notice and/or receive a sticker. Reward
system is not immediately impactful on user experience.
• Suggestion: first check-in should earn first sticker and prompt user to reward
system explanation
17. On logout many participants noticeably expected a hover dropdown
menu and became confused when expectations were not met.
• Suggestion: logo navigations should be hover drop downs
18. Test Suggestions
User comfort with computer.
All tests were done on Macs but some participants were not mac users.
A more controlled environment.
Attempt at natural experience actually produced unrelated distractions.
Test could benefit from making participants use the interface while
consuming entertainment.
There were errors and room for improvement with task instructions.
Many users didn’t follow directions fully or completed tasks out of order.
Some tasks were completed in an unexpected manner.
19. Conclusion
Successfully proved that GetGlue’s Novice
interface is directed towards social Power User
User
media power users.
Interestingly, novice users claim to Ease of use 3.25 3.75
watch more TV than power users (5 – very easy)
and would therefore be a better
target audience. Likely to
use again 2.5 1.5
While power users took less time (5 – very likely)
to complete tasks, their attitude
towards the site was skewed by Overall
unmet expectations leading them Experience 3.25 3.0
to rate the site more difficult to (5 – very positive)
use than novice users.
Hinweis der Redaktion
Selection: the intent was to have a mix of power v. novice users, but that all should be TV watchers.
Average time difference: 25seconds
Average time difference: 25seconds
----- Meeting Notes (12/5/11 19:26) -----1/8 said they got a reward2/8 recieved stickerall recieved reward