Usability test

1. Usability Test
Riawan Arbi Kusuma
PT Ansvia

2. Introduction

3. Usability Testing: Why?
• “Probably the best reason to test for usability
is to eliminate those interminable arguments
about the right way to do something. With
human-factors input and testing, however,
you can replace opinion with data. Real data
tend to make arguments evaporate and
meeting schedules shrink.” (Fowler, 1998,
Appendix, p. 283)

4. Usability Testing: Definition
 Degree to which a user can successfully learn and use a product to
achieve a goal
 Research methodology
• Evaluation
• Experimental design
 Observation and analysis of user behavior while users use a product
or product prototype to achieve a goal (Dumas and Reddish, 1993,
p.22)
 “User-centered design” process involving user from initial design to
product upgrade (Norlin and Winters, 2002)
 Approach is to be a servant to the users of a system NOT to be
subservient to technology (Gluck, 1998)
 Goal is to identify usability problems and make recommendations
for fixing and improving the design (Rubin, 1994)

5. Usability Testing: Background
 Relatively new methodology (Norlin and Winters,
2002)
• Origins in aircraft design
• Traced back to marketing
• Development of a product
• Popular in 1980s with widespread access to
computers
• Initiation of human computer interface usability
studies
• Evolved from human ethnographic observation,
ergonomics, and cognitive psychology
• Qualitative and quantitative data

6. Usability Testing: Purpose
 Evaluation tool
 Identify problem areas
 “Determine the fit of the design to the
intended users” (Norlin and Winters, 2002, p.
5)

7. Usability Testing: Principles
 Keep the end user in mind
 Achieve superiority through simplicity
 Improve performance through design
 Refine and iterate (Norlin and Winters, 2002,
p.10)

8. Usability Testing: Web Design Criteria
 Links must be consistent and predictable
 Group like things on the same page
 Be consistent with language
 Most important information should be on the
first screen
 Provide keywords for quick reading/scanning
 Do not use animation or sounds
 Make links look like links
 Distinguish text from graphics
 Avoid jargon (Spool, 1999)

9. Usability Testing: Web Design Criteria
 Ten Usability Heuristics (Nielsen)
• Visibility of system status
• Match between system and the real world
• User control and freedom
• Consistency and standards
• Error prevention
• Recognition rather than recall
• Flexibility and efficiency of use
• Aesthetic and minimalist design
• Help users recognize, diagnose, and recover from errors
• Help and documentation

10. Usability Testing: Web Design Criteria
 Goals for user-centered design
• Enable users to
• Achieve their particular goals and meet their needs
• Move quickly and with few errors
• Create a site that users like
• More likely to perform well on a product that provides
satisfaction

11. Usability Testing: Methodology
 Artificial environment (laboratory)
• Maintain more control
• May provide more specific data on a particular
feature
 Natural environment
• Better holistic representation of real people doing
real work

12. Usability Testing: Methodology
 Four types of usability tests (Rubin, 1994, p.
31-46)
• Exploratory test – early product development
• Assessment test – most typical, either early or
midway in the product development
• Validation test – verification of product’s usability
• Comparison test – compare two or more designs;
can be used with other three types of tests

13. Usability Testing: Interpret Data
 Usable Web site: (Rubin, 1994)
• Usefulness
• Establish whether it does what the user needs it to do
• Effectiveness
• Ease of use to achieve the desired task
• Learnability
• Ease of learning application and moving from being a novice
to a skilled user
• User satisfaction
• User’s attitude about the site—how enjoyable it is to use

14. Usability Testing: Report Results
 Executive summary
 Report
• Describe methodology
• Who, what, when, where, and how
• Describe how tests were conducted
• Profile users and describe sampling
• Detail data collection methods
• Succinctly explain the analysis
• Provide screen captures
• Include tables and graphs
• Provide examples
• Identify strengths and weaknesses
• Recommend improvements

15. Beberapa Feedback User Mindtalk
• “Aku wes gabung channel akeh, tapi jebule
channel e mati”
• “Kok lemot to bro?”
• “Arbi, itu dialog buat post baru sering error
ya? Button send postnya sering ilang-ilang
sendiri”
• “Ada yang aneh dengan page popular bro, can
u see that?”

16. Terimakasih