UX Antwerp Meetup, 25th of April, 2017 - organised by UXprobe https://www.uxpro.be/
Jan Moons, UX expert and founder of UXprobe (Antwerp, Belgium)
"Usability testing 101-ish"
A live demo of a usability test, to show all learnings we can get from a single test.
4. Problem of unusable products
Product team focuses on machine and underlying system.
Not on the person who will actually use the system!
5. Different models
User / Mental Model
Representation a user has in his
mind about the object he is
interacting with
Design / Conceptual Model
Actual model that is given to the
user through the design and
interface of the product
System Model
How the system actually works
6. Good Design Model
• Resembles User Model as
close as possible
• The more it resembles the
more user friendly the
product
7. ISO 9241-11
The extent to which a
product can be used by
specified users to achieve
specified goals with
effectiveness, efficiency and
satisfaction in specified
context-of-use
Bailey’s Human Performance Model
8. ISO 9241-11 – Measuring usability
Effectiveness
• Can users achieve their goals with the
product?
• Can they do what the product says it
should be able to do?
Efficiency
How much effort is required from the
users in order to achieve their goals?
Satisfaction
It is no good if users can achieve their
goals quickly if they hate the system, they
will probably go somewhere else
10. Usability testing
• Involves real users
• Test participants perform real
tasks to achieve their goals
• Observe behavior: what test
participants do and “say”
• Observations are logged to
analyze and identify real
problems
11. Iterative process
More rounds of small scale
tests
1st round: most significant
problems
1. Fix these problems…
2. 2nd round: new problems
uncovered
3. Fix these problems…
4. Etc.
12. Small sample sizes
~5 participants in a usability test
• Find about 80% of problems
• 80% contains most important
issues
By the end of the design you
might have tested with 20 – 30
participants if not more (with the
assumption of 1 segment)!
16. Welcome participant
Hey XXX, I am Jan and I have been asked by the team from Clear, a to-
do app, to check how easy it is to use their app.
I will give you some tasks which you should try to complete.
In the meanwhile talk out loud and explain whatever you want to do,
what you are looking for, how you feel, etc.
Any Questions so far?
17. Audience observes!
Take notes:
• Behaviors: the first thing he does, unexpected behavior, etc.
• Positive and negative comments
• Errors / problems / issues
• Completion (success or failure) on each task
18. Task 1
You are going for a swim tomorrow.
To make sure you will not forget to pack the necessary “swimming gear”,
you just downloaded the Clear app on your phone.
You are going to make a new to-do list called: “Going for a swim” and add
your “swimming gear” to it.
Can you show us how you normally would do that?
Tell me when you think you completed the task!
20. Task 2
You are ready to pack your Swimming gear
You open up the Clear app again and start checking off the items you
add to your rug sack.
When you are done checking off your swimming gear, remove the to-
do list all at once!
Tell me when you think you completed the task!
25. What did we observe?
• Behaviors
• Positive and negative comments
• Errors / problems / issues
• Completion (success or failure) on each task
26.
27.
28. Zoek het energietarief voor gas en elektriciteit dat het beste bij jouw huidige situatie past
S c e n a r i o 1
Task completion: 78%
Time-on-Task: 6m35s
Quotes Abandon
• “Als dit niet werkt dan zoek ik wel op de website van de
VREG zo ben ik ook bij mijn huidige leverancier terecht
gekomen”
• “Dat is vervelend! Als dit hun website is dan stop ik!”
Satisfaction
Hoe moeilijk of gemakkelijk was het om deze taak uit te
voeren?
My name is Jan Moons, I am the Co-Founder and product manager at UXprobe
Good afternoon, I am Jan Moons, co-founder of UXprobe
UXprobe builds software to help you improve the usability of your products, apps and services
Although our tools are for product managers and UX professionals we also keep our customer’s end-users in mind
Because we don’t want to ruin their experience with the products they are testing because our software gets in their way
For more than a decade now, I have been conducting tons of usability tests, the last one was only 2 weeks ago
Minimum 5 persons
5 participants find about 80% of the usability problems
80% contains the most important problems
From the 6th person more or less the same problems will be found
Spend budgets wisely. Develop more efficiently. And … make your users happy!
Try UXprobe now.