This document discusses tips and best practices for conducting remote user testing. Some key points include moderating pilots to work out issues, using around 40 cards for card sorting, requiring participants to name groups and fully sort cards, using incentives to boost completion rates, iterating testing to improve based on results, and segmenting participants to tailor tests. It also provides examples of tools that can be used for different testing methods like tree testing, card sorting, and click testing.

1. Optimal IA - Pro Tips for
REMOTE USER TESTING
Optimal Workshop
with @optimalworkshop
Andrew Mayfield
by @andrewfantastic
Friday, 6 April 12

2. QUESTIONS
WELCOME
Friday, 6 April 12

3. SWITZERLAND
SAN DIEGO
NEW ZEALAND
Friday, 6 April 12

4. Friday, 6 April 12

5. Friday, 6 April 12

6. WHAT THEY DO
Friday, 6 April 12

7. WHAT YOU GET
Friday, 6 April 12

8. Friday, 6 April 12

9. Friday, 6 April 12

10. PARTICIPANT
CENTRIC
ANALYSIS
Friday, 6 April 12

11. tip
MODERATE PILOTS
with
or
Friday, 6 April 12

12. Friday, 6 April 12

13. Friday, 6 April 12

14. Friday, 6 April 12

15. SOON
Friday, 6 April 12

16. QUAL
vs
QUANT
Friday, 6 April 12

17. tip
QUAL
❤❤
QUANT
Friday, 6 April 12

18. tip
~40 CARDS
Friday, 6 April 12

19. 100"
participant completion rate (%)
90"
80"
70"
60"
50"
40"
30"
20"
10"
0"
20" 30" 40" 50" 60" 70" 80" 90" 100" 110" 120"
number of cards
Friday, 6 April 12

20. Friday, 6 April 12

21. Friday, 6 April 12

22. OptimalSort
73%
COMPLETION RATE
Friday, 6 April 12

23. OptimalSort
65% anon
75% email
80% other
COMPLETION RATE
Friday, 6 April 12

24. OptimalSort
has_password
Friday, 6 April 12

25. OptimalSort
REQUIRE
all groups named
all cards sorted
Friday, 6 April 12

26. tip
SCREEN
with
Friday, 6 April 12

27. tip
INCENT
Friday, 6 April 12

28. tip
FOCUS
Friday, 6 April 12

29. tip
CLOSED
CARD SORTING?
Friday, 6 April 12

30. Friday, 6 April 12

31. Friday, 6 April 12

32. tip
SPREADSHEETS
are still ok with me
Friday, 6 April 12

33. Friday, 6 April 12

34. tip
BENCHMARK!
Friday, 6 April 12

35. tip
Find About Us
Friday, 6 April 12

36. The Pietree
Went down the right path
Went down the wrong path
Went back up the tree
Contact us Chose this as the answer
Visualising
Handsets
Skipped question
Moving house
Monthly plans
Tree Test Knowledge base Pay as you go plans
Results
65 people (46%)
Frequently asked questions went the wrong Internet on your cell phone
way Support click
Help &
on first
Cell Phones & Plans
Nobody went Upgrade my plan Accessories
here. Yay!
My Account
Account tools
Moving house
Home phone plans
Home Home Phone
Most people who
got here went
Add-ons
back up the tree
Premium Services
Internet Of the 54 people who
The task got here, 48 correctly
chose this answer
“Find the lowest cost home Games
Home internet plans
broadband solution.”
Music News
3G Broadband
Of the 16 people who
got here, 15 incorrectly
chose this answer
Treejack
3G Broadband plans
Coverage map
Friday, 6 April 12

37. tip
EVIL ATTRACTORS
Friday, 6 April 12

38. Friday, 6 April 12

39. tip
ITERATE
Friday, 6 April 12

40. tip
CONSERVE
THY
PARTICIPANTS
Friday, 6 April 12

41. tip
~9 TASKS
Friday, 6 April 12

42. Friday, 6 April 12

43. Friday, 6 April 12

44. Friday, 6 April 12

45. this slide was stolen from Nate Bolt
Friday, 6 April 12

46. tip
SEGMENT
Friday, 6 April 12

47. !"w "#r $""%& r"%% '( )
UXPROCESS
OPEN CLOSED
CLICK CARD CARD TREE CLICK
TEST SORT SORT TEST TEST
Chalkmark OptimalSort OptimalSort Treejack Chalkmark
Friday, 6 April 12

48. BUY-IN
Friday, 6 April 12

49. 20% off
MKFLYERS
itsourresear.ch
Friday, 6 April 12

50. THANK YOU,
YOU’RE AWESOME.
Friday, 6 April 12

51. PROBLEM
Quantifying the
effectiveness of an IA is
HARD WORK
Friday, 6 April 12

52. Peter Morville’s
UX HONEYCOMB
useful&
usable& desirable&
valuable&
findable& accessible&
credible&
Friday, 6 April 12

53. Peter Morville’s
UX HONEYCOMB
useful&
usable& desirable&
valuable&
findable& accessible&
credible&
Friday, 6 April 12

54. CONTENT
Organisa(on*
Naviga(on* Labelling*
Search*
Friday, 6 April 12

55. CONTENT
Organisa(on*
Naviga(on* Labelling*
Search*
Friday, 6 April 12