This document provides an agenda for a user testing class held on December 2, 2010. The agenda includes: 1. A discussion of the fundamentals of user testing from 9:05-9:55am with a 5 minute break. 2. A session on how to conduct user tests from 10:00-11:10am. 3. A class debrief from 11:10-11:50am to discuss what problems were found and best practices. 4. Instructor evaluations will be completed from 11:50am-noon. The document provides details on the instructor's qualifications and experience with user testing and web design. It also outlines the topics to be covered in the

1. User Testing
December 2, 2010
Linda Kolker, Instructor
Sponsored by
Chamber Business Academy and PVCC Workforce Services

2. Today’s Agenda
(revised)
1. Fundamentals of User Testing 9:05-9:55 am.
Break: 5 minutes 9:55-10:00 a.m.
2. Conduct Tests 10:00-11:10 a.m.
3. Class Debrief 11:10-11:50 am.
What to Fix/Review Best Practices
4. Instructor Evaluations 11:50-noon
Restrooms: Go right—at end of hall
Vending machines: Left
2

3. Who does she think she is?
• Expert at web best practices, site usability, writing
• Helped launch CD-ROM technology
• Wrote book HR Manager’s Guide to Internet, 1996
• Worked on development of scores of business web sites
• Worked with UVa Arts & Sciences web team for complete overhaul without
changing overall design
• In-house training on web best practices
• Board, New Media Society of Washington, Charlottesville Business
Innovation Council
• Grandfather transported technology and built first ice-making factory in
Mosul, Iraq
3

4. The Fundamentals of User Testing
4

5. “Just sit next to someone
and watch them do stuff”
-- Dana Chisnell
5

6. Easiest, most effective & cheapest!
You can do it yourself
6

7. Identify
problems
Choose
Fix process:
Problems “Get it “vs.
“Key tasks”
The test:
Tester
Facilitator
Observer
Recruit
Debrief Testers
Define
internal
roles:
Facilitator
Observer
7

8. Identify
problems
Choose
Fix process:
Problems “Get it “vs.
“Key tasks”
The test:
Tester
Facilitator
Observer
Recruit
Debrief Testers
Define
internal
roles:
Facilitator
Observer
8

9. The “bible” for do-it-yourself testing
9

10. The springboard
Problems with your site
10

11. What you need
 A test plan – “Get it” vs. “key tasks”
11

12. What you need
 A test plan – “Get it” vs. “key tasks”
 Participants – people who will test
12

13. What you need
 A test plan – “Get it” vs. “key tasks”
 Participants – people who will test
 Facilitator
13

14. What you need
 A test plan – “Get it” vs. “key tasks”
 Participants – people who will test
 Facilitator
 Main observer
14

15. What you need
 A test plan – “Get it” vs. “key tasks”
 Participants – people who will test
 Facilitator
 Main observer
 Other observers
15

16. What you need
 A test plan – “Get it” vs. “key tasks”
 Participants – people who will test
 Facilitator
 Main observer
 Other observers
 A place to test
16

17. What you need
 A test plan – “Get it” vs. “key tasks”
 Participants – people who will test
 Facilitator
 Main observer
 Other observers
 A place to test
 A computer
 Voice recorder or software (Camtasia is an option)
17

18. Conduct the tests
 Facilitator follows the prepared script
18

19. Conduct the tests
 Facilitator follows the prepared script
 Main observer takes notes
19

20. Conduct the tests
 Facilitator follows the prepared script
 Main observer takes notes
 Facilitator and main observer debrief immediately
20

21. Practice
 Guidelines for using the script (p. 6, handout)
 Practice the facilitator script (p. 7 , handout)
21

22. Conduct the test
22

23. Conduct the test
 Find your sense of humor!! Relax.
23

24. Conduct the test
 Find your sense of humor!! Relax.
FACILITATOR
 Bookmark your site in “Favorites.”
24

25. Conduct the test
 Find your sense of humor!! Relax.
FACILITATOR
 Bookmark your site in “Favorites.”
 Put Google on the screen.
25

26. Conduct the test
 Find your sense of humor!! Relax.
FACILITATOR
 Bookmark your site in “Favorites.”
 Put Google on the screen.
 Start reading the script. At the appropriate point, go to
favorites and bring up your screen.
26

27. Conduct the test
 Find your sense of humor!! Relax.
FACILITATOR
 Bookmark your site in “Favorites.”
 Put Google on the screen.
 Start reading the script. At the appropriate point, go to
favorites and bring up your screen.
 Make notes only on what you want to explore with user.
27

28. Conduct the test
 Find your sense of humor!! Relax.
FACILITATOR
 Bookmark your site in “Favorites.”
 Put Google on the screen.
 Start reading the script. At the appropriate point, go to
favorites and bring up your screen.
 Make a note only on what you want to ask user later, for
probing (ie: “Chose 2nd link—why?”)
28

29. Quick debrief after each test
29

30. BREAK
30

31. 3… 2…1…
test!
Learn by trial and error. “Mistakes” are part of the plan!
If you need help:
 Ask your tester (!)
 Refer to handout
 Ask instructor
31

32. 3… 2…1…
test!
Learn by trial and error. “Mistakes” are part of the plan!
Groups of three. An extrovert in each triad, if possible.
[You know who you are ;-) ]
Choose your facilitator. For first round, should be the most
outgoing, extroverted person.
Choose your observer and tester.
32

33. Keep track of the time!
Each complete testing session has 30 minutes.
 20 minutes for preparation and testing
 3-5 minutes for home page
 15 minutes for other pages
 10 minutes for debrief (for this class only, tester can
participate in debrief).
33

34. 34

35. Debrief
 After multiple sessions, meet with team to identify all problems.
They’ll be obvious.
 Ask yourself: Will a lot of people experience this problem?
 Will it cause a serious problem, or is it just an inconvenience?
 List the problems you’re going to fix before the next round of user
testing.
 Take the worst first. Focus ruthlessly only on the most serious
problems, or you’ll never get it done.
35

36. Discussion of exercise
36

37. Guidelines on how to fix problems
 Follow best practices guidelines (resources are at the end
of your handout).
BUT
 They are ONLY guidelines. You must do what works best
for your users and your site!
37

38. Five Core Questions
1.What is this organization about?
2.What is this web site about?
3.How do I find what I’m looking for?
4.What can I do next?
5.How can I get back to where I was?
38

39. Communicates the purpose of your business and your site
 Tag line that explicitly summarizes what the organization
and/or site does
 Value proposition clearly stated
 Name and logo at top / in upper left corner
39

40. Navigation
Do links take users to content they expect to
see? No surprises, please.
Does home page provide links to most
important (to users) content on the site?
On any page, can user tell where they are in
relation to entire site?
March 2010 40
lindakolker.com 434-984-6619
Best Practices for Your Web Site

41. Content
 Subheads
 Bulleted lists
 Highlighted keywords
 Short paragraphs
 The inverted pyramid
 A simple writing style
 De-fluffed language devoid of marketese.
--Jakob Nielsen, Alertbox
March 2010 41
lindakolker.com 434-984-6619
Best Practices for Your Web Site

42. (if enough time) Main take-away?
Mandatory: Instructor Evaluations
42