1. • Compile
• Summarize data
• Analyze data
• Develop recommendations
• Produce the final report
Wednesday, March 28, 12

2. Data Analysis
Wednesday, March 28, 12

3. next 2 weeks:
Wednesday, March 28, 12

4. Wednesday, March 28, 12

5. Wednesday, March 28, 12

6. Step 1: Compile
Wednesday, March 28, 12

7. Wednesday, March 28, 12

8. Get it into a pile.
Wednesday, March 28, 12

9. Get your piles sorted.
Wednesday, March 28, 12

10. Ideally:
Wednesday, March 28, 12

11. compile as you test.
Wednesday, March 28, 12

12. further test the test.
Wednesday, March 28, 12

13. keep the data legible.
Wednesday, March 28, 12

14. • Type handwritten notes
• Verify data captures
• Back up files
Wednesday, March 28, 12

15. Organize raw data.
Wednesday, March 28, 12

16. Do whatever it takes to
get it done.
Wednesday, March 28, 12

17. • lists
• tallies
• matrices
• stories
• structure models
• flow diagrams
Wednesday, March 28, 12

18. Wednesday, March 28, 12

19. Wednesday, March 28, 12

20. Wednesday, March 28, 12

21. Wednesday, March 28, 12

22. Goal:
Wednesday, March 28, 12

23. Wednesday, March 28, 12

24. Step 2: summarize
Wednesday, March 28, 12

25. 1. task accuracy
Wednesday, March 28, 12

26. number of errors made
per task
Wednesday, March 28, 12

27. • categorize errors by type
• ommission
• commission
Wednesday, March 28, 12

28. # of participants who performed:
• successfully
• successfully but with some assistance
• assistance types, tasks, products
Wednesday, March 28, 12

29. Vital Statistics:
Wednesday, March 28, 12

30. % performing successfully, including those
who needed assistance
• regardless of time limits
• regardless of assistance needed
Wednesday, March 28, 12

31. If this percentage is
very low, you’ve got a
serious problem.
Wednesday, March 28, 12

32. % performing successfully
• including those who corrected errors
Wednesday, March 28, 12

33. % performing successfully within
benchmark
• indicative of efficiency
Wednesday, March 28, 12

34. 2. task timings
Wednesday, March 28, 12

35. Wednesday, March 28, 12

36. summarize
preference data
Wednesday, March 28, 12

37. Limited choice questions:
• Sum by choice
• Chart trends
Wednesday, March 28, 12

38. Free-form questions:
• Group into meaningful categories
• Ex: particular screen, doc section, etc.
Wednesday, March 28, 12

39. Summarize other measures
• Unnecessary returns to main navigation
• Number/type of hints and prompts
• Times site map was accessed
• Points of hesitation (and for how long)
Wednesday, March 28, 12

40. Summarize by Group/Version
Wednesday, March 28, 12

41. (see pages 255 - 259)
Wednesday, March 28, 12

42. 3: analyze data
Wednesday, March 28, 12

43. What didn’t succeed?
Wednesday, March 28, 12

44. Wednesday, March 28, 12

45. What were the
difficulties?
Wednesday, March 28, 12

46. What were the
error sources?
Wednesday, March 28, 12

47. Prioritize problems
by severity
Wednesday, March 28, 12

48. Severity descriptions &
definitions: p. 262
Wednesday, March 28, 12