Analyzing the usability of Microsoft Word's evolving interface.

1. *
Adam Emfield
Philip Jones
Ryan McGarry

2. * Microsoft Word 2007 introduced new interface paradigm
(the “Ribbon”) to organize options differently
* Many claim the newer version slows them down, making it harder
to find familiar menu choices that have been reorganized
* Task-based layout
* Word 2010 tweaks 2007, adds Backstage View
*

3. *Tested for empirical confirmation of
anecdotal evidence
* Data from Word 2003, 2007, and 2010 beta
*Each version tweaks method of formatting
text, tracking changes/working with
comments, and accessing printing options
*

4. *Participants had ”moderate” or more
experience with 2003, 2007
* No experience required with 2010 beta
*Given standardized instructions
*Asked to perform specific tasks
* Formatting text, header
* Adding reader comments
* Changing printing options
*

5. * Data collected with screen capture software
* Observation with minimal interaction
* Recorded verbalizations to gain insight into
user perceptions
* Verbal protocol analysis
*

6. * Verbal protocol analysis
* KLMs
* Task x Version
* Timeline analyses
* High resolution due to small task time
*

7. * We predicted that some tasks with new, logical
menu locations would be faster in 2007
* e.g. Changing formatting, double-spacing text
* Other tasks with a longer workflow faster in 2003
* e.g. Adding comments
* Word 2010 beta will improve upon „File‟ menu
operations (compared to 2007), all else constant
* e.g. Print, Save
*

8. *

9. *

10. Expected Task Duration by Version
160.00
140.00
120.00
100.00
Time (sec)
2003
80.00
2007
60.00 2010
40.00
20.00
0.00
Task 1 Task 2 Task 3
*

11. *

12. Time (s) 2003 2007 2010
2 Edit Header Edit Header Edit Header
35.7 34 36.7
10
20
30
Double-Space Document
Double-Space Document 11.3 Double-Space Document
40 7.7 11.3
Format Title Page in APA Format
21.7 Format Title Page in APA Format
50 24 Format Title Page in APA Format
30.7
60
Insert Page Break
70 5.7
Insert Page Break
2.7
80 Insert Page Break
5.3
84
*

13. Time (s) 2003 2007 2010
2 Turn on Track Changes Turn on Track Changes Turn on Track Changes
5.5 7 6.5
10 Correct Spelling Errors and Duplicate Words Correct Spelling Errors and Duplicate Words
144.5 Correct Spelling Errors and Duplicate Words 43.5
78.5
20
30
40
50
Accept Changes in Introduction
6.5
60 Read Comments in Methods Section
9
70 Add Comments to Methods Section
23.5
80
90 Accept Changes in Introduction
10
100 Read Comments in Methods Section
8.5
Add Comments to Methods Section
110 25
120
130
140
150
Accept Changes in Introduction
9.5
160
Read Comments in Methods Section
8.5
*
170
Add Comments to Methods Section
30
180
190
200

14. Time (s) 2003 2007 2010
2 Select Print Select Print Select Print
3.7 4.3 4.7
Select Desired Printer Select Desired Printer Select Desired Printer
5.3 4.3 6.3
10 Edit Advanced Options
Edit Advanced Options 48 Edit Advanced Options
46.3 39.7
20
30
40
50
Print Specific Pages
5.3
60 Print Specific Pages Print Specific Pages Turn Off Collate
4 4.3 6
Turn Off Collate (2.3) Turn Off Collate (2)
Select Print Select Print Select Print
1.7 2 10.3
70
74
*

15. *

16. * Reading comprehension
* 180 WPM on a monitor
* Ziefle, M. (1998), Effects of display resolution on visual performance, Human Factors, 40(4), 555–568.
* Confounds
*

17. * VPA: greater frustration with 2007 associated with
greater experience ratio with 2003 (vs. 2007)
* Minimal changes between 2007, 2010 beta
* Users with 2010 experience likely to prefer
2007/2010 over 2003
*