1. usability testing of the Drupal administrative interface University of Baltimore May 2008

2. we are : graduate students in the Interaction Design and Information Architecture program at the University of Baltimore and we : performed the second round of testing of the Drupal administrative interface testing took place at UB’s User Research Lab

3. who’d we bring in? career or hobbyist web developers experienced in various content management systems (RedDot, SiteExecutive, WordPress, Joomla and others) but with no Drupal experience

4. and we asked them to get a website started for a small non-profit by: creating content creating navigation (i.e., primary links) and setting up a user account for board members

5. we used a pre- and post-test questionnaire to get participant opinions before and after using Drupal, collected gaze data with the Tobii eyetracker, and asked lots of questions

6. afterwards we analyzed the tapes for usability patterns across participants

7. so, why go through the trouble?

8. the Drupal mission statement: By building on relevant standards and open source technologies, Drupal supports and enhances the potential of the Internet as a medium where diverse and geographically-separated individuals and groups can collectively produce, discuss, and share information and ideas . With a central interest in and focus on communities and collaboration, Drupal's flexibility allows the collaborative production of online information systems and communities .

9. who are these people, and does playing with Drupal encourage them to become a Drupal user? diverse and geographically-separated individuals and groups can collectively produce, discuss, and share information and ideas

10. who wants to read a manual? “ I’m not sure what nodes are at this point because I didn’t read the manual, obviously, as I never do, I just install it out of the box and pretend that everything is going to be fine.” - - Participant 1

11. no one. people want to produce, discuss, and share information and ideas

12. and Drupal has user experience goals to try and achieve this developers: well-tooled with a system of hooks that provide ready means to accomplish most foreseeable coding aims that involve interaction with core elements administrators: easy to install and set up so that there is a minimum requirement for specific technical expertise, intuitive and self-explanatory so that administrators can easily find the configuration options they need and highly configurable so that site administrators can present just the interface they wish users: intuitive and self-explanatory so that users with minimal prior experience can easily discover, navigate, and use functionality, uncluttered so that users are not faced with a difficult task of sorting the essential from the non-essential

13. Drupal enables people around the globe to create powerful websites

14. and has some successes in the admin interface, like: participants liked the welcome page (despite some inconsistencies between the contextual links and the admin menu) and all easily located and used the Create content link

15. but we did find some problems

16. everyone expected a WYSIWYG and searched for formatting options

17. (modules were not considered by any participants)

18. participants didn’t get page and story, and spent a lot of time thinking about it

19. the parent item was not what they expected

21. to meet Drupal user experience goals, creative solutions to these problems must be found

22. but wait… overall, the major challenge for all participants was that they didn't get that the administrative menu overlays the website itself – leading to questions like:

23. where's my home page?

24. how do I preview pages?

25. … and see the structure of the site?

26. how do I see the difference between the CMS and the website I'm making?

27. this misunderstanding was the root of a lot of the problems, confusion and frustration “ Nope, can't do it.” P3 “ I have no hope that I am anywhere close.” P3 “ I don't understand what this does at all...” P1 “ Huh. That's crazy.” P2

29. Becca Scollan, Abby Byrnes, Malia Nagle, Paul Coyle, Cynthia York, Maleka Ingram Interaction Design & Information Architecture, University of Baltimore May, 2008