Milestone 6 - Final Design

1. Final Project - CloudDesigner
Usability Testing & Final Prototype
Collin Aycock
Nick Dozier
Alice Leung
Matt Craig
November 19, 2015

2. Usability Testing
Test Plan
Test Goals
Our test goals are to have users perform a task for clicking through the review path, and
determine if there are any further navigational errors or confusion of labels/language.
We would also like to get feedback on the visual design of CloudDesigner to see if the
majority of the participants like the color scheme/font, etc.
Methods
Our usability tests will be conducted in person using the appropriate device. The tester will
administer the test following our script and record the results into a shared spreadsheet.
When necessary, a user can be tested remotely using Google Hangouts.
Description of Target Participants
Stakeholders who use review system/websites to make a decision to purchase, get
feedback for their own designs and inspiration.

3. Usability Testing
Test Plan (cont.)
Test Script
Introduction
Hi, my name is ______. Thank you for agreeing to take part in our usability evaluation.
During the rest of the session, I will be working from a script to ensure that my
instructions to everyone who participates in the study are the same. I will ask you to
use CloudDesigner to perform the task.
Task Prompts
I would like you to pretend that you are a Product Owner who needs to approve a new
design for the company website. Your goal is to find that design on the
CloudDesigner site, view it, and leave feedback either approving or suggesting
changes to the design. You can consider the task complete, once you have left
appropriate feedback on this design.

4. Usability Testing
Test Plan (cont.)
Test Script (cont.)
Post-task Questions
From a scale from 1 to 5 (1-very easy to 5-very difficult), how easy was this task to complete?
Was there anything confusing about the task?
Was their anything enjoyable or especially notable about completing the task?
Was their any language or labels that you had a difficult time understanding?
What was your favorite thing about the app?
What was your least favorite thing about the app?
What improvements would you suggest be added to this app?
Would you find this app useful in real life?

5. Usability Testing
Test Findings - Participant #1
● Moderator: Nick
● Device: Mobile
● Test Subject Info
○ Name: Brandon
○ Demographics: Male, 31 years of age, Engineer (Sports Equipment)
○ Characteristics: Loves to go on Amazon to buy and leave feedback on products.
● Why they fit as our target audience
○ He is an engineer who enjoys browsing through different designers/engineers’ projects to get inspiration.
● Where they struggled
○ He had difficulty leaving a comment on a mobile device (iPhone5).
● Feedback from post-task and post-test sessions
○ Positive: Easy to use
○ Negative: Did not like the color, too black and white, needs more “design” to make it look
professional/trustworthy.

6. Usability Testing
Test Findings - Participant #2
● Moderator: Nick
● Device: Desktop
● Test Subject Info
○ Name: Layla
○ Demographics: Female, 40 years of age, Technical Writer
○ Characteristics: Layla goes on Yelp to search for restaurants before going for dinner. She sometimes
would write reviews on restaurants to let others know the quality of the food.
● Why they fit as our target audience
○ She browses through restaurants nearby before she picks a place to eat dinner with friends.
● Where they struggled
○ Stars didn’t work on rating when she tried to rate the project.
● Feedback from post-task and post-test sessions
○ Positive: Login was quick and easy. She likes the “Welcome username” text.
○ Negative: Login was not easy to see/find.

7. Usability Testing
Test Findings - Participant #3
● Moderator: Nick
● Test Subject Info
○ Name: Trevor
○ Demographics: Male, 35 years of age, Visual Designer
○ Characteristics: Trevor loves to use Glassdoor to search for company reviews before he interviews at a
firm.
● Why they fit as our target audience
○ Because he browses through reviews on companies, he is a good target audience for this crowdsourcing
review system.
● Where they struggled
○ Stars didn’t work; it would be helpful if they took my ratings.
● Feedback from post-task and post-test sessions
○ Positive: Ease of use.
○ Negative: The ratings might influence other commenters, maybe hide overall rating until they leave
feedback. Add some gamification to encourage designers to use. Show them their ratings relative to other
designers.

8. Usability Testing
Test Findings - Participant #4
Moderator: Collin
Device: Mobile
Test Subject Info:
Name: Steven
Demographics: Male, 28 years of age, Electrical Engineer
Characteristics: Enjoys eccentric music and thought problems
Why they fit as our target audience
He is an electrical engineer who enjoys looking through other designers’ projects to get inspiration for his
medical device projects.
Where they struggled
None
Feedback from post-task and post-test sessions
Positive: Useful concept
Negative: Need a way to rate/rank reviewers based on usefulness of comments

9. Usability Testing
Test Findings - Participant #5
Moderator: Collin
Device: Tablet
Test Subject Info:
Name: Steve
Demographics: Male, 29 years of age, Biomedical Engineer
Characteristics: Enjoys online shopping.
Why they fit as our target audience
He is an Biomedical engineer who browse through reviews to find good designers to hire for his company.
Where they struggled
N/A
Feedback from post-task and post-test sessions
Positive: Good design flow
Negative: Need a way to rate/rank reviewers based on usefulness of comments.

10. Usability Testing
Test Findings - Participant #6
Moderator: Collin
Device: Desktop
Test Subject Info:
Name: Heather
Demographics: Female, 26 years of age, Nuclear Engineer
Characteristics: Enjoy the engineering design process
Why they fit as our target audience
Even though she’s a Nuclear Engineer, her passion is to design beautiful websites for people to use. So she
looks through other peoples’ projects to get ideas.
Where they struggled
She tried to use search, but found it frustrating she couldn’t use them.
Feedback from post-task and post-test sessions
Positive: Thought that the feedback loop was useful. The color palette was nice and professional.
Negative: Non-working search function

11. Usability Testing
Test Findings - Participant #7
Moderator: Alice
Device: Desktop
Test Subject Info:
Name: Bob
Demographics: Male, 45 years of age, Machinist
Characteristics: He is very organize and loves to read reviews before buying parts to machine.
Why they fit as our target audience
Even though he is a machinist and not a designer, he oftens would read reviews of components before buying
parts to make sure he has good parts to machine prototypes.
Where they struggled
When pressed the “Enter” key, it didn’t submit the comment.
Feedback from post-task and post-test sessions
Positive: It was easy and user-friendly; looks like it doesn’t have too many things to navigate through.
Negative: Rating systems need to be more interactive.

12. Usability Testing
Test Findings - Participant #8
Moderator: Alice
Device: Mobile
Test Subject Info:
Name: Jeff
Demographics: Male, 45 years of age, Engineer
Characteristics: He oftens goes on Grainger to read reviews on equipment before he buys.
Why they fit as our target audience
He loves the the selections on Grainger website, and likes to leave comments to let people know that the
equipment are good or bad to use.
Where they struggled
It was not clear to him that the prototype design was clickable or not, and there were no stars for him to click,
so he couldn’t rate it.
Feedback from post-task and post-test sessions
Positive: It was straight-forward, simple, and easy-to-use.
Negative: No ratings, the comment was not on top after submitting feedback.

13. Usability Testing
Test Findings - Participant #9
Moderator: Alice
Device: Desktop
Test Subject Info:
Name: Clay
Demographics: Male, 25 years of age, Visual Designer
Characteristics: He is a designer who works at Facebook News Feed team.
Why they fit as our target audience
Since he is a designer, he always goes on projects website to look at other peoples’ designs for inspiration.
Where they struggled
Initially he thought that he had been given the wrong link since the site read more as a public website review
page rather than a site to give internal feedback on a new app design.
Feedback from post-task and post-test sessions
Positive: Liked the ease of submitting a review, it was nice that it only took 5 steps.
Negative: The starring system didn’t make much sense; he didn’t understand the need to give it a set of stars
when he’s giving feedback on what does and doesnt’ work.

14. Usability Testing
Test Findings - Participant #10
Moderator: Collin
Device: Desktop
Test Subject Info:
Name: Molly
Demographics: Female, 25 years of age, UX Designer
Characteristics: Tends to be very critical of UIs
Why they fit as our target audience
She is a designer who always looks through reviews of other peoples’ feedback in order to make her designs
better.
Where they struggled
N/A
Feedback from post-task and post-test sessions
Positive: Straight-forward; would like to see this working as a real website someday.
Negative: Static UI Elements

15. Usability Testing
Test Findings - Participant #11
Moderator: Collin
Device: Tablet
Test Subject Info:
Name: Jon
Demographics: Male 27 years of age, Electrical Engineer
Characteristics: Tends to be hyper focused on details
Why they fit as our target audience
He is an Electrical Engineer who loves to read reviews on Angie’s List to make sure he finds the best
contractor to fix his house.
Where they struggled
Found it hard to find the login button.
Feedback from post-task and post-test sessions
Positive: Likes the idea that his opinions matter
Negative: Make the login easier to find

16. Usability Testing
Test Findings - Participant #12
Moderator: Collin
Device: Mobile
Test Subject Info:
Name: Cynthia
Demographics: Female 26 years of age, Biomedical Engineer
Characteristics: Buys online frequently (amazon, woot, ebay)
Why they fit as our target audience
She loves fashion and goes on Amazon for all the reviews before she buys any pieces of clothing.
Where they struggled
N/A
Feedback from post-task and post-test sessions
Positive: Sense of community; allows her the ability to directly share her ratings with other users.
Negative: No stars to click, couldn’t rate. Color Palette

17. Usability Testing
Test Findings - Participant #13
Moderator: Matt
Device: Desktop
Test Subject Info:
Name: Jamie K.
Demographics: Female, Software Developer
Characteristics: Experience working with different professions (i.e. UX Designers, PM’s, etc.)
Why they fit as our target audience
Understands how to navigate through an app and knows what is realistically able to be developed.
Understands the testing process
Where they struggled
Finding the login
Feedback from post-task and post-test sessions
Positive: Clicking through prototype, commenting was realistic
Negative: Had a hard time with login (when to login)

18. Usability Testing
Test Findings - Participant #14
Moderator: Matt
Device: Mobile
Test Subject Info:
Name: Mike B
Demographics: Entrepreneur of Apps and PM, Male
Characteristics: Has managed the building of multiple apps in iTunes store some succeeded some failed
Why they fit as our target audience
He has experience with all facets of the software development process. Knows what has succeeded in the
past.
Where they struggled
Wasn’t sure if he was supposed to click “search projects” on the first page and what to search for
Feedback from post-task and post-test sessions
Positive: Ease of use, simplicity of App, commenting was realistic and fun
Negative: N/A

19. Usability Testing
Test Findings - Participant #15
Moderator: Matt
Device: Tablet
Test Subject Info:
Name: John M.
Demographics: UX Designer, Male
Characteristics: Is a UX Designer for a company in Chicago.
Why they fit as our target audience
Being a UX Designer, John understands the process and knows what to look for
Where they struggled
Could not click thumbnail to pick project, had to click the “review” link
Feedback from post-task and post-test sessions
Positive: It’s overall possible use.
Negative: Could not see multiple views of the app he was reviewing

20. Usability Testing
Analysis
Themes/Challenges (aka biggest things to fix)
The biggest challenge was to make the starring system functional in Axure.
Many participants were having trouble rating the design due to the non-
interactivity of the stars.
Another challenge was to show participants that the design they are reviewing
are clickable prototypes. This is a prototype within a prototype. Axure has a
lot of limitations in terms of making designs interactive.
Login was also difficult for participants to see, and difficult for participants to
understand the logged-in state vs. the non-logged-in state.
Thumbnail on homepage is not clickable. The user has to select the “review”
link instead.

21. Usability Testing
Recommendations
What must change to make prototype/app better?
If logged in, the username should appear on the review form; user will not have to
re-type their name.
Make the star ratings functional on the review form.
Change the comment avatar to a more generic / gender-neutral one.
Make the entire thumbnail for the prototype being reviewed clickable on the
selection page.

22. Final Prototype
Our AxShare Link
http://5acdzw.axshare.com/#c=2