4. Timeline = 5-6 weeks (depends on the type of the research project*)
Research / Usability Timeline
5. Timeline = 5-6 weeks (depends on the type of the research project*)
Research / Usability Timeline
6. Timeline = 5-6 weeks (depends on the type of the research project*)
Research / Usability Timeline
7. Timeline = 5-6 weeks (depends on the type of the research project*)
Research / Usability Timeline
8. Wireframe / Product NameWireframe / Product Name[Deliverable Type] / [Product Name]
• Slow to set up
• Run 1 every 6 weeks
• 3 weeks of work contingent on UXR
3 issues
9. Wireframe / Product NameWireframe / Product Name[Deliverable Type] / [Product Name]
• Fast to setup
• Run frequently
• Save us time conducting and data
analyzing
Opportunities
21. Wireframe / Product NameWireframe / Product Name[Deliverable Type] / [Product Name]
• Fast to setup
• Run frequently
• Save us time conducting and data
analyzing
Flexible
Can use any prototype with a link,
participants can take it any time, and also
incredibly easy to postpone / push
ahead.
Can do more frequently
Can basically do it anytime with smaller
test, can do it any time, even on the
weekend (while you relax)
Saves time
Less time to do report, don’t have to
moderate the testing
Opportunities
26. Wireframe / Product NameWireframe / Product Name[Deliverable Type] / [Product Name]
Time to haul…
Thursday afternoon: Mental breakdown and requirements gathering.
Friday morning: Designer concepted, Gavin provided half-hearted suggestions.
Friday afternoon: UX, dev and product meet for design feedback and feasibility.
Friday almost end of day: Designer created prototype; Gavin created test plans
and questions.
Friday 6pm: Study was launched.
Saturday – Sunday: Chilled / waited for response to come in.
Monday morning: Gavin analyzed data.
Monday 11am~: Findings and recommendation shared with team. Dev started
coding.
27.
28.
29. Wireframe / Product NameWireframe / Product Name[Deliverable Type] / [Product Name]
Kudos
Dana Walter
UX Design Director
30. Good quality Research
Good flows, questions and mockups
Intentional
Deliberate research
-
Research = Collaboration
Stakeholder buy-in
-
32. High Quality Research
Strength of unmoderated remote testing =
evaluative research
• To effectively evaluate your design, you need 3 things:
1. Realistic setup / scenario
2. Good questions
3. Good mockups
33. Realistic scenario
Since there isn’t a moderator to guide users, the
mockup flow and tasks has to be specific and
realistic
• Realistic flow means the scenario should make sense
without moderator’s explanation.
• Ex. “You are booking a hotel room for 2 adults. You
want to check-in on Aug 1st and check-out on Aug
5th.”
34. Good Questions
To evaluate your designs you must ask good and
specific questions.
A few types of questions that is well suited for
remote testing:
• Complete a task prompt
• Example: ‘Add the cheapest blue dress shirt in
medium to your cart.’
• Be careful about hand holding participants to do the
task you want them to perform.
• Find an answer
• Example: ‘What is the total cost of your cart?’
• User rating
• Example: On a scale of 1 (very difficult )-5 (very easy)
how would you rate the shopping experience?
Protip: Break out long tasks into multiple short ones in
order to prevent participants from getting lost.
35. Good Mockups
Your designs cannot be janky. Aim for user ready.
• This means:
• Minimal place holder text/picture
• Proper alignments
• All necessary interaction should work as well as your
prototyping software allows.
Remember, there is no moderator. You cannot ’explain
away’ wonky interactions.
37. Collaborative Research
Use unmoderated remote research as a tool to
foster collaboration across teams, local or
remotely.
• Work with product, UX and devs to buy in on the goal of
the test.
• Use this as an opportunity to ensure good flows,
questions and mockups by working with designers.
• Get product and dev involved by asking for their input
and to pilot your test.
38. Get Buy ins
Talk to your stakeholder about the goals and
objective. Give them a reason to care.
39. Flows, Questions,
mocksAfter getting buy in, designer and researcher work
together to create the best flows, questions and
mockups.
• Designer works on the prototype while researcher works
on the test script and gets the test environment setup.
• Designer and research get together and adjust their
respective parts to better meet the goals and objective.
40. Pilot testing
Send the preview link to all stakeholders and ask
for feedback.
• This serves as pilot tests to ensure everything works as
intended
• Allow stakeholders to give final inputs and tweaks to the
test.
46. Just in time research vs Research
StrategyJust in time research
“Customer is complaining their site
isn’t converting well. Fix it, UX!”
“We need to test a new feature we
just designed before the next
release.”
“No one is using our cool new
feature, can you see what is wrong
with it?”
47. Just in time research vs Research
StrategyJust in time research
“Customer is complaining their site
isn’t converting well. Fix it, UX!”
“We need to test a new feature we
just designed before the next
release.”
“No one is using our cool new
feature, can you see what is wrong
with it?”
Research Strategy
“Let’s see what the problem is and
explore potential solutions.
Then we should quickly evaluate
these potential solutions to
determine which one is the best.
Evaluate our best concept within the
entire flow of the site.”
48. Wireframe / Product NameWireframe / Product Name[Deliverable Type] / [Product Name]
Product features we wanted to test in 2
months:
• Icons for Rate and Amenities
• Calendar Promo/Rate/Group/Room Codes
• Partial Points/Cash loyalty
• Multi-room Booking and Payment
• Profile Preferences and Requests
Why we had to test this:
• Complex feature
• Affected a crucial part of the flow
• New behavior and interactions
• Urgent
Intentional Research
49. Wireframe / Product NameWireframe / Product Name[Deliverable Type] / [Product Name]
Product features we wanted to test in 2
months:
• Icons for Rate and Amenities
• Calendar Promo/Rate/Group/Room Codes
• Partial Points/Cash loyalty
• Multi-room Booking and Payment
• Profile Preferences and Requests
Intentional Research
50. Wireframe / Product NameWireframe / Product Name[Deliverable Type] / [Product Name]
Product features we wanted to test in 2
months:
• Icons for Rate and Amenities
• Calendar Promo/Rate/Group/Room Codes
• Partial Points/Cash loyalty
• Multi-room Booking and Payment
• Profile Preferences and Requests
Intentional Research
Moderated usability test
51. Wireframe / Product NameWireframe / Product Name[Deliverable Type] / [Product Name]
Snapshot of Features Released
• Total Price
• Bed Types and Options
• Filter Bar Updates
• Sort by Price
• Icons/Room Amenities
• Profile Requests/Room Requests
• Loyalty Partial Points/Cash
• Multi-Room UI
• Show Rates assigned to IATA
• Calendar with promo/group/room/rate codes
• BE Designer JSON file upload
Green = Features
tested
52. In 2019, using unmoderated remote
testing and in-person usability sessions
allowed us to test almost
75% of the product’s
features.
How many of you know what Unmoderated Remote Testing is?
Story -> parking lot -> crying -> laid off -> Why? Why am I so emotional about losing a job? => my purpose is to do work that matters. My next job, my work will matter.
Note: Callouts should use non spark colors to stand out from the design.
Note: Callouts should use non spark colors to stand out from the design.
How to transition into this?
Note: Callouts should use non spark colors to stand out from the design.
Note: Callouts should use non spark colors to stand out from the design.
Note: Callouts should use non spark colors to stand out from the design.
Note: Callouts should use non spark colors to stand out from the design.
Note: Callouts should use non spark colors to stand out from the design.
Note: Callouts should use non spark colors to stand out from the design.
Note: Callouts should use non spark colors to stand out from the design.
Note: Callouts should use non spark colors to stand out from the design.
Note: Callouts should use non spark colors to stand out from the design.
Note: Callouts should use non spark colors to stand out from the design.
Am I saying that remote testing is end all be all? No.
Note: Callouts should use non spark colors to stand out from the design.
How to transition into this?
As a result...(say word for word)
How to transition into this?
Great success!
Great success!
How to transition into this?
The foundation of having an impact with your research is to make sure you know how to do good research and know what method is best for your project. You dont have to be perfect, but you need to have the confidence to carry out a plan and justify it.
However, that doesn't mean you shouldn't be flexible. Your adjustment should still keep the same research integrity.
Be deliberate on your research method and execution
The foundation of having an impact with your research is to make sure you know how to do good research and know what method is best for your project. You dont have to be perfect, but you need to have the confidence to carry out a plan and justify it.
However, that doesn't mean you shouldn't be flexible. Your adjustment should still keep the same research integrity.
Be deliberate on your research method and execution
The foundation of having an impact with your research is to make sure you know how to do good research and know what method is best for your project. You dont have to be perfect, but you need to have the confidence to carry out a plan and justify it.
However, that doesn't mean you shouldn't be flexible. Your adjustment should still keep the same research integrity.
Be deliberate on your research method and execution
The foundation of having an impact with your research is to make sure you know how to do good research and know what method is best for your project. You dont have to be perfect, but you need to have the confidence to carry out a plan and justify it.
However, that doesn't mean you shouldn't be flexible. Your adjustment should still keep the same research integrity.
Be deliberate on your research method and execution
How to transition into this?
The foundation of having an impact with your research is to make sure you know how to do good research and know what method is best for your project. You dont have to be perfect, but you need to have the confidence to carry out a plan and justify it.
However, that doesn't mean you shouldn't be flexible. Your adjustment should still keep the same research integrity.
Be deliberate on your research method and execution
The foundation of having an impact with your research is to make sure you know how to do good research and know what method is best for your project. You dont have to be perfect, but you need to have the confidence to carry out a plan and justify it.
However, that doesn't mean you shouldn't be flexible. Your adjustment should still keep the same research integrity.
Be deliberate on your research method and execution
The foundation of having an impact with your research is to make sure you know how to do good research and know what method is best for your project. You dont have to be perfect, but you need to have the confidence to carry out a plan and justify it.
However, that doesn't mean you shouldn't be flexible. Your adjustment should still keep the same research integrity.
Be deliberate on your research method and execution
The foundation of having an impact with your research is to make sure you know how to do good research and know what method is best for your project. You dont have to be perfect, but you need to have the confidence to carry out a plan and justify it.
However, that doesn't mean you shouldn't be flexible. Your adjustment should still keep the same research integrity.
Be deliberate on your research method and execution
The foundation of having an impact with your research is to make sure you know how to do good research and know what method is best for your project. You dont have to be perfect, but you need to have the confidence to carry out a plan and justify it.
However, that doesn't mean you shouldn't be flexible. Your adjustment should still keep the same research integrity.
Be deliberate on your research method and execution
The foundation of having an impact with your research is to make sure you know how to do good research and know what method is best for your project. You dont have to be perfect, but you need to have the confidence to carry out a plan and justify it.
However, that doesn't mean you shouldn't be flexible. Your adjustment should still keep the same research integrity.
Be deliberate on your research method and execution
The foundation of having an impact with your research is to make sure you know how to do good research and know what method is best for your project. You dont have to be perfect, but you need to have the confidence to carry out a plan and justify it.
However, that doesn't mean you shouldn't be flexible. Your adjustment should still keep the same research integrity.
Be deliberate on your research method and execution
The foundation of having an impact with your research is to make sure you know how to do good research and know what method is best for your project. You dont have to be perfect, but you need to have the confidence to carry out a plan and justify it.
However, that doesn't mean you shouldn't be flexible. Your adjustment should still keep the same research integrity.
Be deliberate on your research method and execution
How to transition into this?
A lot of researcher falls into the trap of assembly line research, they just do as they are told and nothing more. You need to take your research and provide direction to whats next. Having a research plan will allow you to do research with intent that will provide direction.
However, that isn't to say that you should never do research when its not part of the plan. Things changes and you must be strategically flexible.
A lot of researcher falls into the trap of assembly line research, they just do as they are told and nothing more. You need to take your research and provide direction to whats next. Having a research plan will allow you to do research with intent that will provide direction.
However, that isn't to say that you should never do research when its not part of the plan. Things changes and you must be strategically flexible.
- show the couple of features we did on validately, show the others in usability
- Because we did remote testing on the last feature, it opened up a little bit more time for us
Instead of cramming lots of features in one-usability session
- we realized we could focus on the next couple of features (to get better quality test) with more in-depth feedback
We used validately to give us more time to focus on in-person usability session
Again, the right tool for the right job…
Again, the right tool for the right job…
Note: Callouts should use non spark colors to stand out from the design.
As a result...(say word for word)
Note: Callouts should use non spark colors to stand out from the design.
