SlideShare ist ein Scribd-Unternehmen logo
1 von 6
Downloaden Sie, um offline zu lesen
1
Proposed Mobile Usability Test Lab Set Up
LOUISE GRUENBERG
April 19 2015
TABLE OF CONTENTS
Executive Summary----------------- -- 2
Background Information---------- 2–3
How to Get Preliminary Answers- - 3
Hardware & Software
Existing Lab Set Up--------- - - 3
Proposed Additions------ -3–4
Room & Equipment Set Up -- 4
Budget & Rationale----------------- - - 5
Malfunction ‘Insurance’------ 5
Rejected Options------------------- --- 6
2
15%
20%
20%
45%
Website Usage by Device
iPad
iPhone
Android
Desktop
EXECUTIVE SUMMARY
OBJECTIVES
The purpose of this document is to propose a cost effective solution for repurposing our in-house lab to
be able to handle mobile tests of users’ own devices equipped with various operating systems and in a
range of sizes. Improving the lab will make it possible to incorporate mobile device testing into our
standard protocols.
We have a pressing need for the usability team to be able to make reliable recommendations to the
developers as they proceed with the immediate implementation of a responsive redesign for our client.
To communicate results and recommendations in a reasonable amount of time, we need to adopt the
use of Morae, a suite of tools designed for usability testing and also make some hardware purchases.
The Mobile Lab proposal cost is under $3500.00, although alternative options as high as $47,000 are
available.
BACKGROUND INFORMATION
On April 21, 2015 Google intends to reduce the rankings of sites that aren’t mobile friendly in its search
display. We know from checking our client’s site in the Google Mobile-Friendly Test that it doesn’t
currently qualify and must be converted to a responsive design. Every day that goes by without making
this change is costing them money in the form of lost sales, damage to their reputation, increased
customer service costs, and the loss of potential customers.
A majority (55%) of web traffic for
our client is now coming in on
mobile devices. (See chart, left for
breakout by device.) However, their
site was designed for desktop users,
and as noted above, doesn’t work
well on small screens.
The site’s poor performance on
mobile devices means those visitors
go to three fewer pages, spend
about four minutes less on site and
far more frequently than other users are likely to arrive and leave without moving off the first visited
page (bounce rate). The smaller the screen on the device, the more likely the visitor is to bounce.
Obviously, bouncing visitors aren’t spending money. Their closing rate for mobile is one fourth the
ecommerce industry standard, which is typically half the desktop rate. Imagine if the 55% of their users
on mobile could complete the 75% of their sales that they’re currently losing.
3
Adding to their financial hit, call center volumes and costs are up 35% due to the problems their website
visitors are experiencing when they try to shop or make it through checkout on their mobile devices.
Their customer service rankings are also likely to be reduced until they can get this situation addressed.
According to a McKinsey report on digitizing customer care, satisfaction is 19% higher for customers
who are able to receive customer service in a fully digital manner, e.g., completely online.
HOW TO GET SOME PRELIMINARY ANSWERS FAST
Because time is of the essence, we can run some unrecorded tests immediately by inviting three to five
of their local customers to come in. This will help us perfect the proposed testing layout, and, just as
important, identify some mobile based problems that will help us determine the tasks that should be
part of a larger study while we await the equipment order.
HARDWARE & SOFTWARE
EXISTING LAB SET UP
We currently borrow the training room to use as our lab for over-the-shoulder, side-by-side testing. It’s
outfitted with a trainer’s computer connected to a large projector and eight flip top desks (monitors fold
down and keyboard trays slide under) to provide flat surface working options. The desks are all on
wheels and can be rearranged as needed, within the limitations of the networked USB floor outlets.
They’re usually arranged in a large half circle facing the projector screen. Wireless is available in the
room. There’s also a conference phone that can be removed and stored when it’s not needed.
Each computer station is equipped with a Microsoft LifeCam Studio 1080p HD Webcam Q2F-00013 and
a Logitech ClearChat Comfort USB Headset H390 for VOIP, which are removed when not in use.
We have no specialized usability recording software, but can record desktop sessions using an Adobe
Connect virtual meeting room. Our current setup works best for moderated testing of desktop websites
and software applications using screen sharing. We tested Adobe Connect and screen sharing from
mobile devices isn’t possible, although it can use the onboard camera to record facial expressions and
the microphone for voice. Post production tools for highlight reel creation are limited to editing the
proprietary Adobe Connect file format. It’s not possible to mark the video with codes, and the workflow
is very time consuming.
PROPOSED ADDITIONS FOR MOBILE
USABILITY TEST SET UP
We will rearrange the training room to accommodate mobile
testing using the existing desks and chairs. See images, next
page, for proposed arrangement.
4
Participants will use their own devices and hold them in a natural manner. Their screen and gestures will
be captured by a document camera in the Morae software. Their facial expressions will be captured by
pointing the webcam attached to the moderator’s flip desk over to them. The USB microphone will also
be plugged into the moderator’s computer.
The test will be viewed remotely anywhere within the building by the developers and interested
managers using the Morae Observer licenses. We recommend setting up a number of laptops in the
conference room down the hall from the testing room so that people can watch and freely discuss.
See the proposed room layout below.
ROOM & EQUIPMENT SET UP
Tester and moderator seating;
document camera would be positioned
to capture tester’s screen and hands.
Microphone sits between the two, to
record all exchanges.*
2.
3.
1. Workstation
displaying task list for
session on big screen.
2. Moderator
workstation running
Morae to capture
document camera,
webcam and
microphone.*
3. Document camera
with microphone.
4. Tester work zone
and chair.
Note: A fourth desk
can be added to the
left of #4 to shift the
moderator position
from #2 to
accommodate left
handed participants.
4.
1.
*The microphone displayed is not on its stand, as it would be during a session.
Not shown in mockup images: Dark tablecloth for tester recording zone,
optional LED clamping work light, shown right, if needed to further illuminate
the participant’s hands and screen.
5
BUDGET & RATIONALE
Existing items to repurpose: Training Room desks, computers, webcam for participant’s face, and
projector. The microphone shown in the photos is an existing one used by training that no longer has a
working stand.
Every day that goes by without switching the website to a responsive design is costing our client money,
so repurposing what we have and getting everything else in by Amazon Prime means we can start
scheduling sessions as soon as we get the go ahead to purchase.
Note that the budget would be considerably higher than this if we had to provide every possible mobile
device and operating version rather than testing users with their own devices.
Item Rationale Cost
Morae: User Experience & Market
Research Software
To provide the lab with the ability to set up,
monitor, record, and report on tests quickly.
1995.00
ViewSonic VP2770-LED 27-Inch
SuperClear IPS LED-Lit Professional
Monitor, WQHD 2560x1440
For Morae video post-production to create and
edit highlight reels; the 17” training room
monitors are too small and coarse.
700.00
WD My Book 4 TB USB 3.0 Hard
Drive with Backup
Recording video requires a lot of disc space; the
training room network drive allocation is small.
139.00
Blue Microphones Yeti USB
Microphone - Blackout Edition (2)
This microphone will be able to pick up the
participant’s and moderator’s voices.
260.00
KEDSUM Dimmable LED Desk
Clamp Light (2)
To ensure that additional light is available if
needed for recording the user’s hands. Insurance
70.00
IPEVO Ziggi-HD High-Definition USB
Document Camera CDVU-04IP (3)
To record the user’s gestures and device in use. 282.00
Dark tablecloth Reduces glare from the light colored desktop
surface and ensures that attention is on the
participant’s hands and device. Insurance.
18.50
USB Extension Cords (3) To make sure we can plug everything in, even if
the desk arrangement moves devices further
from the in floor USB outlets.
18.90
Total $3483.40
MALFUNCTION ‘INSURANCE’
The budget above includes redundant devices in case of equipment malfunction. For a mere $353 we
can purchase two additional document cameras and an extra microphone and light. Highly
recommended, and still keeps the budget under $3500. However, we will wait to order them until after
we have installed and fully tested the proposed set up, in case substitutions are required.
6
REJECTED OPTIONS
DUE TO CHOOSING TO USE A DOCUMENT CAMERA
Mr. Tappy, $295. This articulated lightweight ‘sled’ for mobile and tablet testing shouldn’t be necessary,
since the document camera will make it possible for testers to work freehand, in a natural way, holding
and moving their devices as they normally would. Homemade mobile sled instructions for various
inexpensive options are available online, but were also rejected in favor of the document camera
approach, recommended in Usability Testing for Mobile Is Easy.
DUE TO COST/ROI REQUIRED
I tend to be conservative about expenditures and believe the proposal on the previous page can provide
the enterprise with suitable value and a good return on investment. We should consider the purchase of
one of the systems below only if we can’t get the information we need in any other way.
Tobii eye tracking setup, at $22,000, consisting of a Tobii X2-30 costing $6,210.00, Tobii Studio at
$11,610.00 and a Mobile Stand at $3,150.00.
Tobii wearable Glasses 2 system optimized for mobile device studies, ranging from $15,000 to $25,000.
Ovo Logger 7.0 Portable Lab: $19,131 with $2,621 annual Ovo Logger 7.0 licensing and support after first
year.
Ovo Logger 7.0 Workstation: Ovo Workstations are customized to the installation. A base model with
two inputs is about $22,000 with $3,371 in annual fees after first year. Consulting, additional A/V
hardware, etc. are not included. This Ovo Workstation has four video inputs and is closer to $38,000
with proportionately higher annual fees.

Weitere ähnliche Inhalte

Empfohlen

How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
ThinkNow
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
 

Empfohlen (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

Gruenberg-Proposed-Mobile-Ux-Test-Lab

  • 1. 1 Proposed Mobile Usability Test Lab Set Up LOUISE GRUENBERG April 19 2015 TABLE OF CONTENTS Executive Summary----------------- -- 2 Background Information---------- 2–3 How to Get Preliminary Answers- - 3 Hardware & Software Existing Lab Set Up--------- - - 3 Proposed Additions------ -3–4 Room & Equipment Set Up -- 4 Budget & Rationale----------------- - - 5 Malfunction ‘Insurance’------ 5 Rejected Options------------------- --- 6
  • 2. 2 15% 20% 20% 45% Website Usage by Device iPad iPhone Android Desktop EXECUTIVE SUMMARY OBJECTIVES The purpose of this document is to propose a cost effective solution for repurposing our in-house lab to be able to handle mobile tests of users’ own devices equipped with various operating systems and in a range of sizes. Improving the lab will make it possible to incorporate mobile device testing into our standard protocols. We have a pressing need for the usability team to be able to make reliable recommendations to the developers as they proceed with the immediate implementation of a responsive redesign for our client. To communicate results and recommendations in a reasonable amount of time, we need to adopt the use of Morae, a suite of tools designed for usability testing and also make some hardware purchases. The Mobile Lab proposal cost is under $3500.00, although alternative options as high as $47,000 are available. BACKGROUND INFORMATION On April 21, 2015 Google intends to reduce the rankings of sites that aren’t mobile friendly in its search display. We know from checking our client’s site in the Google Mobile-Friendly Test that it doesn’t currently qualify and must be converted to a responsive design. Every day that goes by without making this change is costing them money in the form of lost sales, damage to their reputation, increased customer service costs, and the loss of potential customers. A majority (55%) of web traffic for our client is now coming in on mobile devices. (See chart, left for breakout by device.) However, their site was designed for desktop users, and as noted above, doesn’t work well on small screens. The site’s poor performance on mobile devices means those visitors go to three fewer pages, spend about four minutes less on site and far more frequently than other users are likely to arrive and leave without moving off the first visited page (bounce rate). The smaller the screen on the device, the more likely the visitor is to bounce. Obviously, bouncing visitors aren’t spending money. Their closing rate for mobile is one fourth the ecommerce industry standard, which is typically half the desktop rate. Imagine if the 55% of their users on mobile could complete the 75% of their sales that they’re currently losing.
  • 3. 3 Adding to their financial hit, call center volumes and costs are up 35% due to the problems their website visitors are experiencing when they try to shop or make it through checkout on their mobile devices. Their customer service rankings are also likely to be reduced until they can get this situation addressed. According to a McKinsey report on digitizing customer care, satisfaction is 19% higher for customers who are able to receive customer service in a fully digital manner, e.g., completely online. HOW TO GET SOME PRELIMINARY ANSWERS FAST Because time is of the essence, we can run some unrecorded tests immediately by inviting three to five of their local customers to come in. This will help us perfect the proposed testing layout, and, just as important, identify some mobile based problems that will help us determine the tasks that should be part of a larger study while we await the equipment order. HARDWARE & SOFTWARE EXISTING LAB SET UP We currently borrow the training room to use as our lab for over-the-shoulder, side-by-side testing. It’s outfitted with a trainer’s computer connected to a large projector and eight flip top desks (monitors fold down and keyboard trays slide under) to provide flat surface working options. The desks are all on wheels and can be rearranged as needed, within the limitations of the networked USB floor outlets. They’re usually arranged in a large half circle facing the projector screen. Wireless is available in the room. There’s also a conference phone that can be removed and stored when it’s not needed. Each computer station is equipped with a Microsoft LifeCam Studio 1080p HD Webcam Q2F-00013 and a Logitech ClearChat Comfort USB Headset H390 for VOIP, which are removed when not in use. We have no specialized usability recording software, but can record desktop sessions using an Adobe Connect virtual meeting room. Our current setup works best for moderated testing of desktop websites and software applications using screen sharing. We tested Adobe Connect and screen sharing from mobile devices isn’t possible, although it can use the onboard camera to record facial expressions and the microphone for voice. Post production tools for highlight reel creation are limited to editing the proprietary Adobe Connect file format. It’s not possible to mark the video with codes, and the workflow is very time consuming. PROPOSED ADDITIONS FOR MOBILE USABILITY TEST SET UP We will rearrange the training room to accommodate mobile testing using the existing desks and chairs. See images, next page, for proposed arrangement.
  • 4. 4 Participants will use their own devices and hold them in a natural manner. Their screen and gestures will be captured by a document camera in the Morae software. Their facial expressions will be captured by pointing the webcam attached to the moderator’s flip desk over to them. The USB microphone will also be plugged into the moderator’s computer. The test will be viewed remotely anywhere within the building by the developers and interested managers using the Morae Observer licenses. We recommend setting up a number of laptops in the conference room down the hall from the testing room so that people can watch and freely discuss. See the proposed room layout below. ROOM & EQUIPMENT SET UP Tester and moderator seating; document camera would be positioned to capture tester’s screen and hands. Microphone sits between the two, to record all exchanges.* 2. 3. 1. Workstation displaying task list for session on big screen. 2. Moderator workstation running Morae to capture document camera, webcam and microphone.* 3. Document camera with microphone. 4. Tester work zone and chair. Note: A fourth desk can be added to the left of #4 to shift the moderator position from #2 to accommodate left handed participants. 4. 1. *The microphone displayed is not on its stand, as it would be during a session. Not shown in mockup images: Dark tablecloth for tester recording zone, optional LED clamping work light, shown right, if needed to further illuminate the participant’s hands and screen.
  • 5. 5 BUDGET & RATIONALE Existing items to repurpose: Training Room desks, computers, webcam for participant’s face, and projector. The microphone shown in the photos is an existing one used by training that no longer has a working stand. Every day that goes by without switching the website to a responsive design is costing our client money, so repurposing what we have and getting everything else in by Amazon Prime means we can start scheduling sessions as soon as we get the go ahead to purchase. Note that the budget would be considerably higher than this if we had to provide every possible mobile device and operating version rather than testing users with their own devices. Item Rationale Cost Morae: User Experience & Market Research Software To provide the lab with the ability to set up, monitor, record, and report on tests quickly. 1995.00 ViewSonic VP2770-LED 27-Inch SuperClear IPS LED-Lit Professional Monitor, WQHD 2560x1440 For Morae video post-production to create and edit highlight reels; the 17” training room monitors are too small and coarse. 700.00 WD My Book 4 TB USB 3.0 Hard Drive with Backup Recording video requires a lot of disc space; the training room network drive allocation is small. 139.00 Blue Microphones Yeti USB Microphone - Blackout Edition (2) This microphone will be able to pick up the participant’s and moderator’s voices. 260.00 KEDSUM Dimmable LED Desk Clamp Light (2) To ensure that additional light is available if needed for recording the user’s hands. Insurance 70.00 IPEVO Ziggi-HD High-Definition USB Document Camera CDVU-04IP (3) To record the user’s gestures and device in use. 282.00 Dark tablecloth Reduces glare from the light colored desktop surface and ensures that attention is on the participant’s hands and device. Insurance. 18.50 USB Extension Cords (3) To make sure we can plug everything in, even if the desk arrangement moves devices further from the in floor USB outlets. 18.90 Total $3483.40 MALFUNCTION ‘INSURANCE’ The budget above includes redundant devices in case of equipment malfunction. For a mere $353 we can purchase two additional document cameras and an extra microphone and light. Highly recommended, and still keeps the budget under $3500. However, we will wait to order them until after we have installed and fully tested the proposed set up, in case substitutions are required.
  • 6. 6 REJECTED OPTIONS DUE TO CHOOSING TO USE A DOCUMENT CAMERA Mr. Tappy, $295. This articulated lightweight ‘sled’ for mobile and tablet testing shouldn’t be necessary, since the document camera will make it possible for testers to work freehand, in a natural way, holding and moving their devices as they normally would. Homemade mobile sled instructions for various inexpensive options are available online, but were also rejected in favor of the document camera approach, recommended in Usability Testing for Mobile Is Easy. DUE TO COST/ROI REQUIRED I tend to be conservative about expenditures and believe the proposal on the previous page can provide the enterprise with suitable value and a good return on investment. We should consider the purchase of one of the systems below only if we can’t get the information we need in any other way. Tobii eye tracking setup, at $22,000, consisting of a Tobii X2-30 costing $6,210.00, Tobii Studio at $11,610.00 and a Mobile Stand at $3,150.00. Tobii wearable Glasses 2 system optimized for mobile device studies, ranging from $15,000 to $25,000. Ovo Logger 7.0 Portable Lab: $19,131 with $2,621 annual Ovo Logger 7.0 licensing and support after first year. Ovo Logger 7.0 Workstation: Ovo Workstations are customized to the installation. A base model with two inputs is about $22,000 with $3,371 in annual fees after first year. Consulting, additional A/V hardware, etc. are not included. This Ovo Workstation has four video inputs and is closer to $38,000 with proportionately higher annual fees.