How to test your mobile site without spending a fortune

How to
test your mobile site
without spending a fortune
Barry Briggs
Umbraco UK Festival
30th October 2015
#umbUKfest

This presentation
contains
D.I.Y.
Warning:
#umbUKfest

technology
design
research
& strategy
ux are here
@quiffboy #umbUKfest

Northern User Experience
Manchester ~ Leeds ~ Newcastle ~ Liverpool
nuxuk.org ~ @nuxuk

So, usability testing…

Many organisations
are scared of testing
Bold unsubstantiated statement:

Why?
1. Money
2. Time (which also = money)
Econsultancy User Experience Survey 2013

Perceived pain points
1. Hardware
2. Software
3. Recruitment
4. Reporting

Addressing those
pain points…

Silverback
• De facto app for desktop
usability testing on a Mac
• Simple and powerful UI
• Affordable (v2 is now free!)
• v3 due soon (again)

typical desktop usability testing output

What about PCs?
That’s Macs sorted.

90percentofeverything.com/2009/01/26/cheap-and-free-alternatives-to-morae-usability-testing-software/
No
relation

camtasia.com ~ @camtasia

ovosolo.com ~ @ovostudios

ovosolo.com ~ @ovostudios
Last updated
April 2013

They
live!!

We’ve got affordable
desktop testing nailed
Over-simpliﬁed but still truthful statement:

ˊ ` ` ` ` ` ` ` ` ` ` ` ` ` ` `'F'¯'''''L ` ` ` ` ` ` ` ` ` ` ` `
` ` ` ` ` ` ` ` ` ` ` ` ` ` ` `'[``…'¾`` ``` ``` ``` ```
` ` ` ` ` ` ` ` ` ` ` ` ` ` ` `'[```…ʹ[` ` ` ` ``` ``` ```
` ` ` ` ` ` ` ` ` ` ` ` ` ` ` `#````ˆ[```` ``` ``` ``` ``
` ` ` ` ` ` ` ` ` ` ` ` ` ` `'#``…``'[`… ` ` ` ` ` ` ` ` `
` ` ` ` ` ` ` ` ` ` ` ` ` ` #…`````'F`` ` ` ` `` ``` ```
` ` ` ` ` ` ` ` ` ` ` ` ` ƒ¯```````'[__` ` ` ` ` ` ` ``` ``
` ` ` ` ` ` ` ` ` ` ` ` ƒ¯````````ʹ¯¯¯¯''''''''''''¯¯¯¯¯¯™[ `
gµµµµµµµµµµµµµµ_µ™`````````````````````````'# `
'₫₫₫₫₫₫₫₫₫₫₫₫₫F¯…`````````````````````` ` ²q[¯ ` `
ʹ₫₫₫₫₫₫₫₫₫₫₫₫¾````````````````````````````ʹ} … `
›₫₫₫₫₫₫₫₫₫₫₫₫#`````````````````````````__µr… ` `
³₫₫₫₫₫₫₫₫₫₫₫₫₫…`````````````````````````¯[ … ` `
`₫₫₫₫₫₫₫₫₫₫₫₫$``````````````````````````_F … ` `
`]₫₫₫₫₫₫₫₫₫₫₫#````````````````````````ʹ''''[… … ` `
`'₫₫₫₫₫₫₫F''''']₫#___`````````````````````` '# … ` `
…₫₫₫₫₫₫₫bµ₫₫₫₫$¯''''¹uuuuuɷuɷuɷuɷuɷuɷµ#¯ ` ` ` ` `
…'''''''™''''™'''™''''™™ … … ` ` ` ` ` ` ` ` ` ` ` ` … … ` ` `
` … ` ` ` ` ` ` ` ` … ` … ` ` ` ` ` ` ` ` ` ` ` … ` ` ` ` `.

People think testing
on mobile is harder
than desktop
Another bold unsubstantiated statement:

petbucket.com/blog/61984/scaredy-cat-how-to-handle-a-frightened-feline.html

Scaredy-Cat Excuse #1
Requires expensive &
specialist hardware

This is the
D.I.Y.bit
Warning:

tinyurl.com/oxqbxsd

This bit
Not this bit

tinyurl.com/lpv2cvc

This bit
Not these bitsNot these bits

tinyurl.com/ks6xsyj

tinyurl.com/o6vqgzt

tinyurl.com/qbsxpjp

Sticky pad
Extreme D.I.Y.

Flush = stable
#umbUKfest@quiffboy

About £55 *
* device not included

The D.I.Y. bit
is over now
And relax…

Specialist software
is expensive

airsquirrels.com ~ @reﬂectorapp

mobizen.com ~ @mobizenglobal

obsproject.com ~ @obsproject

About £10 *
* unless you want a vimeo pro account

vimeo.com/pro ~ £159 per year

>ruby
-‐e
"$(curl
-‐fsSL
https://
raw.githubusercontent.com/Homebrew/
install/master/install)"

>brew
install
ffmpeg

>ffmpeg
-‐i
source.flv
new.mp4
thanks to @coldclimate & @whitingx

Recruiting participants is
complicated & expensive

tinyurl.com/a9ldz7d
5 users ≈ 85% problems

tinyurl.com/mhr8emm
Caveats, caveats, caveats
Summary: The answer is 5, except when it's not.
Most arguments for using more test participants
are wrong, but some tests should be bigger and
some smaller.

“Testing with one
person is 100% better
than testing with none”
steve krug ~ “rocket surgery made easy” ~ tinyurl.com/oufm9ao

gds.blog.gov.uk/2012/10/05/testing-gov-uk-with-real-users/

This is not how
people use your products
Contentious but accurate statement:

Hello Bev!

£15 for
15 minutes!!
HOW IT WORKS:
We ask you to carry out a couple of simple tasks using a new website, and we learn if we've
designed it correctly. It will take no more than 15 minutes of your time and as a thank you we'll
give you £15 cash.
WHEN:
Monday 17th November // Time slots available 12-1.30pm and 2.30-4pm
WHERE:
Amaze, 1st Floor, Royal Liver Building
We're looking for a few people to help us test a new website.
INTERESTED?
Participants must be female and use a smartphone to browse the internet.
Email b.briggs@amaze.com with your current make of smartphone, and preferred testing slot.

businessupperhand.com/how-to-open-a-coffee-shop/

5 x £15 *
* or 5 cups of coffee, if you’re on a really tight budget

Writing the test
report takes ages

1) Make it a one-pager

2) Bullet-point list,
not reams of copy

3) Structure the report
by task/user journey

4) Make your ﬁndings
actionable

5) Do highlight when
a test passes…

6) …but focus on the
things you can ﬁx

1 day to write *
* or less if you make notes between test sessions

Up-front cost
Hardware ≈ £55 (one-off cost)
Software ≈ £10 (one-off cost)
Recurring cost
Recruitment ≈ £75 (per round of testing)
≈ £140 for one round of testing

What’s your
hourly rate?
And how long have you spent debating
the cost of running tests?

“But you should probably read more”
Anyone Can Usability Test, Part 1: On a Shoestring 
Chris Atherton
How Many Test Users in a Usability Study? 
Jakob Nielson
The Art of Guerrilla Usability Testing 
UX Booth
New to Usability Testing? You’re not alone! 
Jennifer Aldrich
User Experience Survey 2013 
Econsultancy & WhatUsersDo
UX Challenge: how to choose the right approach to user research 
WhatUsersDo & Ian Franklin
“Don’t make me think” & “Rocket Surgery Made Easy” and more… 
Steve Krug

Thanks! ☺
@quiffboy
#umbUKfest

How to test your mobile site without spending a fortune

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Ähnlich wie How to test your mobile site without spending a fortune

Ähnlich wie How to test your mobile site without spending a fortune (6)

How to test your mobile site without spending a fortune