SlideShare ist ein Scribd-Unternehmen logo
1 von 36
Downloaden Sie, um offline zu lesen
Mobile	
  Op*miza*on	
  That	
  
Actually	
  Works
Kyle	
  Duford	
  
eCommerce	
  Director	
  
Chrome	
  Industries	
  
@kyleduford	
  
Peter	
  McLachlan	
  
Founder	
  and	
  CPO	
  
Mobify	
  
@b1tr0t	
  
!
Chrome	
  Industries
Kyle	
  Duford	
  
eCommerce	
  Director	
  
Chrome	
  Industries	
  
@kyleduford	
  
Why	
  Mobile
“One	
  day,	
  all	
  this	
  informa<on	
  —
telecommunica<on,	
  connec<vity	
  
—	
  will	
  be	
  in	
  your	
  pocket.
Prolifera<on	
  of	
  Devices
Everyone’s	
  Doing	
  It
Tweet	
  
Update	
  
Snap	
  
Chat	
  
Text	
  
Call	
  
Search	
  
Read	
  
!
Part	
  of	
  the	
  Equa<on
Types	
  of	
  Mobile
GOLITE.COM! TREKBIKES.COM!
PINCH&AND&ZOOM&
THENORTHFACE.COM! PATAGONIA.COM!
M.SITES'
BURTON.COM!RAPHA.CC!
RESPONSIVE)
Using	
  Data	
  to	
  Understand	
  Mobile
• CONSISTENCY	
  IN	
  ALL	
  ELEMENTS	
  
• General	
  look	
  and	
  feel	
  
• Path	
  to	
  purchase	
  
• Search	
  
• Naviga*on	
  
• Merchandising	
  (eCommerce	
  sites)	
  
• Photos	
  	
  
• Descrip*ons	
  
• Calls	
  to	
  ac*on	
  
• Run	
  sta*s*cal	
  analysis	
  on	
  anything	
  (and	
  everything)	
  
• Because	
  data	
  doesn’t	
  care	
  if	
  you’re	
  mobile	
  
– It	
  just	
  documents	
  and	
  logs	
  
• Then	
  check	
  to	
  see	
  where	
  the	
  points	
  differ,	
  if	
  any,	
  
from	
  desktop,	
  tablet	
  
• Develop	
  your	
  hypothesis	
  
• Test
Data	
  is	
  S<ll	
  King
Tes<ng
• Iden*fy	
  problem/issue	
  
• Hypothesize	
  
• Ideas	
  
• Tes*ng	
  
• Analyze	
  
• Implement	
  or	
  re-­‐test
Using	
  Data	
  to	
  Understand	
  Mobile
• NO	
  SECRET	
  TO	
  BUILDING	
  TEAMS	
  
• No	
  need	
  for	
  a	
  special	
  “Mobile	
  Ops	
  Team”	
  
• Think	
  like	
  a	
  customer	
  
• Use	
  your	
  devices	
  for	
  UAT	
  tes*ng	
  
• Give	
  the	
  ability	
  to	
  try,	
  fail	
  and	
  learn
Test.	
  Learn.	
  Repeat.
Mobify
Peter	
  McLachlan	
  
Founder	
  and	
  CPO	
  
Mobify	
  
@b1tr0t	
  
!
eCommerce Web Experience Acceleration Platform
Mul<-­‐device	
  web:	
  eCommerce
55%
45%
Smartphone / Tablet
Desktop
Source: IBM “Thanksgiving Diges
For	
  many	
  eCommerce	
  sites,	
  
smartphone	
  +	
  tablet	
  traffic	
  
has	
  reached	
  or	
  exceeded	
  
45%	
  of	
  total	
  traffic.	
  	
  	
  
By	
  the	
  end	
  of	
  2014	
  we	
  expect	
  
these	
  channels	
  to	
  represent	
  
the	
  majority	
  of	
  visits	
  to	
  most	
  
eCommerce	
  sites
Time	
  spent	
  by	
  device	
  for	
  eCommerce
41%
59%
Smartphone / Tablet
Desktop
Source: Business Insider
Even	
  though	
  smartphone	
  +	
  
tablet	
  visitors	
  represent	
  45%	
  
of	
  traffic,	
  they	
  can	
  account	
  for	
  
59%	
  of	
  *me	
  spent	
  on	
  your	
  
website	
  
This	
  emphasizes	
  the	
  importance	
  
of	
  the	
  user	
  experience	
  on	
  
these	
  channels
Conversion	
  rates:	
  US	
  retail	
  eCommerce	
  	
  
Cyber	
  Monday	
  2013
0.0%
1.5%
3.0%
4.5%
6.0%
Smartphone
Tablet
Desktop
Source: IBM Digital Analytics Benchmark
Cyber	
  Monday	
  data	
  from	
  2013	
  
reveals	
  the	
  untapped	
  
opportunity	
  of	
  tablets	
  for	
  
eCommerce
Cyber	
  Monday	
  2013	
  eCommerce	
  conversion	
  rates	
  by	
  plaUorm
28%
72%
Source: Google Mobile Playbook
Google’s	
  data	
  shows	
  that	
  72%	
  of	
  
tablet	
  owners	
  make	
  purchases	
  
from	
  their	
  device	
  on	
  a	
  weekly	
  
basis
Conversion	
  rates:	
  Black	
  Friday
Emerging	
  opportunity:	
  the	
  tablet
“As	
  the	
  tablet	
  market	
  matures,	
  the	
  advantages	
  of	
  
desktop	
  and	
  laptop	
  browsing	
  will	
  erode…	
  To	
  engage	
  
customers	
  who	
  use	
  tablets,	
  companies	
  should	
  adopt	
  
tablet-­‐specific	
  strategies	
  instead	
  of	
  offering	
  
experiences	
  iden*cal	
  to	
  those	
  of	
  smartphones	
  or	
  
desktops	
  and	
  laptops.”	
  	
  	
  
!
-­‐	
  Adobe	
  2013	
  Mobile	
  Consumer	
  Survey	
  Results
Why	
  A/B	
  test?	
  A	
  refresher
• A/B	
  tes*ng	
  is	
  a	
  discount	
  leading	
  indicator:	
  it	
  is	
  a	
  
crucial	
  part	
  of	
  a	
  robust	
  internal	
  UX	
  process	
  
• A/B	
  tes*ng	
  tells	
  you	
  the	
  “what”,	
  and	
  helps	
  your	
  UX	
  
analysts	
  &	
  designers	
  find	
  the	
  “why”	
  and	
  the	
  “how”	
  
through	
  rapid	
  experimenta*on	
  and	
  quan*ta*ve	
  
analysis	
  
!
Strategies	
  for	
  mul<-­‐screen	
  tes<ng
Two	
  main	
  strategies	
  
• Test	
  the	
  change	
  on	
  all	
  screen	
  sizes	
  at	
  the	
  same	
  *me	
  
• Test	
  the	
  change	
  on	
  a	
  specific	
  group	
  of	
  screen	
  sizes:	
  
“breakpoints”
Tes<ng	
  on	
  all	
  screen	
  sizes	
  at	
  the	
  same	
  <me
• May	
  or	
  may	
  not	
  be	
  technically	
  feasible	
  
• Will	
  provide	
  cross-­‐channel	
  feedback	
  
• but	
  also	
  cross-­‐channel	
  noise
Tes<ng	
  on	
  all	
  screen	
  sizes	
  at	
  the	
  same	
  <me
Feasibility	
  
• Possible	
  only	
  if	
  UX	
  change	
  is	
  relevant	
  across	
  all	
  
screen	
  sizes	
  
• Only	
  applicable	
  if	
  there	
  is	
  uniform	
  UX	
  between	
  
views	
  at	
  different	
  screen	
  sizes	
  
Tes<ng	
  on	
  all	
  screen	
  sizes	
  at	
  the	
  same	
  <me
Advantages	
  
• Provides	
  cross-­‐channel	
  data	
  
• shorter	
  total	
  test	
  dura*on	
  
• May	
  offer	
  some	
  maintenance	
  advantages	
  
Tes<ng	
  on	
  all	
  screen	
  sizes	
  at	
  the	
  same	
  <me
Disadvantages	
  
• Costly	
  for	
  
• resources	
  
• *me	
  to	
  design	
  test	
  
• Technically	
  challenging	
  
• changes	
  must	
  work	
  &	
  be	
  QA	
  approved	
  across	
  
breakpoints	
  
• or	
  be	
  designed	
  &	
  tested	
  as	
  separate	
  HTML	
  snippets	
  
Tes<ng	
  at	
  a	
  single	
  breakpoint
• Focus	
  your	
  test,	
  taking	
  into	
  account:	
  
• probable	
  user	
  context	
  &	
  intent	
  
• interac*on	
  metaphor	
  
• device	
  capabili*es	
  
• device	
  limita*ons	
  
• Can	
  be	
  a	
  complete	
  template	
  varia*on	
  or	
  minor	
  UX	
  
change
Feasibility	
  
• Can	
  be	
  done	
  regardless	
  of	
  whether	
  you	
  have	
  a	
  
unified	
  UX	
  across	
  smartphone/tablet/desktop	
  
• Works	
  for	
  Responsive	
  Web	
  Design,	
  Separate	
  Mobile	
  
Websites	
  or	
  RESS	
  approaches	
  to	
  suppor*ng	
  mobile	
  
!
Tes<ng	
  at	
  a	
  single	
  breakpoint
Advantages	
  
• Focus	
  on	
  probable	
  visitor	
  context	
  
• Focus	
  on	
  probable	
  visitor	
  use	
  case	
  
• Fewer	
  developer	
  resources	
  to	
  deploy	
  any	
  given	
  test	
  
• Less	
  QA	
  required	
  to	
  deploy	
  a	
  test	
  
• Succeed	
  or	
  fail	
  faster	
  
!
Tes<ng	
  at	
  a	
  single	
  breakpoint
Disadvantages	
  
• Can	
  result	
  in	
  diverging	
  requirements	
  for	
  different	
  
screen	
  sizes	
  that	
  are	
  difficult	
  to	
  merge	
  back	
  into	
  
your	
  codebase	
  
• though	
  an	
  adap*ve	
  templa*ng	
  solu*on	
  can	
  help	
  
you	
  “power	
  up”	
  your	
  templates	
  
!
!
Tes<ng	
  at	
  a	
  single	
  breakpoint
What	
  should	
  you	
  test?	
  A	
  few	
  hints…
Larger	
  targets
Removed	
  hover	
  events
Results
For	
  Coastal	
  Contacts,	
  through	
  
analysis	
  in	
  Google	
  Analy*cs,	
  
Mobify’s	
  team	
  iden*fied	
  that	
  
smartphone	
  visitors	
  seemed	
  
confused	
  about	
  naviga*on.	
  
An	
  A/B	
  test	
  of	
  a	
  simplified	
  naviga*on	
  
structure	
  revealed	
  that	
  
smartphone	
  conversions	
  could	
  be	
  
improved	
  by	
  as	
  much	
  as	
  50%	
  with	
  
an	
  improved	
  naviga*on	
  structure	
  
Closing	
  <ps
• Always	
  A/A	
  test	
  
• Don’t	
  jump	
  to	
  conclusions	
  too	
  early	
  
• If	
  at	
  first	
  it	
  fails…	
  try	
  again	
  
• Smaller	
  changes:	
  segment	
  by	
  device	
  type	
  &	
  screen-­‐
size	
  for	
  each	
  test
Mobile	
  Op*miza*on	
  That	
  
Actually	
  Works
Kyle	
  Duford	
  
eCommerce	
  Director	
  
Chrome	
  Industries	
  
@kyleduford	
  
Peter	
  McLachlan	
  
Founder	
  and	
  CPO	
  
Mobify	
  
@b1tr0t	
  
!

Weitere ähnliche Inhalte

Was ist angesagt?

Usability Overview by Craig Tomlin
Usability Overview by Craig TomlinUsability Overview by Craig Tomlin
Usability Overview by Craig TomlinCraig Tomlin
 
Testing Is Not CRO But It’s Still Darn Important
Testing Is Not CRO But It’s Still Darn ImportantTesting Is Not CRO But It’s Still Darn Important
Testing Is Not CRO But It’s Still Darn ImportantAffiliate Summit
 
Optimizing Websites for Great User Experiences and Increased Conversions
Optimizing Websites for Great User Experiences and Increased ConversionsOptimizing Websites for Great User Experiences and Increased Conversions
Optimizing Websites for Great User Experiences and Increased ConversionsWP Engine
 
Responsive Email Design
Responsive Email DesignResponsive Email Design
Responsive Email DesignAnna Yeaman
 
Going Native: Why and How?
Going Native: Why and How?Going Native: Why and How?
Going Native: Why and How?Intuit Inc.
 
Mobile presentation - Sydney Online Retailer - 26 Sep 2011
Mobile presentation - Sydney Online Retailer - 26 Sep 2011Mobile presentation - Sydney Online Retailer - 26 Sep 2011
Mobile presentation - Sydney Online Retailer - 26 Sep 2011Craig Sullivan
 
Experience is the new differentiator
Experience is the new differentiatorExperience is the new differentiator
Experience is the new differentiatoraFrogleap
 
Mobile App Design Best Practices - Usable Interfaces for Tiny Places
Mobile App Design Best Practices - Usable Interfaces for Tiny PlacesMobile App Design Best Practices - Usable Interfaces for Tiny Places
Mobile App Design Best Practices - Usable Interfaces for Tiny PlacesApigee | Google Cloud
 
Mobile Choice-based Conjoint – A future promise or today‘s reality?
Mobile Choice-based Conjoint – A future promise or today‘s reality?Mobile Choice-based Conjoint – A future promise or today‘s reality?
Mobile Choice-based Conjoint – A future promise or today‘s reality?SKIM
 
Soft Launch Strategies for Mobile App Companies
Soft Launch Strategies for MobileApp CompaniesSoft Launch Strategies for MobileApp Companies
Soft Launch Strategies for Mobile App CompaniesFiksu
 
Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018Jagriti Pande
 
Schuh Responsive Website
Schuh Responsive WebsiteSchuh Responsive Website
Schuh Responsive WebsiteStuart McMillan
 
Native Vs HTML5 Apps
Native Vs HTML5 AppsNative Vs HTML5 Apps
Native Vs HTML5 AppsAppAcademy
 
WhatUsersDo: Remote UX Testing
WhatUsersDo: Remote UX TestingWhatUsersDo: Remote UX Testing
WhatUsersDo: Remote UX TestingThe Research Thing
 
#1NLab14: Responsive Design
#1NLab14: Responsive Design#1NLab14: Responsive Design
#1NLab14: Responsive DesignOne North
 
Building products for real users.
Building products for real users.Building products for real users.
Building products for real users.Sunny R Gupta
 
Introducing a culture of testing & optimisation
Introducing a culture of testing & optimisation Introducing a culture of testing & optimisation
Introducing a culture of testing & optimisation Stuart McMillan
 

Was ist angesagt? (20)

Usability Overview by Craig Tomlin
Usability Overview by Craig TomlinUsability Overview by Craig Tomlin
Usability Overview by Craig Tomlin
 
Lean startup 2019
Lean startup 2019Lean startup 2019
Lean startup 2019
 
Testing Is Not CRO But It’s Still Darn Important
Testing Is Not CRO But It’s Still Darn ImportantTesting Is Not CRO But It’s Still Darn Important
Testing Is Not CRO But It’s Still Darn Important
 
Optimizing Websites for Great User Experiences and Increased Conversions
Optimizing Websites for Great User Experiences and Increased ConversionsOptimizing Websites for Great User Experiences and Increased Conversions
Optimizing Websites for Great User Experiences and Increased Conversions
 
Responsive Email Design
Responsive Email DesignResponsive Email Design
Responsive Email Design
 
Going Native: Why and How?
Going Native: Why and How?Going Native: Why and How?
Going Native: Why and How?
 
Mobile presentation - Sydney Online Retailer - 26 Sep 2011
Mobile presentation - Sydney Online Retailer - 26 Sep 2011Mobile presentation - Sydney Online Retailer - 26 Sep 2011
Mobile presentation - Sydney Online Retailer - 26 Sep 2011
 
Experience is the new differentiator
Experience is the new differentiatorExperience is the new differentiator
Experience is the new differentiator
 
Mobile App Design Best Practices - Usable Interfaces for Tiny Places
Mobile App Design Best Practices - Usable Interfaces for Tiny PlacesMobile App Design Best Practices - Usable Interfaces for Tiny Places
Mobile App Design Best Practices - Usable Interfaces for Tiny Places
 
Mobile Choice-based Conjoint – A future promise or today‘s reality?
Mobile Choice-based Conjoint – A future promise or today‘s reality?Mobile Choice-based Conjoint – A future promise or today‘s reality?
Mobile Choice-based Conjoint – A future promise or today‘s reality?
 
Soft Launch Strategies for Mobile App Companies
Soft Launch Strategies for MobileApp CompaniesSoft Launch Strategies for MobileApp Companies
Soft Launch Strategies for Mobile App Companies
 
Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018Usability for everyone : Google I/O Extended 2018
Usability for everyone : Google I/O Extended 2018
 
Schuh Responsive Website
Schuh Responsive WebsiteSchuh Responsive Website
Schuh Responsive Website
 
Native Vs HTML5 Apps
Native Vs HTML5 AppsNative Vs HTML5 Apps
Native Vs HTML5 Apps
 
WhatUsersDo: Remote UX Testing
WhatUsersDo: Remote UX TestingWhatUsersDo: Remote UX Testing
WhatUsersDo: Remote UX Testing
 
#1NLab14: Responsive Design
#1NLab14: Responsive Design#1NLab14: Responsive Design
#1NLab14: Responsive Design
 
Building products for real users.
Building products for real users.Building products for real users.
Building products for real users.
 
Mobile webinarslides
Mobile webinarslidesMobile webinarslides
Mobile webinarslides
 
Introducing a culture of testing & optimisation
Introducing a culture of testing & optimisation Introducing a culture of testing & optimisation
Introducing a culture of testing & optimisation
 
9 Reasons Why Your Mobile App Failed
9 Reasons Why Your Mobile App Failed9 Reasons Why Your Mobile App Failed
9 Reasons Why Your Mobile App Failed
 

Ähnlich wie Mobile Optimization that Actually Works

Responsive Web Design Primer - NAGW 2014
Responsive Web Design Primer - NAGW 2014Responsive Web Design Primer - NAGW 2014
Responsive Web Design Primer - NAGW 2014Adrian Roselli
 
A Complete Guide to Testing Responsive Websites
A Complete Guide to Testing Responsive WebsitesA Complete Guide to Testing Responsive Websites
A Complete Guide to Testing Responsive WebsitesPerfecto by Perforce
 
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality GameWhy Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality GameAustin Marie Gay
 
Why Are Mobile Websites Important?
Why Are Mobile Websites Important?Why Are Mobile Websites Important?
Why Are Mobile Websites Important?Generate UK
 
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality GameWhy Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality GamePerfecto by Perforce
 
Responding to the challenge of the mobile web (2012)
Responding to the challenge of the mobile web (2012)Responding to the challenge of the mobile web (2012)
Responding to the challenge of the mobile web (2012)Graham Bird
 
Responsive Design: Where, Why and How | Imagine 2013 Strategic Marketing
Responsive Design: Where, Why and How | Imagine 2013 Strategic MarketingResponsive Design: Where, Why and How | Imagine 2013 Strategic Marketing
Responsive Design: Where, Why and How | Imagine 2013 Strategic MarketingAtwix
 
How to Test on the Right Mobile Platforms
How to Test on the Right Mobile PlatformsHow to Test on the Right Mobile Platforms
How to Test on the Right Mobile PlatformsPerfecto by Perforce
 
Web App VS. Hybrid App VS. Native App?
Web App VS. Hybrid App VS. Native App?Web App VS. Hybrid App VS. Native App?
Web App VS. Hybrid App VS. Native App?Justin O'Neill
 
Qa summit shift_to_mobile
Qa summit shift_to_mobileQa summit shift_to_mobile
Qa summit shift_to_mobileShachar Schiff
 
(Webinar) Unlocking Mobile Conversions - Featuring Guest Presenter Charles Ni...
(Webinar) Unlocking Mobile Conversions - Featuring Guest Presenter Charles Ni...(Webinar) Unlocking Mobile Conversions - Featuring Guest Presenter Charles Ni...
(Webinar) Unlocking Mobile Conversions - Featuring Guest Presenter Charles Ni...SiteTuners Conversion Rate Optimization
 
HTML5 vs. Native Apps: Demystifying the Decision Making Process
HTML5 vs. Native Apps: Demystifying the Decision Making ProcessHTML5 vs. Native Apps: Demystifying the Decision Making Process
HTML5 vs. Native Apps: Demystifying the Decision Making ProcessiTexico
 
Conducting Remote Task-Based Usability Testing on Your Mobile Website
Conducting Remote Task-Based Usability Testing on Your Mobile WebsiteConducting Remote Task-Based Usability Testing on Your Mobile Website
Conducting Remote Task-Based Usability Testing on Your Mobile WebsiteUserZoom
 
9 web analytics demystified - turning it up to 11 advanced website optimiza...
9   web analytics demystified - turning it up to 11 advanced website optimiza...9   web analytics demystified - turning it up to 11 advanced website optimiza...
9 web analytics demystified - turning it up to 11 advanced website optimiza...Ensighten
 
Measure camp tools of the cro rabble
Measure camp   tools of the cro rabbleMeasure camp   tools of the cro rabble
Measure camp tools of the cro rabbleCraig Sullivan
 
Draftkings: Launching w/ Confidence at Scale, FutureStack17 NYC
Draftkings: Launching w/ Confidence at Scale, FutureStack17 NYCDraftkings: Launching w/ Confidence at Scale, FutureStack17 NYC
Draftkings: Launching w/ Confidence at Scale, FutureStack17 NYCNew Relic
 
How Responsive Is Your Testing?
How Responsive Is Your Testing?How Responsive Is Your Testing?
How Responsive Is Your Testing?Cognizant
 
Mobile SEO (English Version)
Mobile SEO (English Version)Mobile SEO (English Version)
Mobile SEO (English Version)ssuserd60633
 
Speed and Simplicity: Design and Usability for Multi-device Websites
Speed and Simplicity: Design and Usability for Multi-device WebsitesSpeed and Simplicity: Design and Usability for Multi-device Websites
Speed and Simplicity: Design and Usability for Multi-device WebsitesDoug Gapinski
 
Speed and simplicity
Speed and simplicitySpeed and simplicity
Speed and simplicitymStoner, Inc.
 

Ähnlich wie Mobile Optimization that Actually Works (20)

Responsive Web Design Primer - NAGW 2014
Responsive Web Design Primer - NAGW 2014Responsive Web Design Primer - NAGW 2014
Responsive Web Design Primer - NAGW 2014
 
A Complete Guide to Testing Responsive Websites
A Complete Guide to Testing Responsive WebsitesA Complete Guide to Testing Responsive Websites
A Complete Guide to Testing Responsive Websites
 
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality GameWhy Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
 
Why Are Mobile Websites Important?
Why Are Mobile Websites Important?Why Are Mobile Websites Important?
Why Are Mobile Websites Important?
 
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality GameWhy Apps Succeed: 4 Keys to Winning the Digital Quality Game
Why Apps Succeed: 4 Keys to Winning the Digital Quality Game
 
Responding to the challenge of the mobile web (2012)
Responding to the challenge of the mobile web (2012)Responding to the challenge of the mobile web (2012)
Responding to the challenge of the mobile web (2012)
 
Responsive Design: Where, Why and How | Imagine 2013 Strategic Marketing
Responsive Design: Where, Why and How | Imagine 2013 Strategic MarketingResponsive Design: Where, Why and How | Imagine 2013 Strategic Marketing
Responsive Design: Where, Why and How | Imagine 2013 Strategic Marketing
 
How to Test on the Right Mobile Platforms
How to Test on the Right Mobile PlatformsHow to Test on the Right Mobile Platforms
How to Test on the Right Mobile Platforms
 
Web App VS. Hybrid App VS. Native App?
Web App VS. Hybrid App VS. Native App?Web App VS. Hybrid App VS. Native App?
Web App VS. Hybrid App VS. Native App?
 
Qa summit shift_to_mobile
Qa summit shift_to_mobileQa summit shift_to_mobile
Qa summit shift_to_mobile
 
(Webinar) Unlocking Mobile Conversions - Featuring Guest Presenter Charles Ni...
(Webinar) Unlocking Mobile Conversions - Featuring Guest Presenter Charles Ni...(Webinar) Unlocking Mobile Conversions - Featuring Guest Presenter Charles Ni...
(Webinar) Unlocking Mobile Conversions - Featuring Guest Presenter Charles Ni...
 
HTML5 vs. Native Apps: Demystifying the Decision Making Process
HTML5 vs. Native Apps: Demystifying the Decision Making ProcessHTML5 vs. Native Apps: Demystifying the Decision Making Process
HTML5 vs. Native Apps: Demystifying the Decision Making Process
 
Conducting Remote Task-Based Usability Testing on Your Mobile Website
Conducting Remote Task-Based Usability Testing on Your Mobile WebsiteConducting Remote Task-Based Usability Testing on Your Mobile Website
Conducting Remote Task-Based Usability Testing on Your Mobile Website
 
9 web analytics demystified - turning it up to 11 advanced website optimiza...
9   web analytics demystified - turning it up to 11 advanced website optimiza...9   web analytics demystified - turning it up to 11 advanced website optimiza...
9 web analytics demystified - turning it up to 11 advanced website optimiza...
 
Measure camp tools of the cro rabble
Measure camp   tools of the cro rabbleMeasure camp   tools of the cro rabble
Measure camp tools of the cro rabble
 
Draftkings: Launching w/ Confidence at Scale, FutureStack17 NYC
Draftkings: Launching w/ Confidence at Scale, FutureStack17 NYCDraftkings: Launching w/ Confidence at Scale, FutureStack17 NYC
Draftkings: Launching w/ Confidence at Scale, FutureStack17 NYC
 
How Responsive Is Your Testing?
How Responsive Is Your Testing?How Responsive Is Your Testing?
How Responsive Is Your Testing?
 
Mobile SEO (English Version)
Mobile SEO (English Version)Mobile SEO (English Version)
Mobile SEO (English Version)
 
Speed and Simplicity: Design and Usability for Multi-device Websites
Speed and Simplicity: Design and Usability for Multi-device WebsitesSpeed and Simplicity: Design and Usability for Multi-device Websites
Speed and Simplicity: Design and Usability for Multi-device Websites
 
Speed and simplicity
Speed and simplicitySpeed and simplicity
Speed and simplicity
 

Mehr von Optimizely

Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationOptimizely
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Optimizely
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing RightOptimizely
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleAtlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleOptimizely
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Optimizely
 
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion RevenueZillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion RevenueOptimizely
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsOptimizely
 
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...Optimizely
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Optimizely
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingBuilding an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingOptimizely
 
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideAMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideOptimizely
 
Evolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentEvolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentOptimizely
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOvercoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOptimizely
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...Optimizely
 
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyMaking Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyOptimizely
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueKick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueOptimizely
 
Experimentation through Clients' Eyes
Experimentation through Clients' EyesExperimentation through Clients' Eyes
Experimentation through Clients' EyesOptimizely
 
Shipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubShipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubOptimizely
 
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with ExperimentationTest Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with ExperimentationOptimizely
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely
 

Mehr von Optimizely (20)

Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive Experimentation
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing Right
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleAtlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
 
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion RevenueZillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical Teams
 
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingBuilding an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team Offering
 
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideAMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server Side
 
Evolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentEvolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product Development
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOvercoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
 
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyMaking Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product Strategy
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueKick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
 
Experimentation through Clients' Eyes
Experimentation through Clients' EyesExperimentation through Clients' Eyes
Experimentation through Clients' Eyes
 
Shipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubShipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHub
 
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with ExperimentationTest Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with Experimentation
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature Delivery
 

Mobile Optimization that Actually Works

  • 1. Mobile  Op*miza*on  That   Actually  Works Kyle  Duford   eCommerce  Director   Chrome  Industries   @kyleduford   Peter  McLachlan   Founder  and  CPO   Mobify   @b1tr0t   !
  • 2. Chrome  Industries Kyle  Duford   eCommerce  Director   Chrome  Industries   @kyleduford  
  • 4. “One  day,  all  this  informa<on  — telecommunica<on,  connec<vity   —  will  be  in  your  pocket.
  • 6. Everyone’s  Doing  It Tweet   Update   Snap   Chat   Text   Call   Search   Read   !
  • 7. Part  of  the  Equa<on
  • 8. Types  of  Mobile GOLITE.COM! TREKBIKES.COM! PINCH&AND&ZOOM& THENORTHFACE.COM! PATAGONIA.COM! M.SITES' BURTON.COM!RAPHA.CC! RESPONSIVE)
  • 9. Using  Data  to  Understand  Mobile • CONSISTENCY  IN  ALL  ELEMENTS   • General  look  and  feel   • Path  to  purchase   • Search   • Naviga*on   • Merchandising  (eCommerce  sites)   • Photos     • Descrip*ons   • Calls  to  ac*on  
  • 10. • Run  sta*s*cal  analysis  on  anything  (and  everything)   • Because  data  doesn’t  care  if  you’re  mobile   – It  just  documents  and  logs   • Then  check  to  see  where  the  points  differ,  if  any,   from  desktop,  tablet   • Develop  your  hypothesis   • Test Data  is  S<ll  King
  • 11. Tes<ng • Iden*fy  problem/issue   • Hypothesize   • Ideas   • Tes*ng   • Analyze   • Implement  or  re-­‐test
  • 12. Using  Data  to  Understand  Mobile • NO  SECRET  TO  BUILDING  TEAMS   • No  need  for  a  special  “Mobile  Ops  Team”   • Think  like  a  customer   • Use  your  devices  for  UAT  tes*ng   • Give  the  ability  to  try,  fail  and  learn
  • 14. Mobify Peter  McLachlan   Founder  and  CPO   Mobify   @b1tr0t   !
  • 15. eCommerce Web Experience Acceleration Platform
  • 16. Mul<-­‐device  web:  eCommerce 55% 45% Smartphone / Tablet Desktop Source: IBM “Thanksgiving Diges For  many  eCommerce  sites,   smartphone  +  tablet  traffic   has  reached  or  exceeded   45%  of  total  traffic.       By  the  end  of  2014  we  expect   these  channels  to  represent   the  majority  of  visits  to  most   eCommerce  sites
  • 17. Time  spent  by  device  for  eCommerce 41% 59% Smartphone / Tablet Desktop Source: Business Insider Even  though  smartphone  +   tablet  visitors  represent  45%   of  traffic,  they  can  account  for   59%  of  *me  spent  on  your   website   This  emphasizes  the  importance   of  the  user  experience  on   these  channels
  • 18. Conversion  rates:  US  retail  eCommerce     Cyber  Monday  2013 0.0% 1.5% 3.0% 4.5% 6.0% Smartphone Tablet Desktop Source: IBM Digital Analytics Benchmark Cyber  Monday  data  from  2013   reveals  the  untapped   opportunity  of  tablets  for   eCommerce Cyber  Monday  2013  eCommerce  conversion  rates  by  plaUorm
  • 19. 28% 72% Source: Google Mobile Playbook Google’s  data  shows  that  72%  of   tablet  owners  make  purchases   from  their  device  on  a  weekly   basis Conversion  rates:  Black  Friday
  • 20. Emerging  opportunity:  the  tablet “As  the  tablet  market  matures,  the  advantages  of   desktop  and  laptop  browsing  will  erode…  To  engage   customers  who  use  tablets,  companies  should  adopt   tablet-­‐specific  strategies  instead  of  offering   experiences  iden*cal  to  those  of  smartphones  or   desktops  and  laptops.”       ! -­‐  Adobe  2013  Mobile  Consumer  Survey  Results
  • 21. Why  A/B  test?  A  refresher • A/B  tes*ng  is  a  discount  leading  indicator:  it  is  a   crucial  part  of  a  robust  internal  UX  process   • A/B  tes*ng  tells  you  the  “what”,  and  helps  your  UX   analysts  &  designers  find  the  “why”  and  the  “how”   through  rapid  experimenta*on  and  quan*ta*ve   analysis   !
  • 22. Strategies  for  mul<-­‐screen  tes<ng Two  main  strategies   • Test  the  change  on  all  screen  sizes  at  the  same  *me   • Test  the  change  on  a  specific  group  of  screen  sizes:   “breakpoints”
  • 23. Tes<ng  on  all  screen  sizes  at  the  same  <me • May  or  may  not  be  technically  feasible   • Will  provide  cross-­‐channel  feedback   • but  also  cross-­‐channel  noise
  • 24. Tes<ng  on  all  screen  sizes  at  the  same  <me Feasibility   • Possible  only  if  UX  change  is  relevant  across  all   screen  sizes   • Only  applicable  if  there  is  uniform  UX  between   views  at  different  screen  sizes  
  • 25. Tes<ng  on  all  screen  sizes  at  the  same  <me Advantages   • Provides  cross-­‐channel  data   • shorter  total  test  dura*on   • May  offer  some  maintenance  advantages  
  • 26. Tes<ng  on  all  screen  sizes  at  the  same  <me Disadvantages   • Costly  for   • resources   • *me  to  design  test   • Technically  challenging   • changes  must  work  &  be  QA  approved  across   breakpoints   • or  be  designed  &  tested  as  separate  HTML  snippets  
  • 27. Tes<ng  at  a  single  breakpoint • Focus  your  test,  taking  into  account:   • probable  user  context  &  intent   • interac*on  metaphor   • device  capabili*es   • device  limita*ons   • Can  be  a  complete  template  varia*on  or  minor  UX   change
  • 28. Feasibility   • Can  be  done  regardless  of  whether  you  have  a   unified  UX  across  smartphone/tablet/desktop   • Works  for  Responsive  Web  Design,  Separate  Mobile   Websites  or  RESS  approaches  to  suppor*ng  mobile   ! Tes<ng  at  a  single  breakpoint
  • 29. Advantages   • Focus  on  probable  visitor  context   • Focus  on  probable  visitor  use  case   • Fewer  developer  resources  to  deploy  any  given  test   • Less  QA  required  to  deploy  a  test   • Succeed  or  fail  faster   ! Tes<ng  at  a  single  breakpoint
  • 30. Disadvantages   • Can  result  in  diverging  requirements  for  different   screen  sizes  that  are  difficult  to  merge  back  into   your  codebase   • though  an  adap*ve  templa*ng  solu*on  can  help   you  “power  up”  your  templates   ! ! Tes<ng  at  a  single  breakpoint
  • 31. What  should  you  test?  A  few  hints…
  • 34. Results For  Coastal  Contacts,  through   analysis  in  Google  Analy*cs,   Mobify’s  team  iden*fied  that   smartphone  visitors  seemed   confused  about  naviga*on.   An  A/B  test  of  a  simplified  naviga*on   structure  revealed  that   smartphone  conversions  could  be   improved  by  as  much  as  50%  with   an  improved  naviga*on  structure  
  • 35. Closing  <ps • Always  A/A  test   • Don’t  jump  to  conclusions  too  early   • If  at  first  it  fails…  try  again   • Smaller  changes:  segment  by  device  type  &  screen-­‐ size  for  each  test
  • 36. Mobile  Op*miza*on  That   Actually  Works Kyle  Duford   eCommerce  Director   Chrome  Industries   @kyleduford   Peter  McLachlan   Founder  and  CPO   Mobify   @b1tr0t   !