10 A/B Testing Mistakes that Make Your Wallet Cry

Convert.com
Convert.comConvert.com
10 A/B Testing Mistakes That Make Your Wallet Cry !
Don’t Just Measure
Conversion Rate!
Sequential Testing
Is Not A/B Testing.
Random Testing.
Prioritization
of tests.
Small website
changes give small
conversion changes.
Calling tests early
Don’t surprise
your regulars.
Pre-plan your
tests sample size.
Website wide
consistency
for tests.
Segmenting requires
a bigger sample size.
A B
www.convert.com

Recomendados

Living with acceptance tests: Beyond Write-Once (XP NYC) von
Living with acceptance tests: Beyond Write-Once (XP NYC)Living with acceptance tests: Beyond Write-Once (XP NYC)
Living with acceptance tests: Beyond Write-Once (XP NYC)Daniel Wellman
447 views53 Folien
Think Tank Presentation 5-2012 von
Think Tank Presentation 5-2012Think Tank Presentation 5-2012
Think Tank Presentation 5-2012Jim Borzilleri
616 views52 Folien
Easy Breezy Small Business Bookkeeping von
Easy Breezy Small Business BookkeepingEasy Breezy Small Business Bookkeeping
Easy Breezy Small Business BookkeepingKabbage
4.4K views17 Folien
Selenium Shots by Kyle J. Ginavan & Ryan Felton von
Selenium Shots by Kyle J. Ginavan & Ryan FeltonSelenium Shots by Kyle J. Ginavan & Ryan Felton
Selenium Shots by Kyle J. Ginavan & Ryan FeltonSteven Chau
394 views22 Folien
How to reach a Data Driven culture von
How to reach a Data Driven cultureHow to reach a Data Driven culture
How to reach a Data Driven cultureMark Beekman
2.1K views60 Folien
DAMA Webinar - Big and Little Data Quality von
DAMA Webinar - Big and Little Data QualityDAMA Webinar - Big and Little Data Quality
DAMA Webinar - Big and Little Data QualityDATAVERSITY
34K views21 Folien

Más contenido relacionado

Destacado

PROG_UntoldStory ISV eBook_0706c FINAL von
PROG_UntoldStory ISV eBook_0706c FINALPROG_UntoldStory ISV eBook_0706c FINAL
PROG_UntoldStory ISV eBook_0706c FINALSolarWinds MSP
4.2K views21 Folien
Big Data Revolution: Are You Ready for the Data Overload? von
Big Data Revolution: Are You Ready for the Data Overload?Big Data Revolution: Are You Ready for the Data Overload?
Big Data Revolution: Are You Ready for the Data Overload?Aleah Radovich
24.2K views17 Folien
Data Culture Keynote and Exec Track Birm Dec 8th von
Data Culture Keynote and Exec Track Birm Dec 8thData Culture Keynote and Exec Track Birm Dec 8th
Data Culture Keynote and Exec Track Birm Dec 8thJonathan Woodward
6.8K views138 Folien
CDO Webinar: 2017 Trends in Data Strategy von
CDO Webinar: 2017 Trends in Data StrategyCDO Webinar: 2017 Trends in Data Strategy
CDO Webinar: 2017 Trends in Data StrategyDATAVERSITY
3.4K views18 Folien
Data Gravity, IoT, and Time Series - ThingMonk 2015 von
Data Gravity, IoT, and Time Series - ThingMonk 2015Data Gravity, IoT, and Time Series - ThingMonk 2015
Data Gravity, IoT, and Time Series - ThingMonk 2015dave.m
27.6K views60 Folien
This Isn't 'Big Data.' It's Just Bad Data. von
This Isn't 'Big Data.' It's Just Bad Data.This Isn't 'Big Data.' It's Just Bad Data.
This Isn't 'Big Data.' It's Just Bad Data.Peter Orszag
7.3K views15 Folien

Destacado(12)

PROG_UntoldStory ISV eBook_0706c FINAL von SolarWinds MSP
PROG_UntoldStory ISV eBook_0706c FINALPROG_UntoldStory ISV eBook_0706c FINAL
PROG_UntoldStory ISV eBook_0706c FINAL
SolarWinds MSP4.2K views
Big Data Revolution: Are You Ready for the Data Overload? von Aleah Radovich
Big Data Revolution: Are You Ready for the Data Overload?Big Data Revolution: Are You Ready for the Data Overload?
Big Data Revolution: Are You Ready for the Data Overload?
Aleah Radovich24.2K views
Data Culture Keynote and Exec Track Birm Dec 8th von Jonathan Woodward
Data Culture Keynote and Exec Track Birm Dec 8thData Culture Keynote and Exec Track Birm Dec 8th
Data Culture Keynote and Exec Track Birm Dec 8th
Jonathan Woodward6.8K views
CDO Webinar: 2017 Trends in Data Strategy von DATAVERSITY
CDO Webinar: 2017 Trends in Data StrategyCDO Webinar: 2017 Trends in Data Strategy
CDO Webinar: 2017 Trends in Data Strategy
DATAVERSITY3.4K views
Data Gravity, IoT, and Time Series - ThingMonk 2015 von dave.m
Data Gravity, IoT, and Time Series - ThingMonk 2015Data Gravity, IoT, and Time Series - ThingMonk 2015
Data Gravity, IoT, and Time Series - ThingMonk 2015
dave.m27.6K views
This Isn't 'Big Data.' It's Just Bad Data. von Peter Orszag
This Isn't 'Big Data.' It's Just Bad Data.This Isn't 'Big Data.' It's Just Bad Data.
This Isn't 'Big Data.' It's Just Bad Data.
Peter Orszag7.3K views
Data Science, Machine Learning and Neural Networks von BICA Labs
Data Science, Machine Learning and Neural NetworksData Science, Machine Learning and Neural Networks
Data Science, Machine Learning and Neural Networks
BICA Labs9K views
Introduction to Data Science von Caserta
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
Caserta 6.2K views
A Statistician's View on Big Data and Data Science (Version 1) von Prof. Dr. Diego Kuonen
A Statistician's View on Big Data and Data Science (Version 1)A Statistician's View on Big Data and Data Science (Version 1)
A Statistician's View on Big Data and Data Science (Version 1)
Myths and Mathemagical Superpowers of Data Scientists von David Pittman
Myths and Mathemagical Superpowers of Data ScientistsMyths and Mathemagical Superpowers of Data Scientists
Myths and Mathemagical Superpowers of Data Scientists
David Pittman96.6K views
Big Data [sorry] & Data Science: What Does a Data Scientist Do? von Data Science London
Big Data [sorry] & Data Science: What Does a Data Scientist Do?Big Data [sorry] & Data Science: What Does a Data Scientist Do?
Big Data [sorry] & Data Science: What Does a Data Scientist Do?
Data Science London147.9K views
Working With Big Data von Seth Familian
Working With Big DataWorking With Big Data
Working With Big Data
Seth Familian291.8K views

Último

Advanced_Recommendation_Systems_Presentation.pptx von
Advanced_Recommendation_Systems_Presentation.pptxAdvanced_Recommendation_Systems_Presentation.pptx
Advanced_Recommendation_Systems_Presentation.pptxneeharikasingh29
5 views9 Folien
How Leaders See Data? (Level 1) von
How Leaders See Data? (Level 1)How Leaders See Data? (Level 1)
How Leaders See Data? (Level 1)Narendra Narendra
13 views76 Folien
Ukraine Infographic_22NOV2023_v2.pdf von
Ukraine Infographic_22NOV2023_v2.pdfUkraine Infographic_22NOV2023_v2.pdf
Ukraine Infographic_22NOV2023_v2.pdfAnastosiyaGurin
1.3K views3 Folien
Organic Shopping in Google Analytics 4.pdf von
Organic Shopping in Google Analytics 4.pdfOrganic Shopping in Google Analytics 4.pdf
Organic Shopping in Google Analytics 4.pdfGA4 Tutorials
11 views13 Folien
Cross-network in Google Analytics 4.pdf von
Cross-network in Google Analytics 4.pdfCross-network in Google Analytics 4.pdf
Cross-network in Google Analytics 4.pdfGA4 Tutorials
6 views7 Folien
ColonyOS von
ColonyOSColonyOS
ColonyOSJohanKristiansson6
9 views17 Folien

Último(20)

Advanced_Recommendation_Systems_Presentation.pptx von neeharikasingh29
Advanced_Recommendation_Systems_Presentation.pptxAdvanced_Recommendation_Systems_Presentation.pptx
Advanced_Recommendation_Systems_Presentation.pptx
Ukraine Infographic_22NOV2023_v2.pdf von AnastosiyaGurin
Ukraine Infographic_22NOV2023_v2.pdfUkraine Infographic_22NOV2023_v2.pdf
Ukraine Infographic_22NOV2023_v2.pdf
AnastosiyaGurin1.3K views
Organic Shopping in Google Analytics 4.pdf von GA4 Tutorials
Organic Shopping in Google Analytics 4.pdfOrganic Shopping in Google Analytics 4.pdf
Organic Shopping in Google Analytics 4.pdf
GA4 Tutorials11 views
Cross-network in Google Analytics 4.pdf von GA4 Tutorials
Cross-network in Google Analytics 4.pdfCross-network in Google Analytics 4.pdf
Cross-network in Google Analytics 4.pdf
GA4 Tutorials6 views
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx von DataScienceConferenc1
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx
Survey on Factuality in LLM's.pptx von NeethaSherra1
Survey on Factuality in LLM's.pptxSurvey on Factuality in LLM's.pptx
Survey on Factuality in LLM's.pptx
NeethaSherra15 views
CRIJ4385_Death Penalty_F23.pptx von yvettemm100
CRIJ4385_Death Penalty_F23.pptxCRIJ4385_Death Penalty_F23.pptx
CRIJ4385_Death Penalty_F23.pptx
yvettemm1006 views
Chapter 3b- Process Communication (1) (1)(1) (1).pptx von ayeshabaig2004
Chapter 3b- Process Communication (1) (1)(1) (1).pptxChapter 3b- Process Communication (1) (1)(1) (1).pptx
Chapter 3b- Process Communication (1) (1)(1) (1).pptx
ayeshabaig20045 views
Short Story Assignment by Kelly Nguyen von kellynguyen01
Short Story Assignment by Kelly NguyenShort Story Assignment by Kelly Nguyen
Short Story Assignment by Kelly Nguyen
kellynguyen0119 views
[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M... von DataScienceConferenc1
[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M...[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M...
[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M...
Vikas 500 BIG DATA TECHNOLOGIES LAB.pdf von vikas12611618
Vikas 500 BIG DATA TECHNOLOGIES LAB.pdfVikas 500 BIG DATA TECHNOLOGIES LAB.pdf
Vikas 500 BIG DATA TECHNOLOGIES LAB.pdf
vikas126116188 views

10 A/B Testing Mistakes that Make Your Wallet Cry

  • 1. 10 A/B Testing Mistakes That Make Your Wallet Cry ! Don’t Just Measure Conversion Rate! Sequential Testing Is Not A/B Testing. Random Testing. Prioritization of tests. Small website changes give small conversion changes. Calling tests early Don’t surprise your regulars. Pre-plan your tests sample size. Website wide consistency for tests. Segmenting requires a bigger sample size. A B www.convert.com