SlideShare a Scribd company logo
1 of 18
Download to read offline
Boost Conversions and
Raise your Revenues with
A/B Testing in Rails
Daniel Pritchett
TechCamp Memphis 2013
What do you mean by conversions?
Conversion optimization is a focused attempt to
increase (optimize) the proportion of site
visitors who choose to take specific actions that
benefit your business (convert).
This is a $500 click.
How many clicks
would you like?

Image Ⓒ Metro Atlanta Marketing
Target audience for today’s talk:
● Customers
○

Products with highly relevant messaging find their way into the hands of people happy to
pay for them

● Product owners
○

Gain insight into which features of your product resonate most with customers

● Marketers
○

Validate market appetites for different flavors of product messaging

● Designers
○

Can propose alternate layouts without compromising overall design goals

● Developers
○

Automation skills harmonize well with product and marketing groups in this arena
Nota bene
I’m a consulting application developer, so my
design and marketing speech isn’t exactly
native.
I met a new coworker speaking at TechCamp
2012 and I’m glad to be back.
dpritchett.net // coroutine.com
What do you mean by A/B testing?
Pick a single element of your presentation and
think up an alternative. Set up your site to show
one version to some viewers and the other to
the rest. Track conversion results separately.
Implied: At the end of the test, keep the winning
element.
What can we tweak?
●
●
●
●

Copy
Positioning
Colors
Timing

● Pricing
● Discounts
● Everything!
How can I track a test?

Image Ⓒ Rahul Rodriguez
Why not A/B/C/D/E testing?
A/B tests are intentionally simple - fewer
moving parts confer several benefits over a
‘multi-armed bandit’ approach:
● Quicker to get started
● Easier to explain to the rest of the company
● Harder to misinterpret results
The Funnel
How do we
shepherd front
page viewers
towards that
$500 click?
Image Ⓒ Metro Atlanta Marketing
The Funnel
Usually more
than one
possible positive
outcome.

Image Ⓒ Metro Atlanta Marketing
How do I start?
Consultant’s motto:
“It depends.”

Visual Website Optimizer:
“No coding or HTML knowledge
required!”
Optimizely:
“A/B testing you’ll actually use.”
By hand:
Run page A for a week, run page
B for a week
Bespoke:
Roll your own toolkit
For Ruby on Rails...
Let’s try the “split” gem.

<% ab_test("login_button", "/images/button1.jpg", "/images/button2.jpg") do |button_file| %>
<%= img_tag(button_file, :alt => "Login!") %>
<% end %>

<img alt=”Login!” src=”/images/button1.jpg”>
or...
<img alt=”Login!” src=”/images/button2.jpg”>
Conversion tracking
Thanks for signing up, dude! <% finished("signup_page_redesign")
%>
Weighted test options
ab_test('homepage design', {'Old' => 20}, {'New' => 2})
Long-running tests
finished('experiment_name', :reset => false)
Split web UI
Time to go off-road!
techcamp-abtesting.herokuapp.com

More Related Content

What's hot

Masters Academy workshop BA User stories: be simple, be useful
Masters Academy workshop BA User stories: be simple, be usefulMasters Academy workshop BA User stories: be simple, be useful
Masters Academy workshop BA User stories: be simple, be usefulMasters Academy
 
Product Development in 10 Steps by former Facebook PM
Product Development in 10 Steps by former Facebook PMProduct Development in 10 Steps by former Facebook PM
Product Development in 10 Steps by former Facebook PMProduct School
 
Customer Research & Managing API Based Products w/ Navis & PayPal
Customer Research & Managing API Based Products w/ Navis & PayPalCustomer Research & Managing API Based Products w/ Navis & PayPal
Customer Research & Managing API Based Products w/ Navis & PayPalProduct School
 
How to Build a Product Roadmap by fmr Microsoft Senior PM
How to Build a Product Roadmap by fmr Microsoft Senior PMHow to Build a Product Roadmap by fmr Microsoft Senior PM
How to Build a Product Roadmap by fmr Microsoft Senior PMProduct School
 
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMHow to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMProduct School
 
Making the right call
Making the right callMaking the right call
Making the right callIonut Maxim
 
How to Ace the Product Management Interview by former Uber PM
How to Ace the Product Management Interview by former Uber PMHow to Ace the Product Management Interview by former Uber PM
How to Ace the Product Management Interview by former Uber PMProduct School
 
Redefining your core product
Redefining your core productRedefining your core product
Redefining your core productInVision App
 
Just Another WordPress Designer/Developer - WordCamp Maine
Just Another WordPress Designer/Developer - WordCamp MaineJust Another WordPress Designer/Developer - WordCamp Maine
Just Another WordPress Designer/Developer - WordCamp Mainemy easel
 
Proof of Concept Workshop
Proof of Concept WorkshopProof of Concept Workshop
Proof of Concept WorkshopDanny Holtschke
 
4Developers 2015: Making sense of agile requirements - Łukasz Szydło
4Developers 2015: Making sense of agile requirements - Łukasz Szydło4Developers 2015: Making sense of agile requirements - Łukasz Szydło
4Developers 2015: Making sense of agile requirements - Łukasz SzydłoPROIDEA
 
Call Camp June 2018 - Stories in Focus: Unlocking the Power of Video in Sales
Call Camp June 2018 - Stories in Focus: Unlocking the Power of Video in SalesCall Camp June 2018 - Stories in Focus: Unlocking the Power of Video in Sales
Call Camp June 2018 - Stories in Focus: Unlocking the Power of Video in SalesExecVision
 
How to Become a Successful Non-Tech PM by Spaceship PM
How to Become a Successful Non-Tech PM by Spaceship PMHow to Become a Successful Non-Tech PM by Spaceship PM
How to Become a Successful Non-Tech PM by Spaceship PMProduct School
 
How to Transition From Data to Product by Google Product Manager
How to Transition From Data to Product by Google Product ManagerHow to Transition From Data to Product by Google Product Manager
How to Transition From Data to Product by Google Product ManagerProduct School
 
What is a PM's Guide to Making Design Decisions by LinkedIn PM
What is a PM's Guide to Making Design Decisions by LinkedIn PMWhat is a PM's Guide to Making Design Decisions by LinkedIn PM
What is a PM's Guide to Making Design Decisions by LinkedIn PMProduct School
 
ホームページ制作 神奈川
ホームページ制作 神奈川ホームページ制作 神奈川
ホームページ制作 神奈川mitchellhayden12
 
Askbox pitch final
Askbox pitch finalAskbox pitch final
Askbox pitch finalDaan Assen
 
The Importance of Client Discovery
The Importance of Client Discovery The Importance of Client Discovery
The Importance of Client Discovery jhorocks1
 
The importance of design and marketing collaboration with Dan Slagen of Crayon
The importance of design and marketing collaboration with Dan Slagen of CrayonThe importance of design and marketing collaboration with Dan Slagen of Crayon
The importance of design and marketing collaboration with Dan Slagen of CrayonInVision App
 

What's hot (20)

Masters Academy workshop BA User stories: be simple, be useful
Masters Academy workshop BA User stories: be simple, be usefulMasters Academy workshop BA User stories: be simple, be useful
Masters Academy workshop BA User stories: be simple, be useful
 
Product Development in 10 Steps by former Facebook PM
Product Development in 10 Steps by former Facebook PMProduct Development in 10 Steps by former Facebook PM
Product Development in 10 Steps by former Facebook PM
 
Customer Research & Managing API Based Products w/ Navis & PayPal
Customer Research & Managing API Based Products w/ Navis & PayPalCustomer Research & Managing API Based Products w/ Navis & PayPal
Customer Research & Managing API Based Products w/ Navis & PayPal
 
How to Build a Product Roadmap by fmr Microsoft Senior PM
How to Build a Product Roadmap by fmr Microsoft Senior PMHow to Build a Product Roadmap by fmr Microsoft Senior PM
How to Build a Product Roadmap by fmr Microsoft Senior PM
 
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMHow to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PM
 
Making the right call
Making the right callMaking the right call
Making the right call
 
How to Ace the Product Management Interview by former Uber PM
How to Ace the Product Management Interview by former Uber PMHow to Ace the Product Management Interview by former Uber PM
How to Ace the Product Management Interview by former Uber PM
 
Redefining your core product
Redefining your core productRedefining your core product
Redefining your core product
 
Just Another WordPress Designer/Developer - WordCamp Maine
Just Another WordPress Designer/Developer - WordCamp MaineJust Another WordPress Designer/Developer - WordCamp Maine
Just Another WordPress Designer/Developer - WordCamp Maine
 
Proof of Concept Workshop
Proof of Concept WorkshopProof of Concept Workshop
Proof of Concept Workshop
 
4Developers 2015: Making sense of agile requirements - Łukasz Szydło
4Developers 2015: Making sense of agile requirements - Łukasz Szydło4Developers 2015: Making sense of agile requirements - Łukasz Szydło
4Developers 2015: Making sense of agile requirements - Łukasz Szydło
 
Call Camp June 2018 - Stories in Focus: Unlocking the Power of Video in Sales
Call Camp June 2018 - Stories in Focus: Unlocking the Power of Video in SalesCall Camp June 2018 - Stories in Focus: Unlocking the Power of Video in Sales
Call Camp June 2018 - Stories in Focus: Unlocking the Power of Video in Sales
 
How to Become a Successful Non-Tech PM by Spaceship PM
How to Become a Successful Non-Tech PM by Spaceship PMHow to Become a Successful Non-Tech PM by Spaceship PM
How to Become a Successful Non-Tech PM by Spaceship PM
 
How to Transition From Data to Product by Google Product Manager
How to Transition From Data to Product by Google Product ManagerHow to Transition From Data to Product by Google Product Manager
How to Transition From Data to Product by Google Product Manager
 
What is a PM's Guide to Making Design Decisions by LinkedIn PM
What is a PM's Guide to Making Design Decisions by LinkedIn PMWhat is a PM's Guide to Making Design Decisions by LinkedIn PM
What is a PM's Guide to Making Design Decisions by LinkedIn PM
 
ホームページ制作 神奈川
ホームページ制作 神奈川ホームページ制作 神奈川
ホームページ制作 神奈川
 
Askbox pitch final
Askbox pitch finalAskbox pitch final
Askbox pitch final
 
Producing_Cover Letter
Producing_Cover LetterProducing_Cover Letter
Producing_Cover Letter
 
The Importance of Client Discovery
The Importance of Client Discovery The Importance of Client Discovery
The Importance of Client Discovery
 
The importance of design and marketing collaboration with Dan Slagen of Crayon
The importance of design and marketing collaboration with Dan Slagen of CrayonThe importance of design and marketing collaboration with Dan Slagen of Crayon
The importance of design and marketing collaboration with Dan Slagen of Crayon
 

Viewers also liked

BIO - Jean Fares Couture
BIO - Jean Fares Couture BIO - Jean Fares Couture
BIO - Jean Fares Couture Norma HAYEK
 
Linked in fear factor
Linked in fear factorLinked in fear factor
Linked in fear factorBenaud Jacob
 
Παράξενος Μαθηματικός Λογισμός
Παράξενος Μαθηματικός ΛογισμόςΠαράξενος Μαθηματικός Λογισμός
Παράξενος Μαθηματικός Λογισμόςgiatousfilous
 
Attitude. Do you 'disable' yourself?
Attitude. Do you 'disable' yourself?Attitude. Do you 'disable' yourself?
Attitude. Do you 'disable' yourself?Heena Modi
 
Phrases By Gabriel GarcíA MáRquez
Phrases By Gabriel GarcíA MáRquezPhrases By Gabriel GarcíA MáRquez
Phrases By Gabriel GarcíA MáRquezHeena Modi
 
Humans And Animals
Humans And AnimalsHumans And Animals
Humans And AnimalsHeena Modi
 
The new forest
The new forestThe new forest
The new forestHeena Modi
 
Fear Factor with Outsourcing
Fear Factor with OutsourcingFear Factor with Outsourcing
Fear Factor with OutsourcingBenaud Jacob
 
Afrika Sunrise Jantjebeton
Afrika Sunrise  JantjebetonAfrika Sunrise  Jantjebeton
Afrika Sunrise JantjebetonHeena Modi
 
ICC/Decision Services Mystery Shop Integrity Overview
ICC/Decision Services Mystery Shop Integrity OverviewICC/Decision Services Mystery Shop Integrity Overview
ICC/Decision Services Mystery Shop Integrity OverviewTwig Lane Group, LLC
 
Greens - a gorgeous setting with delicious vegan treats on the menu!
Greens - a gorgeous setting with delicious vegan treats on the menu!Greens - a gorgeous setting with delicious vegan treats on the menu!
Greens - a gorgeous setting with delicious vegan treats on the menu!Heena Modi
 
2014 11-09 book 9 v8
2014 11-09 book 9 v82014 11-09 book 9 v8
2014 11-09 book 9 v8Horace Poon
 
ExL Pharma Clinical Trials Phase I and Phase IIa Conference Brochure: Phase 1...
ExL Pharma Clinical Trials Phase I and Phase IIa Conference Brochure: Phase 1...ExL Pharma Clinical Trials Phase I and Phase IIa Conference Brochure: Phase 1...
ExL Pharma Clinical Trials Phase I and Phase IIa Conference Brochure: Phase 1...bryonmain
 
Pictures Of Zanzibar
Pictures Of ZanzibarPictures Of Zanzibar
Pictures Of ZanzibarHeena Modi
 

Viewers also liked (20)

BIO - Jean Fares Couture
BIO - Jean Fares Couture BIO - Jean Fares Couture
BIO - Jean Fares Couture
 
Linked in fear factor
Linked in fear factorLinked in fear factor
Linked in fear factor
 
Παράξενος Μαθηματικός Λογισμός
Παράξενος Μαθηματικός ΛογισμόςΠαράξενος Μαθηματικός Λογισμός
Παράξενος Μαθηματικός Λογισμός
 
Attitude. Do you 'disable' yourself?
Attitude. Do you 'disable' yourself?Attitude. Do you 'disable' yourself?
Attitude. Do you 'disable' yourself?
 
Phrases By Gabriel GarcíA MáRquez
Phrases By Gabriel GarcíA MáRquezPhrases By Gabriel GarcíA MáRquez
Phrases By Gabriel GarcíA MáRquez
 
Jikumbushe
JikumbusheJikumbushe
Jikumbushe
 
Humans And Animals
Humans And AnimalsHumans And Animals
Humans And Animals
 
The new forest
The new forestThe new forest
The new forest
 
Fear Factor with Outsourcing
Fear Factor with OutsourcingFear Factor with Outsourcing
Fear Factor with Outsourcing
 
Painted Hands
Painted HandsPainted Hands
Painted Hands
 
Afrika Sunrise Jantjebeton
Afrika Sunrise  JantjebetonAfrika Sunrise  Jantjebeton
Afrika Sunrise Jantjebeton
 
Agency Profile: Dawson Marketing Group
Agency Profile: Dawson Marketing GroupAgency Profile: Dawson Marketing Group
Agency Profile: Dawson Marketing Group
 
ICC/Decision Services Mystery Shop Integrity Overview
ICC/Decision Services Mystery Shop Integrity OverviewICC/Decision Services Mystery Shop Integrity Overview
ICC/Decision Services Mystery Shop Integrity Overview
 
Greens - a gorgeous setting with delicious vegan treats on the menu!
Greens - a gorgeous setting with delicious vegan treats on the menu!Greens - a gorgeous setting with delicious vegan treats on the menu!
Greens - a gorgeous setting with delicious vegan treats on the menu!
 
Life Matters
Life MattersLife Matters
Life Matters
 
Indian Art
Indian ArtIndian Art
Indian Art
 
2014 11-09 book 9 v8
2014 11-09 book 9 v82014 11-09 book 9 v8
2014 11-09 book 9 v8
 
ExL Pharma Clinical Trials Phase I and Phase IIa Conference Brochure: Phase 1...
ExL Pharma Clinical Trials Phase I and Phase IIa Conference Brochure: Phase 1...ExL Pharma Clinical Trials Phase I and Phase IIa Conference Brochure: Phase 1...
ExL Pharma Clinical Trials Phase I and Phase IIa Conference Brochure: Phase 1...
 
Father
FatherFather
Father
 
Pictures Of Zanzibar
Pictures Of ZanzibarPictures Of Zanzibar
Pictures Of Zanzibar
 

Similar to Boost Conversions and Raise your Revenues with A/B testing in Rails

Conversion rate optimization CRO breakfast seminar Stockholm, August 2015
Conversion rate optimization CRO breakfast seminar Stockholm, August 2015  Conversion rate optimization CRO breakfast seminar Stockholm, August 2015
Conversion rate optimization CRO breakfast seminar Stockholm, August 2015 ThisIsNansen
 
Mastering Google Adwords, Facebook Ads, and Instagram Ads
Mastering Google Adwords, Facebook Ads, and Instagram AdsMastering Google Adwords, Facebook Ads, and Instagram Ads
Mastering Google Adwords, Facebook Ads, and Instagram AdsCity Unrulyversity
 
Adwords Implementation
Adwords ImplementationAdwords Implementation
Adwords Implementationtgr3gory
 
Free Pitch Deck Template
Free Pitch Deck Template Free Pitch Deck Template
Free Pitch Deck Template Malcolm Lewis
 
A/B Testing for WordPress & Drupal
A/B Testing for WordPress & DrupalA/B Testing for WordPress & Drupal
A/B Testing for WordPress & DrupalOptimizely
 
Google Analytics for Increased Website Conversion
Google Analytics for Increased Website ConversionGoogle Analytics for Increased Website Conversion
Google Analytics for Increased Website ConversionInsivia
 
PPC, SEO & Landing Page Best Practices To Maximize Conversions
PPC, SEO & Landing Page Best Practices To Maximize ConversionsPPC, SEO & Landing Page Best Practices To Maximize Conversions
PPC, SEO & Landing Page Best Practices To Maximize ConversionsSearchSpring
 
The Science of Landing pages
The Science of Landing pagesThe Science of Landing pages
The Science of Landing pagesVbout.com
 
עיצוב מחדש של אתר אינטרנט ומעבר למערכת דרופל
עיצוב מחדש של אתר אינטרנט ומעבר למערכת דרופלעיצוב מחדש של אתר אינטרנט ומעבר למערכת דרופל
עיצוב מחדש של אתר אינטרנט ומעבר למערכת דרופלAmir Simantov
 
Celtra’s Pricing in 2022 & The Best Alternative in Creative Automation.pdf
Celtra’s Pricing in 2022 & The Best Alternative in Creative Automation.pdfCeltra’s Pricing in 2022 & The Best Alternative in Creative Automation.pdf
Celtra’s Pricing in 2022 & The Best Alternative in Creative Automation.pdfFavourOkwowe
 
8 Essential Usability and Conversion Optimisation Tips - How Do Future Commer...
8 Essential Usability and Conversion Optimisation Tips - How Do Future Commer...8 Essential Usability and Conversion Optimisation Tips - How Do Future Commer...
8 Essential Usability and Conversion Optimisation Tips - How Do Future Commer...Become Customer-Centric
 
Adelaide HUG February 19
Adelaide HUG February 19Adelaide HUG February 19
Adelaide HUG February 19Brand chemistry
 
2019-08 Digital Marketing Tools - August 2019
2019-08 Digital Marketing Tools - August 20192019-08 Digital Marketing Tools - August 2019
2019-08 Digital Marketing Tools - August 2019Nick Nicholls
 
Unlocking Success A Comprehensive Guide to Optimize Your Landing Page Strateg...
Unlocking Success A Comprehensive Guide to Optimize Your Landing Page Strateg...Unlocking Success A Comprehensive Guide to Optimize Your Landing Page Strateg...
Unlocking Success A Comprehensive Guide to Optimize Your Landing Page Strateg...kubalesniak93
 
The Truth About Growth Hacking in B2B
The Truth About Growth Hacking in B2BThe Truth About Growth Hacking in B2B
The Truth About Growth Hacking in B2BVishal Sunak
 
The Truth about Growth Hacking in B2B - Vishal Sunak (ProductCamp Boston 2015)
The Truth about Growth Hacking in B2B - Vishal Sunak (ProductCamp Boston 2015)The Truth about Growth Hacking in B2B - Vishal Sunak (ProductCamp Boston 2015)
The Truth about Growth Hacking in B2B - Vishal Sunak (ProductCamp Boston 2015)ProductCamp Boston
 
From Search to Transaction: How to Master the Customer Experience
From Search to Transaction: How to Master the Customer ExperienceFrom Search to Transaction: How to Master the Customer Experience
From Search to Transaction: How to Master the Customer ExperienceBotify
 

Similar to Boost Conversions and Raise your Revenues with A/B testing in Rails (20)

How to Perform a Paid Landing Page Analysis - Travis McKnight, Portent
How to Perform a Paid Landing Page Analysis - Travis McKnight, PortentHow to Perform a Paid Landing Page Analysis - Travis McKnight, Portent
How to Perform a Paid Landing Page Analysis - Travis McKnight, Portent
 
Conversion rate optimization CRO breakfast seminar Stockholm, August 2015
Conversion rate optimization CRO breakfast seminar Stockholm, August 2015  Conversion rate optimization CRO breakfast seminar Stockholm, August 2015
Conversion rate optimization CRO breakfast seminar Stockholm, August 2015
 
Mastering Google Adwords, Facebook Ads, and Instagram Ads
Mastering Google Adwords, Facebook Ads, and Instagram AdsMastering Google Adwords, Facebook Ads, and Instagram Ads
Mastering Google Adwords, Facebook Ads, and Instagram Ads
 
Adwords Implementation
Adwords ImplementationAdwords Implementation
Adwords Implementation
 
Free Pitch Deck Template
Free Pitch Deck Template Free Pitch Deck Template
Free Pitch Deck Template
 
A/B Testing for WordPress & Drupal
A/B Testing for WordPress & DrupalA/B Testing for WordPress & Drupal
A/B Testing for WordPress & Drupal
 
Google Analytics for Increased Website Conversion
Google Analytics for Increased Website ConversionGoogle Analytics for Increased Website Conversion
Google Analytics for Increased Website Conversion
 
PPC, SEO & Landing Page Best Practices To Maximize Conversions
PPC, SEO & Landing Page Best Practices To Maximize ConversionsPPC, SEO & Landing Page Best Practices To Maximize Conversions
PPC, SEO & Landing Page Best Practices To Maximize Conversions
 
SEO & PPC CAMPAIGN STRATEGY
SEO & PPC CAMPAIGN STRATEGYSEO & PPC CAMPAIGN STRATEGY
SEO & PPC CAMPAIGN STRATEGY
 
The Science of Landing pages
The Science of Landing pagesThe Science of Landing pages
The Science of Landing pages
 
Google Adwords
Google AdwordsGoogle Adwords
Google Adwords
 
עיצוב מחדש של אתר אינטרנט ומעבר למערכת דרופל
עיצוב מחדש של אתר אינטרנט ומעבר למערכת דרופלעיצוב מחדש של אתר אינטרנט ומעבר למערכת דרופל
עיצוב מחדש של אתר אינטרנט ומעבר למערכת דרופל
 
Celtra’s Pricing in 2022 & The Best Alternative in Creative Automation.pdf
Celtra’s Pricing in 2022 & The Best Alternative in Creative Automation.pdfCeltra’s Pricing in 2022 & The Best Alternative in Creative Automation.pdf
Celtra’s Pricing in 2022 & The Best Alternative in Creative Automation.pdf
 
8 Essential Usability and Conversion Optimisation Tips - How Do Future Commer...
8 Essential Usability and Conversion Optimisation Tips - How Do Future Commer...8 Essential Usability and Conversion Optimisation Tips - How Do Future Commer...
8 Essential Usability and Conversion Optimisation Tips - How Do Future Commer...
 
Adelaide HUG February 19
Adelaide HUG February 19Adelaide HUG February 19
Adelaide HUG February 19
 
2019-08 Digital Marketing Tools - August 2019
2019-08 Digital Marketing Tools - August 20192019-08 Digital Marketing Tools - August 2019
2019-08 Digital Marketing Tools - August 2019
 
Unlocking Success A Comprehensive Guide to Optimize Your Landing Page Strateg...
Unlocking Success A Comprehensive Guide to Optimize Your Landing Page Strateg...Unlocking Success A Comprehensive Guide to Optimize Your Landing Page Strateg...
Unlocking Success A Comprehensive Guide to Optimize Your Landing Page Strateg...
 
The Truth About Growth Hacking in B2B
The Truth About Growth Hacking in B2BThe Truth About Growth Hacking in B2B
The Truth About Growth Hacking in B2B
 
The Truth about Growth Hacking in B2B - Vishal Sunak (ProductCamp Boston 2015)
The Truth about Growth Hacking in B2B - Vishal Sunak (ProductCamp Boston 2015)The Truth about Growth Hacking in B2B - Vishal Sunak (ProductCamp Boston 2015)
The Truth about Growth Hacking in B2B - Vishal Sunak (ProductCamp Boston 2015)
 
From Search to Transaction: How to Master the Customer Experience
From Search to Transaction: How to Master the Customer ExperienceFrom Search to Transaction: How to Master the Customer Experience
From Search to Transaction: How to Master the Customer Experience
 

Recently uploaded

Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 

Recently uploaded (20)

Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 

Boost Conversions and Raise your Revenues with A/B testing in Rails

  • 1. Boost Conversions and Raise your Revenues with A/B Testing in Rails Daniel Pritchett TechCamp Memphis 2013
  • 2. What do you mean by conversions? Conversion optimization is a focused attempt to increase (optimize) the proportion of site visitors who choose to take specific actions that benefit your business (convert).
  • 3. This is a $500 click. How many clicks would you like? Image Ⓒ Metro Atlanta Marketing
  • 4. Target audience for today’s talk: ● Customers ○ Products with highly relevant messaging find their way into the hands of people happy to pay for them ● Product owners ○ Gain insight into which features of your product resonate most with customers ● Marketers ○ Validate market appetites for different flavors of product messaging ● Designers ○ Can propose alternate layouts without compromising overall design goals ● Developers ○ Automation skills harmonize well with product and marketing groups in this arena
  • 5. Nota bene I’m a consulting application developer, so my design and marketing speech isn’t exactly native. I met a new coworker speaking at TechCamp 2012 and I’m glad to be back. dpritchett.net // coroutine.com
  • 6. What do you mean by A/B testing? Pick a single element of your presentation and think up an alternative. Set up your site to show one version to some viewers and the other to the rest. Track conversion results separately. Implied: At the end of the test, keep the winning element.
  • 7. What can we tweak? ● ● ● ● Copy Positioning Colors Timing ● Pricing ● Discounts ● Everything!
  • 8. How can I track a test? Image Ⓒ Rahul Rodriguez
  • 9. Why not A/B/C/D/E testing? A/B tests are intentionally simple - fewer moving parts confer several benefits over a ‘multi-armed bandit’ approach: ● Quicker to get started ● Easier to explain to the rest of the company ● Harder to misinterpret results
  • 10. The Funnel How do we shepherd front page viewers towards that $500 click? Image Ⓒ Metro Atlanta Marketing
  • 11. The Funnel Usually more than one possible positive outcome. Image Ⓒ Metro Atlanta Marketing
  • 12. How do I start? Consultant’s motto: “It depends.” Visual Website Optimizer: “No coding or HTML knowledge required!” Optimizely: “A/B testing you’ll actually use.” By hand: Run page A for a week, run page B for a week Bespoke: Roll your own toolkit
  • 13. For Ruby on Rails... Let’s try the “split” gem. <% ab_test("login_button", "/images/button1.jpg", "/images/button2.jpg") do |button_file| %> <%= img_tag(button_file, :alt => "Login!") %> <% end %> <img alt=”Login!” src=”/images/button1.jpg”> or... <img alt=”Login!” src=”/images/button2.jpg”>
  • 14. Conversion tracking Thanks for signing up, dude! <% finished("signup_page_redesign") %>
  • 15. Weighted test options ab_test('homepage design', {'Old' => 20}, {'New' => 2})
  • 18. Time to go off-road! techcamp-abtesting.herokuapp.com