SlideShare a Scribd company logo
1 of 16
Charlotte Weiskittel 
Senior Director, Product
TESTING QUEUE
ANALYSIS
STAR VS. HEART 
• Heart led to 135% increase in favorites; small bump in conversion 
• But not on mobile?
MONTHLY DONATIONS
REMOVE $500 AND $1,000 
Removing biggest 
amounts from 
dropdown increased 
conversion by 58%.
PHOTO AND TAGLINE 
1. A teacher spends $40 each month on classroom essentials. 
2. Make giving a monthly habit. 
3. Join the 3,500 people who support a classroom every month. 
4. Help a classroom every month. 
• Female teacher performed best with 3 of 4 taglines 
• “Join 3,500 people…” did slightly better than the original, but it wasn’t 
significant
CHARGE YOUR CARD NOW – OR IN A MONTH? 
Removing mention of 
the next month 
increased conversion 
217%.
$50, $25 OR NO INCENTIVE 
• Conversion rate 
- $50 incentive: 1.8% 
- No incentive: 1.6% 
- $25 incentive: 1.3% 
• The no incentive group 
was the least likely to 
cancel after two months 
(8%) 
• The no incentive group 
had the highest average 
monthly signup amount of 
$26
BUTTONS INSTEAD OF A DROPDOWN 
• The buttons saw a 32% 
decrease in conversion 
compared to the 
dropdown 
• “No thanks” as text 
converted 68% better, but 
at the expense of donors 
reaching the Thank You 
screen 
• “Most popular” converted 
terribly and was paused 
mid-experiment
TESTING PHILOSOPHY 
• Just start testing 
• Clear the path for the tester 
• Solve “I think…” debates 
• Look at the results holistically, not just A vs. B
Optimizely Experience - DonorsChoose.org
Optimizely Experience - DonorsChoose.org

More Related Content

What's hot

The Treadstone Updates 20-4-2014
The Treadstone Updates 20-4-2014The Treadstone Updates 20-4-2014
The Treadstone Updates 20-4-2014
ajayakhnoor
 
Recognition Pays
Recognition PaysRecognition Pays
Recognition Pays
Carey Weiss
 

What's hot (8)

What Fundraisers Can Do to Stop Falling Retention Rates
What Fundraisers Can Do to Stop Falling Retention RatesWhat Fundraisers Can Do to Stop Falling Retention Rates
What Fundraisers Can Do to Stop Falling Retention Rates
 
Tipping Point for Scouting
Tipping Point for ScoutingTipping Point for Scouting
Tipping Point for Scouting
 
Business presentation- recommendation report presentation- english presentation
Business presentation- recommendation report presentation- english presentation Business presentation- recommendation report presentation- english presentation
Business presentation- recommendation report presentation- english presentation
 
Learning from the Psychopath
Learning from the PsychopathLearning from the Psychopath
Learning from the Psychopath
 
The Treadstone Updates 20-4-2014
The Treadstone Updates 20-4-2014The Treadstone Updates 20-4-2014
The Treadstone Updates 20-4-2014
 
FWISD Volunteer Engagement Basics Wrap Up
FWISD Volunteer Engagement Basics Wrap UpFWISD Volunteer Engagement Basics Wrap Up
FWISD Volunteer Engagement Basics Wrap Up
 
Recognition Pays
Recognition PaysRecognition Pays
Recognition Pays
 
How to activate the right emotions in your campaigns | Psychology of communic...
How to activate the right emotions in your campaigns | Psychology of communic...How to activate the right emotions in your campaigns | Psychology of communic...
How to activate the right emotions in your campaigns | Psychology of communic...
 

Viewers also liked

Donors choose presentation, lopez
Donors choose presentation, lopezDonors choose presentation, lopez
Donors choose presentation, lopez
Emmanuel Lopez
 
Link to Donor's Choose Website
Link to Donor's Choose WebsiteLink to Donor's Choose Website
Link to Donor's Choose Website
Lisa Jackson
 
Bhhs atl college tour power point[1]
Bhhs atl college tour power point[1]Bhhs atl college tour power point[1]
Bhhs atl college tour power point[1]
joe42ppc
 

Viewers also liked (9)

Donors choose presentation, lopez
Donors choose presentation, lopezDonors choose presentation, lopez
Donors choose presentation, lopez
 
Donors choose
Donors chooseDonors choose
Donors choose
 
Link to Donor's Choose Website
Link to Donor's Choose WebsiteLink to Donor's Choose Website
Link to Donor's Choose Website
 
Donors Choose Project (1)
Donors Choose Project (1)Donors Choose Project (1)
Donors Choose Project (1)
 
DonorsChoose.org
DonorsChoose.orgDonorsChoose.org
DonorsChoose.org
 
Donors Choose Presentation
Donors Choose PresentationDonors Choose Presentation
Donors Choose Presentation
 
How donors choose charities
How donors choose charitiesHow donors choose charities
How donors choose charities
 
Bhhs atl college tour power point[1]
Bhhs atl college tour power point[1]Bhhs atl college tour power point[1]
Bhhs atl college tour power point[1]
 
6 Easy Steps to Creating a Written Fundraising Plan
6 Easy Steps to Creating a Written Fundraising Plan6 Easy Steps to Creating a Written Fundraising Plan
6 Easy Steps to Creating a Written Fundraising Plan
 

Similar to Optimizely Experience - DonorsChoose.org

Snag 'em for life major gifts - eTapestry User Group 2013
Snag 'em for life   major gifts - eTapestry User Group 2013Snag 'em for life   major gifts - eTapestry User Group 2013
Snag 'em for life major gifts - eTapestry User Group 2013
Blackbaud
 
NACCDO Integrating Social Media & Direct Mail Field and Keim
NACCDO Integrating Social Media & Direct Mail   Field and KeimNACCDO Integrating Social Media & Direct Mail   Field and Keim
NACCDO Integrating Social Media & Direct Mail Field and Keim
PAN - NACCDO
 
LOU powerpoint 2023 Oficial English.pptx
LOU powerpoint 2023 Oficial English.pptxLOU powerpoint 2023 Oficial English.pptx
LOU powerpoint 2023 Oficial English.pptx
Un Negocio Local
 
Monthly Donor Presentation
Monthly Donor PresentationMonthly Donor Presentation
Monthly Donor Presentation
Meghan Brown
 
Join us for the Shaklee opportunity
Join us for the Shaklee opportunityJoin us for the Shaklee opportunity
Join us for the Shaklee opportunity
moyragorski
 
Earn an Income You Deserve
Earn an Income You DeserveEarn an Income You Deserve
Earn an Income You Deserve
ddempsey
 

Similar to Optimizely Experience - DonorsChoose.org (20)

Community Management ROI - CMX Summit East
Community Management ROI - CMX Summit EastCommunity Management ROI - CMX Summit East
Community Management ROI - CMX Summit East
 
Javita Business Presentation
Javita Business PresentationJavita Business Presentation
Javita Business Presentation
 
Evan Hamilton: How to Find the ROI of Community Management
Evan Hamilton: How to Find the ROI of Community ManagementEvan Hamilton: How to Find the ROI of Community Management
Evan Hamilton: How to Find the ROI of Community Management
 
Optimizely Customer Showcase
Optimizely Customer ShowcaseOptimizely Customer Showcase
Optimizely Customer Showcase
 
Javita presentation official - December 18, 2015
Javita presentation official - December 18, 2015 Javita presentation official - December 18, 2015
Javita presentation official - December 18, 2015
 
Developing a Data-Driven Major Gift Culture
Developing a Data-Driven Major Gift CultureDeveloping a Data-Driven Major Gift Culture
Developing a Data-Driven Major Gift Culture
 
Kindful Academy Slides - Wealth Insights for Annual Giving.pdf
Kindful Academy Slides - Wealth Insights for Annual Giving.pdfKindful Academy Slides - Wealth Insights for Annual Giving.pdf
Kindful Academy Slides - Wealth Insights for Annual Giving.pdf
 
Co-operative Party National Weekend School - Email Training
Co-operative Party National Weekend School - Email TrainingCo-operative Party National Weekend School - Email Training
Co-operative Party National Weekend School - Email Training
 
Snag 'em for life major gifts - eTapestry User Group 2013
Snag 'em for life   major gifts - eTapestry User Group 2013Snag 'em for life   major gifts - eTapestry User Group 2013
Snag 'em for life major gifts - eTapestry User Group 2013
 
SCPResume3
SCPResume3SCPResume3
SCPResume3
 
NACCDO Integrating Social Media & Direct Mail Field and Keim
NACCDO Integrating Social Media & Direct Mail   Field and KeimNACCDO Integrating Social Media & Direct Mail   Field and Keim
NACCDO Integrating Social Media & Direct Mail Field and Keim
 
Creating a Donor Communications Plan
Creating a Donor Communications PlanCreating a Donor Communications Plan
Creating a Donor Communications Plan
 
LOU powerpoint 2023 Oficial English.pptx
LOU powerpoint 2023 Oficial English.pptxLOU powerpoint 2023 Oficial English.pptx
LOU powerpoint 2023 Oficial English.pptx
 
Monthly Donor Presentation
Monthly Donor PresentationMonthly Donor Presentation
Monthly Donor Presentation
 
Join us for the Shaklee opportunity
Join us for the Shaklee opportunityJoin us for the Shaklee opportunity
Join us for the Shaklee opportunity
 
Earn an Income You Deserve
Earn an Income You DeserveEarn an Income You Deserve
Earn an Income You Deserve
 
Opp Pres Eng
Opp Pres EngOpp Pres Eng
Opp Pres Eng
 
Portland 2016 GlobalGiving Workshop
Portland 2016 GlobalGiving WorkshopPortland 2016 GlobalGiving Workshop
Portland 2016 GlobalGiving Workshop
 
Isagenix Opp Event 5/11/13
Isagenix Opp Event 5/11/13Isagenix Opp Event 5/11/13
Isagenix Opp Event 5/11/13
 
The Wildtree Opportunty
The Wildtree OpportuntyThe Wildtree Opportunty
The Wildtree Opportunty
 

More from Optimizely

More from Optimizely (20)

Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive Experimentation
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing Right
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleAtlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
 
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion RevenueZillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical Teams
 
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingBuilding an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team Offering
 
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideAMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server Side
 
Evolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentEvolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product Development
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOvercoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
 
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyMaking Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product Strategy
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueKick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
 
Experimentation through Clients' Eyes
Experimentation through Clients' EyesExperimentation through Clients' Eyes
Experimentation through Clients' Eyes
 
Shipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubShipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHub
 
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with ExperimentationTest Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with Experimentation
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature Delivery
 

Optimizely Experience - DonorsChoose.org

  • 1.
  • 2. Charlotte Weiskittel Senior Director, Product
  • 3.
  • 4.
  • 7. STAR VS. HEART • Heart led to 135% increase in favorites; small bump in conversion • But not on mobile?
  • 9. REMOVE $500 AND $1,000 Removing biggest amounts from dropdown increased conversion by 58%.
  • 10. PHOTO AND TAGLINE 1. A teacher spends $40 each month on classroom essentials. 2. Make giving a monthly habit. 3. Join the 3,500 people who support a classroom every month. 4. Help a classroom every month. • Female teacher performed best with 3 of 4 taglines • “Join 3,500 people…” did slightly better than the original, but it wasn’t significant
  • 11. CHARGE YOUR CARD NOW – OR IN A MONTH? Removing mention of the next month increased conversion 217%.
  • 12. $50, $25 OR NO INCENTIVE • Conversion rate - $50 incentive: 1.8% - No incentive: 1.6% - $25 incentive: 1.3% • The no incentive group was the least likely to cancel after two months (8%) • The no incentive group had the highest average monthly signup amount of $26
  • 13. BUTTONS INSTEAD OF A DROPDOWN • The buttons saw a 32% decrease in conversion compared to the dropdown • “No thanks” as text converted 68% better, but at the expense of donors reaching the Thank You screen • “Most popular” converted terribly and was paused mid-experiment
  • 14. TESTING PHILOSOPHY • Just start testing • Clear the path for the tester • Solve “I think…” debates • Look at the results holistically, not just A vs. B