SlideShare ist ein Scribd-Unternehmen logo
1 von 24
Downloaden Sie, um offline zu lesen
Sean Ellis @seanellis
High Tempo Testing
Moving Beyond Hustle to Building
a Predictable Growth Machine
Sean Ellis @seanellis
3,2,1... Hustle!
Sean Ellis @seanellis
Early Growth: Twitter Focused
Feedback: “I find growth articles
on Twitter”
Followers: Easy to find people that
tweet growth articles
Content: Long tail of content ideal
for Twitter
Sean Ellis @seanellis
Goal: Keep Conversation Going
Sean Ellis @seanellis
Some Vacations...
Sean Ellis @seanellis
Viability Achieved by Month 3
Sean Ellis @seanellis
Goals Not Met After First Year
3 Flat Months!
Sean Ellis @seanellis
“Inputs are what you
actually control.”
Andrew Chen
Sean Ellis @seanellis
Problem: Limited Testing
Had specific growth goals, but just said
“test more”.
Team was too busy for much testing...
Building product
Executing Twitter Playbook
Engaging with community
Sean Ellis @seanellis
Solution: High Tempo Testing
Launch 3 Tests Per Week
(Clear “input” goal)
Sean Ellis @seanellis
Result...
Started high
tempo testing
Sean Ellis @seanellis
Hustle › Growth Process
Sean Ellis @seanellis
High Tempo Testing Process
Build
Knowledge
Base
Unbridled
Ideation
Prioritize
Backlog
High
Tempo
Testing
Sean Ellis @seanellis
Challenges of High Tempo Testing
1. Enough ideas: Ideas are fuel for tempo
2. Prioritizing ideas: Finding best ideas to test
3. Implementing tests: Getting the resources
4. Accurate testing: Instrumenting & analyzing
5. Avoiding repeats: Not running same tests
Sean Ellis @seanellis
Challenge 1: Enough Ideas
Unbridled ideation from full team
Ideas across all vectors
Individual & Team Accountability
Acqusition
Activation
Retention
Revenue
Referral
Sean Ellis @seanellis
Challenge 2: Prioritizing Ideas
Formalize ideas in “Experiment Doc”
Include research, hypothesis, target lever...
Score on impact, confidence & ease
Sean Ellis @seanellis
Challenge 3: Implementing Ideas
Weekly growth meeting to plan/assign current
week’s tests. Accountability for previous week.
Recommend Autonomous growth team with
dedicated development, design, analysis...
Empower less technical team members w tools
Sean Ellis @seanellis
Challenge 4: Accurate Testing
Read
Peep Laja
(Next presenter)
Sean Ellis @seanellis
Challenge 5: Avoiding Repeats
Capture all tests in Knowledge Base
Ensure knowledge base shared, clear & searchable
Worked Failed Inconclusive
Sean Ellis @seanellis
High Tempo Test Requirements
Process People System
Build
Knowledge
Base
Unbridled
Ideation
Prioritize
Backlog
High
Tempo
Testing
Sean Ellis @seanellis
High Tempo Testing Process
Build
Knowledge
Base
Unbridled
Ideation
Prioritize
Backlog
High
Tempo
Testing
Sean Ellis @seanellis
Winning Test Example via Process
Moved email collector
from bottom to top.
Result: 700% increase
in collected emails
Impact prediction was
4/10
Sean Ellis @seanellis
High Tempo Testing Advantages
1. Predictable Growth
2. Scaleable Growth
3. Easier Hiring
4. Address Bottlenecks
Sean Ellis @seanellis
Thank you!
@seanellis

Weitere ähnliche Inhalte

Andere mochten auch

[500DISTRO] Sharing Lab Notes: 27 Referral Program Hack-tics in 20 Minutes
[500DISTRO] Sharing Lab Notes: 27 Referral Program Hack-tics in 20 Minutes	[500DISTRO] Sharing Lab Notes: 27 Referral Program Hack-tics in 20 Minutes
[500DISTRO] Sharing Lab Notes: 27 Referral Program Hack-tics in 20 Minutes
500 Startups
 
[PreMoney SF 2015] Rothenberg Ventures >> Mike Rothenberg, "This Time, Virtua...
[PreMoney SF 2015] Rothenberg Ventures >> Mike Rothenberg, "This Time, Virtua...[PreMoney SF 2015] Rothenberg Ventures >> Mike Rothenberg, "This Time, Virtua...
[PreMoney SF 2015] Rothenberg Ventures >> Mike Rothenberg, "This Time, Virtua...
500 Startups
 
The Growth Hacker's Playbook
The Growth Hacker's PlaybookThe Growth Hacker's Playbook
The Growth Hacker's Playbook
Danny Beck
 
[PREMONEY 2014] Innovation Works >> Chris Evdemon, "The Global VC: China"
[PREMONEY 2014] Innovation Works >> Chris Evdemon, "The Global VC: China" [PREMONEY 2014] Innovation Works >> Chris Evdemon, "The Global VC: China"
[PREMONEY 2014] Innovation Works >> Chris Evdemon, "The Global VC: China"
500 Startups
 
HubBOG> GOAP LatAm 2013, Presentacion
HubBOG> GOAP LatAm 2013, PresentacionHubBOG> GOAP LatAm 2013, Presentacion
HubBOG> GOAP LatAm 2013, Presentacion
500 Startups
 

Andere mochten auch (20)

[500DISTRO] Sharing Lab Notes: 27 Referral Program Hack-tics in 20 Minutes
[500DISTRO] Sharing Lab Notes: 27 Referral Program Hack-tics in 20 Minutes	[500DISTRO] Sharing Lab Notes: 27 Referral Program Hack-tics in 20 Minutes
[500DISTRO] Sharing Lab Notes: 27 Referral Program Hack-tics in 20 Minutes
 
[PREMONEY MIAMI] White Star Capital >> Christian Hernandez Gallardo, "The Glo...
[PREMONEY MIAMI] White Star Capital >> Christian Hernandez Gallardo, "The Glo...[PREMONEY MIAMI] White Star Capital >> Christian Hernandez Gallardo, "The Glo...
[PREMONEY MIAMI] White Star Capital >> Christian Hernandez Gallardo, "The Glo...
 
[500DISTRO] Measuring for Engagement: Understanding User Gains, Losses & Leve...
[500DISTRO] Measuring for Engagement: Understanding User Gains, Losses & Leve...[500DISTRO] Measuring for Engagement: Understanding User Gains, Losses & Leve...
[500DISTRO] Measuring for Engagement: Understanding User Gains, Losses & Leve...
 
[#500Distro] The Billion Dollar Question
[#500Distro] The Billion Dollar Question	[#500Distro] The Billion Dollar Question
[#500Distro] The Billion Dollar Question
 
[PreMoney SF 2015] Rothenberg Ventures >> Mike Rothenberg, "This Time, Virtua...
[PreMoney SF 2015] Rothenberg Ventures >> Mike Rothenberg, "This Time, Virtua...[PreMoney SF 2015] Rothenberg Ventures >> Mike Rothenberg, "This Time, Virtua...
[PreMoney SF 2015] Rothenberg Ventures >> Mike Rothenberg, "This Time, Virtua...
 
[PREMONEY MIAMI] AngelList >> Ash Fontana, " Send Me an Angel: Everything You...
[PREMONEY MIAMI] AngelList >> Ash Fontana, " Send Me an Angel: Everything You...[PREMONEY MIAMI] AngelList >> Ash Fontana, " Send Me an Angel: Everything You...
[PREMONEY MIAMI] AngelList >> Ash Fontana, " Send Me an Angel: Everything You...
 
[PreMoney SF 2015] Felicis Ventures >> Aydin Senkut, "How To: Select Companie...
[PreMoney SF 2015] Felicis Ventures >> Aydin Senkut, "How To: Select Companie...[PreMoney SF 2015] Felicis Ventures >> Aydin Senkut, "How To: Select Companie...
[PreMoney SF 2015] Felicis Ventures >> Aydin Senkut, "How To: Select Companie...
 
The Growth Hacker's Playbook
The Growth Hacker's PlaybookThe Growth Hacker's Playbook
The Growth Hacker's Playbook
 
Growth Hacking Paris with Sean Ellis from GrowthHackers.com!
Growth Hacking Paris with Sean Ellis from GrowthHackers.com!Growth Hacking Paris with Sean Ellis from GrowthHackers.com!
Growth Hacking Paris with Sean Ellis from GrowthHackers.com!
 
Startupfest 2015: SEAN ELLIS (GrowthHackers.com) - "How to" Stage
Startupfest 2015: SEAN ELLIS (GrowthHackers.com) - "How to" StageStartupfest 2015: SEAN ELLIS (GrowthHackers.com) - "How to" Stage
Startupfest 2015: SEAN ELLIS (GrowthHackers.com) - "How to" Stage
 
[500DISTRO] Measuring for SaaS Monetization: Choosing Metrics, Running Experi...
[500DISTRO] Measuring for SaaS Monetization: Choosing Metrics, Running Experi...[500DISTRO] Measuring for SaaS Monetization: Choosing Metrics, Running Experi...
[500DISTRO] Measuring for SaaS Monetization: Choosing Metrics, Running Experi...
 
[PREMONEY 2014] Innovation Works >> Chris Evdemon, "The Global VC: China"
[PREMONEY 2014] Innovation Works >> Chris Evdemon, "The Global VC: China" [PREMONEY 2014] Innovation Works >> Chris Evdemon, "The Global VC: China"
[PREMONEY 2014] Innovation Works >> Chris Evdemon, "The Global VC: China"
 
Beyond Pretty: Creating Better Products with Measurable Design
Beyond Pretty: Creating Better Products with Measurable DesignBeyond Pretty: Creating Better Products with Measurable Design
Beyond Pretty: Creating Better Products with Measurable Design
 
The founder's path to and through the exit
The founder's path to and through the exitThe founder's path to and through the exit
The founder's path to and through the exit
 
[500DISTRO] Mix It Up: How to Leverage Product to Discover New Growth Channels
[500DISTRO] Mix It Up: How to Leverage Product to Discover New Growth Channels	[500DISTRO] Mix It Up: How to Leverage Product to Discover New Growth Channels
[500DISTRO] Mix It Up: How to Leverage Product to Discover New Growth Channels
 
Chalkable
ChalkableChalkable
Chalkable
 
Open routedata
Open routedataOpen routedata
Open routedata
 
500 Kobe Pre-Accelerator Demo Day >> GOFITURE
500 Kobe Pre-Accelerator Demo Day >> GOFITURE500 Kobe Pre-Accelerator Demo Day >> GOFITURE
500 Kobe Pre-Accelerator Demo Day >> GOFITURE
 
HubBOG> GOAP LatAm 2013, Presentacion
HubBOG> GOAP LatAm 2013, PresentacionHubBOG> GOAP LatAm 2013, Presentacion
HubBOG> GOAP LatAm 2013, Presentacion
 
500’s Demo Day Batch 17 >> Chefs for Seniors
500’s Demo Day Batch 17 >> Chefs for Seniors500’s Demo Day Batch 17 >> Chefs for Seniors
500’s Demo Day Batch 17 >> Chefs for Seniors
 

Ähnlich wie [WMD 2015] Qualaroo >> Sean Ellis, "Rhythm Is A Hacker: The Advantages & Challenges Of High-Tempo Testing"

Awl ass intro mtg v2
Awl ass intro mtg v2Awl ass intro mtg v2
Awl ass intro mtg v2
shaunallison
 
Questioning Techniques
Questioning TechniquesQuestioning Techniques
Questioning Techniques
Paul Redford
 

Ähnlich wie [WMD 2015] Qualaroo >> Sean Ellis, "Rhythm Is A Hacker: The Advantages & Challenges Of High-Tempo Testing" (20)

Building the Ultimate Full Company Growth Team
Building the Ultimate Full Company Growth TeamBuilding the Ultimate Full Company Growth Team
Building the Ultimate Full Company Growth Team
 
Building a Company-Wide Growth Culture: SaaStr Annual 2016
Building a Company-Wide Growth Culture: SaaStr Annual 2016Building a Company-Wide Growth Culture: SaaStr Annual 2016
Building a Company-Wide Growth Culture: SaaStr Annual 2016
 
"Building a Company Wide Growth Culture" at SaaStr Annual 2016
"Building a Company Wide Growth Culture" at SaaStr Annual 2016"Building a Company Wide Growth Culture" at SaaStr Annual 2016
"Building a Company Wide Growth Culture" at SaaStr Annual 2016
 
3 Essential Coaching Skills
3 Essential Coaching Skills3 Essential Coaching Skills
3 Essential Coaching Skills
 
3 Essential Coaching Skills for Project Leaders
3 Essential Coaching Skills for Project Leaders3 Essential Coaching Skills for Project Leaders
3 Essential Coaching Skills for Project Leaders
 
On the Care and Feeding of Feedback Cycles
On the Care and Feeding of Feedback CyclesOn the Care and Feeding of Feedback Cycles
On the Care and Feeding of Feedback Cycles
 
Awl ass intro mtg v2
Awl ass intro mtg v2Awl ass intro mtg v2
Awl ass intro mtg v2
 
Coaching: Asking the Right Questions
Coaching: Asking the Right QuestionsCoaching: Asking the Right Questions
Coaching: Asking the Right Questions
 
Interview workshop slides final
Interview workshop slides  finalInterview workshop slides  final
Interview workshop slides final
 
Adopting a Continual Improvement Mindset for IT
Adopting a Continual Improvement Mindset for ITAdopting a Continual Improvement Mindset for IT
Adopting a Continual Improvement Mindset for IT
 
Systematic reviews and social media
Systematic reviews and social mediaSystematic reviews and social media
Systematic reviews and social media
 
ACI design and creativity slides 2019 day4
ACI design and creativity slides 2019 day4ACI design and creativity slides 2019 day4
ACI design and creativity slides 2019 day4
 
Making your research and teaching more efficient, transparent and impactful
Making your research and teaching more efficient, transparent and impactfulMaking your research and teaching more efficient, transparent and impactful
Making your research and teaching more efficient, transparent and impactful
 
How to ace the viva dcu
How to ace the viva dcuHow to ace the viva dcu
How to ace the viva dcu
 
UX Café October 2013: Eewei Chen '101 design ingredients to solve big tech pr...
UX Café October 2013: Eewei Chen '101 design ingredients to solve big tech pr...UX Café October 2013: Eewei Chen '101 design ingredients to solve big tech pr...
UX Café October 2013: Eewei Chen '101 design ingredients to solve big tech pr...
 
DATA COLLECTION.pptx
DATA COLLECTION.pptxDATA COLLECTION.pptx
DATA COLLECTION.pptx
 
Sue Sheerin: Why self-assessment exciting?
Sue Sheerin: Why self-assessment exciting?Sue Sheerin: Why self-assessment exciting?
Sue Sheerin: Why self-assessment exciting?
 
Creativity for Learning 5: Linking theory and practice through collaborative ...
Creativity for Learning 5: Linking theory and practice through collaborative ...Creativity for Learning 5: Linking theory and practice through collaborative ...
Creativity for Learning 5: Linking theory and practice through collaborative ...
 
Questioning Techniques
Questioning TechniquesQuestioning Techniques
Questioning Techniques
 
Action research
Action researchAction research
Action research
 

Mehr von 500 Startups

Mehr von 500 Startups (20)

Get on Board
Get on BoardGet on Board
Get on Board
 
Connected Analytics
Connected AnalyticsConnected Analytics
Connected Analytics
 
Sira Medical
Sira MedicalSira Medical
Sira Medical
 
The Atlas
The AtlasThe Atlas
The Atlas
 
Trash Warrior
Trash WarriorTrash Warrior
Trash Warrior
 
Thematic
ThematicThematic
Thematic
 
Shiplyst
ShiplystShiplyst
Shiplyst
 
Renetec
RenetecRenetec
Renetec
 
Predina
PredinaPredina
Predina
 
Pluto
PlutoPluto
Pluto
 
Plant an App
Plant an AppPlant an App
Plant an App
 
Pilota
PilotaPilota
Pilota
 
Mero Technologies
Mero TechnologiesMero Technologies
Mero Technologies
 
Omnitron Sensors
Omnitron SensorsOmnitron Sensors
Omnitron Sensors
 
Juked
JukedJuked
Juked
 
GamerzClass
GamerzClassGamerzClass
GamerzClass
 
eino
einoeino
eino
 
Cenos
CenosCenos
Cenos
 
Bliinx
BliinxBliinx
Bliinx
 
Butlr
ButlrButlr
Butlr
 

Kürzlich hochgeladen

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Kürzlich hochgeladen (20)

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 

[WMD 2015] Qualaroo >> Sean Ellis, "Rhythm Is A Hacker: The Advantages & Challenges Of High-Tempo Testing"