SlideShare a Scribd company logo
1 of 30
METRICS HANDS ON
@THANPOLAS          METRICS
WHAT ARE
METRICS?
• Realize how users use your
product
• Locate your best revenue
streams
@THANPOLAS                     METRICS
THE THEORY
AARRR
• Acquisition
                • Referral
• Activation
                • Revenue
• Retention

@THANPOLAS                   METRICS
* reminder: National Talk Like a Pirate Day is Sept 19th!




       Startup Metrics for Pirates:
               AARRR!!!
(Startup Metrics for Product Marketing & Product Management)




                       Dave McClure
                      Master of 500 Hats

                blog: http://500hats.typepad.com/
                website: http://www.500hats.com/
            slides: http://slideshare.net/dmc500hats/
Customer Lifecycle: 5 Steps to Success

• Acquisition: users come to the site from various channels

• Activation: users enjoy 1st visit: "happy" user experience

• Retention: users come back, visit site multiple times


• Referral: users like product enough to refer others

• Revenue: users conduct some monetization behavior
Customer Lifecycle: 5 Steps to Success

• Acquisition: users come to the site from various channels

• Activation: users enjoy 1st visit: "happy" user experience

• Retention: users come back, visit site multiple times


• Referral: users like product enough to refer others

• Revenue: users conduct some monetization behavior
        AARRR!
Customer Lifecycle / Conversion Behavior
                                     SEO                 Campaigns,
                         SEM                  PR          Contests
                                                                            Biz Dev
             Social
            Networks
                            Blogs                          Affiliates
           Apps &                                                           Direct, Tel,
           Widgets                  Email                                       TV

                     Domains          1. ACQUISITION                                            Campaigns,
                                                                                                 Contests




                                                                                                  R RAL
                                            2. A            Homepage /                      R EFE
              Emails &
                                             ctiv          Landing Page                4.
               Alerts
                                               atio
                                                                                                        Emails &
                                     TION                          Product                              widgets
                                  EN                               Features
                                                   n

System Events & Time-
                                ET
                         3. R
   based Features



                 Blogs, Content                                                             Biz Dev
                                                        Ads, Lead Gen,

                                                                               5. R
                                                       Subscriptions, etc

                                                                                  eve
                                                                                    nu
                                                          Website.com
                                                                                      e$
                                                                                           $$
Example Conversion Metrics
                (note: *not* actuals; your mileage may vary…)

Category                       User Status                      Conv %   Est. Value
Acquisition                       Visit Site                     100%       $.01
                     (or landing page, or external widget)
Acquisition                   Doesn't Abandon                    70%        $.05
                  (views 2+ pages, stays 10+ sec, 2+ clicks)
Activation                     Happy 1st Visit                   30%        $.25
                    (views X pages, stays Y sec, Z clicks)
Activation            Email/Blog/RSS/Widget Signup               5%         $1
                   (anything that could lead to repeat visit)
Activation                      Acct Signup                      2%         $3
                            (includes profile data)
 Retention          Email Open / RSS view -> Clickthru           3%         $2
 Retention                     Repeat Visitor                    2%         $5
                          (3+ visits in first 30 days)
 Referral              Refer 1+ users who visit site             2%         $3
 Referral               Refer 1+ users who activate              1%         $10
 Revenue            User generates minimum revenue               2%         $5
 Revenue            User generates break-even revenue            1%         $25
Customer Lifecycle / Conversion Behavior
                         SEO            Campaigns,
              SEM               PR       Contests
                                                      Biz Dev
  Social
 Networks
                Blogs                    Affiliates
Apps &                                                Direct, Tel,
Widgets                 Email                             TV

          Domains         1. ACQUISITION




                                                      Marketing Channels:
                                                       • largest-volume (#)
                                                       • lowest-cost ($)
                                                       • best-performing (%)


                          Website.com
Customer Lifecycle / Conversion Behavior
                              SEO             Campaigns,
                   SEM               PR        Contests
                                                                  Biz Dev
       Social
      Networks
                     Blogs                        Affiliates
     Apps &                                                       Direct, Tel,
     Widgets                 Email                                    TV

               Domains         1. ACQUISITION




                                     2. A
                                                       Homepage /
                                                      Landing Page
                                      ctiv
                                          atio                 Product
                                                               Features
                                                                                 Do LOTS of
Activation Criteria:
                                              n

                                                                                 landing page
• 10-30+ seconds                                                                 tests & A/B tests -
• 2-3+ page views                                                                just make lots of
                                                                                 dumb guesses &
• 3-5+ clicks                                                                    iterate QUICK
                                              Website.com
• 1 key feature usage
Customer Lifecycle / Conversion Behavior
                                                        SEO                   Campaigns,
                                              SEM                     PR       Contests
                                                                                            Biz Dev
                                    Social
                                   Networks
                                               Blogs                           Affiliates
                                  Apps &                                                    Direct, Tel,
                                  Widgets              Email                                    TV

Automated emails are                 Domains        1. ACQUISITION

simple & easy
retention feature           Emails &




                                                               2. A
                              Alerts
• lifecycle emails @                                            Homepage /
                                                               Landing Page




                                                                ctiv
+3, +7, +30d




                                                                  atio
                                                                    Product
                   System Events
• status emails & Time-based                      ION              Features




                                                                      n
                                                 T
                                             TEN
weekly/monthly       Features         3 . RE

• event-based emails
as they occur
                                        Blogs,
                                       Content
                                                                           Website.com
Customer Lifecycle / Conversion Behavior
                                     SEO               Campaigns,
                         SEM                  PR        Contests
                                                                     Biz Dev
             Social

                                                                                          Campaigns,
            Networks
                            Blogs                       Affiliates

                                                                                           Contests
           Apps &                                                     Direct, Tel,
           Widgets                  Email                                 TV

                     Domains          1. ACQUISITION




                                                                                                 RAL
                                            2. A         Homepage /                          FER
                                                                                     4.   RE
              Emails &
                                             ctiv       Landing Page
               Alerts
                                               atio

                                     TION                       Product
                                                                                                       Emails &
                                  EN                            Features
                                                   n

System Events & Time-
                                ET                                                                     widgets
                         3. R
   based Features



                 Blogs, Content
                                                               Only encourage users to
                                                               refer *after* they have
                                                               “happy” user experience;
                                                    Website.com
                                                                avg score >= 8 out of 10
Customer Lifecycle / Conversion Behavior
                                     SEO               Campaigns,
                         SEM                  PR        Contests
                                                                     Biz Dev
             Social
            Networks
                            Blogs                       Affiliates
           Apps &                                                     Direct, Tel,
           Widgets                  Email                                 TV

                     Domains          1. ACQUISITION                                       Campaigns,
                                                                                            Contests




                                                                                              RAL
                                            2. A         Homepage /
                                                                                      R EFE
                                                                                            R
              Emails &
                                             ctiv       Landing Page             4.
               Alerts
                                               atio
                                                                Product                            Emails &
                                     TION                       Features
                                                                                                   widgets
                                                   n

System Events & Time-
                                ETEN
                         3. R
   based Features


                                                                                              Biz Dev
                 Blogs, Content



                                                                            5. R
                                             Ads, Lead Gen,
                                            Subscriptions, etc
                                                                               eve
This is the part *you*
have to figure out…                                                              nu
                                                       Website.com                   e$
I don’t know jack about                                                               $$

your business
Types of Metrics & Measurement
• Qualitative: Usability Testing / Session Monitoring
  – Watch what users do, figure out problems & solutions from small #
    of users

• Quantitative: Traffic Analysis / User Engagement
  – Report what users do, track usage & conversion %'s for all or
    empirical sample # of users

• Comparative: A/B, Multivariate Testing
  – Compare what users do in one scenario vs another, see which
    copy/graphics/UI are most effective

• Competitive: Monitoring & Tracking Competitors
  – Track competitor activity & compare against yours; if possible
    compare channels, keyword traffic, demographic targeting, user
    satisfaction, etc.
Quantitative & Comparative
              Measurement
• Conversion Criteria:
  – best-performing (%) channels / campaigns / copy
  – largest-volume (#) channels / campaigns / copy
  – lowest-cost ($) channels / campaigns / copy
Quantitative & Comparative
              Measurement
• Conversion Criteria:
  – best-performing (%) channels / campaigns / copy
  – largest-volume (#) channels / campaigns / copy
  – lowest-cost ($) channels / campaigns / copy


• Measurement Components:
  – Audience Segment (young women, regional metro, older singles)
  – Channel Source (social network, SEM, organic, PR, etc)
  – Campaign Theme / Brand Promise (“find a job”, “learn to cook”)
  – Landing Page & CTA
  – Copy & Graphics
Example Conversion Metrics
                (note: *not* actuals; your mileage may vary…)

Category                       User Status                      Conv %   Est. Value
Acquisition                       Visit Site                     100%       $.01
                     (or landing page, or external widget)
Acquisition                   Doesn't Abandon                    70%        $.05
                  (views 2+ pages, stays 10+ sec, 2+ clicks)
Activation                     Happy 1st Visit                   30%        $.25
                    (views X pages, stays Y sec, Z clicks)
Activation            Email/Blog/RSS/Widget Signup               5%         $1
                   (anything that could lead to repeat visit)
Activation                      Acct Signup                      2%         $3
                            (includes profile data)
 Retention          Email Open / RSS view -> Clickthru           3%         $2
 Retention                     Repeat Visitor                    2%         $5
                          (3+ visits in first 30 days)
 Referral              Refer 1+ users who visit site             2%         $3
 Referral               Refer 1+ users who activate              1%         $10
 Revenue            User generates minimum revenue               2%         $5
 Revenue            User generates break-even revenue            1%         $25
Example Conversion Metrics
                (note: *not* actuals; your mileage may vary…)

Category                       User Status                      Conv %   Est. Value
Acquisition                       Visit Site                     100%       $.01
                     (or landing page, or external widget)
Acquisition                   Doesn't Abandon                    70%        $.05
                  (views 2+ pages, stays 10+ sec, 2+ clicks)
Activation                     Happy 1st Visit                   30%        $.25
                    (views X pages, stays Y sec, Z clicks)
Activation            Email/Blog/RSS/Widget Signup               5%         $1
                   (anything that could lead to repeat visit)
Activation                      Acct Signup                      2%         $3
                            (includes profile data)
 Retention          Email Open / RSS view -> Clickthru           3%         $2
 Retention                     Repeat Visitor                    2%         $5
                          (3+ visits in first 30 days)
 Referral              Refer 1+ users who visit site             2%         $3
 Referral               Refer 1+ users who activate              1%         $10
 Revenue            User generates minimum revenue               2%         $5
 Revenue            User generates break-even revenue            1%         $25
Example Conversion Metrics
                (note: *not* actuals; your mileage may vary…)

Category                       User Status                      Conv %   Est. Value
Acquisition                       Visit Site                     100%       $.01
                     (or landing page, or external widget)
Acquisition                   Doesn't Abandon                    70%        $.05
                  (views 2+ pages, stays 10+ sec, 2+ clicks)
Activation                     Happy 1st Visit                   30%        $.25
                    (views X pages, stays Y sec, Z clicks)
Activation            Email/Blog/RSS/Widget Signup               5%         $1
                   (anything that could lead to repeat visit)
Activation                      Acct Signup                      2%         $3
                            (includes profile data)
 Retention          Email Open / RSS view -> Clickthru           3%         $2
 Retention                     Repeat Visitor                    2%         $5
                          (3+ visits in first 30 days)
 Referral              Refer 1+ users who visit site             2%         $3
 Referral               Refer 1+ users who activate              1%         $10
 Revenue            User generates minimum revenue               2%         $5
 Revenue            User generates break-even revenue            1%         $25
Example Conversion Metrics
                (note: *not* actuals; your mileage may vary…)

Category                       User Status                      Conv %   Est. Value
Acquisition                       Visit Site                     100%       $.01
                     (or landing page, or external widget)
Acquisition                   Doesn't Abandon                    70%        $.05
                  (views 2+ pages, stays 10+ sec, 2+ clicks)
Activation                     Happy 1st Visit                   30%        $.25
                    (views X pages, stays Y sec, Z clicks)
Activation            Email/Blog/RSS/Widget Signup               5%         $1
                   (anything that could lead to repeat visit)
Activation                      Acct Signup                      2%         $3
                            (includes profile data)
 Retention          Email Open / RSS view -> Clickthru           3%         $2
 Retention                     Repeat Visitor                    2%         $5
                          (3+ visits in first 30 days)
 Referral              Refer 1+ users who visit site             2%         $3
 Referral               Refer 1+ users who activate              1%         $10
 Revenue            User generates minimum revenue               2%         $5
 Revenue            User generates break-even revenue            1%         $25
Example Conversion Metrics
                (note: *not* actuals; your mileage may vary…)

Category                       User Status                      Conv %   Est. Value
Acquisition                       Visit Site                     100%       $.01
                     (or landing page, or external widget)
Acquisition                   Doesn't Abandon                    70%        $.05
                  (views 2+ pages, stays 10+ sec, 2+ clicks)
Activation                     Happy 1st Visit                   30%        $.25
                    (views X pages, stays Y sec, Z clicks)
Activation            Email/Blog/RSS/Widget Signup               5%         $1
                   (anything that could lead to repeat visit)
Activation                      Acct Signup                      2%         $3
                            (includes profile data)
 Retention          Email Open / RSS view -> Clickthru           3%         $2
 Retention                     Repeat Visitor                    2%         $5
                          (3+ visits in first 30 days)
 Referral              Refer 1+ users who visit site             2%         $3
 Referral               Refer 1+ users who activate              1%         $10
 Revenue            User generates minimum revenue               2%         $5
 Revenue            User generates break-even revenue            1%         $25
Marketing
Q: what channels / who do you market to?

• Design & Test Multiple Mktg Channels
• Select & Focus on Channels with:
  – High Volume
  – High Conversion
  – Low Cost
• Measure *deeper* down the conversion funnel, not
  just to website / landing page
• Segment & Select channels & customers by
  conversion @ deepest possible level (ideally $$$)
Product
Q: how do you choose what to build?

• Choose features for conversion improvement
  – 80% on existing feature optimization
  – 20% on new feature development
• Just guess, then A/B test… A LOT
• Measure conversion improvement
• Rinse & Repeat
Founder/CEO
Q: What metrics do you choose to watch?

• Hypothesize Customer Lifecycle & Refine
  – Choose 5-10 conversion steps
  – Less, not More is better
• BUT measure & iterate
• Focus on conversion improvement
• Delegate each Metric to someone to OWN
SO NOW
WHAT?
PERM Cookie
•   Referrer       •   Visit Counter
•   Campaign       •   Visit Dates Array
•   Landing Page   •   Country / Timezone
•   Meta Data      •   Link to Members
@THANPOLAS                       METRICS
CLIENT SIDE
LIBRARIES
•   High Abstraction
•   Integrated / Interfaced
•   95% of metrics
•   Unobtrusive
@THANPOLAS                    METRICS
SERVER SIDE
LIBRARIES
•   A/B Class
•   Perm Cookie MVC
•   Campaign MVC
•   Lightweight --> Memcache / Cron
@THANPOLAS                     METRICS
METRICS
COST
Can cost up to 30% of development time
Similar overhead in Marketing / Product


@THANPOLAS                          METRICS
BUT YOU CAN’T
DO WITHOUT!


@THANPOLAS      METRICS
THANK
                 YOU.
             http://j.mp/metricshandson
             Thanasis Polychronakis
             Twitter @thanpolas




@THANPOLAS                            METRICS

More Related Content

Similar to Metrics - Hands On

Startupmetrics101aarrr
Startupmetrics101aarrrStartupmetrics101aarrr
Startupmetrics101aarrrTodd Lewis
 
Startup Metrics for Pirates (Sept 2012)
Startup Metrics for Pirates (Sept 2012)Startup Metrics for Pirates (Sept 2012)
Startup Metrics for Pirates (Sept 2012)Dave McClure
 
SaaS and the quest for freemium
SaaS and the quest for freemiumSaaS and the quest for freemium
SaaS and the quest for freemiumKelly Schwedland
 
Startup Metrics for Pirates (Nov 2012)
Startup Metrics for Pirates (Nov 2012)Startup Metrics for Pirates (Nov 2012)
Startup Metrics for Pirates (Nov 2012)Dave McClure
 
Startup Metrics 4 Pirates (Seoul)
Startup Metrics 4 Pirates (Seoul)Startup Metrics 4 Pirates (Seoul)
Startup Metrics 4 Pirates (Seoul)Dave McClure
 
Startup Metrics for Pirates (Startonomics Beijing, June 2009)
Startup Metrics for Pirates (Startonomics Beijing, June 2009)Startup Metrics for Pirates (Startonomics Beijing, June 2009)
Startup Metrics for Pirates (Startonomics Beijing, June 2009)Geeks On A Plane
 
Startup Metrics 4 Pirates (Wildfire Interactive, May 2012)
Startup Metrics 4 Pirates (Wildfire Interactive, May 2012)Startup Metrics 4 Pirates (Wildfire Interactive, May 2012)
Startup Metrics 4 Pirates (Wildfire Interactive, May 2012)Dave McClure
 
Startup Metrics (Ignite Velocity)
Startup Metrics (Ignite Velocity)Startup Metrics (Ignite Velocity)
Startup Metrics (Ignite Velocity)Dave McClure
 
Startup Metrics for Pirates (SeedCamp, Sept 2009)
Startup Metrics for Pirates (SeedCamp, Sept 2009)Startup Metrics for Pirates (SeedCamp, Sept 2009)
Startup Metrics for Pirates (SeedCamp, Sept 2009)Dave McClure
 
Startup Metrics 4 Pirates
Startup Metrics 4 PiratesStartup Metrics 4 Pirates
Startup Metrics 4 Piratescaquino23
 
The Startup Metrics Religion
The Startup Metrics ReligionThe Startup Metrics Religion
The Startup Metrics ReligionChikPea
 
Startup Metrics For Scottish Pirates (AARRR!) v1.3
Startup Metrics For Scottish Pirates (AARRR!) v1.3Startup Metrics For Scottish Pirates (AARRR!) v1.3
Startup Metrics For Scottish Pirates (AARRR!) v1.3Dave McClure
 
Luis Rivera. Cómo no arruinarse invirtiendo en negocios en Internet.
Luis Rivera. Cómo no arruinarse invirtiendo en negocios en Internet. Luis Rivera. Cómo no arruinarse invirtiendo en negocios en Internet.
Luis Rivera. Cómo no arruinarse invirtiendo en negocios en Internet. SalonMiEmpresa
 
Silicon Valley 2.0: Lean Startup, Lean VC
Silicon Valley 2.0: Lean Startup, Lean VCSilicon Valley 2.0: Lean Startup, Lean VC
Silicon Valley 2.0: Lean Startup, Lean VCDave McClure
 
Startup Metrics for Pirates (SeedCamp 2008)
Startup Metrics for Pirates (SeedCamp 2008)Startup Metrics for Pirates (SeedCamp 2008)
Startup Metrics for Pirates (SeedCamp 2008)Dave McClure
 
Startup Metrics 4 Pirates (May 2010)
Startup Metrics 4 Pirates (May 2010)Startup Metrics 4 Pirates (May 2010)
Startup Metrics 4 Pirates (May 2010)Dave McClure
 
Startup metrics for pirates long version463
Startup metrics for pirates long version463Startup metrics for pirates long version463
Startup metrics for pirates long version463PR Consultancy
 
Silicon Valley 2.0: Lean Startup, Lean VC
Silicon Valley 2.0: Lean Startup, Lean VCSilicon Valley 2.0: Lean Startup, Lean VC
Silicon Valley 2.0: Lean Startup, Lean VCDave McClure
 
Startup metrics-for-pirates
Startup metrics-for-piratesStartup metrics-for-pirates
Startup metrics-for-piratesEdmund FOng
 
Startup Metrics for Pirates: AARRR! (SXSW March 2008)
Startup Metrics for Pirates: AARRR!  (SXSW March 2008)Startup Metrics for Pirates: AARRR!  (SXSW March 2008)
Startup Metrics for Pirates: AARRR! (SXSW March 2008)Dave McClure
 

Similar to Metrics - Hands On (20)

Startupmetrics101aarrr
Startupmetrics101aarrrStartupmetrics101aarrr
Startupmetrics101aarrr
 
Startup Metrics for Pirates (Sept 2012)
Startup Metrics for Pirates (Sept 2012)Startup Metrics for Pirates (Sept 2012)
Startup Metrics for Pirates (Sept 2012)
 
SaaS and the quest for freemium
SaaS and the quest for freemiumSaaS and the quest for freemium
SaaS and the quest for freemium
 
Startup Metrics for Pirates (Nov 2012)
Startup Metrics for Pirates (Nov 2012)Startup Metrics for Pirates (Nov 2012)
Startup Metrics for Pirates (Nov 2012)
 
Startup Metrics 4 Pirates (Seoul)
Startup Metrics 4 Pirates (Seoul)Startup Metrics 4 Pirates (Seoul)
Startup Metrics 4 Pirates (Seoul)
 
Startup Metrics for Pirates (Startonomics Beijing, June 2009)
Startup Metrics for Pirates (Startonomics Beijing, June 2009)Startup Metrics for Pirates (Startonomics Beijing, June 2009)
Startup Metrics for Pirates (Startonomics Beijing, June 2009)
 
Startup Metrics 4 Pirates (Wildfire Interactive, May 2012)
Startup Metrics 4 Pirates (Wildfire Interactive, May 2012)Startup Metrics 4 Pirates (Wildfire Interactive, May 2012)
Startup Metrics 4 Pirates (Wildfire Interactive, May 2012)
 
Startup Metrics (Ignite Velocity)
Startup Metrics (Ignite Velocity)Startup Metrics (Ignite Velocity)
Startup Metrics (Ignite Velocity)
 
Startup Metrics for Pirates (SeedCamp, Sept 2009)
Startup Metrics for Pirates (SeedCamp, Sept 2009)Startup Metrics for Pirates (SeedCamp, Sept 2009)
Startup Metrics for Pirates (SeedCamp, Sept 2009)
 
Startup Metrics 4 Pirates
Startup Metrics 4 PiratesStartup Metrics 4 Pirates
Startup Metrics 4 Pirates
 
The Startup Metrics Religion
The Startup Metrics ReligionThe Startup Metrics Religion
The Startup Metrics Religion
 
Startup Metrics For Scottish Pirates (AARRR!) v1.3
Startup Metrics For Scottish Pirates (AARRR!) v1.3Startup Metrics For Scottish Pirates (AARRR!) v1.3
Startup Metrics For Scottish Pirates (AARRR!) v1.3
 
Luis Rivera. Cómo no arruinarse invirtiendo en negocios en Internet.
Luis Rivera. Cómo no arruinarse invirtiendo en negocios en Internet. Luis Rivera. Cómo no arruinarse invirtiendo en negocios en Internet.
Luis Rivera. Cómo no arruinarse invirtiendo en negocios en Internet.
 
Silicon Valley 2.0: Lean Startup, Lean VC
Silicon Valley 2.0: Lean Startup, Lean VCSilicon Valley 2.0: Lean Startup, Lean VC
Silicon Valley 2.0: Lean Startup, Lean VC
 
Startup Metrics for Pirates (SeedCamp 2008)
Startup Metrics for Pirates (SeedCamp 2008)Startup Metrics for Pirates (SeedCamp 2008)
Startup Metrics for Pirates (SeedCamp 2008)
 
Startup Metrics 4 Pirates (May 2010)
Startup Metrics 4 Pirates (May 2010)Startup Metrics 4 Pirates (May 2010)
Startup Metrics 4 Pirates (May 2010)
 
Startup metrics for pirates long version463
Startup metrics for pirates long version463Startup metrics for pirates long version463
Startup metrics for pirates long version463
 
Silicon Valley 2.0: Lean Startup, Lean VC
Silicon Valley 2.0: Lean Startup, Lean VCSilicon Valley 2.0: Lean Startup, Lean VC
Silicon Valley 2.0: Lean Startup, Lean VC
 
Startup metrics-for-pirates
Startup metrics-for-piratesStartup metrics-for-pirates
Startup metrics-for-pirates
 
Startup Metrics for Pirates: AARRR! (SXSW March 2008)
Startup Metrics for Pirates: AARRR!  (SXSW March 2008)Startup Metrics for Pirates: AARRR!  (SXSW March 2008)
Startup Metrics for Pirates: AARRR! (SXSW March 2008)
 

More from Thanos Polychronakis

More from Thanos Polychronakis (6)

Entities, the theory
Entities, the theoryEntities, the theory
Entities, the theory
 
Entities on Node.JS
Entities on Node.JSEntities on Node.JS
Entities on Node.JS
 
Intro to node.js
Intro to node.jsIntro to node.js
Intro to node.js
 
Intro to node.js web apps
Intro to node.js web appsIntro to node.js web apps
Intro to node.js web apps
 
HowTo Freelance
HowTo FreelanceHowTo Freelance
HowTo Freelance
 
Mantri Presentation One
Mantri Presentation OneMantri Presentation One
Mantri Presentation One
 

Recently uploaded

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 

Recently uploaded (20)

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 

Metrics - Hands On

  • 2. WHAT ARE METRICS? • Realize how users use your product • Locate your best revenue streams @THANPOLAS METRICS
  • 3. THE THEORY AARRR • Acquisition • Referral • Activation • Revenue • Retention @THANPOLAS METRICS
  • 4. * reminder: National Talk Like a Pirate Day is Sept 19th! Startup Metrics for Pirates: AARRR!!! (Startup Metrics for Product Marketing & Product Management) Dave McClure Master of 500 Hats blog: http://500hats.typepad.com/ website: http://www.500hats.com/ slides: http://slideshare.net/dmc500hats/
  • 5. Customer Lifecycle: 5 Steps to Success • Acquisition: users come to the site from various channels • Activation: users enjoy 1st visit: "happy" user experience • Retention: users come back, visit site multiple times • Referral: users like product enough to refer others • Revenue: users conduct some monetization behavior
  • 6. Customer Lifecycle: 5 Steps to Success • Acquisition: users come to the site from various channels • Activation: users enjoy 1st visit: "happy" user experience • Retention: users come back, visit site multiple times • Referral: users like product enough to refer others • Revenue: users conduct some monetization behavior AARRR!
  • 7. Customer Lifecycle / Conversion Behavior SEO Campaigns, SEM PR Contests Biz Dev Social Networks Blogs Affiliates Apps & Direct, Tel, Widgets Email TV Domains 1. ACQUISITION Campaigns, Contests R RAL 2. A Homepage / R EFE Emails & ctiv Landing Page 4. Alerts atio Emails & TION Product widgets EN Features n System Events & Time- ET 3. R based Features Blogs, Content Biz Dev Ads, Lead Gen, 5. R Subscriptions, etc eve nu Website.com e$ $$
  • 8. Example Conversion Metrics (note: *not* actuals; your mileage may vary…) Category User Status Conv % Est. Value Acquisition Visit Site 100% $.01 (or landing page, or external widget) Acquisition Doesn't Abandon 70% $.05 (views 2+ pages, stays 10+ sec, 2+ clicks) Activation Happy 1st Visit 30% $.25 (views X pages, stays Y sec, Z clicks) Activation Email/Blog/RSS/Widget Signup 5% $1 (anything that could lead to repeat visit) Activation Acct Signup 2% $3 (includes profile data) Retention Email Open / RSS view -> Clickthru 3% $2 Retention Repeat Visitor 2% $5 (3+ visits in first 30 days) Referral Refer 1+ users who visit site 2% $3 Referral Refer 1+ users who activate 1% $10 Revenue User generates minimum revenue 2% $5 Revenue User generates break-even revenue 1% $25
  • 9. Customer Lifecycle / Conversion Behavior SEO Campaigns, SEM PR Contests Biz Dev Social Networks Blogs Affiliates Apps & Direct, Tel, Widgets Email TV Domains 1. ACQUISITION Marketing Channels: • largest-volume (#) • lowest-cost ($) • best-performing (%) Website.com
  • 10. Customer Lifecycle / Conversion Behavior SEO Campaigns, SEM PR Contests Biz Dev Social Networks Blogs Affiliates Apps & Direct, Tel, Widgets Email TV Domains 1. ACQUISITION 2. A Homepage / Landing Page ctiv atio Product Features Do LOTS of Activation Criteria: n landing page • 10-30+ seconds tests & A/B tests - • 2-3+ page views just make lots of dumb guesses & • 3-5+ clicks iterate QUICK Website.com • 1 key feature usage
  • 11. Customer Lifecycle / Conversion Behavior SEO Campaigns, SEM PR Contests Biz Dev Social Networks Blogs Affiliates Apps & Direct, Tel, Widgets Email TV Automated emails are Domains 1. ACQUISITION simple & easy retention feature Emails & 2. A Alerts • lifecycle emails @ Homepage / Landing Page ctiv +3, +7, +30d atio Product System Events • status emails & Time-based ION Features n T TEN weekly/monthly Features 3 . RE • event-based emails as they occur Blogs, Content Website.com
  • 12. Customer Lifecycle / Conversion Behavior SEO Campaigns, SEM PR Contests Biz Dev Social Campaigns, Networks Blogs Affiliates Contests Apps & Direct, Tel, Widgets Email TV Domains 1. ACQUISITION RAL 2. A Homepage / FER 4. RE Emails & ctiv Landing Page Alerts atio TION Product Emails & EN Features n System Events & Time- ET widgets 3. R based Features Blogs, Content Only encourage users to refer *after* they have “happy” user experience; Website.com avg score >= 8 out of 10
  • 13. Customer Lifecycle / Conversion Behavior SEO Campaigns, SEM PR Contests Biz Dev Social Networks Blogs Affiliates Apps & Direct, Tel, Widgets Email TV Domains 1. ACQUISITION Campaigns, Contests RAL 2. A Homepage / R EFE R Emails & ctiv Landing Page 4. Alerts atio Product Emails & TION Features widgets n System Events & Time- ETEN 3. R based Features Biz Dev Blogs, Content 5. R Ads, Lead Gen, Subscriptions, etc eve This is the part *you* have to figure out… nu Website.com e$ I don’t know jack about $$ your business
  • 14. Types of Metrics & Measurement • Qualitative: Usability Testing / Session Monitoring – Watch what users do, figure out problems & solutions from small # of users • Quantitative: Traffic Analysis / User Engagement – Report what users do, track usage & conversion %'s for all or empirical sample # of users • Comparative: A/B, Multivariate Testing – Compare what users do in one scenario vs another, see which copy/graphics/UI are most effective • Competitive: Monitoring & Tracking Competitors – Track competitor activity & compare against yours; if possible compare channels, keyword traffic, demographic targeting, user satisfaction, etc.
  • 15. Quantitative & Comparative Measurement • Conversion Criteria: – best-performing (%) channels / campaigns / copy – largest-volume (#) channels / campaigns / copy – lowest-cost ($) channels / campaigns / copy
  • 16. Quantitative & Comparative Measurement • Conversion Criteria: – best-performing (%) channels / campaigns / copy – largest-volume (#) channels / campaigns / copy – lowest-cost ($) channels / campaigns / copy • Measurement Components: – Audience Segment (young women, regional metro, older singles) – Channel Source (social network, SEM, organic, PR, etc) – Campaign Theme / Brand Promise (“find a job”, “learn to cook”) – Landing Page & CTA – Copy & Graphics
  • 17. Example Conversion Metrics (note: *not* actuals; your mileage may vary…) Category User Status Conv % Est. Value Acquisition Visit Site 100% $.01 (or landing page, or external widget) Acquisition Doesn't Abandon 70% $.05 (views 2+ pages, stays 10+ sec, 2+ clicks) Activation Happy 1st Visit 30% $.25 (views X pages, stays Y sec, Z clicks) Activation Email/Blog/RSS/Widget Signup 5% $1 (anything that could lead to repeat visit) Activation Acct Signup 2% $3 (includes profile data) Retention Email Open / RSS view -> Clickthru 3% $2 Retention Repeat Visitor 2% $5 (3+ visits in first 30 days) Referral Refer 1+ users who visit site 2% $3 Referral Refer 1+ users who activate 1% $10 Revenue User generates minimum revenue 2% $5 Revenue User generates break-even revenue 1% $25
  • 18. Example Conversion Metrics (note: *not* actuals; your mileage may vary…) Category User Status Conv % Est. Value Acquisition Visit Site 100% $.01 (or landing page, or external widget) Acquisition Doesn't Abandon 70% $.05 (views 2+ pages, stays 10+ sec, 2+ clicks) Activation Happy 1st Visit 30% $.25 (views X pages, stays Y sec, Z clicks) Activation Email/Blog/RSS/Widget Signup 5% $1 (anything that could lead to repeat visit) Activation Acct Signup 2% $3 (includes profile data) Retention Email Open / RSS view -> Clickthru 3% $2 Retention Repeat Visitor 2% $5 (3+ visits in first 30 days) Referral Refer 1+ users who visit site 2% $3 Referral Refer 1+ users who activate 1% $10 Revenue User generates minimum revenue 2% $5 Revenue User generates break-even revenue 1% $25
  • 19. Example Conversion Metrics (note: *not* actuals; your mileage may vary…) Category User Status Conv % Est. Value Acquisition Visit Site 100% $.01 (or landing page, or external widget) Acquisition Doesn't Abandon 70% $.05 (views 2+ pages, stays 10+ sec, 2+ clicks) Activation Happy 1st Visit 30% $.25 (views X pages, stays Y sec, Z clicks) Activation Email/Blog/RSS/Widget Signup 5% $1 (anything that could lead to repeat visit) Activation Acct Signup 2% $3 (includes profile data) Retention Email Open / RSS view -> Clickthru 3% $2 Retention Repeat Visitor 2% $5 (3+ visits in first 30 days) Referral Refer 1+ users who visit site 2% $3 Referral Refer 1+ users who activate 1% $10 Revenue User generates minimum revenue 2% $5 Revenue User generates break-even revenue 1% $25
  • 20. Example Conversion Metrics (note: *not* actuals; your mileage may vary…) Category User Status Conv % Est. Value Acquisition Visit Site 100% $.01 (or landing page, or external widget) Acquisition Doesn't Abandon 70% $.05 (views 2+ pages, stays 10+ sec, 2+ clicks) Activation Happy 1st Visit 30% $.25 (views X pages, stays Y sec, Z clicks) Activation Email/Blog/RSS/Widget Signup 5% $1 (anything that could lead to repeat visit) Activation Acct Signup 2% $3 (includes profile data) Retention Email Open / RSS view -> Clickthru 3% $2 Retention Repeat Visitor 2% $5 (3+ visits in first 30 days) Referral Refer 1+ users who visit site 2% $3 Referral Refer 1+ users who activate 1% $10 Revenue User generates minimum revenue 2% $5 Revenue User generates break-even revenue 1% $25
  • 21. Example Conversion Metrics (note: *not* actuals; your mileage may vary…) Category User Status Conv % Est. Value Acquisition Visit Site 100% $.01 (or landing page, or external widget) Acquisition Doesn't Abandon 70% $.05 (views 2+ pages, stays 10+ sec, 2+ clicks) Activation Happy 1st Visit 30% $.25 (views X pages, stays Y sec, Z clicks) Activation Email/Blog/RSS/Widget Signup 5% $1 (anything that could lead to repeat visit) Activation Acct Signup 2% $3 (includes profile data) Retention Email Open / RSS view -> Clickthru 3% $2 Retention Repeat Visitor 2% $5 (3+ visits in first 30 days) Referral Refer 1+ users who visit site 2% $3 Referral Refer 1+ users who activate 1% $10 Revenue User generates minimum revenue 2% $5 Revenue User generates break-even revenue 1% $25
  • 22. Marketing Q: what channels / who do you market to? • Design & Test Multiple Mktg Channels • Select & Focus on Channels with: – High Volume – High Conversion – Low Cost • Measure *deeper* down the conversion funnel, not just to website / landing page • Segment & Select channels & customers by conversion @ deepest possible level (ideally $$$)
  • 23. Product Q: how do you choose what to build? • Choose features for conversion improvement – 80% on existing feature optimization – 20% on new feature development • Just guess, then A/B test… A LOT • Measure conversion improvement • Rinse & Repeat
  • 24. Founder/CEO Q: What metrics do you choose to watch? • Hypothesize Customer Lifecycle & Refine – Choose 5-10 conversion steps – Less, not More is better • BUT measure & iterate • Focus on conversion improvement • Delegate each Metric to someone to OWN
  • 25. SO NOW WHAT? PERM Cookie • Referrer • Visit Counter • Campaign • Visit Dates Array • Landing Page • Country / Timezone • Meta Data • Link to Members @THANPOLAS METRICS
  • 26. CLIENT SIDE LIBRARIES • High Abstraction • Integrated / Interfaced • 95% of metrics • Unobtrusive @THANPOLAS METRICS
  • 27. SERVER SIDE LIBRARIES • A/B Class • Perm Cookie MVC • Campaign MVC • Lightweight --> Memcache / Cron @THANPOLAS METRICS
  • 28. METRICS COST Can cost up to 30% of development time Similar overhead in Marketing / Product @THANPOLAS METRICS
  • 29. BUT YOU CAN’T DO WITHOUT! @THANPOLAS METRICS
  • 30. THANK YOU. http://j.mp/metricshandson Thanasis Polychronakis Twitter @thanpolas @THANPOLAS METRICS

Editor's Notes

  1. \n
  2. \n
  3. \n
  4. \n
  5. \n
  6. \n
  7. \n
  8. \n
  9. \n
  10. \n
  11. \n
  12. \n
  13. Qualitative: SurveyMonkey (surveys), CrazyEgg (heatmap), TechSmith Morae / UserVue (ux recording), RobotReplay, TapeFailure. Quantitative: Google Analytics (free), MyBlogLog, ClickTracks, Index Tools, Visual Sciences / Webside Story, Omniture, WebTrends, etc. Comparative: Google Website Optimizer, SiteSpect, Optimost, Offermatica, Vertster, Kefta. Competitive: Quantcast, Compete.com, Alexa, Hitwise, Comscore, Nielsens. see more info at: http://webanalyticsassociation.com/ (WAA) http://kaushik.net/ (Avinash Kaushik) http://grokdotcom.com/ (Eisenbergs) \nhttp://www.emetrics.org/ (Jim Sterne)\n
  14. \n
  15. \n
  16. \n
  17. \n
  18. \n
  19. \n
  20. \n
  21. \n
  22. \n
  23. \n
  24. perm cookie tracks, count visits, logins, segment visitors campaigns / visit source\n
  25. Easy - accessible - ajax - 3rd party, strongly tied to server-side\n
  26. Lightweight, simple writes only, croned processing, A/B tests\n
  27. \n\n
  28. \n\n
  29. \n