SlideShare ist ein Scribd-Unternehmen logo
1 von 44
Downloaden Sie, um offline zu lesen
Marketing Analytics:
How Not to Shoot Yourself in the Foot
Ivan Ravovoy
Dmitry Severinets
Such products as:
- Weight Loss Fitness
- Weight Loss Running
- Weight Loss Walking
Main Goal: Help people to achieve personal lifestyle goals and live a
healthier life with the help of high-quality and easy-to-use apps.
We are developer of customized mobile apps
with a strong focus on health and well-being
A couple of facts about Verv
app downloads worldwide
75 000 000+
During the course of 2018 alone we achieved

the following results:
Weight Loss Walking
about 900,000 km
22 times the distance
around the Earth
Weight Loss Running
about 18,000,000 km
47 times
Weight Loss Fitness
about 250,000 kilos
20 «Falcon 9» rockets to deliver
such weight to the space
Before we start :)
Couple of questions
Why it’s important?
1. (in)correct data transferring
2. Wrong optimization metrics (events)
2 cases:
(in)correct data transferring
App Appsflyer
App Appsflyer
Case 1: Server / App issues
Example: Shutdowns / Delays / No internet / SDK failures / App crashes
Solution:
- QA. To reveal and describe all possible weaknesses
- Try to fix or avoid them
Case 2: Duplications
Example: Payment duplications / sending single event multiple times
Solution:
- Compare aggregated internal data with analytics/MMP
- Additional event/receipt validation before sending
- Comparative QA and fixing bugs
Case 3: Test/internal traffic
Example: Events from QA or company employees
Solution:
- Whitelist all test/QA devices
- Exclude test data from analytics / calculations
Case 4: Different time zones
Example: UTC +3 (Minsk) vs UTC -7 (Los Angeles)
Solution:
- To chose one time zone for all systems
- To align all internal and external analytics to one time zone
Case 5: Incorrect event tracking (or none at all)
In fact: Weak analytics (No analytics)
Solution:
- Start doing something :)
- To develop solid event structure on the basis of user behavior / funnels
- Check/Update SDK’s for analytic systems
- A lot of QA
Case 6: Logical mistakes. Defining events incorrectly
Example: Refunds vs Cancels
Solution:
- Perform full event taxonomy. With a single documentation for everyone
- Detailed event description, including all possible cases
- QA and control permanently
Case 7: No refunds/Cancellations
Example: Payments without refund information
Solution:
- Adding refunds and cancels for data enrichment
vs
Automated Data Validation with Apache Airflow
Slack notifications in case of data inconsistency
Detailed data validation report in Tableau
Detailed data validation report in Tableau
Wrong optimization metrics (events)
Key customer’s actions in events log
event
Install Onboarding Trial Payment
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event event
event
event
event
event
event
event
event event
event
event
event
event
event
event
event
event
event
event
eventevent
Key customer’s actions in events log
event
Install Onboarding Trial
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event event
event
event
event
event
event
event
event event
event
event
event
event
eventeventevent
Payment
event
event
event
event
event
eventevent
Key customer’s actions in events log
event
Install Onboarding Trial
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event event
event
event
event
event
event
event
event event
event
event
event
event
eventeventevent
Payment
event
event
Weak correlation
event
event
event
eventevent
Key customer’s actions in events log
event
Install Onboarding Trial Payment
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event event
event
event
event
event
event
event
event event
event
event
event
event
event
event
event
event
event
event
eventevent
Key customer’s actions in events log
Install Onboarding Trial Payment
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event event
event
event
event
event
event
event
event event
event
event
event
event
event
event
event
event
event
event
eventevent
event
Key customer’s actions in events log
Install Onboarding Trial Payment
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event event
event
event
event
event
event
event
event event
event
event
event
event
event
event
event
event
event
event
eventevent
event
How to find these events?
Create features from Events log
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event event
event
event
event
event
event
event
event
eventevent
Create dataset to train the model
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
event
. . .
Train the model to find key events
event
event
event
event
event
event
event
event
event event
event
event
event
event
event
event
event
event
- Be aware of data correctness, cover all possible failure cases
- Try to perform sophisticated analysis for finding the best
optimization metrics
To sum up:
Be aware of data correctness, cover all possible failure cases
- Try to perform sophisticated analysis for finding the best
optimization metrics
To sum up:
Be aware of data correctness, cover all possible failure cases
Try to perform sophisticated analysis for finding the best
optimization metrics
To sum up:
Thank you!
Q&A

Weitere ähnliche Inhalte

Was ist angesagt?

TargetSummit Moscow 2016 | 5 Ways not to get crushed by the App Ecosystem, St...
TargetSummit Moscow 2016 | 5 Ways not to get crushed by the App Ecosystem, St...TargetSummit Moscow 2016 | 5 Ways not to get crushed by the App Ecosystem, St...
TargetSummit Moscow 2016 | 5 Ways not to get crushed by the App Ecosystem, St...TargetSummit
 
Your Ticket to Mobile Growth: How to Safeguard Ad Spend when Running Marketin...
Your Ticket to Mobile Growth: How to Safeguard Ad Spend when Running Marketin...Your Ticket to Mobile Growth: How to Safeguard Ad Spend when Running Marketin...
Your Ticket to Mobile Growth: How to Safeguard Ad Spend when Running Marketin...Adjust
 
MAU Vegas 2016 — Digging Into Data — Capitalizing on the Clues Users Give Yo...
MAU Vegas 2016 —  Digging Into Data — Capitalizing on the Clues Users Give Yo...MAU Vegas 2016 —  Digging Into Data — Capitalizing on the Clues Users Give Yo...
MAU Vegas 2016 — Digging Into Data — Capitalizing on the Clues Users Give Yo...Grow.co
 
Mobile App Tracking - How it Works
Mobile App Tracking - How it WorksMobile App Tracking - How it Works
Mobile App Tracking - How it WorksMobileAppTracking
 
Unlock App Marketing Success With Rewarded Ads
Unlock App Marketing Success With Rewarded AdsUnlock App Marketing Success With Rewarded Ads
Unlock App Marketing Success With Rewarded AdsAdjust
 
MAU Vegas 2016 — How to Build a UA Infrastructure to Maximize Your Time and E...
MAU Vegas 2016 — How to Build a UA Infrastructure to Maximize Your Time and E...MAU Vegas 2016 — How to Build a UA Infrastructure to Maximize Your Time and E...
MAU Vegas 2016 — How to Build a UA Infrastructure to Maximize Your Time and E...Grow.co
 
Adjust Workshop - PUSHING AND PULLING YOUR DATA
Adjust Workshop - PUSHING AND PULLING YOUR DATA Adjust Workshop - PUSHING AND PULLING YOUR DATA
Adjust Workshop - PUSHING AND PULLING YOUR DATA Adjust
 
MAU Vegas 2016 — Conceptualizing and Implementing a Cross-Channel Segmentatio...
MAU Vegas 2016 — Conceptualizing and Implementing a Cross-Channel Segmentatio...MAU Vegas 2016 — Conceptualizing and Implementing a Cross-Channel Segmentatio...
MAU Vegas 2016 — Conceptualizing and Implementing a Cross-Channel Segmentatio...Grow.co
 
Has offers 'global insights performance marketing' presentation 2015 - shared
Has offers 'global insights   performance marketing' presentation 2015 - sharedHas offers 'global insights   performance marketing' presentation 2015 - shared
Has offers 'global insights performance marketing' presentation 2015 - sharedDavid Burke
 
MAU Vegas 2016 — Retention is Every App's Game to Lose
MAU Vegas 2016 — Retention is Every App's Game to LoseMAU Vegas 2016 — Retention is Every App's Game to Lose
MAU Vegas 2016 — Retention is Every App's Game to LoseGrow.co
 
Appsflyer - NOAH19 Tel Aviv
Appsflyer - NOAH19 Tel AvivAppsflyer - NOAH19 Tel Aviv
Appsflyer - NOAH19 Tel AvivNOAH Advisors
 
Roadshow Europe Flurry - Richard Firminger
Roadshow Europe Flurry - Richard Firminger Roadshow Europe Flurry - Richard Firminger
Roadshow Europe Flurry - Richard Firminger mobilesquared Ltd
 
The Audience Builder - Paul H. Müller (CTO of Adjust)
The Audience Builder - Paul H. Müller (CTO of Adjust)The Audience Builder - Paul H. Müller (CTO of Adjust)
The Audience Builder - Paul H. Müller (CTO of Adjust)Adjust
 
Leveling Up: Best Practices for Your Mobile Gaming App Launch
Leveling Up: Best Practices for Your Mobile Gaming App LaunchLeveling Up: Best Practices for Your Mobile Gaming App Launch
Leveling Up: Best Practices for Your Mobile Gaming App LaunchAdjust
 
Rewarded Video Advertising: How to Engage the Mobile Gamer
Rewarded Video Advertising: How to Engage the Mobile GamerRewarded Video Advertising: How to Engage the Mobile Gamer
Rewarded Video Advertising: How to Engage the Mobile GamerAdjust
 
ROI without monetization - Stefan Bielau
ROI without monetization - Stefan Bielau ROI without monetization - Stefan Bielau
ROI without monetization - Stefan Bielau Adjust
 
Affiliate Marketing for Mobile Apps
Affiliate Marketing for Mobile AppsAffiliate Marketing for Mobile Apps
Affiliate Marketing for Mobile AppsDavid Vogelpohl
 
The Best Mobile Retargeting Strategies for the Future - EMEA
The Best Mobile Retargeting Strategies for the Future - EMEAThe Best Mobile Retargeting Strategies for the Future - EMEA
The Best Mobile Retargeting Strategies for the Future - EMEAAdjust
 
Mobile Growth Summit - Mobile User Acquisition: A Network's Perspective
Mobile Growth Summit - Mobile User Acquisition: A Network's PerspectiveMobile Growth Summit - Mobile User Acquisition: A Network's Perspective
Mobile Growth Summit - Mobile User Acquisition: A Network's PerspectiveironSource
 

Was ist angesagt? (20)

TargetSummit Moscow 2016 | 5 Ways not to get crushed by the App Ecosystem, St...
TargetSummit Moscow 2016 | 5 Ways not to get crushed by the App Ecosystem, St...TargetSummit Moscow 2016 | 5 Ways not to get crushed by the App Ecosystem, St...
TargetSummit Moscow 2016 | 5 Ways not to get crushed by the App Ecosystem, St...
 
Mcommerce Breaking Mobile 2015
Mcommerce Breaking Mobile 2015Mcommerce Breaking Mobile 2015
Mcommerce Breaking Mobile 2015
 
Your Ticket to Mobile Growth: How to Safeguard Ad Spend when Running Marketin...
Your Ticket to Mobile Growth: How to Safeguard Ad Spend when Running Marketin...Your Ticket to Mobile Growth: How to Safeguard Ad Spend when Running Marketin...
Your Ticket to Mobile Growth: How to Safeguard Ad Spend when Running Marketin...
 
MAU Vegas 2016 — Digging Into Data — Capitalizing on the Clues Users Give Yo...
MAU Vegas 2016 —  Digging Into Data — Capitalizing on the Clues Users Give Yo...MAU Vegas 2016 —  Digging Into Data — Capitalizing on the Clues Users Give Yo...
MAU Vegas 2016 — Digging Into Data — Capitalizing on the Clues Users Give Yo...
 
Mobile App Tracking - How it Works
Mobile App Tracking - How it WorksMobile App Tracking - How it Works
Mobile App Tracking - How it Works
 
Unlock App Marketing Success With Rewarded Ads
Unlock App Marketing Success With Rewarded AdsUnlock App Marketing Success With Rewarded Ads
Unlock App Marketing Success With Rewarded Ads
 
MAU Vegas 2016 — How to Build a UA Infrastructure to Maximize Your Time and E...
MAU Vegas 2016 — How to Build a UA Infrastructure to Maximize Your Time and E...MAU Vegas 2016 — How to Build a UA Infrastructure to Maximize Your Time and E...
MAU Vegas 2016 — How to Build a UA Infrastructure to Maximize Your Time and E...
 
Adjust Workshop - PUSHING AND PULLING YOUR DATA
Adjust Workshop - PUSHING AND PULLING YOUR DATA Adjust Workshop - PUSHING AND PULLING YOUR DATA
Adjust Workshop - PUSHING AND PULLING YOUR DATA
 
MAU Vegas 2016 — Conceptualizing and Implementing a Cross-Channel Segmentatio...
MAU Vegas 2016 — Conceptualizing and Implementing a Cross-Channel Segmentatio...MAU Vegas 2016 — Conceptualizing and Implementing a Cross-Channel Segmentatio...
MAU Vegas 2016 — Conceptualizing and Implementing a Cross-Channel Segmentatio...
 
Has offers 'global insights performance marketing' presentation 2015 - shared
Has offers 'global insights   performance marketing' presentation 2015 - sharedHas offers 'global insights   performance marketing' presentation 2015 - shared
Has offers 'global insights performance marketing' presentation 2015 - shared
 
MAU Vegas 2016 — Retention is Every App's Game to Lose
MAU Vegas 2016 — Retention is Every App's Game to LoseMAU Vegas 2016 — Retention is Every App's Game to Lose
MAU Vegas 2016 — Retention is Every App's Game to Lose
 
Appsflyer - NOAH19 Tel Aviv
Appsflyer - NOAH19 Tel AvivAppsflyer - NOAH19 Tel Aviv
Appsflyer - NOAH19 Tel Aviv
 
Roadshow Europe Flurry - Richard Firminger
Roadshow Europe Flurry - Richard Firminger Roadshow Europe Flurry - Richard Firminger
Roadshow Europe Flurry - Richard Firminger
 
The Audience Builder - Paul H. Müller (CTO of Adjust)
The Audience Builder - Paul H. Müller (CTO of Adjust)The Audience Builder - Paul H. Müller (CTO of Adjust)
The Audience Builder - Paul H. Müller (CTO of Adjust)
 
Leveling Up: Best Practices for Your Mobile Gaming App Launch
Leveling Up: Best Practices for Your Mobile Gaming App LaunchLeveling Up: Best Practices for Your Mobile Gaming App Launch
Leveling Up: Best Practices for Your Mobile Gaming App Launch
 
Rewarded Video Advertising: How to Engage the Mobile Gamer
Rewarded Video Advertising: How to Engage the Mobile GamerRewarded Video Advertising: How to Engage the Mobile Gamer
Rewarded Video Advertising: How to Engage the Mobile Gamer
 
ROI without monetization - Stefan Bielau
ROI without monetization - Stefan Bielau ROI without monetization - Stefan Bielau
ROI without monetization - Stefan Bielau
 
Affiliate Marketing for Mobile Apps
Affiliate Marketing for Mobile AppsAffiliate Marketing for Mobile Apps
Affiliate Marketing for Mobile Apps
 
The Best Mobile Retargeting Strategies for the Future - EMEA
The Best Mobile Retargeting Strategies for the Future - EMEAThe Best Mobile Retargeting Strategies for the Future - EMEA
The Best Mobile Retargeting Strategies for the Future - EMEA
 
Mobile Growth Summit - Mobile User Acquisition: A Network's Perspective
Mobile Growth Summit - Mobile User Acquisition: A Network's PerspectiveMobile Growth Summit - Mobile User Acquisition: A Network's Perspective
Mobile Growth Summit - Mobile User Acquisition: A Network's Perspective
 

Ähnlich wie DATA: Marketing Analytics. How Not to Shoot Yourself in the Foot!

Emvigo Data Visualization - E Commerce Deck
Emvigo Data Visualization - E Commerce DeckEmvigo Data Visualization - E Commerce Deck
Emvigo Data Visualization - E Commerce DeckEmvigo Technologies
 
Effective Cost Measurement through DMAIC.
Effective Cost Measurement through DMAIC.Effective Cost Measurement through DMAIC.
Effective Cost Measurement through DMAIC.Kaustav Lahiri
 
Intro to Data Analytics with Oscar's Director of Product
 Intro to Data Analytics with Oscar's Director of Product Intro to Data Analytics with Oscar's Director of Product
Intro to Data Analytics with Oscar's Director of ProductProduct School
 
Project List of Ook Anthony Kim_
Project List of Ook Anthony Kim_Project List of Ook Anthony Kim_
Project List of Ook Anthony Kim_Anthony Kim
 
Using microsoft application insights to implement a build, measure, learn loop
Using microsoft application insights to implement a build, measure, learn loopUsing microsoft application insights to implement a build, measure, learn loop
Using microsoft application insights to implement a build, measure, learn loopMarcel de Vries
 
Improve phase lean six sigma tollgate template
Improve phase   lean six sigma tollgate templateImprove phase   lean six sigma tollgate template
Improve phase lean six sigma tollgate templateSteven Bonacorsi
 
Improve phase lean six sigma tollgate template
Improve phase   lean six sigma tollgate templateImprove phase   lean six sigma tollgate template
Improve phase lean six sigma tollgate templateSteven Bonacorsi
 
Application Requirements For Rolling Forecasts
Application Requirements For Rolling ForecastsApplication Requirements For Rolling Forecasts
Application Requirements For Rolling ForecastsBen Lamorte
 
The Digital Twin For Production Optimization
The Digital Twin For Production OptimizationThe Digital Twin For Production Optimization
The Digital Twin For Production OptimizationYokogawa1
 
How the World Bank Standardized on AppDynamics as its Enterprise-Wide APM Sol...
How the World Bank Standardized on AppDynamics as its Enterprise-Wide APM Sol...How the World Bank Standardized on AppDynamics as its Enterprise-Wide APM Sol...
How the World Bank Standardized on AppDynamics as its Enterprise-Wide APM Sol...AppDynamics
 
Metrics that every startup should know
Metrics that every startup should knowMetrics that every startup should know
Metrics that every startup should knowAlexey Orap
 
Blind scrum programme presentation
Blind scrum programme presentationBlind scrum programme presentation
Blind scrum programme presentationAlberto Gonzalez
 
Redefine Triage by Learning the Golden Nuggets of APM From Noted "APM Best Pr...
Redefine Triage by Learning the Golden Nuggets of APM From Noted "APM Best Pr...Redefine Triage by Learning the Golden Nuggets of APM From Noted "APM Best Pr...
Redefine Triage by Learning the Golden Nuggets of APM From Noted "APM Best Pr...CA Technologies
 
Co-dependency with Clients - building a great product ≠ great product success
Co-dependency with Clients - building a great product ≠ great product successCo-dependency with Clients - building a great product ≠ great product success
Co-dependency with Clients - building a great product ≠ great product successBarry Magee
 
Introduction to appDynamics
Introduction to appDynamics Introduction to appDynamics
Introduction to appDynamics Siddhanta Rath
 
Startup Analytics
Startup Analytics Startup Analytics
Startup Analytics Resad Zacina
 
Deloitte lean agile state of the nation
Deloitte lean   agile state of the nationDeloitte lean   agile state of the nation
Deloitte lean agile state of the nationAlexis Hui
 
Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationOptimizely
 

Ähnlich wie DATA: Marketing Analytics. How Not to Shoot Yourself in the Foot! (20)

Emvigo Data Visualization - E Commerce Deck
Emvigo Data Visualization - E Commerce DeckEmvigo Data Visualization - E Commerce Deck
Emvigo Data Visualization - E Commerce Deck
 
Effective Cost Measurement through DMAIC.
Effective Cost Measurement through DMAIC.Effective Cost Measurement through DMAIC.
Effective Cost Measurement through DMAIC.
 
Intro to Data Analytics with Oscar's Director of Product
 Intro to Data Analytics with Oscar's Director of Product Intro to Data Analytics with Oscar's Director of Product
Intro to Data Analytics with Oscar's Director of Product
 
Project List of Ook Anthony Kim_
Project List of Ook Anthony Kim_Project List of Ook Anthony Kim_
Project List of Ook Anthony Kim_
 
Using microsoft application insights to implement a build, measure, learn loop
Using microsoft application insights to implement a build, measure, learn loopUsing microsoft application insights to implement a build, measure, learn loop
Using microsoft application insights to implement a build, measure, learn loop
 
Resume
ResumeResume
Resume
 
CV
CVCV
CV
 
Improve phase lean six sigma tollgate template
Improve phase   lean six sigma tollgate templateImprove phase   lean six sigma tollgate template
Improve phase lean six sigma tollgate template
 
Improve phase lean six sigma tollgate template
Improve phase   lean six sigma tollgate templateImprove phase   lean six sigma tollgate template
Improve phase lean six sigma tollgate template
 
Application Requirements For Rolling Forecasts
Application Requirements For Rolling ForecastsApplication Requirements For Rolling Forecasts
Application Requirements For Rolling Forecasts
 
The Digital Twin For Production Optimization
The Digital Twin For Production OptimizationThe Digital Twin For Production Optimization
The Digital Twin For Production Optimization
 
How the World Bank Standardized on AppDynamics as its Enterprise-Wide APM Sol...
How the World Bank Standardized on AppDynamics as its Enterprise-Wide APM Sol...How the World Bank Standardized on AppDynamics as its Enterprise-Wide APM Sol...
How the World Bank Standardized on AppDynamics as its Enterprise-Wide APM Sol...
 
Metrics that every startup should know
Metrics that every startup should knowMetrics that every startup should know
Metrics that every startup should know
 
Blind scrum programme presentation
Blind scrum programme presentationBlind scrum programme presentation
Blind scrum programme presentation
 
Redefine Triage by Learning the Golden Nuggets of APM From Noted "APM Best Pr...
Redefine Triage by Learning the Golden Nuggets of APM From Noted "APM Best Pr...Redefine Triage by Learning the Golden Nuggets of APM From Noted "APM Best Pr...
Redefine Triage by Learning the Golden Nuggets of APM From Noted "APM Best Pr...
 
Co-dependency with Clients - building a great product ≠ great product success
Co-dependency with Clients - building a great product ≠ great product successCo-dependency with Clients - building a great product ≠ great product success
Co-dependency with Clients - building a great product ≠ great product success
 
Introduction to appDynamics
Introduction to appDynamics Introduction to appDynamics
Introduction to appDynamics
 
Startup Analytics
Startup Analytics Startup Analytics
Startup Analytics
 
Deloitte lean agile state of the nation
Deloitte lean   agile state of the nationDeloitte lean   agile state of the nation
Deloitte lean agile state of the nation
 
Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive Experimentation
 

Mehr von AppsFlyer

Data the future is private secure data management best practice
Data the future is private  secure data management best practice Data the future is private  secure data management best practice
Data the future is private secure data management best practice AppsFlyer
 
DATA: Automation: Success Starts with Data
DATA: Automation: Success Starts with DataDATA: Automation: Success Starts with Data
DATA: Automation: Success Starts with DataAppsFlyer
 
Winning the Future: How Countries Can Become Global Innovation Leaders / Saul...
Winning the Future: How Countries Can Become Global Innovation Leaders / Saul...Winning the Future: How Countries Can Become Global Innovation Leaders / Saul...
Winning the Future: How Countries Can Become Global Innovation Leaders / Saul...AppsFlyer
 
Holistic Monetisation: Ads, IAP and Player Engagement / Felix The, Head of Pr...
Holistic Monetisation: Ads, IAP and Player Engagement / Felix The, Head of Pr...Holistic Monetisation: Ads, IAP and Player Engagement / Felix The, Head of Pr...
Holistic Monetisation: Ads, IAP and Player Engagement / Felix The, Head of Pr...AppsFlyer
 
Smart Events: Create Effective CPA Campaigns
Smart Events: Create Effective CPA Campaigns  Smart Events: Create Effective CPA Campaigns
Smart Events: Create Effective CPA Campaigns AppsFlyer
 
Welcome to MAMA Minsk!
Welcome to MAMA Minsk!Welcome to MAMA Minsk!
Welcome to MAMA Minsk!AppsFlyer
 
China : How to Compete in the World's Most Competitive Market (Keynote Speech)
China : How to Compete in the World's Most Competitive Market (Keynote Speech)China : How to Compete in the World's Most Competitive Market (Keynote Speech)
China : How to Compete in the World's Most Competitive Market (Keynote Speech)AppsFlyer
 
Connecting the Dots in a World of 24 Billion Connected Devices / Alexander Gr...
Connecting the Dots in a World of 24 Billion Connected Devices / Alexander Gr...Connecting the Dots in a World of 24 Billion Connected Devices / Alexander Gr...
Connecting the Dots in a World of 24 Billion Connected Devices / Alexander Gr...AppsFlyer
 
Bootstrapping Your UA: Lessons for Businesses Both Big and Small /
Bootstrapping Your UA: Lessons for Businesses Both Big and Small / Bootstrapping Your UA: Lessons for Businesses Both Big and Small /
Bootstrapping Your UA: Lessons for Businesses Both Big and Small / AppsFlyer
 
Always On UA: Seasonality and Scale / Alex Tkach - COO, Sports.ru & Tribuna.com
Always On UA: Seasonality and Scale / Alex Tkach - COO, Sports.ru & Tribuna.comAlways On UA: Seasonality and Scale / Alex Tkach - COO, Sports.ru & Tribuna.com
Always On UA: Seasonality and Scale / Alex Tkach - COO, Sports.ru & Tribuna.comAppsFlyer
 
4 Elements of a Mission-Critical Marketing Platform
4 Elements of a Mission-Critical Marketing Platform4 Elements of a Mission-Critical Marketing Platform
4 Elements of a Mission-Critical Marketing PlatformAppsFlyer
 
Como maximizar omni channel e implementar uma estrategia web-app de sucesso
Como maximizar omni channel e implementar uma estrategia web-app de sucessoComo maximizar omni channel e implementar uma estrategia web-app de sucesso
Como maximizar omni channel e implementar uma estrategia web-app de sucessoAppsFlyer
 
Como monetizar com sucesso seu aplicativo no brasil
Como monetizar com sucesso seu aplicativo no brasilComo monetizar com sucesso seu aplicativo no brasil
Como monetizar com sucesso seu aplicativo no brasilAppsFlyer
 
Como trabalhar com sucesso com varias ad networks e canais de distribuicao
Como trabalhar com sucesso com varias ad networks e canais de distribuicaoComo trabalhar com sucesso com varias ad networks e canais de distribuicao
Como trabalhar com sucesso com varias ad networks e canais de distribuicaoAppsFlyer
 
David vs Golias como o aplicativo hopper esta ganhando o mercado dos gigantes...
David vs Golias como o aplicativo hopper esta ganhando o mercado dos gigantes...David vs Golias como o aplicativo hopper esta ganhando o mercado dos gigantes...
David vs Golias como o aplicativo hopper esta ganhando o mercado dos gigantes...AppsFlyer
 
The State of Mobile Ad Fraud 2018 - Mama Sao Paulo 2018
The State of Mobile Ad Fraud 2018 - Mama Sao Paulo 2018The State of Mobile Ad Fraud 2018 - Mama Sao Paulo 2018
The State of Mobile Ad Fraud 2018 - Mama Sao Paulo 2018AppsFlyer
 
The State of App Marketing in Brazil and LATAM 2018 by AppsFlyer
The State of App Marketing in Brazil and LATAM 2018 by AppsFlyerThe State of App Marketing in Brazil and LATAM 2018 by AppsFlyer
The State of App Marketing in Brazil and LATAM 2018 by AppsFlyerAppsFlyer
 
Como monetizar com sucesso seu aplicativo no brasil
Como monetizar com sucesso seu aplicativo no brasilComo monetizar com sucesso seu aplicativo no brasil
Como monetizar com sucesso seu aplicativo no brasilAppsFlyer
 
Mama London - creatives are not important!, Matej Lancaric, Head of Mobile Ma...
Mama London - creatives are not important!, Matej Lancaric, Head of Mobile Ma...Mama London - creatives are not important!, Matej Lancaric, Head of Mobile Ma...
Mama London - creatives are not important!, Matej Lancaric, Head of Mobile Ma...AppsFlyer
 
MAMA London - Football's Competitive Advantage: From Talent, to Technology &...
MAMA London -  Football's Competitive Advantage: From Talent, to Technology &...MAMA London -  Football's Competitive Advantage: From Talent, to Technology &...
MAMA London - Football's Competitive Advantage: From Talent, to Technology &...AppsFlyer
 

Mehr von AppsFlyer (20)

Data the future is private secure data management best practice
Data the future is private  secure data management best practice Data the future is private  secure data management best practice
Data the future is private secure data management best practice
 
DATA: Automation: Success Starts with Data
DATA: Automation: Success Starts with DataDATA: Automation: Success Starts with Data
DATA: Automation: Success Starts with Data
 
Winning the Future: How Countries Can Become Global Innovation Leaders / Saul...
Winning the Future: How Countries Can Become Global Innovation Leaders / Saul...Winning the Future: How Countries Can Become Global Innovation Leaders / Saul...
Winning the Future: How Countries Can Become Global Innovation Leaders / Saul...
 
Holistic Monetisation: Ads, IAP and Player Engagement / Felix The, Head of Pr...
Holistic Monetisation: Ads, IAP and Player Engagement / Felix The, Head of Pr...Holistic Monetisation: Ads, IAP and Player Engagement / Felix The, Head of Pr...
Holistic Monetisation: Ads, IAP and Player Engagement / Felix The, Head of Pr...
 
Smart Events: Create Effective CPA Campaigns
Smart Events: Create Effective CPA Campaigns  Smart Events: Create Effective CPA Campaigns
Smart Events: Create Effective CPA Campaigns
 
Welcome to MAMA Minsk!
Welcome to MAMA Minsk!Welcome to MAMA Minsk!
Welcome to MAMA Minsk!
 
China : How to Compete in the World's Most Competitive Market (Keynote Speech)
China : How to Compete in the World's Most Competitive Market (Keynote Speech)China : How to Compete in the World's Most Competitive Market (Keynote Speech)
China : How to Compete in the World's Most Competitive Market (Keynote Speech)
 
Connecting the Dots in a World of 24 Billion Connected Devices / Alexander Gr...
Connecting the Dots in a World of 24 Billion Connected Devices / Alexander Gr...Connecting the Dots in a World of 24 Billion Connected Devices / Alexander Gr...
Connecting the Dots in a World of 24 Billion Connected Devices / Alexander Gr...
 
Bootstrapping Your UA: Lessons for Businesses Both Big and Small /
Bootstrapping Your UA: Lessons for Businesses Both Big and Small / Bootstrapping Your UA: Lessons for Businesses Both Big and Small /
Bootstrapping Your UA: Lessons for Businesses Both Big and Small /
 
Always On UA: Seasonality and Scale / Alex Tkach - COO, Sports.ru & Tribuna.com
Always On UA: Seasonality and Scale / Alex Tkach - COO, Sports.ru & Tribuna.comAlways On UA: Seasonality and Scale / Alex Tkach - COO, Sports.ru & Tribuna.com
Always On UA: Seasonality and Scale / Alex Tkach - COO, Sports.ru & Tribuna.com
 
4 Elements of a Mission-Critical Marketing Platform
4 Elements of a Mission-Critical Marketing Platform4 Elements of a Mission-Critical Marketing Platform
4 Elements of a Mission-Critical Marketing Platform
 
Como maximizar omni channel e implementar uma estrategia web-app de sucesso
Como maximizar omni channel e implementar uma estrategia web-app de sucessoComo maximizar omni channel e implementar uma estrategia web-app de sucesso
Como maximizar omni channel e implementar uma estrategia web-app de sucesso
 
Como monetizar com sucesso seu aplicativo no brasil
Como monetizar com sucesso seu aplicativo no brasilComo monetizar com sucesso seu aplicativo no brasil
Como monetizar com sucesso seu aplicativo no brasil
 
Como trabalhar com sucesso com varias ad networks e canais de distribuicao
Como trabalhar com sucesso com varias ad networks e canais de distribuicaoComo trabalhar com sucesso com varias ad networks e canais de distribuicao
Como trabalhar com sucesso com varias ad networks e canais de distribuicao
 
David vs Golias como o aplicativo hopper esta ganhando o mercado dos gigantes...
David vs Golias como o aplicativo hopper esta ganhando o mercado dos gigantes...David vs Golias como o aplicativo hopper esta ganhando o mercado dos gigantes...
David vs Golias como o aplicativo hopper esta ganhando o mercado dos gigantes...
 
The State of Mobile Ad Fraud 2018 - Mama Sao Paulo 2018
The State of Mobile Ad Fraud 2018 - Mama Sao Paulo 2018The State of Mobile Ad Fraud 2018 - Mama Sao Paulo 2018
The State of Mobile Ad Fraud 2018 - Mama Sao Paulo 2018
 
The State of App Marketing in Brazil and LATAM 2018 by AppsFlyer
The State of App Marketing in Brazil and LATAM 2018 by AppsFlyerThe State of App Marketing in Brazil and LATAM 2018 by AppsFlyer
The State of App Marketing in Brazil and LATAM 2018 by AppsFlyer
 
Como monetizar com sucesso seu aplicativo no brasil
Como monetizar com sucesso seu aplicativo no brasilComo monetizar com sucesso seu aplicativo no brasil
Como monetizar com sucesso seu aplicativo no brasil
 
Mama London - creatives are not important!, Matej Lancaric, Head of Mobile Ma...
Mama London - creatives are not important!, Matej Lancaric, Head of Mobile Ma...Mama London - creatives are not important!, Matej Lancaric, Head of Mobile Ma...
Mama London - creatives are not important!, Matej Lancaric, Head of Mobile Ma...
 
MAMA London - Football's Competitive Advantage: From Talent, to Technology &...
MAMA London -  Football's Competitive Advantage: From Talent, to Technology &...MAMA London -  Football's Competitive Advantage: From Talent, to Technology &...
MAMA London - Football's Competitive Advantage: From Talent, to Technology &...
 

Kürzlich hochgeladen

A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????blackmambaettijean
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESmohitsingh558521
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 

Kürzlich hochgeladen (20)

A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICESSALESFORCE EDUCATION CLOUD | FEXLE SERVICES
SALESFORCE EDUCATION CLOUD | FEXLE SERVICES
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 

DATA: Marketing Analytics. How Not to Shoot Yourself in the Foot!

  • 1. Marketing Analytics: How Not to Shoot Yourself in the Foot Ivan Ravovoy Dmitry Severinets
  • 2. Such products as: - Weight Loss Fitness - Weight Loss Running - Weight Loss Walking Main Goal: Help people to achieve personal lifestyle goals and live a healthier life with the help of high-quality and easy-to-use apps. We are developer of customized mobile apps with a strong focus on health and well-being
  • 3. A couple of facts about Verv app downloads worldwide 75 000 000+
  • 4. During the course of 2018 alone we achieved
 the following results:
  • 6. 22 times the distance around the Earth
  • 10. 20 «Falcon 9» rockets to deliver such weight to the space
  • 11. Before we start :) Couple of questions
  • 13. 1. (in)correct data transferring 2. Wrong optimization metrics (events) 2 cases:
  • 17. Case 1: Server / App issues Example: Shutdowns / Delays / No internet / SDK failures / App crashes Solution: - QA. To reveal and describe all possible weaknesses - Try to fix or avoid them
  • 18. Case 2: Duplications Example: Payment duplications / sending single event multiple times Solution: - Compare aggregated internal data with analytics/MMP - Additional event/receipt validation before sending - Comparative QA and fixing bugs
  • 19. Case 3: Test/internal traffic Example: Events from QA or company employees Solution: - Whitelist all test/QA devices - Exclude test data from analytics / calculations
  • 20. Case 4: Different time zones Example: UTC +3 (Minsk) vs UTC -7 (Los Angeles) Solution: - To chose one time zone for all systems - To align all internal and external analytics to one time zone
  • 21. Case 5: Incorrect event tracking (or none at all) In fact: Weak analytics (No analytics) Solution: - Start doing something :) - To develop solid event structure on the basis of user behavior / funnels - Check/Update SDK’s for analytic systems - A lot of QA
  • 22. Case 6: Logical mistakes. Defining events incorrectly Example: Refunds vs Cancels Solution: - Perform full event taxonomy. With a single documentation for everyone - Detailed event description, including all possible cases - QA and control permanently
  • 23. Case 7: No refunds/Cancellations Example: Payments without refund information Solution: - Adding refunds and cancels for data enrichment
  • 24. vs
  • 25. Automated Data Validation with Apache Airflow
  • 26. Slack notifications in case of data inconsistency
  • 27. Detailed data validation report in Tableau
  • 28. Detailed data validation report in Tableau
  • 30. Key customer’s actions in events log event Install Onboarding Trial Payment event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event eventevent
  • 31. Key customer’s actions in events log event Install Onboarding Trial event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event eventeventevent Payment event event event event event eventevent
  • 32. Key customer’s actions in events log event Install Onboarding Trial event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event eventeventevent Payment event event Weak correlation event event event eventevent
  • 33. Key customer’s actions in events log event Install Onboarding Trial Payment event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event eventevent
  • 34. Key customer’s actions in events log Install Onboarding Trial Payment event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event eventevent event
  • 35. Key customer’s actions in events log Install Onboarding Trial Payment event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event eventevent event
  • 36. How to find these events?
  • 37. Create features from Events log event event event event event event event event event event event event event event event event event event event event event event event eventevent
  • 38. Create dataset to train the model event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event event . . .
  • 39. Train the model to find key events event event event event event event event event event event event event event event event event event event
  • 40. - Be aware of data correctness, cover all possible failure cases - Try to perform sophisticated analysis for finding the best optimization metrics To sum up:
  • 41. Be aware of data correctness, cover all possible failure cases - Try to perform sophisticated analysis for finding the best optimization metrics To sum up:
  • 42. Be aware of data correctness, cover all possible failure cases Try to perform sophisticated analysis for finding the best optimization metrics To sum up:
  • 44. Q&A