SlideShare a Scribd company logo
1 of 21
Download to read offline
PRADA: Prioritizing Android
Devices for Apps by Mining
Large-Scale Usage Data
Presented by: Akshay Mittal
Course: CS 5393
Professor: Dr. Guowei Yang
Authors
• Lu, Xuan;
• Liu, Xuanzhe;
• Li, Huoran;
• Xie, Tao; Mei,
• Qiaozhu;
• Hao, Dan;
• Huang, Gang;
10/20/2016 CS5393 Software Quality 2
Overview
• Motivation
• Approach
• Evaluation
• Strength
• Weakness
• Conclusion
• Q&A
10/20/2016 CS5393 Software Quality 3
Overview of PRADA Approach
10/20/2016 CS5393 Software Quality 4
Motivation
• Android Fragmentation that is,
concern over the alarming
number of different
available Android operating
system (OS) versions in the
market.
• to explore whether we can
make accurate estimates for
a new app.
10/20/2016 CS5393 Software Quality 5
10/20/2016 CS5393 Software Quality 6
Approach
Wandoujia
•Native Management
Tool
In Nutshell
•Usage Data Collection
•Similar App Selection
•Device Model Clustering
•Collaborative Filtering
• Operational profiling-how to
increase productivity and
reliability.
10/20/2016 CS5393 Software Quality 7
Wandoujia
Features
Network Activity
statistics
Permission
Monitoring
Content
recommendation
10/20/2016 CS5393 Software Quality 8
Approach (cont..)
Effectiveness Metrics
Device
Model Hit
Average
Precision
Usage Data
Coverage
10/20/2016 CS5393 Software Quality 9
Time-Share Driven Prioritization
• Browsing time on app • Collaborative Filtering by Time
Share
It Uses, Leave-One-Out Cross-
Validation (LOOCV)
10/20/2016 CS5393 Software Quality 10
Algorithm-I
Device model hit (DH), time
share coverage (T C) and
average precision (AP) against
top N device models with K
apps in the same category
10/20/2016 CS5393 Software Quality 11
Evaluation
1. Device Model Distribution
• Explains, RQ1: How many
device models account for
the majority of the browsing
time?
• Uses, Pareto Principle
2. Predicting Top Device Model
• Explains, RQ2: How effectively
can PRADA identify major
device models for a new app
given that developers have
no knowledge about this
app’s actual usage?
10/20/2016 CS5393 Software Quality 12
Device Model Distribution Statistics
10/20/2016 CS5393 Software Quality 13
Number of device models and users that use top 100 apps
from each of the two categories.
Results from Predicting Top Device Models
Using collaborative filtering algorithm on Game and Media Apps
10/20/2016 CS5393 Software Quality 14
Top 10 device models with the most time share for two apps (Temple Run 2 and Xunlei Movie),
and the selected device models by AppBrain, Wandoujia, and PRADA.
Comparison of Device Model Hit, Time Share Coverage, and AP by using market share
and PRADA to recommend top 10 device models for Game apps
Results of Device Model Hit, Time Share Coverage, and AP of top 10 device
models that are predicted by PRADA for 100 apps in each category, i.e., N =10
and K=100.
10/20/2016 CS5393 Software Quality 15
Strength of Prada
10/20/2016 CS5393 Software Quality 16
 Mining from large scale of data
 Leverage usage data
 Satisfactory accuracy
 Operational Profiling
Weakness
• Restricted on only two network categories
• Need access to existing data usage
• Not accurate for offline apps
• Relies on accuracy of Wandoujia
10/20/2016 CS5393 Software Quality 17
Related work
• A framework for detecting similar mobile applications by online
kernel learning.
• Rescaling reliability bounds for a new operational profile
• Mining large-scale smartphone data for personality studies.
• Prioritizing the devices to test your app on: A case study of
Android game apps.
• Understanding Android fragmentation with topic analysis of
vendor-specific bugs.
10/20/2016 CS5393 Software Quality 18
Conclusion
PRADA includes a collaborative filtering
technique to accurately predict major
device models for a new app, given the
usage data from existing apps with similar
functionalities.
Future work a) impact of localization on
device model prioritization.
b) how to cluster device models at different
granularities.
10/20/2016 CS5393 Software Quality 19
Questions for Deeper Analysis
• How the system can be efficient without
the time-share-based technique not
included in Wandoujia dataset?
• Why only browsing time is main parameter
in analysis?
10/20/2016 CS5393 Software Quality 20
Any Questions?
10/20/2016 CS5393 Software Quality 21

More Related Content

Viewers also liked

Revision session feb
Revision session febRevision session feb
Revision session febHannah Laham
 
ELECTRÓNICA+RADIO+TV. Tomo I. Apéndice. Realizaciones Prácticas.
ELECTRÓNICA+RADIO+TV. Tomo I. Apéndice. Realizaciones Prácticas.ELECTRÓNICA+RADIO+TV. Tomo I. Apéndice. Realizaciones Prácticas.
ELECTRÓNICA+RADIO+TV. Tomo I. Apéndice. Realizaciones Prácticas.Gabriel Araceli
 
HUMER Guelle verlustarm und geruchsarm auf Felder und Wiesen ausbringen 2016j...
HUMER Guelle verlustarm und geruchsarm auf Felder und Wiesen ausbringen 2016j...HUMER Guelle verlustarm und geruchsarm auf Felder und Wiesen ausbringen 2016j...
HUMER Guelle verlustarm und geruchsarm auf Felder und Wiesen ausbringen 2016j...Johann HUMER
 
Cartilha gicra final
Cartilha gicra finalCartilha gicra final
Cartilha gicra finalNabelle Melo
 
ELECTRÓNICA+RADIO+TV. Tomo VI: RECEPTORES DE FRECUENCIA MODULADA Lecciones 32...
ELECTRÓNICA+RADIO+TV. Tomo VI: RECEPTORES DE FRECUENCIA MODULADA Lecciones 32...ELECTRÓNICA+RADIO+TV. Tomo VI: RECEPTORES DE FRECUENCIA MODULADA Lecciones 32...
ELECTRÓNICA+RADIO+TV. Tomo VI: RECEPTORES DE FRECUENCIA MODULADA Lecciones 32...Gabriel Araceli
 
Hyatt and Miraval - The Long Game
Hyatt and Miraval - The Long GameHyatt and Miraval - The Long Game
Hyatt and Miraval - The Long GameTrent Munday
 
Ensayo de los piratas de somalia
Ensayo de los piratas de somaliaEnsayo de los piratas de somalia
Ensayo de los piratas de somaliajucamo_or
 
Comparacion de dos metodos para medir el indice de área foliar en el cultivo ...
Comparacion de dos metodos para medir el indice de área foliar en el cultivo ...Comparacion de dos metodos para medir el indice de área foliar en el cultivo ...
Comparacion de dos metodos para medir el indice de área foliar en el cultivo ...Candido Mendoza Perez
 
Global and china li ion power battery industry report , 2017-2020
Global and china li ion power battery industry report , 2017-2020Global and china li ion power battery industry report , 2017-2020
Global and china li ion power battery industry report , 2017-2020ResearchInChina
 

Viewers also liked (16)

Act19David manzanilla
Act19David manzanillaAct19David manzanilla
Act19David manzanilla
 
Terminologias cirúrgicas
Terminologias cirúrgicasTerminologias cirúrgicas
Terminologias cirúrgicas
 
Revision session feb
Revision session febRevision session feb
Revision session feb
 
Zon 120402
Zon 120402Zon 120402
Zon 120402
 
ELECTRÓNICA+RADIO+TV. Tomo I. Apéndice. Realizaciones Prácticas.
ELECTRÓNICA+RADIO+TV. Tomo I. Apéndice. Realizaciones Prácticas.ELECTRÓNICA+RADIO+TV. Tomo I. Apéndice. Realizaciones Prácticas.
ELECTRÓNICA+RADIO+TV. Tomo I. Apéndice. Realizaciones Prácticas.
 
HUMER Guelle verlustarm und geruchsarm auf Felder und Wiesen ausbringen 2016j...
HUMER Guelle verlustarm und geruchsarm auf Felder und Wiesen ausbringen 2016j...HUMER Guelle verlustarm und geruchsarm auf Felder und Wiesen ausbringen 2016j...
HUMER Guelle verlustarm und geruchsarm auf Felder und Wiesen ausbringen 2016j...
 
Cartilha gicra final
Cartilha gicra finalCartilha gicra final
Cartilha gicra final
 
ELECTRÓNICA+RADIO+TV. Tomo VI: RECEPTORES DE FRECUENCIA MODULADA Lecciones 32...
ELECTRÓNICA+RADIO+TV. Tomo VI: RECEPTORES DE FRECUENCIA MODULADA Lecciones 32...ELECTRÓNICA+RADIO+TV. Tomo VI: RECEPTORES DE FRECUENCIA MODULADA Lecciones 32...
ELECTRÓNICA+RADIO+TV. Tomo VI: RECEPTORES DE FRECUENCIA MODULADA Lecciones 32...
 
Hyatt and Miraval - The Long Game
Hyatt and Miraval - The Long GameHyatt and Miraval - The Long Game
Hyatt and Miraval - The Long Game
 
Ensayo de los piratas de somalia
Ensayo de los piratas de somaliaEnsayo de los piratas de somalia
Ensayo de los piratas de somalia
 
Operation Management
Operation ManagementOperation Management
Operation Management
 
Comparacion de dos metodos para medir el indice de área foliar en el cultivo ...
Comparacion de dos metodos para medir el indice de área foliar en el cultivo ...Comparacion de dos metodos para medir el indice de área foliar en el cultivo ...
Comparacion de dos metodos para medir el indice de área foliar en el cultivo ...
 
Global and china li ion power battery industry report , 2017-2020
Global and china li ion power battery industry report , 2017-2020Global and china li ion power battery industry report , 2017-2020
Global and china li ion power battery industry report , 2017-2020
 
Pedoman Dasar Karang Taruna
Pedoman Dasar Karang TarunaPedoman Dasar Karang Taruna
Pedoman Dasar Karang Taruna
 
Jean Jacques Rousseau’s
Jean Jacques Rousseau’s Jean Jacques Rousseau’s
Jean Jacques Rousseau’s
 
Cobro persuasivo
Cobro persuasivoCobro persuasivo
Cobro persuasivo
 

Similar to PRADA

App Days 2016 Munich - Mobile Applications testing by Leaware
App Days 2016 Munich - Mobile Applications testing by LeawareApp Days 2016 Munich - Mobile Applications testing by Leaware
App Days 2016 Munich - Mobile Applications testing by LeawareLeaware.com
 
Challenges and solutions in mobile and cloud computing testing - ZANEC
Challenges and solutions in mobile and cloud computing testing  - ZANECChallenges and solutions in mobile and cloud computing testing  - ZANEC
Challenges and solutions in mobile and cloud computing testing - ZANECSatya Kaliki
 
Photo Sharing Among Computer Aided Drafting
Photo Sharing Among Computer Aided DraftingPhoto Sharing Among Computer Aided Drafting
Photo Sharing Among Computer Aided DraftingAdamKennihan
 
Survey on Fraud Malware Detection in Google Play Store
Survey on Fraud Malware Detection in Google Play Store         Survey on Fraud Malware Detection in Google Play Store
Survey on Fraud Malware Detection in Google Play Store IRJET Journal
 
IEEE ANDROID APPLICATION 2016 TITLE AND ABSTRACT
IEEE ANDROID APPLICATION 2016 TITLE AND ABSTRACTIEEE ANDROID APPLICATION 2016 TITLE AND ABSTRACT
IEEE ANDROID APPLICATION 2016 TITLE AND ABSTRACTtsysglobalsolutions
 
12 considerations for mobile testing (march 2017)
12 considerations for mobile testing (march 2017)12 considerations for mobile testing (march 2017)
12 considerations for mobile testing (march 2017)Antoine Aymer
 
On the Link Between Mobile App Quality and User Reviews
On the Link Between Mobile App Quality and User ReviewsOn the Link Between Mobile App Quality and User Reviews
On the Link Between Mobile App Quality and User ReviewsSAIL_QU
 
Generating Risk Summary Risk Scores For Mobile Applications
Generating Risk Summary Risk Scores For Mobile ApplicationsGenerating Risk Summary Risk Scores For Mobile Applications
Generating Risk Summary Risk Scores For Mobile ApplicationsPapitha Velumani
 
TechEvent 2019: Artificial Intelligence in Dev & Ops; Martin Luckow - Trivadis
TechEvent 2019: Artificial Intelligence in Dev & Ops; Martin Luckow - TrivadisTechEvent 2019: Artificial Intelligence in Dev & Ops; Martin Luckow - Trivadis
TechEvent 2019: Artificial Intelligence in Dev & Ops; Martin Luckow - TrivadisTrivadis
 
AYOUB MAHDI - SUMMARY of FLOWPRINT: SEMI-SUPERVISED MOBILE-APP FINGERPRINTIN...
AYOUB MAHDI - SUMMARY of FLOWPRINT: SEMI-SUPERVISED  MOBILE-APP FINGERPRINTIN...AYOUB MAHDI - SUMMARY of FLOWPRINT: SEMI-SUPERVISED  MOBILE-APP FINGERPRINTIN...
AYOUB MAHDI - SUMMARY of FLOWPRINT: SEMI-SUPERVISED MOBILE-APP FINGERPRINTIN...MahdiAyoub2
 
testCloud & Crittercism: How to Continuously Ensure Mobile App Quality
testCloud & Crittercism: How to Continuously Ensure Mobile App QualitytestCloud & Crittercism: How to Continuously Ensure Mobile App Quality
testCloud & Crittercism: How to Continuously Ensure Mobile App QualityApteligent
 
How to effectively perform Multiple Device Testing on Cloud (1).pdf
How to effectively perform Multiple Device Testing on Cloud (1).pdfHow to effectively perform Multiple Device Testing on Cloud (1).pdf
How to effectively perform Multiple Device Testing on Cloud (1).pdfpCloudy
 
How to generate Synthetic Data for an effective App Testing strategy.pdf
How to generate Synthetic Data for an effective App Testing strategy.pdfHow to generate Synthetic Data for an effective App Testing strategy.pdf
How to generate Synthetic Data for an effective App Testing strategy.pdfpCloudy
 
What are the Characteristics of High-rated Apps
What are the Characteristics of High-rated AppsWhat are the Characteristics of High-rated Apps
What are the Characteristics of High-rated AppsSAIL_QU
 
Performance Testing
Performance TestingPerformance Testing
Performance TestingSelin Gungor
 
Eurecom уличили приложения для Android в тайной от пользователя активности
Eurecom уличили приложения для Android в тайной от пользователя активностиEurecom уличили приложения для Android в тайной от пользователя активности
Eurecom уличили приложения для Android в тайной от пользователя активностиSergey Ulankin
 
Android Device Testing_ Ensuring Quality and Performance.pdf
Android Device Testing_ Ensuring Quality and Performance.pdfAndroid Device Testing_ Ensuring Quality and Performance.pdf
Android Device Testing_ Ensuring Quality and Performance.pdfkalichargn70th171
 
Tizen Developer Conference 2014
Tizen Developer Conference 2014 Tizen Developer Conference 2014
Tizen Developer Conference 2014 appbackr
 

Similar to PRADA (20)

App Days 2016 Munich - Mobile Applications testing by Leaware
App Days 2016 Munich - Mobile Applications testing by LeawareApp Days 2016 Munich - Mobile Applications testing by Leaware
App Days 2016 Munich - Mobile Applications testing by Leaware
 
Challenges and solutions in mobile and cloud computing testing - ZANEC
Challenges and solutions in mobile and cloud computing testing  - ZANECChallenges and solutions in mobile and cloud computing testing  - ZANEC
Challenges and solutions in mobile and cloud computing testing - ZANEC
 
Crowdsourcing
CrowdsourcingCrowdsourcing
Crowdsourcing
 
Photo Sharing Among Computer Aided Drafting
Photo Sharing Among Computer Aided DraftingPhoto Sharing Among Computer Aided Drafting
Photo Sharing Among Computer Aided Drafting
 
Survey on Fraud Malware Detection in Google Play Store
Survey on Fraud Malware Detection in Google Play Store         Survey on Fraud Malware Detection in Google Play Store
Survey on Fraud Malware Detection in Google Play Store
 
IEEE ANDROID APPLICATION 2016 TITLE AND ABSTRACT
IEEE ANDROID APPLICATION 2016 TITLE AND ABSTRACTIEEE ANDROID APPLICATION 2016 TITLE AND ABSTRACT
IEEE ANDROID APPLICATION 2016 TITLE AND ABSTRACT
 
12 considerations for mobile testing (march 2017)
12 considerations for mobile testing (march 2017)12 considerations for mobile testing (march 2017)
12 considerations for mobile testing (march 2017)
 
On the Link Between Mobile App Quality and User Reviews
On the Link Between Mobile App Quality and User ReviewsOn the Link Between Mobile App Quality and User Reviews
On the Link Between Mobile App Quality and User Reviews
 
Generating Risk Summary Risk Scores For Mobile Applications
Generating Risk Summary Risk Scores For Mobile ApplicationsGenerating Risk Summary Risk Scores For Mobile Applications
Generating Risk Summary Risk Scores For Mobile Applications
 
TechEvent 2019: Artificial Intelligence in Dev & Ops; Martin Luckow - Trivadis
TechEvent 2019: Artificial Intelligence in Dev & Ops; Martin Luckow - TrivadisTechEvent 2019: Artificial Intelligence in Dev & Ops; Martin Luckow - Trivadis
TechEvent 2019: Artificial Intelligence in Dev & Ops; Martin Luckow - Trivadis
 
Softcrylic_CIO_Review
Softcrylic_CIO_ReviewSoftcrylic_CIO_Review
Softcrylic_CIO_Review
 
AYOUB MAHDI - SUMMARY of FLOWPRINT: SEMI-SUPERVISED MOBILE-APP FINGERPRINTIN...
AYOUB MAHDI - SUMMARY of FLOWPRINT: SEMI-SUPERVISED  MOBILE-APP FINGERPRINTIN...AYOUB MAHDI - SUMMARY of FLOWPRINT: SEMI-SUPERVISED  MOBILE-APP FINGERPRINTIN...
AYOUB MAHDI - SUMMARY of FLOWPRINT: SEMI-SUPERVISED MOBILE-APP FINGERPRINTIN...
 
testCloud & Crittercism: How to Continuously Ensure Mobile App Quality
testCloud & Crittercism: How to Continuously Ensure Mobile App QualitytestCloud & Crittercism: How to Continuously Ensure Mobile App Quality
testCloud & Crittercism: How to Continuously Ensure Mobile App Quality
 
How to effectively perform Multiple Device Testing on Cloud (1).pdf
How to effectively perform Multiple Device Testing on Cloud (1).pdfHow to effectively perform Multiple Device Testing on Cloud (1).pdf
How to effectively perform Multiple Device Testing on Cloud (1).pdf
 
How to generate Synthetic Data for an effective App Testing strategy.pdf
How to generate Synthetic Data for an effective App Testing strategy.pdfHow to generate Synthetic Data for an effective App Testing strategy.pdf
How to generate Synthetic Data for an effective App Testing strategy.pdf
 
What are the Characteristics of High-rated Apps
What are the Characteristics of High-rated AppsWhat are the Characteristics of High-rated Apps
What are the Characteristics of High-rated Apps
 
Performance Testing
Performance TestingPerformance Testing
Performance Testing
 
Eurecom уличили приложения для Android в тайной от пользователя активности
Eurecom уличили приложения для Android в тайной от пользователя активностиEurecom уличили приложения для Android в тайной от пользователя активности
Eurecom уличили приложения для Android в тайной от пользователя активности
 
Android Device Testing_ Ensuring Quality and Performance.pdf
Android Device Testing_ Ensuring Quality and Performance.pdfAndroid Device Testing_ Ensuring Quality and Performance.pdf
Android Device Testing_ Ensuring Quality and Performance.pdf
 
Tizen Developer Conference 2014
Tizen Developer Conference 2014 Tizen Developer Conference 2014
Tizen Developer Conference 2014
 

PRADA

  • 1. PRADA: Prioritizing Android Devices for Apps by Mining Large-Scale Usage Data Presented by: Akshay Mittal Course: CS 5393 Professor: Dr. Guowei Yang
  • 2. Authors • Lu, Xuan; • Liu, Xuanzhe; • Li, Huoran; • Xie, Tao; Mei, • Qiaozhu; • Hao, Dan; • Huang, Gang; 10/20/2016 CS5393 Software Quality 2
  • 3. Overview • Motivation • Approach • Evaluation • Strength • Weakness • Conclusion • Q&A 10/20/2016 CS5393 Software Quality 3
  • 4. Overview of PRADA Approach 10/20/2016 CS5393 Software Quality 4
  • 5. Motivation • Android Fragmentation that is, concern over the alarming number of different available Android operating system (OS) versions in the market. • to explore whether we can make accurate estimates for a new app. 10/20/2016 CS5393 Software Quality 5
  • 7. Approach Wandoujia •Native Management Tool In Nutshell •Usage Data Collection •Similar App Selection •Device Model Clustering •Collaborative Filtering • Operational profiling-how to increase productivity and reliability. 10/20/2016 CS5393 Software Quality 7
  • 9. Approach (cont..) Effectiveness Metrics Device Model Hit Average Precision Usage Data Coverage 10/20/2016 CS5393 Software Quality 9
  • 10. Time-Share Driven Prioritization • Browsing time on app • Collaborative Filtering by Time Share It Uses, Leave-One-Out Cross- Validation (LOOCV) 10/20/2016 CS5393 Software Quality 10
  • 11. Algorithm-I Device model hit (DH), time share coverage (T C) and average precision (AP) against top N device models with K apps in the same category 10/20/2016 CS5393 Software Quality 11
  • 12. Evaluation 1. Device Model Distribution • Explains, RQ1: How many device models account for the majority of the browsing time? • Uses, Pareto Principle 2. Predicting Top Device Model • Explains, RQ2: How effectively can PRADA identify major device models for a new app given that developers have no knowledge about this app’s actual usage? 10/20/2016 CS5393 Software Quality 12
  • 13. Device Model Distribution Statistics 10/20/2016 CS5393 Software Quality 13 Number of device models and users that use top 100 apps from each of the two categories.
  • 14. Results from Predicting Top Device Models Using collaborative filtering algorithm on Game and Media Apps 10/20/2016 CS5393 Software Quality 14 Top 10 device models with the most time share for two apps (Temple Run 2 and Xunlei Movie), and the selected device models by AppBrain, Wandoujia, and PRADA.
  • 15. Comparison of Device Model Hit, Time Share Coverage, and AP by using market share and PRADA to recommend top 10 device models for Game apps Results of Device Model Hit, Time Share Coverage, and AP of top 10 device models that are predicted by PRADA for 100 apps in each category, i.e., N =10 and K=100. 10/20/2016 CS5393 Software Quality 15
  • 16. Strength of Prada 10/20/2016 CS5393 Software Quality 16  Mining from large scale of data  Leverage usage data  Satisfactory accuracy  Operational Profiling
  • 17. Weakness • Restricted on only two network categories • Need access to existing data usage • Not accurate for offline apps • Relies on accuracy of Wandoujia 10/20/2016 CS5393 Software Quality 17
  • 18. Related work • A framework for detecting similar mobile applications by online kernel learning. • Rescaling reliability bounds for a new operational profile • Mining large-scale smartphone data for personality studies. • Prioritizing the devices to test your app on: A case study of Android game apps. • Understanding Android fragmentation with topic analysis of vendor-specific bugs. 10/20/2016 CS5393 Software Quality 18
  • 19. Conclusion PRADA includes a collaborative filtering technique to accurately predict major device models for a new app, given the usage data from existing apps with similar functionalities. Future work a) impact of localization on device model prioritization. b) how to cluster device models at different granularities. 10/20/2016 CS5393 Software Quality 19
  • 20. Questions for Deeper Analysis • How the system can be efficient without the time-share-based technique not included in Wandoujia dataset? • Why only browsing time is main parameter in analysis? 10/20/2016 CS5393 Software Quality 20
  • 21. Any Questions? 10/20/2016 CS5393 Software Quality 21