SlideShare ist ein Scribd-Unternehmen logo
1 von 37
1 26.März2015
Customer Visual
How to Break your App -
Best Practices in Mobile App Testing
Workshop
Daniel Knott | @dnlkntt
Who am I ?
• Daniel Knott
• Software Test Manager/ Mobile Tester @AOE
• Software Tester since 2008
• Mobile Testing since the end of 2010
• Author, Blogger and Speaker
http://www.adventuresinqa.com
@dnlkntt
http://www.linkedin.com/pub/daniel-knott/1a/925/993
https://www.xing.com/profile/Daniel_Knott
3 26.März2015
I Company Profile
Agenda
1. Current Status
3. How to break your app
2. Exercise I
5. Summary and
Close Up
4. Exercise II
5 26.März2015
I Current Status
Author: Barry Caruth, https://www.flickr.com/photos/caruth/8401943928/
Current Status | Some Numbers
2+ millions apps available
100+ billion downloads
+19,000 Android Devices
16 iOS Devices
Current Status | Some Numbers
80% – 90% of apps are deleted after the first usage
56% of apps that requires a registration gets deleted
Average user checks device 150 times per day
45% are not well tested
Current Status | Mobile Testing is different
High User expectation
Lot’s of different devices with HW and SW
Users are on the move
Mobile Tools and Approaches
9 26.März2015
I Exercise I
Exercise I
Build up groups 2-5 person
Mind Map your challenges in mobile testing
20 minutes
Group discussion about the mind map
Exercise I
Challenges| How to handle fragmentation
Group your devices, A B C
Test only on those devices
Test on real device
Don’t use simulators or emulators
Know the devices of your target group
Challenges | How to handle fragmentation
Group 1, Prio A
• High End
Devices
• Dual/ Quad Core
CPU
• RAM >2048MB
• Retina, Full HD
Display >= 5“
Group 2, Prio B
• Mid-range
devices
• Dual Core CPU
• RAM <=1024MB
• Screen size <= 4“
• Software not
older than 1 year
Group 3, Prio C
• Small devices
• Single Core
• RAM < 512MB
• Low screen size
and resolution
• Older OS, older
browser
Based on your target group
Challenges | The User - KIFSU
Simple UseableFastItKeep
K I F S U
16 26.März2015
I How to break your app
Author: OZinOH, http://www.flickr.com/photos/75905404@N00/7126147125/
Mobile Specific Testing
Known functional testing is still required
• Boundary values
• Equivalence classes
• Testing against acceptance criteria
Test the app as black box
• Try to break it
• Be creative and think in edge cases
Mobile Specific Testing
Author: Juan de Dios Santander Vela, http://www.flickr.com/photos/juandesant/209098053
Author: Ian Britton, http://www.flickr.com/photos/freefoto/728651045/
Author: Moyan Brenn, https://www.flickr.com/photos/aigle_dore/5626341059/
Author: @Doug88888, http://www.flickr.com/photos/doug88888/7149187135/
Author: Dan Levy, http://www.flickr.com/photos/danlevy/5607259711/
Author: Davide Vizzini Limbte, http://www.flickr.com/photos/limbte/4007115435/
Mobile Specific Testing
• Logout (English)
• Ausloggen (German)
• Déconnexion (French)
• Çıkış yap (Turkish)
• Выйти (Russian)
Mobile Specific Testing
Author: amateur_photo_bore, http://www.flickr.com/photos/andresv/233667770/ Author: Rain Rabbit, http://www.flickr.com/photos/37996583811@N01/8033259053/
Author, Daniel Sancho, http://www.flickr.com/photos/teclasorg/2852716491/
Mobile Specific Testing
Author: Surat Lozowick, http://www.flickr.com/photos/suratlozowick/4311105154/ Author: Surat Lozowick, http://www.flickr.com/photos/suratlozowick/4464587302/
Author: Theus Falcao, http://www.flickr.com/photos/theusfalcao/9563767145/
Mobile Specific Testing
Author: Molly Holzschlag, http://www.flickr.com/photos/mollyeh11/272434559/ Author: Quinn Dombrowski, http://www.flickr.com/photos/quinnanya/4718635484/
Mobile Specific Testing
Author: minxlj, http://www.flickr.com/photos/minxlj/3270996158/ Author: Ryan B. BulaPhotography, http://www.flickr.com/photos/nayralub/3763581778/
Author: Sterling Coffey, http://www.flickr.com/photos/n0ssc/7046915929/
Author: Anthony Catalano, http://www.flickr.com/photos/badwsky/34164244/
Author: Dennis Wong, http://www.flickr.com/photos/denniswong/2406135310/
Âuthor: orkomedix, http://www.flickr.com/photos/orkomedix/5211437958/
Mobile Specific Testing
30 26.März2015
I Exercise II
Exercise II
Build up groups 2-5 person
Download a mobile app of your choice
Test it with provided scenarios
Note down the bugs
30 Minutes
Let’s talk about the bugs
Exercise II – My Bugs – Android Wordpress App
Using the app in bad network
conditions
Don’t show technical errors
Exercise II – My Bugs – Android Wordpress App
Provide user friendly error messages
Test app without backend
availability
Exercise II – My Bugs – Android Wordpress App
Language size
Test your app in different languages
Exercise II – My Bugs – Android Wordpress App
Localization problems
Exercise II – My Bugs – Android Wordpress App
Localization problems
37 26.März2015
I Summary
Mobile Specific Testing | Summary
Mobile Testing is different compared to other software
Be creative and on the move while testing mobile apps
Be up to date! Know your target group
Keep the mobile features in mind
Keep the high user expectations in mind
Thanks for your attention!
www.handsonmobileapptesting.com
More information about mobile testing
can be found in my book
„Hands-On Mobile App Testing“
Soon available in a printed copy, too.
40 26.März2015
AOE GmbH
LuisenForum, Kirchgasse 6
65185 Wiesbaden
Germany
Phone: +49 6122 70 70 7 - 0
Fax: +49 6122 70 70 7 - 199
E-Mail: sales@aoe.com
Web: www.aoe.com
I in Germany
Links & References
• World Quality Report [http://www.sogeti.com/en-us/looking-for-solutions/Services/Software-
Control-Testing/The-World-Quality-Report-2013--2014/]
• Robotium [https://code.google.com/p/robotium/]
• Spoon [https://github.com/square/spoon]
• Robolectric [http://robolectric.org/]
• Calabash for Android [https://github.com/calabash/calabash-android]
• Selendroid [http://selendroid.io/]
• ExtSolo
[http://docs.testdroid.com/_static/extSolodocs/com/bitbar/recorder/extensions/ExtSolo.html]
• Espresso [https://code.google.com/p/android-test-kit/wiki/Espresso]
• Monkey [http://developer.android.com/tools/help/monkey.html]
• UI AutoMonkey [https://github.com/jonathanpenn/ui-auto-monkey]
Links & References
• MonkeyTalk [https://www.cloudmonkeymobile.com/monkeytalk]
• UIAutomation[https://developer.apple.com/library/mac/documentation/DeveloperTools/Conceptual/
InstrumentsUserGuide/UsingtheAutomationInstrument/UsingtheAutomationInstrument.html]
• Keep It Functional [https://github.com/kif-framework/KIF]
• XCTest
[https://developer.apple.com/library/ios/documentation/ToolsLanguages/Conceptual/Xcode_Overvi
ew/UnitTestYourApp/UnitTestYourApp.html]
• Calabash for iOS [https://github.com/calabash/calabash-ios]
• ios-driver [http://ios-driver.github.io/ios-driver/?page=home]
• Kiwi [https://github.com/allending/Kiwi]
• Appium [http://appium.io/]
• JouleJunit [https://code.google.com/p/jouleunit/]
• Energy Usage Instruments
[https://developer.apple.com/library/ios/documentation/AnalysisTools/Reference/Instruments_User
_Reference/EnergyUsageInstrument/EnergyUsageInstrument.html]
How to Break your App - Workshop - Testbash 2015

Weitere ähnliche Inhalte

Was ist angesagt?

Mobile App Testing Checklist
Mobile App Testing ChecklistMobile App Testing Checklist
Mobile App Testing ChecklistManoj Lonar
 
TestElf Informational Presentation
TestElf Informational PresentationTestElf Informational Presentation
TestElf Informational PresentationTestElf
 
3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy
3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy
3 Free Tools That Will Help You Create the Right Mobile & Web Test StrategyPerfecto by Perforce
 
Continuous Quality For a 5 Star Mobile Apps Delivery
Continuous Quality For a 5 Star Mobile Apps DeliveryContinuous Quality For a 5 Star Mobile Apps Delivery
Continuous Quality For a 5 Star Mobile Apps DeliveryPerfecto Mobile
 
Building Drupal Apps for Distributions
Building Drupal Apps for DistributionsBuilding Drupal Apps for Distributions
Building Drupal Apps for DistributionsPhase2
 
App testing and publishing
App testing and publishingApp testing and publishing
App testing and publishingNiall Roche
 
Stephen janaway mobile testing - that's just a smaller screen, right
Stephen janaway  mobile testing - that's just a smaller screen, rightStephen janaway  mobile testing - that's just a smaller screen, right
Stephen janaway mobile testing - that's just a smaller screen, rightRomania Testing
 
appmom - Recommendation of Android Apps
appmom - Recommendation of Android Appsappmom - Recommendation of Android Apps
appmom - Recommendation of Android AppsNaoko Tsubaki
 
iOS9 Launch - Mobile Dev & Test Implications
iOS9 Launch - Mobile Dev & Test ImplicationsiOS9 Launch - Mobile Dev & Test Implications
iOS9 Launch - Mobile Dev & Test ImplicationsPerfecto Mobile
 
Measuring the Right App Metrics - Guide for Beginners
Measuring the Right App Metrics - Guide for BeginnersMeasuring the Right App Metrics - Guide for Beginners
Measuring the Right App Metrics - Guide for BeginnersDeepak Abbot
 
Mobile Test Coverage- Israel 4th meetup
Mobile Test Coverage- Israel 4th meetupMobile Test Coverage- Israel 4th meetup
Mobile Test Coverage- Israel 4th meetupPerfecto Mobile
 
Openbar Kontich // Mobile app automation on a budget by Wim Vervust & Bram Thys
Openbar Kontich // Mobile app automation on a budget by Wim Vervust & Bram ThysOpenbar Kontich // Mobile app automation on a budget by Wim Vervust & Bram Thys
Openbar Kontich // Mobile app automation on a budget by Wim Vervust & Bram ThysOpenbar
 
The Use and Future of Applications for Mobile Marketing: Nutella
The Use and Future of Applications for Mobile Marketing: NutellaThe Use and Future of Applications for Mobile Marketing: Nutella
The Use and Future of Applications for Mobile Marketing: NutellaRebecca Booker
 
Webapps: introduction and publishing on Firefox OS
Webapps: introduction and publishing on Firefox OSWebapps: introduction and publishing on Firefox OS
Webapps: introduction and publishing on Firefox OSJorge Ferreiro
 
Ppt on Instagram Like Inhancer And Followers
Ppt on Instagram Like Inhancer And FollowersPpt on Instagram Like Inhancer And Followers
Ppt on Instagram Like Inhancer And FollowersDiksha sharma
 
Cross platform test automation using Appium
Cross platform test automation using AppiumCross platform test automation using Appium
Cross platform test automation using AppiumJatin Bhasin
 
Why you should care about Progressive Web Apps?
Why you should care about Progressive Web Apps?Why you should care about Progressive Web Apps?
Why you should care about Progressive Web Apps?Vytas Dargis
 

Was ist angesagt? (20)

Mobile App Testing Checklist
Mobile App Testing ChecklistMobile App Testing Checklist
Mobile App Testing Checklist
 
TestElf Informational Presentation
TestElf Informational PresentationTestElf Informational Presentation
TestElf Informational Presentation
 
3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy
3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy
3 Free Tools That Will Help You Create the Right Mobile & Web Test Strategy
 
Continuous Quality For a 5 Star Mobile Apps Delivery
Continuous Quality For a 5 Star Mobile Apps DeliveryContinuous Quality For a 5 Star Mobile Apps Delivery
Continuous Quality For a 5 Star Mobile Apps Delivery
 
Building Drupal Apps for Distributions
Building Drupal Apps for DistributionsBuilding Drupal Apps for Distributions
Building Drupal Apps for Distributions
 
App testing and publishing
App testing and publishingApp testing and publishing
App testing and publishing
 
Stephen janaway mobile testing - that's just a smaller screen, right
Stephen janaway  mobile testing - that's just a smaller screen, rightStephen janaway  mobile testing - that's just a smaller screen, right
Stephen janaway mobile testing - that's just a smaller screen, right
 
appmom - Recommendation of Android Apps
appmom - Recommendation of Android Appsappmom - Recommendation of Android Apps
appmom - Recommendation of Android Apps
 
iOS9 Launch - Mobile Dev & Test Implications
iOS9 Launch - Mobile Dev & Test ImplicationsiOS9 Launch - Mobile Dev & Test Implications
iOS9 Launch - Mobile Dev & Test Implications
 
Mobile DevTest Dictionary
Mobile DevTest DictionaryMobile DevTest Dictionary
Mobile DevTest Dictionary
 
Wearables meetup
Wearables meetupWearables meetup
Wearables meetup
 
Measuring the Right App Metrics - Guide for Beginners
Measuring the Right App Metrics - Guide for BeginnersMeasuring the Right App Metrics - Guide for Beginners
Measuring the Right App Metrics - Guide for Beginners
 
Juc oct 2014 final
Juc oct 2014 finalJuc oct 2014 final
Juc oct 2014 final
 
Mobile Test Coverage- Israel 4th meetup
Mobile Test Coverage- Israel 4th meetupMobile Test Coverage- Israel 4th meetup
Mobile Test Coverage- Israel 4th meetup
 
Openbar Kontich // Mobile app automation on a budget by Wim Vervust & Bram Thys
Openbar Kontich // Mobile app automation on a budget by Wim Vervust & Bram ThysOpenbar Kontich // Mobile app automation on a budget by Wim Vervust & Bram Thys
Openbar Kontich // Mobile app automation on a budget by Wim Vervust & Bram Thys
 
The Use and Future of Applications for Mobile Marketing: Nutella
The Use and Future of Applications for Mobile Marketing: NutellaThe Use and Future of Applications for Mobile Marketing: Nutella
The Use and Future of Applications for Mobile Marketing: Nutella
 
Webapps: introduction and publishing on Firefox OS
Webapps: introduction and publishing on Firefox OSWebapps: introduction and publishing on Firefox OS
Webapps: introduction and publishing on Firefox OS
 
Ppt on Instagram Like Inhancer And Followers
Ppt on Instagram Like Inhancer And FollowersPpt on Instagram Like Inhancer And Followers
Ppt on Instagram Like Inhancer And Followers
 
Cross platform test automation using Appium
Cross platform test automation using AppiumCross platform test automation using Appium
Cross platform test automation using Appium
 
Why you should care about Progressive Web Apps?
Why you should care about Progressive Web Apps?Why you should care about Progressive Web Apps?
Why you should care about Progressive Web Apps?
 

Andere mochten auch

2010 bb dev con
2010 bb dev con 2010 bb dev con
2010 bb dev con Eing Ong
 
2011 py con
2011 py con2011 py con
2011 py conEing Ong
 
“Rebuilding Corporate Trust: The Essential Role Of IT Governance
“Rebuilding Corporate Trust: The Essential Role Of IT Governance“Rebuilding Corporate Trust: The Essential Role Of IT Governance
“Rebuilding Corporate Trust: The Essential Role Of IT GovernanceSUNIL KUMAR KOHLI, IDAS ndc
 
Testing for a Great App and Web Experience | QualiTest Group
Testing for a Great App and Web Experience | QualiTest GroupTesting for a Great App and Web Experience | QualiTest Group
Testing for a Great App and Web Experience | QualiTest GroupQualitest
 
Mobile First: How To Approach Mobile Testing!
Mobile First: How To Approach Mobile Testing!Mobile First: How To Approach Mobile Testing!
Mobile First: How To Approach Mobile Testing!Usersnap
 
Valuation of Banks
Valuation of BanksValuation of Banks
Valuation of BanksPankaj Baid
 
7 Steps Needed to Get Lenders to Fund Your Real Estate Deals
7 Steps Needed to Get Lenders to Fund Your Real Estate Deals7 Steps Needed to Get Lenders to Fund Your Real Estate Deals
7 Steps Needed to Get Lenders to Fund Your Real Estate DealsJoshua Dorkin
 
2015-StarWest presentation on REST-assured
2015-StarWest presentation on REST-assured2015-StarWest presentation on REST-assured
2015-StarWest presentation on REST-assuredEing Ong
 
Testing Checklist for Mobile Applications-By Anurag Khode
Testing Checklist for Mobile Applications-By Anurag KhodeTesting Checklist for Mobile Applications-By Anurag Khode
Testing Checklist for Mobile Applications-By Anurag KhodeAnurag Khode
 
How can L&D support today's smart workers?
How can L&D support today's smart workers?How can L&D support today's smart workers?
How can L&D support today's smart workers?Jane Hart
 
10 future workplace trends
10 future workplace trends10 future workplace trends
10 future workplace trendsCPA Australia
 
A Complete Guide to Testing Responsive Websites
A Complete Guide to Testing Responsive WebsitesA Complete Guide to Testing Responsive Websites
A Complete Guide to Testing Responsive WebsitesPerfecto by Perforce
 
Business optimization | building your first million is easy
Business optimization | building your first million is easyBusiness optimization | building your first million is easy
Business optimization | building your first million is easySurjeet Singh
 
Agile Mobile Testing Workshop
Agile Mobile Testing WorkshopAgile Mobile Testing Workshop
Agile Mobile Testing WorkshopNaresh Jain
 
Adara - Dublin Tour May 2014
Adara - Dublin Tour May 2014Adara - Dublin Tour May 2014
Adara - Dublin Tour May 2014DDM Alliance
 

Andere mochten auch (18)

2010 bb dev con
2010 bb dev con 2010 bb dev con
2010 bb dev con
 
2011 py con
2011 py con2011 py con
2011 py con
 
“Rebuilding Corporate Trust: The Essential Role Of IT Governance
“Rebuilding Corporate Trust: The Essential Role Of IT Governance“Rebuilding Corporate Trust: The Essential Role Of IT Governance
“Rebuilding Corporate Trust: The Essential Role Of IT Governance
 
Testing for a Great App and Web Experience | QualiTest Group
Testing for a Great App and Web Experience | QualiTest GroupTesting for a Great App and Web Experience | QualiTest Group
Testing for a Great App and Web Experience | QualiTest Group
 
Banks and cybersecurity v2
Banks and cybersecurity v2Banks and cybersecurity v2
Banks and cybersecurity v2
 
Mobile First: How To Approach Mobile Testing!
Mobile First: How To Approach Mobile Testing!Mobile First: How To Approach Mobile Testing!
Mobile First: How To Approach Mobile Testing!
 
Valuation of Banks
Valuation of BanksValuation of Banks
Valuation of Banks
 
7 Steps Needed to Get Lenders to Fund Your Real Estate Deals
7 Steps Needed to Get Lenders to Fund Your Real Estate Deals7 Steps Needed to Get Lenders to Fund Your Real Estate Deals
7 Steps Needed to Get Lenders to Fund Your Real Estate Deals
 
2015-StarWest presentation on REST-assured
2015-StarWest presentation on REST-assured2015-StarWest presentation on REST-assured
2015-StarWest presentation on REST-assured
 
Testing Checklist for Mobile Applications-By Anurag Khode
Testing Checklist for Mobile Applications-By Anurag KhodeTesting Checklist for Mobile Applications-By Anurag Khode
Testing Checklist for Mobile Applications-By Anurag Khode
 
How Square is Disrupting Banks
How Square is Disrupting BanksHow Square is Disrupting Banks
How Square is Disrupting Banks
 
How can L&D support today's smart workers?
How can L&D support today's smart workers?How can L&D support today's smart workers?
How can L&D support today's smart workers?
 
Americans and CEO Pay: 2016 Public Perception Survey on CEO Compensation
Americans and CEO Pay: 2016 Public Perception Survey on CEO CompensationAmericans and CEO Pay: 2016 Public Perception Survey on CEO Compensation
Americans and CEO Pay: 2016 Public Perception Survey on CEO Compensation
 
10 future workplace trends
10 future workplace trends10 future workplace trends
10 future workplace trends
 
A Complete Guide to Testing Responsive Websites
A Complete Guide to Testing Responsive WebsitesA Complete Guide to Testing Responsive Websites
A Complete Guide to Testing Responsive Websites
 
Business optimization | building your first million is easy
Business optimization | building your first million is easyBusiness optimization | building your first million is easy
Business optimization | building your first million is easy
 
Agile Mobile Testing Workshop
Agile Mobile Testing WorkshopAgile Mobile Testing Workshop
Agile Mobile Testing Workshop
 
Adara - Dublin Tour May 2014
Adara - Dublin Tour May 2014Adara - Dublin Tour May 2014
Adara - Dublin Tour May 2014
 

Ähnlich wie How to Break your App - Workshop - Testbash 2015

Best Practices in Mobile App Testing
Best Practices in Mobile App TestingBest Practices in Mobile App Testing
Best Practices in Mobile App TestingAOE
 
Insights on Android App Development, Marketing and Monetization
Insights on Android App Development, Marketing and MonetizationInsights on Android App Development, Marketing and Monetization
Insights on Android App Development, Marketing and MonetizationJayneel Patel
 
5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing StrategySOASTA
 
Ensure Your Mobile Channels Generate Revenue on Holiday Peak Days
Ensure Your Mobile Channels Generate Revenue on Holiday Peak DaysEnsure Your Mobile Channels Generate Revenue on Holiday Peak Days
Ensure Your Mobile Channels Generate Revenue on Holiday Peak DaysBitbar
 
Mobile Test Management Done Right
Mobile Test Management Done RightMobile Test Management Done Right
Mobile Test Management Done RightDaniel Knott
 
How to make sure your App isnt CrApp
How to make sure your App isnt CrAppHow to make sure your App isnt CrApp
How to make sure your App isnt CrAppChristian Cook
 
The mobile ecosystem & technological strategies
The mobile ecosystem & technological strategiesThe mobile ecosystem & technological strategies
The mobile ecosystem & technological strategiesIvano Malavolta
 
How to get from 0 to #1 on App Stores? by Hamid Palo
How to get from 0 to #1 on App Stores? by Hamid PaloHow to get from 0 to #1 on App Stores? by Hamid Palo
How to get from 0 to #1 on App Stores? by Hamid PaloTheFamily
 
Юрий Чемёркин (Yury Chemerkin) Owasp russia 2016
Юрий Чемёркин (Yury Chemerkin) Owasp russia 2016Юрий Чемёркин (Yury Chemerkin) Owasp russia 2016
Юрий Чемёркин (Yury Chemerkin) Owasp russia 2016Advanced monitoring
 
Web Apps and Responsive Design for Libraries
Web Apps and Responsive Design for LibrariesWeb Apps and Responsive Design for Libraries
Web Apps and Responsive Design for LibrariesMatt Machell
 
Smartphones
SmartphonesSmartphones
Smartphonesbrendahj
 
Study for a Virtual Personal Assistant Mobile Application for GlaxoSmithKline...
Study for a Virtual Personal Assistant Mobile Application for GlaxoSmithKline...Study for a Virtual Personal Assistant Mobile Application for GlaxoSmithKline...
Study for a Virtual Personal Assistant Mobile Application for GlaxoSmithKline...George Sofroniou
 
Think tank event mobile app testing v1.3
Think tank event   mobile app testing v1.3Think tank event   mobile app testing v1.3
Think tank event mobile app testing v1.3Samer Desouky
 
7 reasons why user uninstall your app(final)
7 reasons why user uninstall your app(final)7 reasons why user uninstall your app(final)
7 reasons why user uninstall your app(final)BetaGlide
 
Mobilize Your Business, Not Just an App
Mobilize Your Business, Not Just an AppMobilize Your Business, Not Just an App
Mobilize Your Business, Not Just an AppTeamstudio
 
What is your mobile strategy?
What is your mobile strategy?What is your mobile strategy?
What is your mobile strategy?Emily Massey
 
Option 2015- Getting Started with Optimizely for Mobile
Option 2015- Getting Started with Optimizely for MobileOption 2015- Getting Started with Optimizely for Mobile
Option 2015- Getting Started with Optimizely for MobileOptimizely
 
Experitest & Capgemini Co-webinar -
Experitest & Capgemini Co-webinar -Experitest & Capgemini Co-webinar -
Experitest & Capgemini Co-webinar -Experitest
 
Transforming Web Business to a Mobile Business - Presentation by Sirish Kosaraju
Transforming Web Business to a Mobile Business - Presentation by Sirish KosarajuTransforming Web Business to a Mobile Business - Presentation by Sirish Kosaraju
Transforming Web Business to a Mobile Business - Presentation by Sirish KosarajuRapidValue
 

Ähnlich wie How to Break your App - Workshop - Testbash 2015 (20)

Best Practices in Mobile App Testing
Best Practices in Mobile App TestingBest Practices in Mobile App Testing
Best Practices in Mobile App Testing
 
Insights on Android App Development, Marketing and Monetization
Insights on Android App Development, Marketing and MonetizationInsights on Android App Development, Marketing and Monetization
Insights on Android App Development, Marketing and Monetization
 
5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy5 Keys to Your Best Automated Testing Strategy
5 Keys to Your Best Automated Testing Strategy
 
Ensure Your Mobile Channels Generate Revenue on Holiday Peak Days
Ensure Your Mobile Channels Generate Revenue on Holiday Peak DaysEnsure Your Mobile Channels Generate Revenue on Holiday Peak Days
Ensure Your Mobile Channels Generate Revenue on Holiday Peak Days
 
Mobile Test Management Done Right
Mobile Test Management Done RightMobile Test Management Done Right
Mobile Test Management Done Right
 
How to make sure your App isnt CrApp
How to make sure your App isnt CrAppHow to make sure your App isnt CrApp
How to make sure your App isnt CrApp
 
The mobile ecosystem & technological strategies
The mobile ecosystem & technological strategiesThe mobile ecosystem & technological strategies
The mobile ecosystem & technological strategies
 
How to get from 0 to #1 on App Stores? by Hamid Palo
How to get from 0 to #1 on App Stores? by Hamid PaloHow to get from 0 to #1 on App Stores? by Hamid Palo
How to get from 0 to #1 on App Stores? by Hamid Palo
 
Юрий Чемёркин (Yury Chemerkin) Owasp russia 2016
Юрий Чемёркин (Yury Chemerkin) Owasp russia 2016Юрий Чемёркин (Yury Chemerkin) Owasp russia 2016
Юрий Чемёркин (Yury Chemerkin) Owasp russia 2016
 
Web Apps and Responsive Design for Libraries
Web Apps and Responsive Design for LibrariesWeb Apps and Responsive Design for Libraries
Web Apps and Responsive Design for Libraries
 
Smartphones
SmartphonesSmartphones
Smartphones
 
Study for a Virtual Personal Assistant Mobile Application for GlaxoSmithKline...
Study for a Virtual Personal Assistant Mobile Application for GlaxoSmithKline...Study for a Virtual Personal Assistant Mobile Application for GlaxoSmithKline...
Study for a Virtual Personal Assistant Mobile Application for GlaxoSmithKline...
 
Think tank event mobile app testing v1.3
Think tank event   mobile app testing v1.3Think tank event   mobile app testing v1.3
Think tank event mobile app testing v1.3
 
7 reasons why user uninstall your app(final)
7 reasons why user uninstall your app(final)7 reasons why user uninstall your app(final)
7 reasons why user uninstall your app(final)
 
how to choose right mobile app development tools
how to choose right mobile app development toolshow to choose right mobile app development tools
how to choose right mobile app development tools
 
Mobilize Your Business, Not Just an App
Mobilize Your Business, Not Just an AppMobilize Your Business, Not Just an App
Mobilize Your Business, Not Just an App
 
What is your mobile strategy?
What is your mobile strategy?What is your mobile strategy?
What is your mobile strategy?
 
Option 2015- Getting Started with Optimizely for Mobile
Option 2015- Getting Started with Optimizely for MobileOption 2015- Getting Started with Optimizely for Mobile
Option 2015- Getting Started with Optimizely for Mobile
 
Experitest & Capgemini Co-webinar -
Experitest & Capgemini Co-webinar -Experitest & Capgemini Co-webinar -
Experitest & Capgemini Co-webinar -
 
Transforming Web Business to a Mobile Business - Presentation by Sirish Kosaraju
Transforming Web Business to a Mobile Business - Presentation by Sirish KosarajuTransforming Web Business to a Mobile Business - Presentation by Sirish Kosaraju
Transforming Web Business to a Mobile Business - Presentation by Sirish Kosaraju
 

Mehr von Daniel Knott

How To Grow Your Testing Team Members
How To Grow Your Testing Team MembersHow To Grow Your Testing Team Members
How To Grow Your Testing Team MembersDaniel Knott
 
Softskills Software Testers
Softskills Software TestersSoftskills Software Testers
Softskills Software TestersDaniel Knott
 
From Testing to Product Management
From Testing to Product ManagementFrom Testing to Product Management
From Testing to Product ManagementDaniel Knott
 
Mobile App Testing ScanAgile 2012
Mobile App Testing ScanAgile 2012Mobile App Testing ScanAgile 2012
Mobile App Testing ScanAgile 2012Daniel Knott
 
Mobile Testautomatisierung
Mobile TestautomatisierungMobile Testautomatisierung
Mobile TestautomatisierungDaniel Knott
 
Mobile Testautomatisierung mit Robotium
Mobile Testautomatisierung mit RobotiumMobile Testautomatisierung mit Robotium
Mobile Testautomatisierung mit RobotiumDaniel Knott
 
Agile Mobile Test Automatisierung
Agile Mobile Test AutomatisierungAgile Mobile Test Automatisierung
Agile Mobile Test AutomatisierungDaniel Knott
 
Challenges in mobile test automation - 2011
Challenges in mobile test automation - 2011Challenges in mobile test automation - 2011
Challenges in mobile test automation - 2011Daniel Knott
 
How to scale mobile testing across several teams
How to scale mobile testing across several teamsHow to scale mobile testing across several teams
How to scale mobile testing across several teamsDaniel Knott
 
10 Mobile App Testing Mistakes To Avoid by Daniel Knott
10 Mobile App Testing Mistakes To Avoid by Daniel Knott10 Mobile App Testing Mistakes To Avoid by Daniel Knott
10 Mobile App Testing Mistakes To Avoid by Daniel KnottDaniel Knott
 
Mobile testing @ XING - Ist der Release Train pünktlich
Mobile testing @ XING - Ist der Release Train pünktlichMobile testing @ XING - Ist der Release Train pünktlich
Mobile testing @ XING - Ist der Release Train pünktlichDaniel Knott
 
Mobile testing @ stughh
Mobile testing @ stughhMobile testing @ stughh
Mobile testing @ stughhDaniel Knott
 
8 Jahre Agiles Testen - Was kommt jetzt?
8 Jahre Agiles Testen - Was kommt jetzt?8 Jahre Agiles Testen - Was kommt jetzt?
8 Jahre Agiles Testen - Was kommt jetzt?Daniel Knott
 
Best Practices in Mobile App Testing @STUGRM
Best Practices in Mobile App Testing @STUGRMBest Practices in Mobile App Testing @STUGRM
Best Practices in Mobile App Testing @STUGRMDaniel Knott
 

Mehr von Daniel Knott (15)

Remote Leadership
Remote LeadershipRemote Leadership
Remote Leadership
 
How To Grow Your Testing Team Members
How To Grow Your Testing Team MembersHow To Grow Your Testing Team Members
How To Grow Your Testing Team Members
 
Softskills Software Testers
Softskills Software TestersSoftskills Software Testers
Softskills Software Testers
 
From Testing to Product Management
From Testing to Product ManagementFrom Testing to Product Management
From Testing to Product Management
 
Mobile App Testing ScanAgile 2012
Mobile App Testing ScanAgile 2012Mobile App Testing ScanAgile 2012
Mobile App Testing ScanAgile 2012
 
Mobile Testautomatisierung
Mobile TestautomatisierungMobile Testautomatisierung
Mobile Testautomatisierung
 
Mobile Testautomatisierung mit Robotium
Mobile Testautomatisierung mit RobotiumMobile Testautomatisierung mit Robotium
Mobile Testautomatisierung mit Robotium
 
Agile Mobile Test Automatisierung
Agile Mobile Test AutomatisierungAgile Mobile Test Automatisierung
Agile Mobile Test Automatisierung
 
Challenges in mobile test automation - 2011
Challenges in mobile test automation - 2011Challenges in mobile test automation - 2011
Challenges in mobile test automation - 2011
 
How to scale mobile testing across several teams
How to scale mobile testing across several teamsHow to scale mobile testing across several teams
How to scale mobile testing across several teams
 
10 Mobile App Testing Mistakes To Avoid by Daniel Knott
10 Mobile App Testing Mistakes To Avoid by Daniel Knott10 Mobile App Testing Mistakes To Avoid by Daniel Knott
10 Mobile App Testing Mistakes To Avoid by Daniel Knott
 
Mobile testing @ XING - Ist der Release Train pünktlich
Mobile testing @ XING - Ist der Release Train pünktlichMobile testing @ XING - Ist der Release Train pünktlich
Mobile testing @ XING - Ist der Release Train pünktlich
 
Mobile testing @ stughh
Mobile testing @ stughhMobile testing @ stughh
Mobile testing @ stughh
 
8 Jahre Agiles Testen - Was kommt jetzt?
8 Jahre Agiles Testen - Was kommt jetzt?8 Jahre Agiles Testen - Was kommt jetzt?
8 Jahre Agiles Testen - Was kommt jetzt?
 
Best Practices in Mobile App Testing @STUGRM
Best Practices in Mobile App Testing @STUGRMBest Practices in Mobile App Testing @STUGRM
Best Practices in Mobile App Testing @STUGRM
 

Kürzlich hochgeladen

VictoriaMetrics Q1 Meet Up '24 - Community & News Update
VictoriaMetrics Q1 Meet Up '24 - Community & News UpdateVictoriaMetrics Q1 Meet Up '24 - Community & News Update
VictoriaMetrics Q1 Meet Up '24 - Community & News UpdateVictoriaMetrics
 
OpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full Recording
OpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full RecordingOpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full Recording
OpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full RecordingShane Coughlan
 
SensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving CarsSensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving CarsChristian Birchler
 
Ronisha Informatics Private Limited Catalogue
Ronisha Informatics Private Limited CatalogueRonisha Informatics Private Limited Catalogue
Ronisha Informatics Private Limited Catalogueitservices996
 
What’s New in VictoriaMetrics: Q1 2024 Updates
What’s New in VictoriaMetrics: Q1 2024 UpdatesWhat’s New in VictoriaMetrics: Q1 2024 Updates
What’s New in VictoriaMetrics: Q1 2024 UpdatesVictoriaMetrics
 
Patterns for automating API delivery. API conference
Patterns for automating API delivery. API conferencePatterns for automating API delivery. API conference
Patterns for automating API delivery. API conferencessuser9e7c64
 
Simplifying Microservices & Apps - The art of effortless development - Meetup...
Simplifying Microservices & Apps - The art of effortless development - Meetup...Simplifying Microservices & Apps - The art of effortless development - Meetup...
Simplifying Microservices & Apps - The art of effortless development - Meetup...Rob Geurden
 
Real-time Tracking and Monitoring with Cargo Cloud Solutions.pptx
Real-time Tracking and Monitoring with Cargo Cloud Solutions.pptxReal-time Tracking and Monitoring with Cargo Cloud Solutions.pptx
Real-time Tracking and Monitoring with Cargo Cloud Solutions.pptxRTS corp
 
Effectively Troubleshoot 9 Types of OutOfMemoryError
Effectively Troubleshoot 9 Types of OutOfMemoryErrorEffectively Troubleshoot 9 Types of OutOfMemoryError
Effectively Troubleshoot 9 Types of OutOfMemoryErrorTier1 app
 
SAM Training Session - How to use EXCEL ?
SAM Training Session - How to use EXCEL ?SAM Training Session - How to use EXCEL ?
SAM Training Session - How to use EXCEL ?Alexandre Beguel
 
Post Quantum Cryptography – The Impact on Identity
Post Quantum Cryptography – The Impact on IdentityPost Quantum Cryptography – The Impact on Identity
Post Quantum Cryptography – The Impact on Identityteam-WIBU
 
UI5ers live - Custom Controls wrapping 3rd-party libs.pptx
UI5ers live - Custom Controls wrapping 3rd-party libs.pptxUI5ers live - Custom Controls wrapping 3rd-party libs.pptx
UI5ers live - Custom Controls wrapping 3rd-party libs.pptxAndreas Kunz
 
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptx
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptxThe Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptx
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptxRTS corp
 
2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdf
2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdf2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdf
2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdfAndrey Devyatkin
 
Salesforce Implementation Services PPT By ABSYZ
Salesforce Implementation Services PPT By ABSYZSalesforce Implementation Services PPT By ABSYZ
Salesforce Implementation Services PPT By ABSYZABSYZ Inc
 
Strategies for using alternative queries to mitigate zero results
Strategies for using alternative queries to mitigate zero resultsStrategies for using alternative queries to mitigate zero results
Strategies for using alternative queries to mitigate zero resultsJean Silva
 
Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...
Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...
Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...OnePlan Solutions
 
Enhancing Supply Chain Visibility with Cargo Cloud Solutions.pdf
Enhancing Supply Chain Visibility with Cargo Cloud Solutions.pdfEnhancing Supply Chain Visibility with Cargo Cloud Solutions.pdf
Enhancing Supply Chain Visibility with Cargo Cloud Solutions.pdfRTS corp
 
Comparing Linux OS Image Update Models - EOSS 2024.pdf
Comparing Linux OS Image Update Models - EOSS 2024.pdfComparing Linux OS Image Update Models - EOSS 2024.pdf
Comparing Linux OS Image Update Models - EOSS 2024.pdfDrew Moseley
 
Leveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Leveraging AI for Mobile App Testing on Real Devices | Applitools + KobitonLeveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Leveraging AI for Mobile App Testing on Real Devices | Applitools + KobitonApplitools
 

Kürzlich hochgeladen (20)

VictoriaMetrics Q1 Meet Up '24 - Community & News Update
VictoriaMetrics Q1 Meet Up '24 - Community & News UpdateVictoriaMetrics Q1 Meet Up '24 - Community & News Update
VictoriaMetrics Q1 Meet Up '24 - Community & News Update
 
OpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full Recording
OpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full RecordingOpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full Recording
OpenChain AI Study Group - Europe and Asia Recap - 2024-04-11 - Full Recording
 
SensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving CarsSensoDat: Simulation-based Sensor Dataset of Self-driving Cars
SensoDat: Simulation-based Sensor Dataset of Self-driving Cars
 
Ronisha Informatics Private Limited Catalogue
Ronisha Informatics Private Limited CatalogueRonisha Informatics Private Limited Catalogue
Ronisha Informatics Private Limited Catalogue
 
What’s New in VictoriaMetrics: Q1 2024 Updates
What’s New in VictoriaMetrics: Q1 2024 UpdatesWhat’s New in VictoriaMetrics: Q1 2024 Updates
What’s New in VictoriaMetrics: Q1 2024 Updates
 
Patterns for automating API delivery. API conference
Patterns for automating API delivery. API conferencePatterns for automating API delivery. API conference
Patterns for automating API delivery. API conference
 
Simplifying Microservices & Apps - The art of effortless development - Meetup...
Simplifying Microservices & Apps - The art of effortless development - Meetup...Simplifying Microservices & Apps - The art of effortless development - Meetup...
Simplifying Microservices & Apps - The art of effortless development - Meetup...
 
Real-time Tracking and Monitoring with Cargo Cloud Solutions.pptx
Real-time Tracking and Monitoring with Cargo Cloud Solutions.pptxReal-time Tracking and Monitoring with Cargo Cloud Solutions.pptx
Real-time Tracking and Monitoring with Cargo Cloud Solutions.pptx
 
Effectively Troubleshoot 9 Types of OutOfMemoryError
Effectively Troubleshoot 9 Types of OutOfMemoryErrorEffectively Troubleshoot 9 Types of OutOfMemoryError
Effectively Troubleshoot 9 Types of OutOfMemoryError
 
SAM Training Session - How to use EXCEL ?
SAM Training Session - How to use EXCEL ?SAM Training Session - How to use EXCEL ?
SAM Training Session - How to use EXCEL ?
 
Post Quantum Cryptography – The Impact on Identity
Post Quantum Cryptography – The Impact on IdentityPost Quantum Cryptography – The Impact on Identity
Post Quantum Cryptography – The Impact on Identity
 
UI5ers live - Custom Controls wrapping 3rd-party libs.pptx
UI5ers live - Custom Controls wrapping 3rd-party libs.pptxUI5ers live - Custom Controls wrapping 3rd-party libs.pptx
UI5ers live - Custom Controls wrapping 3rd-party libs.pptx
 
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptx
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptxThe Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptx
The Role of IoT and Sensor Technology in Cargo Cloud Solutions.pptx
 
2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdf
2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdf2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdf
2024-04-09 - From Complexity to Clarity - AWS Summit AMS.pdf
 
Salesforce Implementation Services PPT By ABSYZ
Salesforce Implementation Services PPT By ABSYZSalesforce Implementation Services PPT By ABSYZ
Salesforce Implementation Services PPT By ABSYZ
 
Strategies for using alternative queries to mitigate zero results
Strategies for using alternative queries to mitigate zero resultsStrategies for using alternative queries to mitigate zero results
Strategies for using alternative queries to mitigate zero results
 
Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...
Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...
Revolutionizing the Digital Transformation Office - Leveraging OnePlan’s AI a...
 
Enhancing Supply Chain Visibility with Cargo Cloud Solutions.pdf
Enhancing Supply Chain Visibility with Cargo Cloud Solutions.pdfEnhancing Supply Chain Visibility with Cargo Cloud Solutions.pdf
Enhancing Supply Chain Visibility with Cargo Cloud Solutions.pdf
 
Comparing Linux OS Image Update Models - EOSS 2024.pdf
Comparing Linux OS Image Update Models - EOSS 2024.pdfComparing Linux OS Image Update Models - EOSS 2024.pdf
Comparing Linux OS Image Update Models - EOSS 2024.pdf
 
Leveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Leveraging AI for Mobile App Testing on Real Devices | Applitools + KobitonLeveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
Leveraging AI for Mobile App Testing on Real Devices | Applitools + Kobiton
 

How to Break your App - Workshop - Testbash 2015

  • 1. 1 26.März2015 Customer Visual How to Break your App - Best Practices in Mobile App Testing Workshop Daniel Knott | @dnlkntt
  • 2. Who am I ? • Daniel Knott • Software Test Manager/ Mobile Tester @AOE • Software Tester since 2008 • Mobile Testing since the end of 2010 • Author, Blogger and Speaker http://www.adventuresinqa.com @dnlkntt http://www.linkedin.com/pub/daniel-knott/1a/925/993 https://www.xing.com/profile/Daniel_Knott
  • 4. Agenda 1. Current Status 3. How to break your app 2. Exercise I 5. Summary and Close Up 4. Exercise II
  • 5. 5 26.März2015 I Current Status Author: Barry Caruth, https://www.flickr.com/photos/caruth/8401943928/
  • 6. Current Status | Some Numbers 2+ millions apps available 100+ billion downloads +19,000 Android Devices 16 iOS Devices
  • 7. Current Status | Some Numbers 80% – 90% of apps are deleted after the first usage 56% of apps that requires a registration gets deleted Average user checks device 150 times per day 45% are not well tested
  • 8. Current Status | Mobile Testing is different High User expectation Lot’s of different devices with HW and SW Users are on the move Mobile Tools and Approaches
  • 10. Exercise I Build up groups 2-5 person Mind Map your challenges in mobile testing 20 minutes Group discussion about the mind map
  • 12. Challenges| How to handle fragmentation Group your devices, A B C Test only on those devices Test on real device Don’t use simulators or emulators Know the devices of your target group
  • 13. Challenges | How to handle fragmentation Group 1, Prio A • High End Devices • Dual/ Quad Core CPU • RAM >2048MB • Retina, Full HD Display >= 5“ Group 2, Prio B • Mid-range devices • Dual Core CPU • RAM <=1024MB • Screen size <= 4“ • Software not older than 1 year Group 3, Prio C • Small devices • Single Core • RAM < 512MB • Low screen size and resolution • Older OS, older browser Based on your target group
  • 14. Challenges | The User - KIFSU Simple UseableFastItKeep K I F S U
  • 15. 16 26.März2015 I How to break your app Author: OZinOH, http://www.flickr.com/photos/75905404@N00/7126147125/
  • 16. Mobile Specific Testing Known functional testing is still required • Boundary values • Equivalence classes • Testing against acceptance criteria Test the app as black box • Try to break it • Be creative and think in edge cases
  • 17. Mobile Specific Testing Author: Juan de Dios Santander Vela, http://www.flickr.com/photos/juandesant/209098053 Author: Ian Britton, http://www.flickr.com/photos/freefoto/728651045/ Author: Moyan Brenn, https://www.flickr.com/photos/aigle_dore/5626341059/ Author: @Doug88888, http://www.flickr.com/photos/doug88888/7149187135/ Author: Dan Levy, http://www.flickr.com/photos/danlevy/5607259711/
  • 18. Author: Davide Vizzini Limbte, http://www.flickr.com/photos/limbte/4007115435/ Mobile Specific Testing • Logout (English) • Ausloggen (German) • Déconnexion (French) • Çıkış yap (Turkish) • Выйти (Russian)
  • 19. Mobile Specific Testing Author: amateur_photo_bore, http://www.flickr.com/photos/andresv/233667770/ Author: Rain Rabbit, http://www.flickr.com/photos/37996583811@N01/8033259053/ Author, Daniel Sancho, http://www.flickr.com/photos/teclasorg/2852716491/
  • 20. Mobile Specific Testing Author: Surat Lozowick, http://www.flickr.com/photos/suratlozowick/4311105154/ Author: Surat Lozowick, http://www.flickr.com/photos/suratlozowick/4464587302/ Author: Theus Falcao, http://www.flickr.com/photos/theusfalcao/9563767145/
  • 21. Mobile Specific Testing Author: Molly Holzschlag, http://www.flickr.com/photos/mollyeh11/272434559/ Author: Quinn Dombrowski, http://www.flickr.com/photos/quinnanya/4718635484/
  • 22. Mobile Specific Testing Author: minxlj, http://www.flickr.com/photos/minxlj/3270996158/ Author: Ryan B. BulaPhotography, http://www.flickr.com/photos/nayralub/3763581778/ Author: Sterling Coffey, http://www.flickr.com/photos/n0ssc/7046915929/
  • 23. Author: Anthony Catalano, http://www.flickr.com/photos/badwsky/34164244/ Author: Dennis Wong, http://www.flickr.com/photos/denniswong/2406135310/ Âuthor: orkomedix, http://www.flickr.com/photos/orkomedix/5211437958/ Mobile Specific Testing
  • 25. Exercise II Build up groups 2-5 person Download a mobile app of your choice Test it with provided scenarios Note down the bugs 30 Minutes Let’s talk about the bugs
  • 26. Exercise II – My Bugs – Android Wordpress App Using the app in bad network conditions Don’t show technical errors
  • 27. Exercise II – My Bugs – Android Wordpress App Provide user friendly error messages Test app without backend availability
  • 28. Exercise II – My Bugs – Android Wordpress App Language size Test your app in different languages
  • 29. Exercise II – My Bugs – Android Wordpress App Localization problems
  • 30. Exercise II – My Bugs – Android Wordpress App Localization problems
  • 32. Mobile Specific Testing | Summary Mobile Testing is different compared to other software Be creative and on the move while testing mobile apps Be up to date! Know your target group Keep the mobile features in mind Keep the high user expectations in mind
  • 33. Thanks for your attention! www.handsonmobileapptesting.com More information about mobile testing can be found in my book „Hands-On Mobile App Testing“ Soon available in a printed copy, too.
  • 34. 40 26.März2015 AOE GmbH LuisenForum, Kirchgasse 6 65185 Wiesbaden Germany Phone: +49 6122 70 70 7 - 0 Fax: +49 6122 70 70 7 - 199 E-Mail: sales@aoe.com Web: www.aoe.com I in Germany
  • 35. Links & References • World Quality Report [http://www.sogeti.com/en-us/looking-for-solutions/Services/Software- Control-Testing/The-World-Quality-Report-2013--2014/] • Robotium [https://code.google.com/p/robotium/] • Spoon [https://github.com/square/spoon] • Robolectric [http://robolectric.org/] • Calabash for Android [https://github.com/calabash/calabash-android] • Selendroid [http://selendroid.io/] • ExtSolo [http://docs.testdroid.com/_static/extSolodocs/com/bitbar/recorder/extensions/ExtSolo.html] • Espresso [https://code.google.com/p/android-test-kit/wiki/Espresso] • Monkey [http://developer.android.com/tools/help/monkey.html] • UI AutoMonkey [https://github.com/jonathanpenn/ui-auto-monkey]
  • 36. Links & References • MonkeyTalk [https://www.cloudmonkeymobile.com/monkeytalk] • UIAutomation[https://developer.apple.com/library/mac/documentation/DeveloperTools/Conceptual/ InstrumentsUserGuide/UsingtheAutomationInstrument/UsingtheAutomationInstrument.html] • Keep It Functional [https://github.com/kif-framework/KIF] • XCTest [https://developer.apple.com/library/ios/documentation/ToolsLanguages/Conceptual/Xcode_Overvi ew/UnitTestYourApp/UnitTestYourApp.html] • Calabash for iOS [https://github.com/calabash/calabash-ios] • ios-driver [http://ios-driver.github.io/ios-driver/?page=home] • Kiwi [https://github.com/allending/Kiwi] • Appium [http://appium.io/] • JouleJunit [https://code.google.com/p/jouleunit/] • Energy Usage Instruments [https://developer.apple.com/library/ios/documentation/AnalysisTools/Reference/Instruments_User _Reference/EnergyUsageInstrument/EnergyUsageInstrument.html]

Hinweis der Redaktion

  1. Welcome to my workshop My Name is Daniel Knott Who is new to mobile testing? This workshop contains some talking time from my side roughly around 30minutes and the rest of the time we will have some exercises. Please raise your hand whenever you have a question Test Automation will not part of this workshop, there is not enough time for that. However if you need some mobile testing tools just ask
  2. Currently software test manager @AOE, Mobile Testing for a big german telecommunication provider. Testing iOS, Android and BlackBerry Apps Mobile Tester since end of 2010 Build up the mobile testing team @XING Mobile test automation for iOS and Android Get in touch with me over the provided social links
  3. IT agency since 1999 150 employees, HQ Wiesbaden, SFO, Zürich Background TYPO3 and Magento Own Search product ‚Searchperience‘ Enterprise e Commerce shops e.g. Angry Birds Webshop, QVC Enterprise CMS Systems: Congstar Sony Entertainment System ConnectedCar, Mobile Apps Enough marketing! Lets get started
  4. Intro shows the topic I will cover today in this presentation For each topic I will give some best practices Lets get startet. If you have questions just ask them I have slides for 30minutes. Remember if you have any kind of question don‘t hesitate to ask them.
  5. 16 iOS devices (7 iPhones von 4 – 6+ | 9 iPads von iPad2)
  6. Some number about the mobile world, numbers based on different reports e.g. Gartner, Compuware and World Quality Report Every 6 minutes an AVG. User is checking his smartphone, thats more than 150 times a day! - Users also expect fast loading times under 2 seconds! Keep this numbers in mind Number from Gartner, Comupware and World Quality Report
  7. Why is mobile testing different? High user expectations, reminder the 90% Mobile Testing is different Remind the numbers from prev. Page - This was a rough first overview of the mobile world. 10 Minutes
  8. I will also my current challenges with possible solution for it, maybe you have the same challenges. 20 min
  9. Device Fragmentation User expectations -> Remember the huge numbers from the first slides. Data Networks Mobile Usage Device Specific Functions Tools 10min
  10. In the projects I was working on we used the following approach to downsize the effort in device fragmentation Lets have a look at the grouped devices
  11. Group Devices into A B C, example for techi app. Customers always have the latest devices. Group or grading is different for every app Create groups based on your target group Keep in mind, this is an ongoing process!!! Handling the devices in an mobile team could be a full time job! Don‘t underestimate the efforts here. If you don‘t want to buy phones, you can rent them. Open Device Labs, Cloud Devices!
  12. Based on KISS Principle -> Keep It Simple Stupid I created my own mobile principle KIFSU to keep user expectation in mind Follow the 3 simple rules Fast, Simple and Useable and your customer will be happy
  13. Best Practices Know your target group. With that knowledge you can downsize the dev and testing effort. Because you know the devices of your customers and their needs Talk to them! Invite them to your company and talk to them (not all of course :D) Then do usability testing with them Invite them to be a beta tester. For example I tested the Sonos App in a beta program. Was a nice approach to feel valuable as a customer Create Personas based on your target group
  14. 20min
  15. I think you all know the biggest mobile challenge! You can hear this in nearly every mobile report, post, article Software and Hardware Fragmentation, different CPU, RAM, Camera, Battery, Screensize, Density
  16. iOS Fragmentation is also there! Two new form factors with the iPhone6 and iPhone 6+ But also keep the different Software Versions in mind But there are more challenges than just the fragmentation But how to handle the fragmentation?
  17. The is also a challenge when developing a mobile app! If you don‘t know your customer you don‘t know what to develop and on which platform to test Why is the customer here a big challeneg? Any ideas? Because Mobile users have a much higher expectation to mobile apps than to any other software like browser based applications Get to know the customer
  18. - Lets come to mobile specific testing.
  19. First of all, the known testing techniques are also valid for mobile apps Like boundary testing, equivalence classes, acceptance criteria In the mobile challenge slides I already mentioned the fragmentation, language and the network Be mobile and on the move while testing your app. Test your app in the real environment! Test in data networks!
  20. To handle network scenarios do Mobile Field Testing Test the app in the city, in the country side, while commuting to work, in the park, at home  be mobile Test the app also in the environment the app is made for. When testing sports app, do sports :) When testing e.g. a skiing app, be on the slope! Network situations are hard to automate. Simulating them is ok but not enough Test also more network provider If you don‘t have the time for doing that kind of field testing, use the crowd! They can offer you that kind of stuff. Plane Mode Edge, 3G, 4G
  21. Keep different languages in mind Logout (English) Ausloggen (German) Déconnexion (French) Çıkış yap (Turkish) Выйти (Russian)
  22. Test the device specific hardware 1. Camera. Different Vendors == different cameras and resolutions. Even in iPhones different cameras are installed 2. Test the sensors that are used by your app. Tilt sensors, motion sensor, light sensor, shake the phone etc. GPS testing, check that used GPS is released by the app again to save battery - TWITTER APP EXAMPLE 3. Memory, test if your app can be stored on sdk card on android. Test how your app behave when the local phone storage empty, full is  no crashes? Proper error message? Put lots of data to your device and see how it behaves
  23. 1. Test the battery consumption of your app. Charge the app before testing to 100% and mesaure every 10 minutes the current battery state Use tools for measure the battery. There are some tools on the market. Also use an nearyl empty phone for testing and see how the app is performing. Some phones switch off some sensors to save battery, can your app work with that? 2. Start the app and leave the phone in standby mode, open the app again, is the app still working? Maybe triggering a reload to get the latest data from the backend Start the app from multitask  switch off the network  plane mode!? 3.Test different interrupt  notifications, incomming sms, mms, phone call usw. If your app supports push notifications open the app and send a push notification check the handling. _> monkey tools Use tools like JouleUnit (Android) On iOS use the Energy Usage Function of Instruments Monkey for Android to stresstest your app and see the handling of the interrupts UI AutoMonkey for ios
  24. There are some tools that help you analyzing the battery consumption of your app. And tools to stress test your app Use tools like JouleUnit (Android) On iOS use the Energy Usage Function of Instruments Monkey for Android to stresstest your app and see the handling of the interrupts UI AutoMonkey for ios
  25. On this slide there is one category that most of the people don‘t care. But in some apps it makes really sense. 1. Do usability testing Invite people to test your app Starbucks test Test early versions, prototypes, skribbles 2. Think of handycaped people (blind) and do some accessibility testing (screen readers, color testing) Use the build in screenreaders! At least try to think at those people In my current project the iOS app needs to fully accessable. This was really hard to develop and to test. You need to think of the contrast and the colors of the app. Every part had to be tested with a screenreader and so . Keep this point in mind or try it tomorrow 
  26. 1. Test the update process of your app Check that user is still logged in Check that data is still the same Check that database changes will not affect the current data Test the update from an older version to the current version 2. Do performance testing Hard to do manually, but compare at least the old with the new version in terms of loading time (gut feeling is always good) If there is time and money see how to use an performance testing tool to measure the app (enterprise software) 3. Check the log files of the app while testing Often there are exceptions Check that the request and response is encrypted Lock for debug information that should not be in the release candidate of your app
  27. 1. Check if the communication between your app and the backend is encrypted (use a proxy tool) Check that the data that is stored is encrypted in the local database 2. Check that the signing certificate is valid, check signing password of the app Check also the developer account password from the stores! 3. Use only the permissions you really need in the app Ask the devs twice what they have done!
  28. 30min
  29. 20min
  30. Summary, lets just recap the last slides 10min
  31. We have seen pleenty of topics that needs to be covered when a mobile app should be tested Here are some other facts and point that maybe help you guys in your daily work
  32. Thank you very much for your attention. If you have questions feel free to ask them If you are still looking for mobile testing content visit my blog from time to time, I try to keep you updated there!
  33. Thats it so far for the mobile specific testing Lets come to mobile tools. When I talk to other mobile testers, this is always a problem. The tools and to find the right mobile test automation tool. The tools based in the next couple of slide are open source tools
  34. Before I start with some tools, I want briefly talk about the test automation pyramid You see the traditional test automation pyramid for software applications But this pyramid is not applicable for mobile apps Mobile Testing requires lots of manual testing Unit Testing for mobile apps is not easy and sufficient Lots of interfaces or APIs needs to be mocked or is not possible Integration testing is not easy UI Tests including E2E testing is important Mobile tools are not mature enough for unit testing
  35. Most projects look like this from a test pyramid point of view. It‘s flipped No stable foundation, it can fall to the right or left side Therefore I created a mobile test pyramid Due to the current tool situation and the fact that mobile requires lots of manual testing has flipped the testing pyramid
  36. Foundation is manual testing Followed by End to end automation from the UI to the backend systems New is Beta Testing. Have the customer expectations in mind. Use beta testing in your project. Either with colleagues or using a crowd testing approach And still use unit tests but this time very little compared to the rest. NEW: The pyramid contains manual and automated parts I use this pyramid in my mobile projects.
  37. Before I come to some tools I wrote down some sentences that maybe helps you finding a mobile test automation tool. 1. First of all, DO TEST AUTOMATION. It is not easy, but you have to do it, also on mobile 2. Don‘t huge test automation tools, enterprise tools might be good, but most the time there are just expensive and slow. For example, when there is a new update from ios or android it could be that the software is not supporting it Since 4 years I am working with open source tools and this worked out pretty good! Open source can be extended, by YOU! 3. Start small and simple. KISS is the magic word here. Discover the tools, see the documentation and so on 4. No tool is perfect neither closed or open source. Mobile test tools are still at the beginning 5. See which tool fits best in your dev and testing environment! Thats different for every company. But now, some tools for Android and iOS
  38. List some open source test frameworks for android  Robotium Recorder List is not complete Most of the tools simulate real user interaction All frameworks except Robolectric to execute the tests on the real device! You can combine tools A good way to find the right tool is to build a dummy app that contains all elements your future app will have, then test the test tool and see if the tool can handle all the elements A short example from my current project. Android project, want to try espresso (test tool from google). We have a date and timepicker in our app. Espresso has no support for that elements so we are using robotium together with spoon A greate source for mobile tools is the dev corner from the company square. And there are many other tools on the market.
  39. Also a list of open source tools Android offers more open source tools than on the iOS side All listed tools are automating the user interface Most of them can execute the test on the real device Sometime it make sense to combine the tools, like Kiwi or XCTest with Keep It Functional There are also tools in the cloud that could be used for testautomation, there are plenty of providers Waiting for Selenium 3, this should offer full mobile test automation features Another tip that was always pretty helpful in my mobile projects, if the mobile test tool is using the same language than the production app. Then developers and testers can work together on the test environment.
  40. - Lets come to the last topic for today - Lets have a look at security testing on mobile devices.
  41. Security testing is not easy Get help by experts to avoid image loss, money and whatever To get started with the topic security testing check the OWASP Mobile security page