1 16. Mai 2014
Customer Visual
Best Practices in Mobile App Testing
Daniel Knott | @dnlkntt
Vienna Mobile Quality Crew
Auf...
Who am I ?
• Daniel Knott
• Software Test Manager @AOE
• Mobile Testing since the end of 2010
• Before AOE, Team Lead QA @...
3 16. Mai 2014
I Company Profile
Intro
Current Status
Mobile Challenges
The Customer
Mobile Specific
Testing
Security
Tools
5 16. Mai 2014
I Current Status
Author: Barry Caruth, https://www.flickr.com/photos/caruth/8401943928/
Current Status | Some Numbers
2+ millions apps available
100+ billion downloads
80% – 90% of apps are deleted after the fi...
7 16. Mai 2014
I Mobile Challenges
Mobile Challenges | All known!?
http://opensignal.com/reports/fragmentation-2013/
Mobile Challenges | All known!?
http://opensignal.com/reports/fragmentation-2013/
Mobile Challenges | How to handle fragmentation
Group your devices, A B C
Test only on those devices
Test on real device
D...
Mobile Challenges | How to handle fragmentation
Group 1, Prio A
• High End
Devices
• Dual/ Quad Core
CPU
• RAM >1024MB
• R...
Author: Davide Vizzini Limbte, http://www.flickr.com/photos/limbte/4007115435/
Mobile Challenges | More…
Author: Juan de D...
13 16. Mai 2014
I The Customer
Author: Michael Newman, https://www.flickr.com/photos/mzn37/1226016289/
The Customer | Better know them
Know the target group
Talk to your customer
Will downsize testing effort
Do usability test...
15 16. Mai 2014
I Mobile Specific Testing
Author: Theus Falcao, http://www.flickr.com/photos/theusfalcao/9563767145/
Mobile Specific Testing
Known functional testing is still required
• Boundary values
• Equivalence classes
• Testing again...
Mobile Specific Testing
Author: Juan de Dios Santander Vela, http://www.flickr.com/photos/juandesant/209098053
Author: Ian...
Mobile Specific Testing
Author: amateur_photo_bore, http://www.flickr.com/photos/andresv/233667770/ Author: Rain Rabbit, h...
Mobile Specific Testing
Author: Surat Lozowick, http://www.flickr.com/photos/suratlozowick/4311105154/ Author: Surat Lozow...
Mobile Specific Testing
Android
• JouleUnit, to measure battery usage
• Monkey, to stress test the app
iOS
• Energy Usage ...
Mobile Specific Testing
Author: Molly Holzschlag, http://www.flickr.com/photos/mollyeh11/272434559/ Author: Quinn Dombrows...
Mobile Specific Testing
Author: minxlj, http://www.flickr.com/photos/minxlj/3270996158/ Author: Ryan B. BulaPhotography, h...
23 16. Mai 2014
I Tools
Author: OZinOH, http://www.flickr.com/photos/75905404@N00/7126147125/
Tools
Do test automation!
Start simple and discover different tools
Don’t buy huge test automation tools
No tool is perfec...
Tools | Android
Robotium (ExtSolo)
Selendroid
Spoon
Calabash for Android
Robolectric
Espresso
Monkey
Great mobile tools pr...
Tools | iOS
UIAutomation
MonkeyTalk
Keep It Functional
Calabash for iOS
ios-driver
Kiwi
XCTest
Appium
27 16. Mai 2014
I Security
Author: Alexandre Dulaunoy, http://www.flickr.com/photos/adulau/7712545428/
Security
Author: Anthony Catalano, http://www.flickr.com/photos/badwsky/34164244/
Author: Dennis Wong, http://www.flickr.c...
Security
Security testing is not easy
Get help from experts
Check the OWASP mobile security page
https://www.owasp.org/ind...
30 16. Mai 2014
I Summary
Mobile Specific Testing | Summary
Combine your in house testing with crowd testing
Be up to date! Know your target group
K...
Questions?
Thank you for your attention!
http://www.adventuresinqa.com
33 16. Mai 2014
AOE GmbH
LuisenForum, Kirchgasse 6
65185 Wiesbaden
Germany
Phone: +49 6122 70 70 7 - 0
Fax: +49 6122 70 70...
Links & References
• World Quality Report [http://www.sogeti.com/en-us/looking-for-solutions/Services/Software-
Control-Te...
Links & References
• MonkeyTalk [https://www.cloudmonkeymobile.com/monkeytalk]
• UIAutomation[https://developer.apple.com/...
Best Practices in Mobile App Testing
Nächste SlideShare
Wird geladen in …5
×

Best Practices in Mobile App Testing

1.109 Aufrufe

Veröffentlicht am

My slides about Best Practices in Mobile App Testing. Slides include mobile testing challenges, mobile test automation tools and some more useful information. Further mobile testing information can be found on my blog:

http://www.adventuresinqa.com

Veröffentlicht in: Software, Technologie, Sport
0 Kommentare
0 Gefällt mir
Statistik
Notizen
  • Als Erste(r) kommentieren

  • Gehören Sie zu den Ersten, denen das gefällt!

Keine Downloads
Aufrufe
Aufrufe insgesamt
1.109
Auf SlideShare
0
Aus Einbettungen
0
Anzahl an Einbettungen
38
Aktionen
Geteilt
0
Downloads
25
Kommentare
0
Gefällt mir
0
Einbettungen 0
Keine Einbettungen

Keine Notizen für die Folie

Best Practices in Mobile App Testing

  1. 1. 1 16. Mai 2014 Customer Visual Best Practices in Mobile App Testing Daniel Knott | @dnlkntt Vienna Mobile Quality Crew Auf die Plätze, Fertig, APP!
  2. 2. Who am I ? • Daniel Knott • Software Test Manager @AOE • Mobile Testing since the end of 2010 • Before AOE, Team Lead QA @XING Mobile Team • Blogger and Speaker http://www.adventuresinqa.com @dnlkntt http://www.linkedin.com/pub/daniel-knott/1a/925/993 https://www.xing.com/profile/Daniel_Knott
  3. 3. 3 16. Mai 2014 I Company Profile
  4. 4. Intro Current Status Mobile Challenges The Customer Mobile Specific Testing Security Tools
  5. 5. 5 16. Mai 2014 I Current Status Author: Barry Caruth, https://www.flickr.com/photos/caruth/8401943928/
  6. 6. Current Status | Some Numbers 2+ millions apps available 100+ billion downloads 80% – 90% of apps are deleted after the first usage 56% of apps that requires a registration gets deleted Average user checks device 150 times per day 45% are not well tested
  7. 7. 7 16. Mai 2014 I Mobile Challenges
  8. 8. Mobile Challenges | All known!? http://opensignal.com/reports/fragmentation-2013/
  9. 9. Mobile Challenges | All known!? http://opensignal.com/reports/fragmentation-2013/
  10. 10. Mobile Challenges | How to handle fragmentation Group your devices, A B C Test only on those devices Test on real device Don’t use simulators or emulators Know the target group
  11. 11. Mobile Challenges | How to handle fragmentation Group 1, Prio A • High End Devices • Dual/ Quad Core CPU • RAM >1024MB • Retina, Full HD Display > 4,5“ Group 2, Prio B • Mid-range devices • Dual Core CPU • RAM <1024MB • Screen size < 4“ • Software not older than 1 year Group 3, Prio C • Small devices • Single Core • RAM < 512MB • Low screen size and resolution • Older OS, older browser Based on your target group
  12. 12. Author: Davide Vizzini Limbte, http://www.flickr.com/photos/limbte/4007115435/ Mobile Challenges | More… Author: Juan de Dios Santander Vela, http://www.flickr.com/photos/juandesant/209098053 Author: Rain Rabbit, http://www.flickr.com/photos/37996583811@N01/8033259053/
  13. 13. 13 16. Mai 2014 I The Customer Author: Michael Newman, https://www.flickr.com/photos/mzn37/1226016289/
  14. 14. The Customer | Better know them Know the target group Talk to your customer Will downsize testing effort Do usability testing with them Invite them to a beta testing program (Sonos, FB, Twitter) Author: Grzegorz Lobinski, http://www.flickr.com/photos/gregloby/3515990945/
  15. 15. 15 16. Mai 2014 I Mobile Specific Testing Author: Theus Falcao, http://www.flickr.com/photos/theusfalcao/9563767145/
  16. 16. Mobile Specific Testing Known functional testing is still required • Boundary values • Equivalence classes • Testing against acceptance criteria Test the app as black box • Try to break it • Be creative and think in edge cases
  17. 17. Mobile Specific Testing Author: Juan de Dios Santander Vela, http://www.flickr.com/photos/juandesant/209098053 Author: Ian Britton, http://www.flickr.com/photos/freefoto/728651045/ Author: Moyan Brenn, https://www.flickr.com/photos/aigle_dore/5626341059/ Author: @Doug88888, http://www.flickr.com/photos/doug88888/7149187135/ Author: Dan Levy, http://www.flickr.com/photos/danlevy/5607259711/
  18. 18. Mobile Specific Testing Author: amateur_photo_bore, http://www.flickr.com/photos/andresv/233667770/ Author: Rain Rabbit, http://www.flickr.com/photos/37996583811@N01/8033259053/ Author, Daniel Sancho, http://www.flickr.com/photos/teclasorg/2852716491/
  19. 19. Mobile Specific Testing Author: Surat Lozowick, http://www.flickr.com/photos/suratlozowick/4311105154/ Author: Surat Lozowick, http://www.flickr.com/photos/suratlozowick/4464587302/ Author: Theus Falcao, http://www.flickr.com/photos/theusfalcao/9563767145/
  20. 20. Mobile Specific Testing Android • JouleUnit, to measure battery usage • Monkey, to stress test the app iOS • Energy Usage in Instruments • UI AutoMonkey, to stress test the app
  21. 21. Mobile Specific Testing Author: Molly Holzschlag, http://www.flickr.com/photos/mollyeh11/272434559/ Author: Quinn Dombrowski, http://www.flickr.com/photos/quinnanya/4718635484/
  22. 22. Mobile Specific Testing Author: minxlj, http://www.flickr.com/photos/minxlj/3270996158/ Author: Ryan B. BulaPhotography, http://www.flickr.com/photos/nayralub/3763581778/ Author: Sterling Coffey, http://www.flickr.com/photos/n0ssc/7046915929/
  23. 23. 23 16. Mai 2014 I Tools Author: OZinOH, http://www.flickr.com/photos/75905404@N00/7126147125/
  24. 24. Tools Do test automation! Start simple and discover different tools Don’t buy huge test automation tools No tool is perfect See which tool fits in your development environment
  25. 25. Tools | Android Robotium (ExtSolo) Selendroid Spoon Calabash for Android Robolectric Espresso Monkey Great mobile tools provided by the company square: http://square.github.io/ MonkeyTalk Appium
  26. 26. Tools | iOS UIAutomation MonkeyTalk Keep It Functional Calabash for iOS ios-driver Kiwi XCTest Appium
  27. 27. 27 16. Mai 2014 I Security Author: Alexandre Dulaunoy, http://www.flickr.com/photos/adulau/7712545428/
  28. 28. Security Author: Anthony Catalano, http://www.flickr.com/photos/badwsky/34164244/ Author: Dennis Wong, http://www.flickr.com/photos/denniswong/2406135310/ Âuthor: orkomedix, http://www.flickr.com/photos/orkomedix/5211437958/
  29. 29. Security Security testing is not easy Get help from experts Check the OWASP mobile security page https://www.owasp.org/index.php/OWASP_Mobile_ Security_Project Think twice about app permissions
  30. 30. 30 16. Mai 2014 I Summary
  31. 31. Mobile Specific Testing | Summary Combine your in house testing with crowd testing Be up to date! Know your target group Keep the mobile features in mind Do test automation and know the right tools Do security testing Be creative and on the move while testing mobile apps
  32. 32. Questions? Thank you for your attention! http://www.adventuresinqa.com
  33. 33. 33 16. Mai 2014 AOE GmbH LuisenForum, Kirchgasse 6 65185 Wiesbaden Germany Phone: +49 6122 70 70 7 - 0 Fax: +49 6122 70 70 7 - 199 E-Mail: sales@aoe.com Web: www.aoe.com I in Germany
  34. 34. Links & References • World Quality Report [http://www.sogeti.com/en-us/looking-for-solutions/Services/Software- Control-Testing/The-World-Quality-Report-2013--2014/] • Robotium [https://code.google.com/p/robotium/] • Spoon [https://github.com/square/spoon] • Robolectric [http://robolectric.org/] • Calabash for Android [https://github.com/calabash/calabash-android] • Selendroid [http://selendroid.io/] • ExtSolo [http://docs.testdroid.com/_static/extSolodocs/com/bitbar/recorder/extensions/ExtSolo.html] • Espresso [https://code.google.com/p/android-test-kit/wiki/Espresso] • Monkey [http://developer.android.com/tools/help/monkey.html] • UI AutoMonkey [https://github.com/jonathanpenn/ui-auto-monkey]
  35. 35. Links & References • MonkeyTalk [https://www.cloudmonkeymobile.com/monkeytalk] • UIAutomation[https://developer.apple.com/library/mac/documentation/DeveloperTools/Conceptual/ InstrumentsUserGuide/UsingtheAutomationInstrument/UsingtheAutomationInstrument.html] • Keep It Functional [https://github.com/kif-framework/KIF] • XCTest [https://developer.apple.com/library/ios/documentation/ToolsLanguages/Conceptual/Xcode_Overvi ew/UnitTestYourApp/UnitTestYourApp.html] • Calabash for iOS [https://github.com/calabash/calabash-ios] • ios-driver [http://ios-driver.github.io/ios-driver/?page=home] • Kiwi [https://github.com/allending/Kiwi] • Appium [http://appium.io/] • JouleJunit [https://code.google.com/p/jouleunit/] • Energy Usage Instruments [https://developer.apple.com/library/ios/documentation/AnalysisTools/Reference/Instruments_User _Reference/EnergyUsageInstrument/EnergyUsageInstrument.html]

×