Mobile testing is different. We cannot confine app testing to just the functionality of the app itself. We have a new set of test conditions we have to consider just because the app is running on a mobile device. This presentation discusses high-level mobile specific test conditions and how to choose the appropriate ones for your mobile app.

1. © Utopia Solutions
Mobile Testing Checklist
Lee Barnes, CTO
Utopia Solutions

2. 2 © Utopia Solutions
Mobile testing is…
…different
www.motivationalmemo.com

3. 3 © Utopia Solutions
iOS 8
iOS 7
Earlier
Multiple OS / Fragmentation
4.4
4.3
4.2
4.1
4.03 - 4.04
2.3.3 - 2.3.7
2.2 & earlier
Source: OpenSignal Android Fragmentation Report August 2014
Source: Mixpanel Trends iOS Adoption – Sept 23, 2014

4. 4 © Utopia Solutions
Device Diversity

5. 5 © Utopia Solutions
Carrier Modifications

6. 6 © Utopia Solutions
App Functionality
Mobile Specific Test Conditions
Mobile Testing Iceberg
Diversity Increases Test Burden

7. 7 © Utopia Solutions
Mobile Specific Checklist Test Conditions
Installation
Interrupt
Network
Device Integration
Performance

8. 8 © Utopia Solutions
Mobile Testing Checklist
Interrupt Conditions
Incoming / Outgoing Calls
Popup Alerts (Calendar, Alarm, SMS, etc.)
Power Cycle
Extended Background

9. 9 © Utopia Solutions
Mobile Testing Checklist
Installation Conditions
Install
Uninstall
Reinstall
Update

10. 10 © Utopia Solutions
Mobile Testing Checklist
Network Conditions
Network Type (Mobile variations and WiFi)
Network Quality
Network Loss
Network Transition

11. 11 © Utopia Solutions
Mobile Testing Checklist
Performance Conditions
Speed / Responsiveness
CPU and Memory Usage
Battery Drain
On-Device / Memory Card Storage

12. 12 © Utopia Solutions
Mobile Testing Checklist
Device Conditions
Location / GPS
Video / Still Camera
Screen Size, Resolution, Orientation
Gestures & Accelerometer

13. 13 © Utopia Solutions
Mobile Test Case Selection
App Type
App Usage
App / Device Integration

14. 14 © Utopia Solutions
Device Configuration Selection
App
Functionality
& Technology
User Profile
Business
Objectives
•
Deployment platforms & versions
•
App interaction with device
•
Integrated systems
•
Prevalent Devices
•
Preferred Browser
•
Concurrent usage / load profile
•
Application value to the business
•
Risk of application failure

15. 15 © Utopia Solutions
Mobile Testing

16. 16 © Utopia Solutions
Mobile Test Case Matrix

17. 17 © Utopia Solutions
Test Automation
Execute test cases across a set of diverse devices

18. 18 © Utopia Solutions
Questions…
…. and Answers!
Direct future questions to:
Lee Barnes
Founder and CTO
Utopia Solutions, Inc.
Email: lee.barnes@utopiasolutions.com
Twitter: twitter.com/USI_LeeBarnes
LinkedIn: linkedin.com/in/leebarnes
Blog: www.RaiseYourMQ.com