Impetus webcast " Maturity of Mobile Test Automation: Approaches and Future Trends " available at http://lf1.me/Pxb/
This Impetus webcast talks about:
• Mobile test automation challenges
• Evolution of test automation challenges from Unit tests to image based and object comparison methods
• What next?
• Impetus solution approach for comprehensive mobile testing automation
2. • Mobile Application Testing
• Generic challenges
• Technical challenges
• Business challenges
• Evolution of Test Automation
Approaches
• Current and future trends –
mAutomate
Outline
Recorded version available at http://lf1.me/Pxb/
3. • It is the use of strategies, tools, and
artifacts that reduce the need for human
involvement on repetitive testing tasks
• Unit, UI, and Functional testing
Test Automation
Recorded version available at http://lf1.me/Pxb/
4. • Application specific test case writing
• Conversion of test cases into scripts
(Code / Record)
• Execution of test scripts on devices
• Unattended test cycles
How Test Automation Works?
Recorded version available at http://lf1.me/Pxb/
5. • Programmable
• Repeatable and reusable
• Reliable and comprehensive
• Increased productivity
• Cost reduction
• Superior application quality
Benefits
Recorded version available at http://lf1.me/Pxb/
6. • Diversity of device / platforms
• Hardware complexity
• Application complexity
• Carrier network issues
• Compressed software
• Development schedules
Generic Challenges
Recorded version available at http://lf1.me/Pxb/
7. • Large number of test cases
• API level test execution
• Verification of UI control
• Handset specific features
Technical Challenges
Recorded version available at http://lf1.me/Pxb/
8. • Reduced time to market
• First impression is the last
• Increasing cost of QA cycles
• High cost of onsite testing in target
networks
• Procurement of large number of devices
at multiple locations
Business Challenges
Recorded version available at http://lf1.me/Pxb/
9. Evolution of Test Automation
Approaches
9
Recorded version available at http://lf1.me/Pxb/
10. • Unit Testing Automation Frameworks
• XUnit family of tools
• JM Unit
• B Unit
• OC Unit
• CI integrations
Evolution of Test Automation
Recorded version available at http://lf1.me/Pxb/
11. • UI Testing Automation using Image
Comparison / OCR based tools
• Started with VnC based tools
• Basic Record and Playback support
• Scripting with manual creation of
Image Object mapping repo’s
• Hardware wired device docks
• Remote testing enabled
Evolution of Test Automation
Recorded version available at http://lf1.me/Pxb/
12. • Functional Testing Automation Tools
• Combination of unit test type scripts
with instruments
• Android - Robotium
• iOS instruments
• Code test scripts – no recording
• Test on USB or Wifi connected devices only
Evolution of Test Automation
Recorded version available at http://lf1.me/Pxb/
13. • Object Comparison based test tools
• Automated script generation – Record
Once, Play on multiple devices
• Test Library instrumented with test
build
• Execution on remote device for testing
• Generates desired environmental
conditions for recording
Evolution of Test Automation
13 Recorded version available at http://lf1.me/Pxb/
14. • Object Comparison based test tools
• Simulates required sensor data in
playback
• Provides ways to add assertions and
regressions
• Facilities mobile device cloud for
remote testing
Evolution of Test Automation
Recorded version available at http://lf1.me/Pxb/
15. Approach Comparison
15
Attribute Unit Test Image/OCR Instruments Object
Automatic Script Generation
Automatic code instrumentation N/R
Integration with CI
Record once execute on any device
No impact of UI position changes on
the test script
Test Scripts are independent of device
resolution/screen size
Asynchronous test execution on
multiple remote devices
Automatic UI verification with
functional test execution
Total Points 3/8 3.5/8 3/8 7/8
Not Supported
Partially
Supported
Dependency
No-dependency
LEGEND
S:
Supported
Recorded version available at http://lf1.me/Pxb/
16. • Combination of Object and Image
Comparison based tools
• Automatic UI verification along with
functional test execution
Moving Towards Hybrid
Recorded version available at http://lf1.me/Pxb/
17. • Enhanced hybrid approach
• Automatic system / UI object mapping
• Automatic transversal of app
What Next?
Recorded version available at http://lf1.me/Pxb/
18. • Enhanced hybrid approach
• Execution of functional test cases will
provide following without extra
scripting
• Seamless UI verification
• Automatic Security testing
• Automatic Random Interrupt testing
• Automatic app store compliance certification
What Next?
Recorded version available at http://lf1.me/Pxb/
49. mAutomate Differentiators
Build your own private device cloud for
testing across geographies
Record once, execute on multiple devices
Web based infrastructure for test case &
device suite management
Push based mechanism to execute test
cases on remote devices
Complete test execution reports, along with
resource usage numbers are made
available on the web
50. Visit www.mAutomate.com
Request access to free hosted version
OR
Buy license for in-premise deployment
Get Started with mAutomate
Recorded version available at http://lf1.me/Pxb/
Automated UI guidelines verification – scripts will be auto generated based on Platform specific UI guidelinesAutomatic app store compliance certificationAutomatic Random Interrupt Testing of appAutomatic transversal of app – automatic system/UI object mapping – on a reference device for generation of test cases and asynchronous execution on multiple devices across geographies
Automated UI guidelines verification – scripts will be auto generated based on Platform specific UI guidelinesAutomatic app store compliance certificationAutomatic Random Interrupt Testing of appAutomatic transversal of app – automatic system/UI object mapping – on a reference device for generation of test cases and asynchronous execution on multiple devices across geographies