Streamlining QA process for Mobile Apps: Strategies and Technologies
•Als PPT, PDF herunterladen•
0 gefällt mir•904 views
Presented at Canterbury Software Cluster Meetup Nov 2014. Testing mobile apps is a time consuming exercise – it is tedious to switch between devices and defect tracker and to capture screens and steps to recreate defects. Plus, the quality of mobile apps is more than just functional testing – it includes ensuring usability of the mobile application. How do we simplify this entire process of ensuring quality of your mobile application? Alan Kan will take you through common issues from mobile QA teams, and IBM’s latest technologies to streamline the mobile QA process.
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Mehr von Alan Kan
Mehr von Alan Kan (10)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
Streamlining QA process for Mobile Apps: Strategies and Technologies
- 1. © 2014 IBM Corporation Streamlining QA process for Mobile Apps: Strategies and Technologies Continuously deliver high quality mobile app Alan Kan alankan@nz1.ibm.com @alankannet
- 2. © 2014 IBM Corporation2 #IBMMobile Mobile?
- 3. © 2014 IBM Corporation3 #IBMMobile Mobile? Challenges to assure quality?
- 4. © 2014 IBM Corporation4 #IBMMobile So many combinations, so little time
- 5. © 2014 IBM Corporation5 #IBMMobile Slow manual process to log a defect for an app
- 6. © 2014 IBM Corporation6 #IBMMobile Integrations not available delays testing Web Services integration Mainframe integration 3rd party integration Database integration Front-end app
- 7. © 2014 IBM Corporation7 #IBMMobile Performance testing sometimes skipped
- 8. © 2014 IBM Corporation8 #IBMMobile Do not receive end users feedback in time (or at all)
- 9. © 2014 IBM Corporation9 #IBMMobile Some common ways of mobile apps QA leading to these issues Manual testing of mobile apps Separate automation tools for testing different OS/configurations Use a PC based defect tracker When integration not available, delay test, or write stubs manually No perf test tool or no reuse Difficult for users to submit feedback or feedback is not monitored/analysed
- 10. © 2014 IBM Corporation10 #IBMMobile Strategies and Technologies
- 11. © 2014 IBM Corporation11 #IBMMobile Mobile Test Automation across Platforms Mobile Test Automation Capture and Playback including multi-touch events Object recognition Visual Test Editing Cross platform • Web tests run across mobile devices and desktop • Support native and hybrid apps on Android and iOS Mobile performance: Reuse functional tests for performance testing Monitor device resource utilisation counters for Android and iOS Capture response time measurements for Android applications End to end mobile testing Testing of middle-tier and back-end services Performance testing of integration infrastructure
- 12. © 2014 IBM Corporation12 #IBMMobile IBM Rational Test Workbench Recording Playback Authoring Reporting
- 13. © 2014 IBM Corporation13 #IBMMobile Deliver feedback from test to development Testers send bug reports from “in app” Apps report their own crashes, and send logs Developers diagnose and fix context rich bugs / crashes Owners prioritize and direct resolution of bugs / crashes Dev Owner User Test Crashes Bugreports Logging Enables testers to submit bug reports directly from their phone In-app bug reporting
- 14. © 2014 IBM Corporation14 #IBMMobile Build user feedback into the app and analyse feedback quickly Deliver feedback from users to development Users send feedback “in app” Apps report their own crashes, and send logs Owners assess feedback and direct development Developers diagnose and fix crashes Dev Owner User Test Crashes Feedback reports Logging Enables developers to connect with users
- 15. © 2014 IBM Corporation15 #IBMMobile Tester End UsersDeveloper Over the air build distribution1 In app bug reporting2 Crash log reporting 4 In app user feedback3 LOB/Digital Marketer User Sentiment5 Builds User Feedback Crash logs Bugs Bugs vs. Crashes IBM MobileFirst Quality Assurance
- 16. © 2014 IBM Corporation16 #IBMMobile Simulate the mobile middle tier and back office systems Reuse integration tests to verify scalability of middleware and services infrastructure Virtualise app services to enable continuous testing and reduce application integration risk Test mobile and non-mobile components of your infrastructure using same intuitive environment Continuous testing through Service Virtualization IBM Rational Test Virtualization Server Client Tier Middle Tier Backend Data and Services Virtual component or service
- 17. © 2014 IBM Corporation17 #IBMMobile Alan Kan alankan@nz1.ibm.com @alankannet Streamline mobile app QA process with • Cross Platform mobile test automation • In-app bug reporting and sentiment analysis • Service virtualisation
Hinweis der Redaktion
- 0a. How many tests mobile apps? 0b. What are your pain points?
- 0a. How many tests mobile apps? 0b. What are your pain points?
- Automation – cross browser types and devices Pick a perf test tool that allows you to reuse your automation script In app bug reporting and crash logging Service virtualisation Build user feedback into the app and analyse feedback quickly
- IBM MobileFirst Quality Assurance services provides the answer for all of these concerns. MobileFirst Quality Assurance includes two components – some code that is included in your mobile app, and a service that receives the user feedback and context so that it can perform advanced analytics on it. (1) Using the “over the air” app distribution capability of MQA, your developers can distribute new builds of the app to a targeted set of testers. And testers can quickly acquire exactly the right version of the app to be tested without having to use anything other than their mobile device attached to the network. (2&4) The MQA SDK component allows testers to capture and quickly send bug reports containing deep technical context of the app – including details of the device on which the app was running at the time that the bug occurred. Crash context is capture automatically also. (3) End users of your app in production can enjoy the same ability to effortlessly send your team feedback that includes important contextual information. And crashes in production are captured & recorded. (5) When your users write reviews of your app in the public app store, MQA captures those comments and analyzes the sentiment expressed based on over 140 different “signals” contained in the review. This allows your app owner to understand the aggregate perception of your app as expressed by the review comments, and to guide the development team regarding what enhancements to the app should be the highest priority. MQA is available as a service on the public internet and is also available as a private on-premise software solution
- Continuous Testing is just as important to mobile development teams as building the apps. Does the app work as expected? How does it perform on the large spectrum of devices and form factors? Will it work properly on Android and iOS? Agile mobile teams need to answer these questions across the fragmented set of device/OS combinations to deliver quality mobile apps. Released in June, IBM Rational Test Workbench mobile app functional testing capabilities provide development teams with automated testing of Android and iOS native, hybrid and mobile-web apps. Tests can be recorded on an actual device or simulator, edited and enhanced through a powerful natural language interface, and then played back on devices of different form factors, orientations and operating systems, even devices running in device-clouds. Results are then immediately available to developers to act upon and improve the mobile app.