Mobile Web Testing - Success Through Automation
•Als PPTX, PDF herunterladen•
2 gefällt mir•1,736 views
Learn About: best practices to leverage test automation to overcome the challenges of testing Websites on mobile devices With the growing penetration of HTML5 , mobile web is being seen as the future of mobile applications. However, developing or expanding your mobile web solutions can be challenging due to rapid changes in technology; diversity of the device environment; variations in platforms, hardware, networks and form factors that can affect performance, compatibility and usability; attaining a secure mobile Web experience; and certifications and app store approvals. In this live Webinar, Sivakumar Anna, InfoStretch Director of Enterprise Services, will present a comprehensive overview of the Web mobility landscape and testing systems, and best practices to leverage test automation to overcome the challenges of testing Websites on mobile devices. Siva’s presentation will include: 1. Diversity of the mobile device environment including mobile phones, smartphones and iPads, and how to identify your device list for target customer base. 2. Managing the challenges of hardware configurations, networks, carriers and platforms. 3. How to build a framework to conceptualize, automate and regress hundreds of test cases on mobile devices without requiring a significant investment in device acquisition. 4. Managing usability in the event of exceptions or interrupts, and how to handle unknowns for connected applications due to carrier restrictions. 5. Demonstration of a framework for automating mobile Web testing using commercial and/or open source tools.
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
Empfohlen
Empfohlen (20)
Mobile Web Testing - Success Through Automation
- 1. InfoStretch Webinar Mobile Web Testing: Success Through Automation By: Sivakumar Anna Wed. June 29, 2011 All trademarks are the property of their respective owners.©2004-2010 InfoStretch Corporation. All rights reserved.
- 2. Agenda 1. InfoStretch Overview 2. Enterprise Mobile Web Landscape 3. Enterprise Mobile Web Testing 4. Mobile Web Automation Demo INFOSTRETCH CORP CONTACT INFORMATION (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
- 3. 1 About InfoStretch Elevating Confidence INFOSTRETCH CORPORATION (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
- 6. Industry Expertise in Finance, Retail, Mobile and Healthcare
- 7. Strong Project Mgmt. team
- 8. Extensive Platform Compatibility and Performance Test Labs
- 9. 2000+ Mobile Handset Test Lab
- 11. High Availability and 24 hours secure offshore centers with
- 13. HQ in Silicon Valley
- 14. Offices in New York, Seattle
- 15. 105+ Clients and 160+ Projects
- 16. Well Established Recruitment, retention and training programs Market Mover for Software Testing Awarded Inc 500/5000 company of the year 2010 Key Partners Recognitions Tot 20 QA Services Provider INFOSTRETCH CORPORATE (p) (408) 727-1100 | (w) ww.infostretch.com | (e) info@infostretch.com | Presenter: Rutesh Shah ©2004-2011 InfoStretch Corporation. All rights reserved.
- 17. 2 Enterprise Mobile Web INFOSTRETCH CORP CONTACT INFORMATION (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
- 18. Global Mobile Data 2 Billion internet users worldwide 40 Percent Smartphone US Population 4 Years Mobile internet users will over take desktop internet users 100+ Countries With more than 10 millioninternet requests4 50 Percent 120 Billion Mobile Payment by 2014 Mobile E-Commerce Market by 2015 INFOSTRETCH CORPORATION (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
- 19. Mobile Web Growth INFOSTRETCH CORPORATION (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
- 21. Retail Services
- 22. CRM ServicesINFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
- 25. Leverage Standards and TechnologiesINFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
- 26. 3 Enterprise Mobile Web Testing Models INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 27. The difference New Presentation Channel Fully working backend exists Testing Challenges Knowledgebase available Reduced Time to Market Generating device specific traffic Single set of scripts across multiple devices / platforms INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 28. The difference Channel Integration Information Sync across different channels Alerts and Notifications Testing Challenges Features dependent on multiple channels Co-ordination with other channels Setting up environment Validation on multiple systems INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 29. How to test? 70% 1. Simulators / Emulators 20% 2. On Real Devices using Remote Access Services 10% 3. On Real Devices INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 30. Mobile Web Test approach INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 31. What is Simulator testing? Simulators - Software that duplicates the mobile internet traffic Generate browser request by sending device specific HTTP Header details Vendors provide platform specific simulators / emulators Browser plug-ins available to generate the HTTP traffic INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 32. Conceptual diagram of enterprise architecture Mobile Web Presentation Layer Web Presentation Layer Web Presentation Layer Application Layer Database Layer INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 33. Benefits of Mobile Simulators Testing High Return on Investment Test at early stages of dev cycle Ability to do end-to-end automation Leverage existing infrastructure Over-the-air (OTA) is possible INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 34. Limitations of Mobile Simulators Testing Can’t do peripheral connectivity testing Not possible to perform any carrier imposed restrictions Cannot test the device interruptions INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 35. Mobile Website Samples - simulated Mcdonalds.com INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 36. Mobile Website Samples - simulated Cars.com INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 37. Automation Architecture (Deployment) Browser 2 Application Under Test 5 3 4 1. Update proxy with device configuration Web Proxy 2. Automation tool invokes test step 1 3. Browser Intercepts HTTP Request 4. Proxy Massages HTTP Request with Device Header Information Automation Lab 5. AUT assumes the request came from Mobile Device INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 38. 4 Mobile Web Automation Demo INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 39. Device Execution Summary Report INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 40. Device Execution Summary Report INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 41. Mobile Web Automation - Remote Devices INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 43. Provide Automation Implementation and Training
- 44. Provide device inventory based on the customer needINFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
- 45. Test Case Automation Architecture Browser Open Browser Go To Sign On Make Payment Confirm Payment Sign Off Text Verify QTP / Web IDE Make Payment Test case Sync Text Browser Open Image Select Schedule Payment Sync Text Quick Links Nick Name Text Select Send SMS Make Call ZIP ATM Search Sign On Make Payment Confirm Payment Perfecto Library Virtual Function Library iOS Android HTC Aria Android HTC Droid BB Torch LG CU620 LG VX9000 BB 8520 Device Implementations for Sign On (10+) Devices Virtual Functions QTP Testcases Device Implementations
- 46. Demo – Real Device using Perfecto Mobile INFOSTRETCH CORPORATION WEBINAR (p) (408) 727-1100 | (w) www.infostretch.com (e) info@infostretch.com | presenter: Sivakumar Anna
- 47. Any questions? INFOSTRETCH CORPORATION (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
- 48. Website: www.infostretch.com Ahmedabad 5th Floor , Regency Plaza, Anand Nagar, Ahmedabad-15, Gujarat, India 91-79-40266266 Mumbai Vashi InfoTech Park ,B103,Tower # 1, Vashi Rail Station, New Mumbai, Maharashtra, India 91-22-6947900 New York 17 Tanglewood Rd, Scarsdale, NY 10583 (703) 395-9791 Seattle 2550 3rd Ave, #712 Seattle, WA 98121 (206) 402-2426 Headquarters 2880 Lakeside Drive, #200 Santa Clara, CA 95054 (408) 727 1100 Partners INFOSTRETCH CORPORATION (p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna
Hinweis der Redaktion
- Here is the agenda for today’s presentationTo start with I will give an overview of the mobile web – more from enterprise perspective. I will be talking about how enterprises are looking at the mobile channel, what are the possible strategic solutions available and briefly talk about WHY mobile web is the RIGHT way for enterprise companiesFollowing to that I will focus my discussion on mobile web testing – Here I will be talking about what should be the testing strategy and discuss on the benefits / limitation of those options. I will also share some the tools and technologies that would allow you to implement the automation strategy to achieve the maximum benefits.After that I will show a demo video of the sample implementation – where you can see the results and give you an idea of how this can be effectively implemented in your work environmentI will conclude the presentation with giving my thoughts on the enterprise mobile – where we are today, what are some of the hurdles and in future what kind of role the mobile will play in the enterprise sector
- 92 Countries - Based on the recent Admob Metrics report, there were 92 countries with more than 10 million – that increment is from 27 countries in 2008.1.9 Billion – According to the global internet usage report, the total number of internet users today worldwide3.4 Billion – The number of the mobile phone subscribers today across the globe – that number to increase to 4.5 by the year 201231% - Out of 308 million US population, 31% of the users are using smartphones. As per the CTIA 2009 Annual report (http://www.ctia.org/media/industry_info/index.cfm/AID/10323), wireless penetration is at 91% in US alone5 Years – In the next 5 years, the mobile internet users will surpass the desktop internet users based on a report from Morgan stanely. (http://gigaom.com/2010/04/12/mary-meeker-mobile-internet-will-soon-overtake-fixed-internet)Though these numbers are very interesting …http://internetworldstats.com/stats.htm
- What is more exciting is the fact that today 1/3 of the internet users globally access internet via the mobile devices. And this is expected to grow very rapidly in the next few years and more than half the users will be enjoying the internet using the handheld devices.
- The other option is to write a mobile version of the appsThat means all you have to do is writing a new presentation layer with the already existing business implementation .. Avoid the cost overhead in building multiple version of the applications and maintenance and support of the same applications on various platformsImplementing the mobile web based solutions will also help in pushing the features more faster to the communities and quickly fix the production issues
- The other option is to write a mobile version of the appsThat means all you have to do is writing a new presentation layer with the already existing business implementation .. Avoid the cost overhead in building multiple version of the applications and maintenance and support of the same applications on various platformsImplementing the mobile web based solutions will also help in pushing the features more faster to the communities and quickly fix the production issues
- With knowing how valuable for the enterprises to have mobile web based solutions for the mobile strategy, lets look at the testing options we have for that kind of applications.
- But before going into that, I want to highlight couple of points. What makes the mobile web different from a typical web based applicationPresentation Channel – Mobile Web is another presentation channel with lot of UI specific biz logic implemented from the ground up. It is not something like you tweak here and there on the existing web front end and make it available for mobile devices – you can do that but it is not going to be effective and user friendlyThough the UI representation is different, everything else from the middle tier to backend infrastructure is going to be the same – for which you might have already testing strategy available for most of the services. You already have resources, supporting tools and technologies, users with domain knowledge exist already which you should be able to re-use the maximum benefitWhat are the testing challenges, you have to make the testing strategy for mobile web fit into the existing strategy. You may not have liberty to pick and choose how you want to implement the testing strategy. You have to build your strategy surrounding to the existing ones.Generating device specific traffic – Because the mobile web is about serving the mobile customers, you should be able to test the mobile web by generating the traffic with various type of device profiles. Smartphones, non-smartphones, JavaScript enabled / disabled, with CSS properties, HTTP / HTTPs etcAnd most the challenging one is how to achieve an automation implementation by defining one scripts and running with all the necessary device variations
- Another difference:Channel Integration- Because mobile web is another channel, most of the times, the transactions are inter related. Eg: if a mobile customer is doing an account transfer, the balance needs to be reflected / updated immediately on the online channel and send the customer an alert if the bill-payment is going to denied Also for some of the high-value transactions, still, the customer need to go and verify and authenticate to make the transactions completeAlerts and Notifications needs to be raised and delivered to across all the channels based on the exception conditions defined by the business rulesThe testing challenge here is to have a QA environment that would allow to access and exercise the transactions across multiple channels. To test the exception conditions, it is important that to have access to the backend systems to simulate conditions.
- There are three different categories by which you can achieve your mobile test strategy ..First one is using simulators / emulators – This is most economical solution for having a test coverage across various device combinations and also it has other key benefits which I will talk in the next slidesThe focus of the testing will be more on validating the business functionalities and business rules.Secondly the remote testing capabilities of the devices. There are few of our partners providing this service by you can access the devices of your business need and test the various functionalities per your testing need.You will be focusing your testing on UI interface, device specific interfaces etc. The last one option you have for your mobile testing is actual physical devices .. You will still need to do it for a limited set of test cases.
- This table shows the various type of testing and what is possible and what not for each of the testing approach ..As you can see, pretty much you can do all of your testing with simulators – what you cannot do with this approach are the Security Testing and Usability Testing and Synchronization testing (Battery low condition, Incoming Call, Alert from other apps, etc)Our focus will be on the first approach for our today’s presentation
- At a high level, lets look at what is this approach means ..Simulators – This basically means that with the aid of the available software, you duplicate the mobile handset internet access. Emulators – This is a software / hardware based solution that will behave very similar to the mobile device. The emulators also will have some internal knowledge on how the system will behave, let say, when an incoming call comes, when you are editing a document on the deviceWith both the approach, the internet traffic is generated by modifying the HTTP headers with device specific profiles – The key header element that you have to know is the User Agent – this one is almost unique for each mobile deviceWhat are the examples:There are tools from each of the platform providers – like iPhone, Android, Blackberry, Windows Mobile etc – almost all they platforms provide the emulatorsThere are also Browser Plug-ins that will allow you to change the HTTP Header – this is what will be covering in our demo todayAnd also there is a nice product from Keynote called MITE - that allows you to define and run scripts across the mobile devices with in the MITE product
- What is our testing boundary? Where do we test from? [click]You have basically several layers of back end appDatabase layer, app layer, Web Presentation layer [click] and it is accessed by online customers via internet using browsers[click]With the introduction of the mobile web, there will be another presentation layer catering to the mobile users [click]And our testing focus will be this ..
- What are the benefitsROI is high – one reason being the investment itself very low - [click]You can do start doing your testing at the early stages of the dev cycle and also you can integrate with your build cycle. Because it is easier to recreate the setup, helpful to do analysis on issues, become easier [click]You can start doing performing your end-to-end cycle testing in an agile environment [click]You will be able to leverage the existing infrastructure – Lab, Tools and Technologies and Resources experienced on the domain, OTA testing is possible
- Limited simulation capabilities for device specific features – like Camera, Voice InteractionYou will not be able to verify the carrier based restrictions (data usage, roaming usage, etc)Simulating the device specific conditions are another set of things that you will not be able to test it out like Power Switch off, Incoming Calls, Low Battery condition
- Here is a look at the deployment architecture for test automation for mobile webYou have Automation lab – can be QTP, Selenium, SilkTest, Sahi etc [click]You have browsers of your choice – automation tool interacts with browser [click]Browsers in-turn send request to the AUT via web proxy ..The execution process looks something like this: [click]First, the automation tool setups the proxy with the necessary device header [click]Then Automation sends the test steps to browser [click] and web proxy intercepts the request and changes the header with the device profile [click]And AUT assumes that the request came of the specific device and sends the response accordingly . [click]
- The other option is to write a mobile version of the appsThat means all you have to do is writing a new presentation layer with the already existing business implementation .. Avoid the cost overhead in building multiple version of the applications and maintenance and support of the same applications on various platformsImplementing the mobile web based solutions will also help in pushing the features more faster to the communities and quickly fix the production issues