The Essentials of Mobile App Performance Testing and Monitoring
•Als PPTX, PDF herunterladen•
4 gefällt mir•3,696 views
Complexity across mobile carriers, locations and operating systems has made building mobile apps and monitoring their end user performance time consuming and expensive. The importance of testing mobile apps on iOS, Android and Windows Phone is increasing as more users embrace these devices. Join Correlsense and uTest for an online seminar which will teach you the steps to successful mobile application testing and performance management. We will discuss: - The proliferation of mobile devices and the technical challenges they bring to end user experience monitoring - Ways to prepare mobile applications for peak usage periods with the right load and performance testing techniques - Tips and techniques for gaining visibility into the performance of mobile applications with the right monitoring tools We will conclude with a discussion of the Correlsense and uTest solutions.
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (19)
Andere mochten auch
Andere mochten auch (14)
Ähnlich wie The Essentials of Mobile App Performance Testing and Monitoring
Ähnlich wie The Essentials of Mobile App Performance Testing and Monitoring (20)
Mehr von Correlsense
Mehr von Correlsense (13)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
The Essentials of Mobile App Performance Testing and Monitoring
- 1. The Essentials of Mobile App Performance Testing and Monitoring April 26, 2012
- 2. Agenda 1. The Mobile Web Today 2. Mobile Performance Testing 3. Mobile App Monitoring 4. Summary/Q&A
- 3. Housekeeping • Presentation will last 30 minutes • Submit questions via the chat window • Slides will be made available tomorrow
- 4. Featured Speakers Stanton Champion Product Marketing Manager uTest Frank Days VP, Marketing Correlsense
- 5. THE MOBILE WEB TODAY…
- 6. 1.2 billion mobile web users world wide -IDG Feb 2012
- 7. 74% of users will bounce after waiting 5 seconds for a mobile site to load
- 8. Gartner predicts that by 2014, 90% of all corporations will support applications on personal devices – Feb 2012
- 9. Mobile’s Just Getting Started 2.5 Tablets 2.0 Units $MM 1.5 1.0 Smartphones 0.5 Personal Computers 2000 Year 2016
- 10. So Lo Mo Social Local Mobile
- 11. Test Coverage Web Testing Matrix Is Tough Features OS & Browser
- 12. Test Coverage Mobile Testing Matrix Is Insane Features Handset Makers OS & Browser & Models
- 13. Test Coverage Mobile Testing Matrix Is Insane Features Wireless Handset Makers Carriers OS & Browser & Models
- 14. Test Coverage Mobile Testing Matrix Is Insane Features Location Wireless Handset Makers Carriers OS & Browser & Models
- 15. Increasingly Complex Testing • The laughably simplistic notion of a “test matrix”
- 16. Not Just Testing, but More Complex Monitoring from Test to Production Wider range of devices are connected to a more complex IT world
- 17. Both Are Needed to Improve End User Experience • Opportunities • Challenges – Mobile technologies to – Complaints performance Improve Productivity – No visibility into mobile app – For “mobile workforce” transactions – Real-time data access – Limited/no load testing prior to mobile rollout • Examples: – Huge headache for CIO – CRM – Order entry – ERP
- 18. ESSENTIALS FOR PERFORMANCE TESTING
- 19. Lab-Based Testing Innovation Manual vs. Automation Managing vs. Leading Teams In-House vs. Outsourced Agile vs. Waterfall Exploratory vs. Testers vs. Test Cases Engineers Offshore vs. Nearshore
- 20. Users Work & Live 'In The Wild' I n The Wi l
- 21. Look Beyond The Lab • Recognize it will never again be sufficient on its own • Build your company’s plan for testing ‘In The Wild’ – Real-world conditions: Live testers, real devices, imperfect connectivity – Mirror your user base • Technologically: OS, browser, anti-virus, device, carrier • Geographically: Continent, country, city, language • Demographically: Age, gender, education, employment, industry
- 22. Your Connection to the Cloud
- 23. Your Automated Load Testing Tool’s Connection to the Cloud
- 24. Your Users’ Connections to the Cloud
- 25. Testing 'In The Wild' Finds New Bottlenecks • Different users have different connection pathways – Mobile towers – Network providers – Backbone connections – Content Delivery Networks – DNS providers • Above can add latency, making the user’s experience worse 'In The Wild' testing helps you identity down-stream network problems that you can’t find in the lab
- 26. Smarter Load Testing With Experts • People don't load test often, few are experts • Professional testers are valuable • Technical understanding improves perception of problems and root causes • When testing 'In The Wild', need professionals with skills and experience
- 27. Coupled with end-to-end monitoring • You need smart, adaptable monitoring that can work in the wild and inside your data center
- 28. ESSENTIALS FOR MOBILE APP MONITORING
- 29. 1. Be Strategic You need measurable SLAs To tie mobile strategy to biz goals
- 30. 2. Be Transparent Keep biz stakeholders in the loop and ensure SLA data is accessible
- 31. 3. Be Paranoid
- 32. Watch Every Transaction for Every User SERVER WEB APP SVR PROXY MQ/ESB LDAP CORBA DCOM Web Services Datacenter
- 33. Track Key User Experience Metrics Mobile Total End-User Response Time Browser Rendering Time Datacenter Time Network Latency Mobile Real User Monitoring Rendering
- 34. 4. Be Smart - Understand what is happening across the Space-Time continuum
- 35. Look Across Time
- 37. Know When There is a Problem
- 38. Summary • Mobile web is complex • When testing mobile • New testing and monitoring – Test outside the lab tools are needed – 'In The Wild' • End user experiences are still – Use professionals critical • When monitoring mobile – Be strategic – Be transparent – Be paranoid – Be smart
- 39. Questions Contact uTest: Contact Correlsense: http://www.utest.com/ www.correlsense.com/demo Phone: www.real-user-monitoring.com 1-800-445-3914 info@correlsense.com Follow us: Follow us: twitter.com/uTest twitter.com/correlsense facebook.com/uTest facebook.com/correlsense Contact Us At Get your free copy http://www.utest.com/contact- GET STARTED SharePath RUM! customers TODAY! http://www.real-user-monitoring.com/
Hinweis der Redaktion
- Dan
- Don’t read slide. Summarize
- When you are thinking about best practices in mobile performance monitoring, you have to think strategically about your overall business goals and objectives. With that in mind, the first thing you should do is identify all the stakeholders which are driving your mobile strategy and discuss the overall goals of your mobile plan.Next, you will have to construct or modify an SLA which is clear to both parties. Make sure all the details are understood and agreed upon by your customers. You must be able to have definitive metrics, and ensure the SLA can be monitored. Without a measureable SLA, you are essentially leaving your customer in the dark, with know way to manage their expectations. Obviously, this is quite frustrating to them and will most likely cause them to never return.
- Being open with your stakeholders is crucial to creating a good customer experience. Also, you will want to keep your fellow IT team members in the loop with what is going on. Ensure the SLA date is readily available to all stakeholders, you don’t want to keep customers or colleagues in the dark. Before implementing the SLA make sure to: develop tracking mechanisms, establish reporting processes, develop procedures for carrying out stated responsibilities, communicate expectations to staff, and provide pertinent training. After the SLA is established: provide a point of contact for problems related to the agreement, maintain an ongoing contact with the other party, conduct service reviews, coordinate and implement modifications to the SLA when needed, and assess and reporting on how the two parties can further enhance their working relationship.A things not to do with SLAs:Sometimes service providers sometimes want to create an SLA to suppress customer complaints;Don't do this! It backfires most of the time! This just gives them something else to complain about!As strange as it may sound, most SLAs are initiated and unilaterally established by service providers. The customer is given little or no say about either the content of the SLA or the process by which it is established or managed. Obviously this leads to unhappy customers. Make sure the customer is engaged and understands the SLA. Remember, be open!
- But why is this infrastructure in place? It is to host Applications that are required to support the Business.And the Transactions that flow through these applications are what allow the Business to be a Success.The founders of SharePath realized that by managing these Transactions is the most important thing because they are the lifeblood of the company.These transactions can be simple client Server transactions from Thick Clients talking to Databases <click>To more complex legacy Client Server transactions that connect multiple Back-End systems <click>To Web Transactions that now allow end-users to directly interact with your business systems and issue their own transactions.<click>And now these Web Technologies allow internal applications to be built to run the business.The point is that in this Complex, Heterogenous technology architecture, the key thing to monitor is the Transactions of all types that flow through these systems.<click
- What Is A Transaction?Request issued by an end-userGoes through multiple componentsEach component may be activated multiple timesNote that:Different transaction types take different paths and flowsSometimes instances of the same transaction type execute across different flows