Best practices of building the mobile performance testing strategy, how it is important to use real device for mobile performance testing.

1. Mobile Performance Best Practices
Enabling Enterprise mobility
Extending Software Quality to Mobile
We will be starting momentarily
Perfectomobile Mobile Testing Center of Excellence Group

2. Webinar Agenda
1 2 3 4
• Intro • Mobile • Mobile • Q&A
Performance Performance
Intro Demo
• Mobile • Mobile
Performance Performance Case
building blocks Study

3. ∙ Founded 2006
∙ 80+ employees
Mobile Application Quality
across the mobile application lifecycle
∙ Office in Boston, London, Israel
∙ Over 600 customers Monitoring Testing Automation
∙ Fortune 500 enterprises,
ALM Continuous
Telcos, SMBs Integration
Offshoring
Integration
∙ SaaS Platform + Licenses Public Cloud Private Cloud
∙ Recurring revenue model

4. Solution - The MobileCloud™ Platform

5. Mobile Performance
Testing

6. Mobile Performance in the
application lifecycle
Performance
Automation
Functional
Production
Continuous
Delivery
Time

7. What is mobile performance
testing?
Measuring the mobile end user experience in real-world simulated
conditions
Servers will be loaded
Networks will experience performance issues
Devices will behave differently
Optimizing/troubleshooting the bottlenecks
Find & measure against a mobile-specific benchmark
Understanding the specific mobile bottlenecks. And optimize
• Caching
• Reduce network dependency & chatter
• Provide graceful fallback

8. Different devices will behave
differently when the server is loaded
(Delay, timeout,…)
Response time &
availability
Mobile KPI
Virtual Users

9. Different devices will behave
differently under network
conditions The mobile constraint:
Bandwidth CPU
Transaction
response time
Mobile KPI
Bandwidth
WiFi
3G
LTE

10. POLL

11. “Performance is the key to success”
“Efficiency of performance was identified as a focus for
mobile testing activity by almost two-thirds (64%) of firms”
“Mobile users expect robust performance and usability on the
move”
“Financial firms are the most acutely concerned about
application performance with 72% citing this as a priority. ”

12. 5 Key Requirements for Mobile
Performance Testing
Measure the mobile end user experience
Define and execute the metrics that users care about
Execute the test on a variety of devices
Execute the test on a variety of networks
Discover the impact of server load on mobile users
Measure the mobile experience while server load
Enable mobile performance testing on proven enterprise-
grade solutions

13. Performance testing- Mobile User Experience- How To
Network conditions Server load conditions
Measure user-facing KPIs Convert network sniffer (PCAP)
under network conditions file into emulated traffic load
Collect network sniffer file Conduct measurement from
real devices (while the service
Analyze network traffic
is under load)
View network optimization
recommendations Focus on real device
measurements

14. Mobile Performance
Demo

15. Mobile Performance
Best Practices
Ramesh Nagarajan
Sky IT Group

16. About Sky I.T. Group
About Sky I.T. Group Organization
• Established in 1997 • Seasoned Executive & Account Management Teams
• Headquartered in NYC, Office in: ATL, Raleigh, Boston, Baltimore, • HP Certified PS Delivery Teams
Ft. Lauderdale & San Jose • Leading provider of HP Software Solutions
• 60+ Employees • Largest/Authorized HP SW Training Partner
• Focus: Leverage Technology to solve Business Challenges • HP SW Certification Center
• Target Market – Mid-to-Large Enterprise
• HP Focus
• HP Software Reseller
• HP Solution Provider – Professional Services
• HP Education Provider
• Specialty Focus:
• Managed “Testing-as-a-Service”
• Mobility Testing CoE
• Service Delivery – Throughout the USA
Awards
• 2012 HP Software Spirit Award
• 2011 HP East Commercial Partner of the Quarter & Year
• 2010 HP Emerging Partner of the Year
• 2010 Arrow Partner of the Year
16

17. Importance of Mobile Performance
Testing
YOU YOUR COMPETITOR
Impact
Customer to your Loss of
dissatisfaction brand customers
The customer Loss of
goes to your revenue
competitor’s
mobile site

18. Impact of mobile on performance
500 Web Virtual Users 10 Mobile
against a web users
application – No Mobile introduced at
users until 26 minutes – 26 minutes
stable performance

19. Factors that impact Mobile
Performance
Mobile Mobile Type of
Number of Application
Devices carriers Connection
Mobile Design and Location
and their and their – 3G, 4G,
users Code
OS quality WiFi etc.,

20. Key Considerations for Mobile
Performance Testing
Capture,
Analyze and
Identify the
performance
bottlenecks
Identify the
right
combination
to emulate
Selection of Right
Mobile Automation
Tools

21. Selection of Right Mobile
Automation Tools
Scripting capability
Network emulation capability
Load testing capability
Analyzing capability

22. Right combinations to emulate
Know your end user profile
Identify the business processes
Identify the most important device and network
conditions combinations
Determine the expected load
Emulate production load mobile scenarios using
PCAP and real devices

23. Capture, Analyze and Identify the
performance bottlenecks
Monitor real devices power and performance
Utilize snapshots, video of test executions & logs
Correlate the metrics and identify bottlenecks
Analyze the impact of mobile users

24. Mobile Performance White paper
In this white paper, you will be able to gain insights
into the following mobile performance aspects:
Key building blocks for a mobile performance solution
Best practices and process to build a mobile performance
solution
Best practice solution design overview
LINK to download (Registration required):
http://help.perfectomobile.com/article/AA-01594/

25. Thank You!
If you have any further questions,
please contact:
Perfecto Mobile
info@perfectomobile.com
erank@perfectomobile.com
amirr@perfectomobile.com
rnagarajan@skyitgroup.com
Join us on LinkedIn
Mobile Testing Center of Excellence