Your mobile test plan can't be adhoc. Watch this webinar and learn how to start testing more methodically to provide test coverage that reflects your users and ensures a great digital experience.
We'll cover the most important insights from the latest issue of the Digital Mobile Test Coverage Index, including benchmarks, geographies and the latest devices and OS's that app developers and testers need to know.
3. A few housekeeping items
1. Submit
questions using the
Q&A panel.
2. Slides and
recording sent
after the webinar.
3. Please complete
survey after the
presentation.
6. Coverage Strategy is Fundamental
All-Around
For the Business itâs
market coverage
âą Great end user experience
âą Build requirement for IT
âą Optimize user engagement & rating
For the Dev/QA itâs
test coverage
âą Optimize process
âą Discover bugs early, mitigate risk
âą Continuously test on what matters
7. What does it take to cover the
REAL end user experience?
v
Device & Platform
Model
OS Version
Screen Size
browser
v
Environment
Location
Network
Phone events
Other apps
v
Conditions
Signal
Load
CPU
8. Device
Test Cases
iPhone 4
iPhone 4s
iPhone 5
iPhone 5s
iPhone 6
iPhone 6+
iPad Mini
iPad Mini
iPad Gen3
iPad Gen4
Samsung S4
Samsung S5
Samsung Note III
Android 2.4
Android 4.4
Improving Test Coverage Through Automation
Environment
While Driving
Cell Site handoff
GPS Locations
Under Load
4G
LTE
Wifi
Improve Overall Quality
- Run Test Automation as part of CI
- Run Parallel Unattended Tests
- Run Anytime & More Frequently
9. Test Coverage Optimization
Process
2. Lab Sizing
Teams Projects
SDLC
Cycle
Requirements
How many?
v
Me
Analytics
Market
My Space
Popular & emerging
1. Coverage Mix
Industry trends & insights
Which?
22. Mobile Market Calendar
Force Touch
Large screens trending
Samsung 18.4ââ, iPad Pro 12.9ââ
Growing customer demand
1st Tablet by Google, 10ââ,
Android 6.x
Submit questions using the Q&A panel.
We try to answer all questions during and after the presentation.
Our experts do not have access to the chat interface
Participate in the polls
Your participation is critical to a relevant, meaningful discussion.
Watch your email for a copy of the recording and slides
Todayâs presentation will be recorded and sent to you.
Complete the survey following the presentation
Your feedback helps us provide educational tools like this webinar.
User profile â Consider your end user real life experience
What should you do with this data? Combine it with your own data and guidelines
What should you do with this data? Combine it with your own data and guidelines
gil
In 2015 there were twice as many iOS releases than Android
There are specific months which are âbusierâ than others (e.g. April â post MWC, September â Apple product/platform releases) â testing/dev can prepare in advance and be ready
Technologies growing in 2015 involve more sensor based capabilities (Force touch, Finger print authentication, Mobile payments and smart watches)
Mix of new & emerging as well as legacy is critical in the lab â iPad 2 & iPad air account for 40% of the iPad market. iPad Pro as an exception is being required to be tested by Enterprises since it has new characteristics and might get adopted as a tablet replacement.
BB is still a relevant platform in Canada for both the old BB OS as well as the emerging BB on Android (Priv)
Apple and Samsung are as well clear leaders in this country.
R.I.P XP
Microsoft stopped supporting windows XP at the end of 2015
Both Chrome and FF stopped supporting XP around that time
R.I.P windows 8
On Jan 12th 2016 Microsoft stopped supporting windows 8
R.I.P old IE
On Jan 12th 2016 Microsoft stopped supporting IE<11
Go Windows 10
Microsoft has stopped supporting windows 7 and 8.1 on new hardware profiles
R.I.P XP
Microsoft stopped supporting windows XP at the end of 2015
Both Chrome and FF stopped supporting XP around that time
R.I.P windows 8
On Jan 12th 2016 Microsoft stopped supporting windows 8
R.I.P old IE
On Jan 12th 2016 Microsoft stopped supporting IE<11
Go Windows 10
Microsoft has stopped supporting windows 7 and 8.1 on new hardware profiles
Need a visualâŠ
FF 37 on Windows 10?
Submit questions using the Q&A panel.
We try to answer all questions during and after the presentation.
Our experts do not have access to the chat interface
Participate in the polls
Your participation is critical to a relevant, meaningful discussion.
Watch your email for a copy of the recording and slides
Todayâs presentation will be recorded and sent to you.
Complete the survey following the presentation
Your feedback helps us provide educational tools like this webinar.
1) Assign a team member who consolidates Index reports with business analytics and assure continuous coverage task is managed and maintained.
merging business requirements (which are often based on analytics) with Index report and market stats is a valuable to do item
2) CI & automation is key to continuous quality. Build the lab based on the right coverage and cross platform test automatically to assure no regressions introduced when lab is refreshed by new device, new OS version, new browser/desktop permutation
3) The index is a recommendation but it includes valuable platform characteristics such as recommended OSV, screen properties, legacy & new devices etc. - even if you decide to include additional devices or change the mix based on your analytics, please make sure to keep the various mix of the above properties to assure high quality across screens, platforms etc.
4) Though reference devices do not often tend to be that popular from a market share perspective (e.g. Nexus devices) - their importance to the test coverage does not come from their market share but from the frequent OS updates these devices receives - making them the 1st in the market to run on the latest Android OS. These devices are a must in any test lab in today's market
5) From a desktop and web perspective there is a clear auto update mechanism for leading web browsers (e.g. Chrome) where the end users are not even aware to. The fast adoption of these new platforms due to them being transparently updated, forces Dev/Test teams to continuously update their lab and test on early Beta/Dev versions of these browsers so they are ready to support them on Day 1