Make your Appium scripts enterprise-grade with the Continuous Quality Lab™
Appium makes automated testing easy, but until now, Dev teams using Appium faced challenges efficiently scaling, controlling test devices, and recreating real end-user conditions.
Now, you can extend your Appium scripts to turbocharge app testing with Perfecto Mobile’s Continuous Quality Lab™.
1. Getting More Out of Appium
With an Enterprise Grade Level
August 4, 2015
2. Today’s Presenters
Proprietary & Confidential
Roy Nuriel
Director, Product Manager
Perfecto Mobile
royn@perfectomobile.com
Hadas Shani
Product Owner
Perfecto Mobile
hadass@perfectomobile.com
3. 4 Things to do during this webinar
Submit
questions using
the Q&A panel.
Participate in
the polls
Watch your
email for a copy
of the recording
and slides
Complete the
survey
following the
presentation
5. Introducing Perfecto Mobile
Dominant leader &
visionary
Strong
Ecosystem
Customers
Partnering with Enterprises to create better
mobile apps faster with continuous quality
“Perfecto Mobile marks shift in mobile
apps QA with Continuous Quality Lab”
Proprietary & Confidential 5
Setting the bar for
market success
7. Quality
Velocity
• Release frequently
• Drive fast feedback loop
• Automation coverage
• Lab is not a 24/7 operation
• Multiple environments scenarios
• Quality bars are higher
• Complex lab setup
Need Challenge Pain
The Digital Experience Challenges
All env. Scenarios
Unattended
Automation
Simple to manage
Reliable
Secure
Continuous Quality
Lab in the Cloud
8. What is Appium?
Appium is an open source test automation
framework for use with native, hybrid and mobile
web apps. It drives iOS and Android apps using
the WebDriver protocol.
10. We Make Open Source, Enterprise Grade
Mobile Cloud Platform
Environment Capabilities
Automation
Selenium or Appium
IDEIDE
Enterprise
Grade
Lab
Zero test code changes
Selenium or Appium
11. Perfecto Mobile for Appium
Automation
Real User Env Capabilities
Enterprise Grade Service
MAKING
OPEN-SOURCE
ENTERPRISE
READY
12. Perfecto Mobile for Appium
Real User Env Capabilities
Enterprise Grade Service
System
Level
Control
Parallel
& Cross
Platform
OCR &
Image
Object
Recognition
Rich
ReportsAutomation
13. Perfecto Mobile for Appium
Automation
Enterprise Grade Service
Real user
environment
GPS
Injection
Network
Virtualizatio
n
Single User
Performanc
e
Hybrid Cloud
Global
Coverage
14. Perfecto Mobile for Appium
Automation
Real User Env Capabilities
Enterprise
Security
24X7
Support
Scale &
Flexible
Roles &
Permission
s
Enterprise
Grade
15. Perfecto Mobile for Appium
Open
Source
iOS &
Android
Native
Object
Recognition
CI Support
Automation
Real user
environment
Enterprise
Grade
System
Level
Control
Parallel
& Cross
Platform
OCR &
Image
Object
Recognition
Rich
Reports
GPS
Injection
Network
Virtualizatio
n
Single User
Performanc
e
Hybrid Cloud
Global
Coverage
Enterprise
Security
24X7
Support
Scale &
Flexible
Roles &
Permission
s
MAKING
OPEN-SOURCE
ENTERPRISE
READY
16. “Of the many companies offering the mobile testing service,
we have found that Perfecto Mobile provides us with the
best support.
The Appium framework for both iOS and Android aligns
with our acceptance test driven development goals and
allows for the most flexibility with manual and automated
testing.”
Mahshadul Alam, Manager,
Master Software Engineer at Capital One
22. Quality - Users Expectations are High, Feedback is Public
“Poor app quality is the primary reason
behind the weak adoption, usage and
even failure of many mobile apps.”
[ Gartner, Sep 2014 ]
Starbucks App Store
Reviews
Proprietary & Confidential 23
23. Mobile Is Diverse, Complex & Dynamic
24Proprietary & Confidential
20132012201120102009
Windows
8
Oct 2012
Windows
7
Oct 2009
Froyo
May 2010
Cupcake
Apr 2009
iOS 6
Sep 2012
iOS 5.1
Mar 2012
iOS 5.0
Oct 2011
iOS 4.3
Mar 2011
iOS 4.2
Nov 2010
iOS 3.1
Sep 2009
iOS 3.0
Jun 2009
iOS
6.0.1
Nov201
2 iOS 6.1
Jan 2013
iOS 6.1.3
Ma2013
Jelly Bean
Jelly
Bean
June
2012
Jelly Bean
Jelly BeanJelly
Bean
ICS
ICS
Oct 2011
ICS
ICS
ICS
Gingerbread
Gingerbread
Gingerbread
Gingerbread
Donut
Sep 2009
Eclair
Oct 2009 Gingerbread
Dec 2010
iOS 4.1
Sep 2010
iOS 4.0
Jun 2010
iOS 3.2
Apr 2010
24. Velocity – Without Compromising on Quality
2010
4 per year
2015
36 per year
Typical app releases per
year
IDC
Proprietary & Confidential 25
Code Test Deploy Production
Defect Reporting
Defect < Incidents
±4-6 months delivery cycle
“Traditional Development
Practices Will Fail for Mobile
Apps”
[ Gartner April 2014 ]
±4 weeks delivery
cycle
The Desired Mobile SDLC with Continuous
Quality
Hinweis der Redaktion
Submit questions using the Q&A panel.
We try to answer all questions during and after the presentation.
Our experts do not have access to the chat interface
Participate in the polls
Your participation is critical to a relevant, meaningful discussion.
Watch your email for a copy of the recording and slides
Today’s presentation will be recorded and sent to you.
Complete the survey following the presentation
Your feedback helps us provide educational tools like this webinar.
Perfecto Mobile offers a Cloud Based Continuous Quality Lab
enabling application testing and monitoring on real devices in real end user conditions,
for enterprises adopting agile delivery processes
No experience
Just starting
3-6 months
1 year
More than 1 year
Scale & Setup
Cross platform automation
Parallel execution
Interact with the device context
Simulate real end user environment
SLIDE OBJECTIVE: Experts agree … getting it right is challenging. Realigning and extending existing systems and processes is non-trivial.
Starbucks has earned the distinction for its mobile payments execution driving ~12% of revenue via mobile and delivering a differentiated experience to it most ardent fans. But they are not immune to high profile UX and outage challenges .
WatchESPN video-streaming service frustrated many of its users by crashing during this high profile 2014 USA v Germany World Cupmatch. Sadly this in truth was likely not caused by ESPN but by a third p arty service handling the authentication process to verify a user’s pay-TV subscription. Regardless, die-hard fans simply got mad, tweeted and then found alternative streaming sites to watch the game. http://variety.com/2014/digital/news/espn-video-streaming-service-crashes-during-usa-germany-world-cup-match-1201251221/
Gartner, IT Market Clock for Enterprise Mobility, Sep 2014
There’s a but, High user expectations. As complicated as the mobile content delivery chain complete with both back end and third party services / ad networks or fact that the quality of user network conditions vary widely – users expect apps to work, and work flawlessly with near immediate responsiveness.
Mobile has nearly eliminated any switching cost between apps. Users encountering a negative experience are highly likely shift their attention and engagement to a competitive offering. This also extends to vendors who fail to leverage the very latest mobile innovation including the internet of things trend.
Keep up or risk being abandoned.
DAUs/MAUs (ratio of daily active users to monthly active users) – What percentage of your users are visiting every day? You can also break this down and see what percentage of your users are visiting 8 times a month, 4 times a month, etc.Average visits per month – How often does each user open the app? Some app managers look at the inverse of this which is visit interval or what is the average time between visits. You can look at it either way. The insight is similar.Time in app – How long is the duration of each visit?Screen views – How many screens is each user visiting?Retention – What percent of new installs are visiting the next day, the day after that, the day after that, etc.? The most common metric for this is 30/60/90 day retention (how many users are still visiting 30, 60, and 90 days after the first install).
Need to connect the business outcome to the required process
A successful mobile initiative requires the right process
3 pillars: engagement centric planning, Velocity/Frequency, Quality
Paychex QA team is gearing up it continuous integration program currently optimizing its daily 4-hr test iterations to test iterations executed several times a day … fast feedback is a key pillar for faster defect reduction
Dell offers a great example, in anticipation of a traffic shift from web to mobile, they are shifting from a current bi-monthly release to one ultimately capable of supporting continuous delivery fed by 110 feature teams constantly upgrading different components of the eCommerce giant’s platform
SLIDE OBJECTIVE: Mobile is a fast moving technology. Successful execution mandates fast delivery and fast learning.