SlideShare ist ein Scribd-Unternehmen logo
1 von 34
Downloaden Sie, um offline zu lesen
3 March 2016 – 12pm GMT
Ville-Veikko Helppi
Head of Demand Generation
ville-veikko.helppi@bitbar.com
Best Practices for DevOps
in Mobile App Testing
W E B I N A R
Agenda
• Deconstructing ‘Mobile DevOps’
• Mobile Product Development
Life-Cycle & Used Tools
• The DevOps Approach in Mobile
App Development & Testing
• Best Practices for DevOps in
Mobile App Testing
• Q&A
http://testdroid.com
DECONSTRUCTING “MOBILE DEVOPS”
http://testdroid.com
Mobile DevOps
DevOps = Practices that emphasize the collaboration and communication of both
software developers and other information-technology (IT) professionals while
automating the process of software delivery and infrastructure changes. --Wikipedia
• Development focus on
building the actual product
and using relevant tools
• QA doing continuous testing
on robustness, functionality,
performance, and preferably
use test automation
• Operations maintain the
continuous
build/integration/deployment/
delivery environments, and
do releases
3 Things in Mobile DevOps
• 3 DevOps Principles
1. Develop & Test Against Real Environment
2. Deploy Frequently
3. Continuously Validate Quality Characteristics
• 3 Business-Critical DevOps Categories
1. Continuous Integration & Continuous Delivery
2. App and Infrastructure (e.g. Back-End) Testing & Monitoring
3. Entire Dev&Test Process and Mobile App Delivery
http://testdroid.com
DevOps Strategy & Typical Goals
• Maximize the Delivered Value
• Customers, Internally between BUs and Teams
• Maximize the Efficiency and Productivity
• Improved Process, The ‘Right’ Tools & Methods, Faster T2M
• Maximize the Quality and Robustness of Apps
• Better Quality with Equal Effort, Investments in Quality
• Maximize the Support, Service & The Delivery
• Alignment and Collaboration between Teams
The highest priority is to satisfy the customer through
early and continuous delivery of valuable software.
Agile Manifesto – Principle #1
“ “http://testdroid.com
How DevOps Can Make A Difference
• Based on Testdroid Customer Survey 2015
• Things That Go Wrong with App Testing
1. Too Long Dev-Test-Feedback Cycles
2. Bug Catching/Reporting Too Slow to Developers
3. Non-Functional or Not Well Utilized Test Automation
4. Use of Emulators - Setting Up & Maintaining Real Devices
5. Access to Relevant Mobile Platform / OS version / Devices
6. Use of Manual Testing – The Weakest Link in Agile and
Devops Process
7. No Geographically Relevant Testbed – Devices, Networks,
Back-End Integration
http://testdroid.com
Where DevOps Make A Difference
• Devices / Hardware
- Handling of new devices and other new HW used in the infrastructure
• Infrastructure
- Ready-to-Go infrastructure means no delays for development, testing and
result-driven approach speeds things up & saves time and money
• Support
- SW devs, SW devs in test (SDET), QA engineers – all need different type of
support when using the infrastructure and DevOps approach can help a lot
• Operations
- Maintaining and Upgrading infrastructure, devices, networks, additional SW
• Tools Integration
- Support for multiple test tools gives the users/developers freedom of choice.
No vendor, tech, tools lock-ins!
http://testdroid.com
MOBILE DEVOPS & DEVELOPMENT
- LIFECYCLE & TOOLS
http://testdroid.com
DevOps Challenges *
• Building the DevOps culture across organization
• Overcoming the Dev vs. Ops mentality
• Moving from legacy (and sometimes on-premise setup)
to cloud based tools and environment
• Broader scope than before: SW and HW for mobile dev
• Learning new skills – DevOps practice requires change
and collaboration across teams
• Mobile Challenges:
• Fragmentation, Tools and Platforms, Not Enough Real Devices
• Less Worrying Challenges on Mobile:
• Cross-platform, Using Cloud Efficiently
* = Based on Testdroid Customer Survey 2015http://testdroid.com
DevOps ‘Toolchain’
• Code – Code Development and Code Reviews, Continuous Integration tools
• Build – Version control tools, SCM, code merging, Build status
• Test – Test and results determine performance
• Package – Artifact repository, Application
pre-deployment staging
• Release – Change management,
Release approvals, release automation
• Configure – Infrastructure
configuration and management,
Infrastructure as Code tools
• Monitor – App perf.
monitoring, UX
DevOps ‘Toolchain’
Code & Build
Continuous Integration,
Continuous Development
Package, Release, Configure &
Monitoring
Continuous Delivery, Continuous
Deployment/Release
GOAL: End-to-End Transparency, Traceability,
Seamless Workflow, Continuous Everything!
2 Valid Options for
Mobile Testing:
Cloud or On-
Premise
http://testdroid.com
DevOps – Testing in the ‘Cloud’
1
2
3
DevOps – Testing On-Premise
CONTINUOUS
INTEGRATION
http://testdroid.com
Benefits of Test Automation
• App Compatibility & Global coverage
• Reusability
• Speed & Efficiency
• Test efficiency
• Test effectiveness
• Time-to-market
http://testdroid.com
DevOps Must Rely on Automation
• DevOps is more than just a tool or a process change; it
inherently requires an organizational culture shift
• Agile methodologies back up this thinking
• Increase focus on test automation and CI methods
• Best practices and continuous iteration
Time
Resources
Infrastructure
Training
Tools
http://testdroid.com
THE DEVOPS APPROACH IN
MOBILE APP TESTING
http://testdroid.com
Testing Philosophy
http://testdroid.com
Manual Automation
Testing Philosophy
http://testdroid.com
Smaller coverage, More
money burnt & time
wasted, Error-prone
Manual Automation
Large
coverage,
quickly
completed,
Less money &
time wasted,
Exact results.
Testing Philosophy
Top Requirement for Testing
• Real Devices and Real Browsers, as
emulators cannot help you to test...
• User Experience
• Usability
• Hardware
• Software
• Infrastructure
0 % = the percentage of your app users
that use emulator to run your app!
http://testdroid.com
Devices & Daily Tasks for DevOps
• In order to maintain mobile device farm,
environment and all aspects of SW & HW the
following daily check-ups must be done:
• Are all devices connected and operating?
• Are all devices WiFi connected?
• Do all devices have an active USB connection?
• Are battery levels adequate (at least 50%) for every device?
• Are there any pop-ups, system notification or other system
dialogs open on the screen?
• Are screens unlocked?
http://testdroid.com
Troubleshooting Ain’t The Same
http://testdroid.com
Automation vs Manual
http://testdroid.com
Test Breakdown
FAILED FAILED
http://testdroid.com
Mobile Test Automation
Automatic test exercisersRecord and PlaybackHand written test scripts
Benefits:
Accurate, specific to
your testing needs,
plenty of options with
frameworks, tools
Fast to create, accurate,
not as sensitive to
human-errors as hand-
written tests, tools
avail’ty
Fastest & extremely
automated, excellent for
smoke testing/quick
testing, availability
Tradeoffs:
Takes a lot of time, ties
resources to write test
cases/scripts, error-
prone (humans)
Compelling Recorder +
Playback tools available
for only few test
automation frameworks
Not accurate as real
test cases
http://testdroid.com
Why Should DevOps Be Interested in …
Robotium uiautomator Espresso Appium Calabash
Android Yes Yes Yes Yes Yes
iOS No No No Yes Yes
Mobile web Yes
(Android)
Limited to x.y
clicks
No Yes
(Android &
iOS)
Yes
(Android)
Scripting
Language
Java Java Java Almost any Ruby
Test creation
tools
Testdroid
Recorder
UI Automator
viewer
Hierarchy
Viewer
Appium.app CLI
Supported
API levels
All 16 => 8, 10, 15- All All
Community Contributors Google Google Active Pretty quiet
http://testdroid.com
BEST PRACTICES FOR DEVOPS IN
MOBILE APP TESTING
http://testdroid.com
Automate (Everything)
• When it comes to mobile app testing, the more
you can automate repetitive things, the better
• Not always possible but leave the last
‘exploratory testing’ for the final phase
• Smoke, Unit, All sorts of Performance,
Regression testing should be automated
• Run your test patterns against EVERY build
• Start small but make sure you can scale-up
http://testdroid.com
Ensure Workflow is Seamless
• Only use tools, frameworks and software that is
fully compatible across used toolchain/workflow
• Ensure all processes, results, tools are entirely
transparent and available for use across teams
• This has a significant impact on productivity and
efficiency
• Open source is always highly recommended
http://testdroid.com
Rely Only On Real & Quality HW
• Mobile device farms require lots of hardware –
this is the correct place to invest in quality HW
• Make sure the mobile device coverage is
adequate – globally
• Execute the upgrade and support policies
relentlessly
http://testdroid.com
“The Right” Testing Framework
• Variety of choices when it comes mobile test
automation frameworks, ask the right questions:
• App, Game, Web? Native, Hybrid?
• Mobile Back-End Integrated?
• Who needs to write, read and interpret tests?
• Does test run results provide you what you
organization needs / is looking for?
http://testdroid.com
Best Practices for DevOps in Mobile App Testing
THANK YOU!
More information about frameworks, devices
and testing at www.testdroid.com
http://testdroid.com

Weitere ähnliche Inhalte

Was ist angesagt?

Ensure Your Mobile Channels Generate Revenue on Holiday Peak Days
Ensure Your Mobile Channels Generate Revenue on Holiday Peak DaysEnsure Your Mobile Channels Generate Revenue on Holiday Peak Days
Ensure Your Mobile Channels Generate Revenue on Holiday Peak DaysBitbar
 
Best Practices in Mobile Game Testing
Best Practices in Mobile Game TestingBest Practices in Mobile Game Testing
Best Practices in Mobile Game TestingBitbar
 
The Status of Android Hardware and Software - From App Developer's Point of View
The Status of Android Hardware and Software - From App Developer's Point of ViewThe Status of Android Hardware and Software - From App Developer's Point of View
The Status of Android Hardware and Software - From App Developer's Point of ViewBitbar
 
Exercising and Scaling Up Mobile DevOps in the Enterprise
Exercising and Scaling Up Mobile DevOps in the EnterpriseExercising and Scaling Up Mobile DevOps in the Enterprise
Exercising and Scaling Up Mobile DevOps in the EnterpriseBitbar
 
Hassle-Free Continuous Integration with Real Device Testing
Hassle-Free Continuous Integration with Real Device TestingHassle-Free Continuous Integration with Real Device Testing
Hassle-Free Continuous Integration with Real Device TestingBitbar
 
Selenium training
Selenium trainingSelenium training
Selenium trainingShivaraj R
 
Introduction To Mobile-Automation
Introduction To Mobile-AutomationIntroduction To Mobile-Automation
Introduction To Mobile-AutomationMindfire Solutions
 
Which One Works You The Best: In-House or Cloud-Based Development Environment
Which One Works You The Best: In-House or Cloud-Based Development EnvironmentWhich One Works You The Best: In-House or Cloud-Based Development Environment
Which One Works You The Best: In-House or Cloud-Based Development EnvironmentBitbar
 
Top Best Practices for Successful Mobile Test Automation
Top Best Practices for Successful Mobile Test AutomationTop Best Practices for Successful Mobile Test Automation
Top Best Practices for Successful Mobile Test AutomationFred Beringer
 
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on WebinarParallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on WebinarBitbar
 
Parallel testing with appium
Parallel testing with appiumParallel testing with appium
Parallel testing with appiummoizjv
 
Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017Perfecto Mobile
 
Mobile Test Automation
Mobile Test AutomationMobile Test Automation
Mobile Test AutomationLee Barnes
 
Different Android Test Automation Frameworks - What Works You the Best?
Different Android Test Automation Frameworks - What Works You the Best?Different Android Test Automation Frameworks - What Works You the Best?
Different Android Test Automation Frameworks - What Works You the Best?Bitbar
 
How to Break your App - Best Practices in Mobile App Testing
How to Break your App - Best Practices in Mobile App TestingHow to Break your App - Best Practices in Mobile App Testing
How to Break your App - Best Practices in Mobile App TestingDaniel Knott
 
Mobile Application Testing
Mobile Application Testing Mobile Application Testing
Mobile Application Testing Shivaraj R
 
Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...
Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...
Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...Perfecto Mobile
 
Cloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More AccessibleCloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More AccessiblePerfecto by Perforce
 
Mobile Test Automation
Mobile Test AutomationMobile Test Automation
Mobile Test AutomationAndreas Jakl
 
Test Automation for Mobile Applications: A Practical Guide
Test Automation for Mobile Applications: A Practical GuideTest Automation for Mobile Applications: A Practical Guide
Test Automation for Mobile Applications: A Practical GuideTechWell
 

Was ist angesagt? (20)

Ensure Your Mobile Channels Generate Revenue on Holiday Peak Days
Ensure Your Mobile Channels Generate Revenue on Holiday Peak DaysEnsure Your Mobile Channels Generate Revenue on Holiday Peak Days
Ensure Your Mobile Channels Generate Revenue on Holiday Peak Days
 
Best Practices in Mobile Game Testing
Best Practices in Mobile Game TestingBest Practices in Mobile Game Testing
Best Practices in Mobile Game Testing
 
The Status of Android Hardware and Software - From App Developer's Point of View
The Status of Android Hardware and Software - From App Developer's Point of ViewThe Status of Android Hardware and Software - From App Developer's Point of View
The Status of Android Hardware and Software - From App Developer's Point of View
 
Exercising and Scaling Up Mobile DevOps in the Enterprise
Exercising and Scaling Up Mobile DevOps in the EnterpriseExercising and Scaling Up Mobile DevOps in the Enterprise
Exercising and Scaling Up Mobile DevOps in the Enterprise
 
Hassle-Free Continuous Integration with Real Device Testing
Hassle-Free Continuous Integration with Real Device TestingHassle-Free Continuous Integration with Real Device Testing
Hassle-Free Continuous Integration with Real Device Testing
 
Selenium training
Selenium trainingSelenium training
Selenium training
 
Introduction To Mobile-Automation
Introduction To Mobile-AutomationIntroduction To Mobile-Automation
Introduction To Mobile-Automation
 
Which One Works You The Best: In-House or Cloud-Based Development Environment
Which One Works You The Best: In-House or Cloud-Based Development EnvironmentWhich One Works You The Best: In-House or Cloud-Based Development Environment
Which One Works You The Best: In-House or Cloud-Based Development Environment
 
Top Best Practices for Successful Mobile Test Automation
Top Best Practices for Successful Mobile Test AutomationTop Best Practices for Successful Mobile Test Automation
Top Best Practices for Successful Mobile Test Automation
 
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on WebinarParallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
Parallel Test Runs with Appium on Real Mobile Devices – Hands-on Webinar
 
Parallel testing with appium
Parallel testing with appiumParallel testing with appium
Parallel testing with appium
 
Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017Boston meetup blaze_meter_feb2017
Boston meetup blaze_meter_feb2017
 
Mobile Test Automation
Mobile Test AutomationMobile Test Automation
Mobile Test Automation
 
Different Android Test Automation Frameworks - What Works You the Best?
Different Android Test Automation Frameworks - What Works You the Best?Different Android Test Automation Frameworks - What Works You the Best?
Different Android Test Automation Frameworks - What Works You the Best?
 
How to Break your App - Best Practices in Mobile App Testing
How to Break your App - Best Practices in Mobile App TestingHow to Break your App - Best Practices in Mobile App Testing
How to Break your App - Best Practices in Mobile App Testing
 
Mobile Application Testing
Mobile Application Testing Mobile Application Testing
Mobile Application Testing
 
Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...
Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...
Cross Platform Mobile Test Automation using Selenium WebDriver by Perfecto Mo...
 
Cloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More AccessibleCloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More Accessible
 
Mobile Test Automation
Mobile Test AutomationMobile Test Automation
Mobile Test Automation
 
Test Automation for Mobile Applications: A Practical Guide
Test Automation for Mobile Applications: A Practical GuideTest Automation for Mobile Applications: A Practical Guide
Test Automation for Mobile Applications: A Practical Guide
 

Andere mochten auch

IBM Innovate DevOps for Mobile Apps
IBM Innovate DevOps for Mobile Apps IBM Innovate DevOps for Mobile Apps
IBM Innovate DevOps for Mobile Apps Sanjeev Sharma
 
Mobile App Testing by Mark Wilson
Mobile App Testing by Mark WilsonMobile App Testing by Mark Wilson
Mobile App Testing by Mark Wilsonphpwgtn
 
Hands-On Mobile App Testing
Hands-On Mobile App TestingHands-On Mobile App Testing
Hands-On Mobile App TestingDaniel Knott
 
7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTesting7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTestingUserTesting
 
Mobile app testing services
Mobile app testing servicesMobile app testing services
Mobile app testing servicesRichard_S
 
Mobile App Testing
Mobile App TestingMobile App Testing
Mobile App TestingDuy Tan Geek
 
Mobile App Testing Strategy by RapidValue Solutions
Mobile App Testing Strategy by RapidValue SolutionsMobile App Testing Strategy by RapidValue Solutions
Mobile App Testing Strategy by RapidValue SolutionsRapidValue
 
Techniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App TestingTechniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App TestingSOASTA
 
Mobile Application Testing Training Presentation
Mobile Application Testing Training PresentationMobile Application Testing Training Presentation
Mobile Application Testing Training PresentationMobiGnosis
 
Mobile Application Testing
Mobile Application TestingMobile Application Testing
Mobile Application TestingSWAAM Tech
 
Mobile App Testing Checklist
Mobile App Testing ChecklistMobile App Testing Checklist
Mobile App Testing ChecklistManoj Lonar
 
Designing a Mobile Device Lab - XBOSoft Webinar
Designing a Mobile Device Lab - XBOSoft WebinarDesigning a Mobile Device Lab - XBOSoft Webinar
Designing a Mobile Device Lab - XBOSoft WebinarXBOSoft
 
Webinar Navita | Saiba Como Profissionalizar a Gestão de Dispositivos Móveis...
Webinar Navita |  Saiba Como Profissionalizar a Gestão de Dispositivos Móveis...Webinar Navita |  Saiba Como Profissionalizar a Gestão de Dispositivos Móveis...
Webinar Navita | Saiba Como Profissionalizar a Gestão de Dispositivos Móveis...Navita BR
 
Case Walmart.com: a prática da entrega de software com rapidez e qualidade
Case Walmart.com: a prática da entrega de software com rapidez e qualidadeCase Walmart.com: a prática da entrega de software com rapidez e qualidade
Case Walmart.com: a prática da entrega de software com rapidez e qualidadeRodrigo Russo
 
The Powerful and Comprehensive API for Mobile App Development and Testing
The Powerful and Comprehensive API for Mobile App Development and TestingThe Powerful and Comprehensive API for Mobile App Development and Testing
The Powerful and Comprehensive API for Mobile App Development and TestingBitbar
 
Deploy your app with one Slack command
Deploy your app with one Slack commandDeploy your app with one Slack command
Deploy your app with one Slack commandFabio Milano
 
Travis and fastlane
Travis and fastlaneTravis and fastlane
Travis and fastlaneSteven Shen
 
Testing in DevOps: UKStar conference
Testing in DevOps: UKStar conferenceTesting in DevOps: UKStar conference
Testing in DevOps: UKStar conferenceLaurent PY
 

Andere mochten auch (20)

IBM Innovate DevOps for Mobile Apps
IBM Innovate DevOps for Mobile Apps IBM Innovate DevOps for Mobile Apps
IBM Innovate DevOps for Mobile Apps
 
Mobile App Testing by Mark Wilson
Mobile App Testing by Mark WilsonMobile App Testing by Mark Wilson
Mobile App Testing by Mark Wilson
 
Hands-On Mobile App Testing
Hands-On Mobile App TestingHands-On Mobile App Testing
Hands-On Mobile App Testing
 
7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTesting7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTesting
 
Mobile app testing services
Mobile app testing servicesMobile app testing services
Mobile app testing services
 
Mobile App Testing
Mobile App TestingMobile App Testing
Mobile App Testing
 
Mobile App Testing Strategy by RapidValue Solutions
Mobile App Testing Strategy by RapidValue SolutionsMobile App Testing Strategy by RapidValue Solutions
Mobile App Testing Strategy by RapidValue Solutions
 
Techniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App TestingTechniques, Tips & Tools For Mobile App Testing
Techniques, Tips & Tools For Mobile App Testing
 
Mobile App Testing
Mobile App TestingMobile App Testing
Mobile App Testing
 
Mobile Application Testing Training Presentation
Mobile Application Testing Training PresentationMobile Application Testing Training Presentation
Mobile Application Testing Training Presentation
 
Mobile Application Testing
Mobile Application TestingMobile Application Testing
Mobile Application Testing
 
Mobile App Testing Checklist
Mobile App Testing ChecklistMobile App Testing Checklist
Mobile App Testing Checklist
 
Designing a Mobile Device Lab - XBOSoft Webinar
Designing a Mobile Device Lab - XBOSoft WebinarDesigning a Mobile Device Lab - XBOSoft Webinar
Designing a Mobile Device Lab - XBOSoft Webinar
 
Webinar Navita | Saiba Como Profissionalizar a Gestão de Dispositivos Móveis...
Webinar Navita |  Saiba Como Profissionalizar a Gestão de Dispositivos Móveis...Webinar Navita |  Saiba Como Profissionalizar a Gestão de Dispositivos Móveis...
Webinar Navita | Saiba Como Profissionalizar a Gestão de Dispositivos Móveis...
 
Case Walmart.com: a prática da entrega de software com rapidez e qualidade
Case Walmart.com: a prática da entrega de software com rapidez e qualidadeCase Walmart.com: a prática da entrega de software com rapidez e qualidade
Case Walmart.com: a prática da entrega de software com rapidez e qualidade
 
The Powerful and Comprehensive API for Mobile App Development and Testing
The Powerful and Comprehensive API for Mobile App Development and TestingThe Powerful and Comprehensive API for Mobile App Development and Testing
The Powerful and Comprehensive API for Mobile App Development and Testing
 
Deploy your app with one Slack command
Deploy your app with one Slack commandDeploy your app with one Slack command
Deploy your app with one Slack command
 
Geekit -Testing Services
Geekit -Testing ServicesGeekit -Testing Services
Geekit -Testing Services
 
Travis and fastlane
Travis and fastlaneTravis and fastlane
Travis and fastlane
 
Testing in DevOps: UKStar conference
Testing in DevOps: UKStar conferenceTesting in DevOps: UKStar conference
Testing in DevOps: UKStar conference
 

Ähnlich wie Best Practices for DevOps in Mobile App Testing

How Digital Changed the Game... and how to cross platform test for it
How Digital Changed the Game... and how to cross platform test for itHow Digital Changed the Game... and how to cross platform test for it
How Digital Changed the Game... and how to cross platform test for itLizzy Guido (she/her)
 
Mobile App Quality Roadmap for DevTest Teams
Mobile App Quality Roadmap for DevTest TeamsMobile App Quality Roadmap for DevTest Teams
Mobile App Quality Roadmap for DevTest TeamsPerfecto by Perforce
 
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-54&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5hemasubbu08
 
Shorten Business Life Cycle Using DevOps
Shorten Business Life Cycle Using DevOpsShorten Business Life Cycle Using DevOps
Shorten Business Life Cycle Using DevOpsPerfecto Mobile
 
Amalgamation of BDD, parallel execution and mobile automation
Amalgamation of BDD, parallel execution and mobile automationAmalgamation of BDD, parallel execution and mobile automation
Amalgamation of BDD, parallel execution and mobile automationAgile Testing Alliance
 
Testing in the new age of DevOps
Testing in the new age of DevOpsTesting in the new age of DevOps
Testing in the new age of DevOpsMoataz Mahmoud
 
How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks Ulf Mattsson
 
5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test Automation5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test AutomationSauce Labs
 
DevOps Overview in my own words
DevOps Overview in my own wordsDevOps Overview in my own words
DevOps Overview in my own wordsSUBHENDU KARMAKAR
 
DevOps Engineering.pptx
DevOps Engineering.pptxDevOps Engineering.pptx
DevOps Engineering.pptxAbalBoot
 
Zen Test Labs Mobile Application Testing
Zen Test Labs Mobile Application TestingZen Test Labs Mobile Application Testing
Zen Test Labs Mobile Application TestingZen Test Labs
 
Experitest-Infosys Co-Webinar on Mobile Continuous Integration
Experitest-Infosys Co-Webinar on Mobile Continuous IntegrationExperitest-Infosys Co-Webinar on Mobile Continuous Integration
Experitest-Infosys Co-Webinar on Mobile Continuous IntegrationExperitest
 
The QA/Testing Process
The QA/Testing ProcessThe QA/Testing Process
The QA/Testing ProcessSynerzip
 
Best Practices in Mobile CI (webinar)
Best Practices in Mobile CI (webinar)Best Practices in Mobile CI (webinar)
Best Practices in Mobile CI (webinar)Sauce Labs
 

Ähnlich wie Best Practices for DevOps in Mobile App Testing (20)

How Digital Changed the Game... and how to cross platform test for it
How Digital Changed the Game... and how to cross platform test for itHow Digital Changed the Game... and how to cross platform test for it
How Digital Changed the Game... and how to cross platform test for it
 
Mobile App Quality Roadmap for DevTest Teams
Mobile App Quality Roadmap for DevTest TeamsMobile App Quality Roadmap for DevTest Teams
Mobile App Quality Roadmap for DevTest Teams
 
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-54&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
 
Shorten Business Life Cycle Using DevOps
Shorten Business Life Cycle Using DevOpsShorten Business Life Cycle Using DevOps
Shorten Business Life Cycle Using DevOps
 
Amalgamation of BDD, parallel execution and mobile automation
Amalgamation of BDD, parallel execution and mobile automationAmalgamation of BDD, parallel execution and mobile automation
Amalgamation of BDD, parallel execution and mobile automation
 
Testing in the new age of DevOps
Testing in the new age of DevOpsTesting in the new age of DevOps
Testing in the new age of DevOps
 
How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks
 
5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test Automation5 Steps to Jump Start Your Test Automation
5 Steps to Jump Start Your Test Automation
 
Swagatika_QALead
Swagatika_QALeadSwagatika_QALead
Swagatika_QALead
 
Musharraf_Syed_Resume
Musharraf_Syed_ResumeMusharraf_Syed_Resume
Musharraf_Syed_Resume
 
TechTalk: Getting to Know Perfecto
TechTalk: Getting to Know PerfectoTechTalk: Getting to Know Perfecto
TechTalk: Getting to Know Perfecto
 
DevOps Overview in my own words
DevOps Overview in my own wordsDevOps Overview in my own words
DevOps Overview in my own words
 
What is DevOps? What is DevOps CoE?
What is DevOps? What is DevOps CoE? What is DevOps? What is DevOps CoE?
What is DevOps? What is DevOps CoE?
 
DevOps Engineering.pptx
DevOps Engineering.pptxDevOps Engineering.pptx
DevOps Engineering.pptx
 
Zen Test Labs Mobile Application Testing
Zen Test Labs Mobile Application TestingZen Test Labs Mobile Application Testing
Zen Test Labs Mobile Application Testing
 
Experitest-Infosys Co-Webinar on Mobile Continuous Integration
Experitest-Infosys Co-Webinar on Mobile Continuous IntegrationExperitest-Infosys Co-Webinar on Mobile Continuous Integration
Experitest-Infosys Co-Webinar on Mobile Continuous Integration
 
The QA/Testing Process
The QA/Testing ProcessThe QA/Testing Process
The QA/Testing Process
 
Neev QA Offering
Neev QA OfferingNeev QA Offering
Neev QA Offering
 
Best Practices in Mobile CI (webinar)
Best Practices in Mobile CI (webinar)Best Practices in Mobile CI (webinar)
Best Practices in Mobile CI (webinar)
 
Journey to the center of DevOps - v6
Journey to the center of DevOps - v6Journey to the center of DevOps - v6
Journey to the center of DevOps - v6
 

Mehr von Bitbar

The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...Bitbar
 
Getting Started with XCTest and XCUITest for iOS App Testing
Getting Started with XCTest and XCUITest for iOS App TestingGetting Started with XCTest and XCUITest for iOS App Testing
Getting Started with XCTest and XCUITest for iOS App TestingBitbar
 
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)Bitbar
 
Testing Your Android and iOS Apps with Appium in Testdroid Cloud
Testing Your Android and iOS Apps with Appium in Testdroid CloudTesting Your Android and iOS Apps with Appium in Testdroid Cloud
Testing Your Android and iOS Apps with Appium in Testdroid CloudBitbar
 
Maximize the Benefits from Your Test Automation Investment
Maximize the Benefits from Your Test Automation InvestmentMaximize the Benefits from Your Test Automation Investment
Maximize the Benefits from Your Test Automation InvestmentBitbar
 
Android testing
Android testingAndroid testing
Android testingBitbar
 

Mehr von Bitbar (6)

The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
 
Getting Started with XCTest and XCUITest for iOS App Testing
Getting Started with XCTest and XCUITest for iOS App TestingGetting Started with XCTest and XCUITest for iOS App Testing
Getting Started with XCTest and XCUITest for iOS App Testing
 
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
LDNSE: Testdroid for Mobile App and Web Testing (London Selenium Meetup)
 
Testing Your Android and iOS Apps with Appium in Testdroid Cloud
Testing Your Android and iOS Apps with Appium in Testdroid CloudTesting Your Android and iOS Apps with Appium in Testdroid Cloud
Testing Your Android and iOS Apps with Appium in Testdroid Cloud
 
Maximize the Benefits from Your Test Automation Investment
Maximize the Benefits from Your Test Automation InvestmentMaximize the Benefits from Your Test Automation Investment
Maximize the Benefits from Your Test Automation Investment
 
Android testing
Android testingAndroid testing
Android testing
 

Kürzlich hochgeladen

Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXTarek Kalaji
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxUdaiappa Ramachandran
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-pyJamie (Taka) Wang
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 

Kürzlich hochgeladen (20)

Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBX
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptx
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-py
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 

Best Practices for DevOps in Mobile App Testing

  • 1. 3 March 2016 – 12pm GMT Ville-Veikko Helppi Head of Demand Generation ville-veikko.helppi@bitbar.com Best Practices for DevOps in Mobile App Testing W E B I N A R
  • 2. Agenda • Deconstructing ‘Mobile DevOps’ • Mobile Product Development Life-Cycle & Used Tools • The DevOps Approach in Mobile App Development & Testing • Best Practices for DevOps in Mobile App Testing • Q&A http://testdroid.com
  • 4. Mobile DevOps DevOps = Practices that emphasize the collaboration and communication of both software developers and other information-technology (IT) professionals while automating the process of software delivery and infrastructure changes. --Wikipedia • Development focus on building the actual product and using relevant tools • QA doing continuous testing on robustness, functionality, performance, and preferably use test automation • Operations maintain the continuous build/integration/deployment/ delivery environments, and do releases
  • 5. 3 Things in Mobile DevOps • 3 DevOps Principles 1. Develop & Test Against Real Environment 2. Deploy Frequently 3. Continuously Validate Quality Characteristics • 3 Business-Critical DevOps Categories 1. Continuous Integration & Continuous Delivery 2. App and Infrastructure (e.g. Back-End) Testing & Monitoring 3. Entire Dev&Test Process and Mobile App Delivery http://testdroid.com
  • 6. DevOps Strategy & Typical Goals • Maximize the Delivered Value • Customers, Internally between BUs and Teams • Maximize the Efficiency and Productivity • Improved Process, The ‘Right’ Tools & Methods, Faster T2M • Maximize the Quality and Robustness of Apps • Better Quality with Equal Effort, Investments in Quality • Maximize the Support, Service & The Delivery • Alignment and Collaboration between Teams The highest priority is to satisfy the customer through early and continuous delivery of valuable software. Agile Manifesto – Principle #1 “ “http://testdroid.com
  • 7. How DevOps Can Make A Difference • Based on Testdroid Customer Survey 2015 • Things That Go Wrong with App Testing 1. Too Long Dev-Test-Feedback Cycles 2. Bug Catching/Reporting Too Slow to Developers 3. Non-Functional or Not Well Utilized Test Automation 4. Use of Emulators - Setting Up & Maintaining Real Devices 5. Access to Relevant Mobile Platform / OS version / Devices 6. Use of Manual Testing – The Weakest Link in Agile and Devops Process 7. No Geographically Relevant Testbed – Devices, Networks, Back-End Integration http://testdroid.com
  • 8. Where DevOps Make A Difference • Devices / Hardware - Handling of new devices and other new HW used in the infrastructure • Infrastructure - Ready-to-Go infrastructure means no delays for development, testing and result-driven approach speeds things up & saves time and money • Support - SW devs, SW devs in test (SDET), QA engineers – all need different type of support when using the infrastructure and DevOps approach can help a lot • Operations - Maintaining and Upgrading infrastructure, devices, networks, additional SW • Tools Integration - Support for multiple test tools gives the users/developers freedom of choice. No vendor, tech, tools lock-ins! http://testdroid.com
  • 9. MOBILE DEVOPS & DEVELOPMENT - LIFECYCLE & TOOLS http://testdroid.com
  • 10. DevOps Challenges * • Building the DevOps culture across organization • Overcoming the Dev vs. Ops mentality • Moving from legacy (and sometimes on-premise setup) to cloud based tools and environment • Broader scope than before: SW and HW for mobile dev • Learning new skills – DevOps practice requires change and collaboration across teams • Mobile Challenges: • Fragmentation, Tools and Platforms, Not Enough Real Devices • Less Worrying Challenges on Mobile: • Cross-platform, Using Cloud Efficiently * = Based on Testdroid Customer Survey 2015http://testdroid.com
  • 11. DevOps ‘Toolchain’ • Code – Code Development and Code Reviews, Continuous Integration tools • Build – Version control tools, SCM, code merging, Build status • Test – Test and results determine performance • Package – Artifact repository, Application pre-deployment staging • Release – Change management, Release approvals, release automation • Configure – Infrastructure configuration and management, Infrastructure as Code tools • Monitor – App perf. monitoring, UX
  • 12. DevOps ‘Toolchain’ Code & Build Continuous Integration, Continuous Development Package, Release, Configure & Monitoring Continuous Delivery, Continuous Deployment/Release GOAL: End-to-End Transparency, Traceability, Seamless Workflow, Continuous Everything! 2 Valid Options for Mobile Testing: Cloud or On- Premise http://testdroid.com
  • 13. DevOps – Testing in the ‘Cloud’ 1 2 3
  • 14. DevOps – Testing On-Premise CONTINUOUS INTEGRATION http://testdroid.com
  • 15. Benefits of Test Automation • App Compatibility & Global coverage • Reusability • Speed & Efficiency • Test efficiency • Test effectiveness • Time-to-market http://testdroid.com
  • 16. DevOps Must Rely on Automation • DevOps is more than just a tool or a process change; it inherently requires an organizational culture shift • Agile methodologies back up this thinking • Increase focus on test automation and CI methods • Best practices and continuous iteration Time Resources Infrastructure Training Tools http://testdroid.com
  • 17. THE DEVOPS APPROACH IN MOBILE APP TESTING http://testdroid.com
  • 20. Smaller coverage, More money burnt & time wasted, Error-prone Manual Automation Large coverage, quickly completed, Less money & time wasted, Exact results. Testing Philosophy
  • 21. Top Requirement for Testing • Real Devices and Real Browsers, as emulators cannot help you to test... • User Experience • Usability • Hardware • Software • Infrastructure 0 % = the percentage of your app users that use emulator to run your app! http://testdroid.com
  • 22. Devices & Daily Tasks for DevOps • In order to maintain mobile device farm, environment and all aspects of SW & HW the following daily check-ups must be done: • Are all devices connected and operating? • Are all devices WiFi connected? • Do all devices have an active USB connection? • Are battery levels adequate (at least 50%) for every device? • Are there any pop-ups, system notification or other system dialogs open on the screen? • Are screens unlocked? http://testdroid.com
  • 23. Troubleshooting Ain’t The Same http://testdroid.com
  • 26. Mobile Test Automation Automatic test exercisersRecord and PlaybackHand written test scripts Benefits: Accurate, specific to your testing needs, plenty of options with frameworks, tools Fast to create, accurate, not as sensitive to human-errors as hand- written tests, tools avail’ty Fastest & extremely automated, excellent for smoke testing/quick testing, availability Tradeoffs: Takes a lot of time, ties resources to write test cases/scripts, error- prone (humans) Compelling Recorder + Playback tools available for only few test automation frameworks Not accurate as real test cases http://testdroid.com
  • 27. Why Should DevOps Be Interested in … Robotium uiautomator Espresso Appium Calabash Android Yes Yes Yes Yes Yes iOS No No No Yes Yes Mobile web Yes (Android) Limited to x.y clicks No Yes (Android & iOS) Yes (Android) Scripting Language Java Java Java Almost any Ruby Test creation tools Testdroid Recorder UI Automator viewer Hierarchy Viewer Appium.app CLI Supported API levels All 16 => 8, 10, 15- All All Community Contributors Google Google Active Pretty quiet http://testdroid.com
  • 28. BEST PRACTICES FOR DEVOPS IN MOBILE APP TESTING http://testdroid.com
  • 29. Automate (Everything) • When it comes to mobile app testing, the more you can automate repetitive things, the better • Not always possible but leave the last ‘exploratory testing’ for the final phase • Smoke, Unit, All sorts of Performance, Regression testing should be automated • Run your test patterns against EVERY build • Start small but make sure you can scale-up http://testdroid.com
  • 30. Ensure Workflow is Seamless • Only use tools, frameworks and software that is fully compatible across used toolchain/workflow • Ensure all processes, results, tools are entirely transparent and available for use across teams • This has a significant impact on productivity and efficiency • Open source is always highly recommended http://testdroid.com
  • 31. Rely Only On Real & Quality HW • Mobile device farms require lots of hardware – this is the correct place to invest in quality HW • Make sure the mobile device coverage is adequate – globally • Execute the upgrade and support policies relentlessly http://testdroid.com
  • 32. “The Right” Testing Framework • Variety of choices when it comes mobile test automation frameworks, ask the right questions: • App, Game, Web? Native, Hybrid? • Mobile Back-End Integrated? • Who needs to write, read and interpret tests? • Does test run results provide you what you organization needs / is looking for? http://testdroid.com
  • 34. THANK YOU! More information about frameworks, devices and testing at www.testdroid.com http://testdroid.com