ITP session delivered during DevOps West 2018 in Vegas, Eran Kinsbruner

1. Coverage Guidelines Throughout
the DevOps Pipeline

2. About Me
• Lead Technical Evangelist at Perfecto
• Blogger and Speaker
• http://continuoustesting.blog
• https://www.infoworld.com/author/Eran-
Kinsbruner/
• 18+ Years in Development & Testing
• Author of The Digital Quality Handbook
Weekly Podcast - Testiumpod
Twitter: @ek121268
Email: Erank@perfectomobile.com

3. Agenda
• Coverage within the DevOps Process
• Matching the right tool for testing throughout the pipeline
• Advanced test automation demo

4. What’s new?
• Refreshed Country Data
• Added Nordics (Denmark, Sweden, Norway)
• Coverage Principals Across DevOps Pipeline
• Mobile, Web, RWD Coverage Methods
Perfecto’s Factors Magazine - 9th Edition
Where to get it from: https://info.perfectomobile.com/factors-magazine.html

5. The Coverage Cube Principal
6/12/2018 5© 2015, Perfecto Mobile Ltd. All Rights Reserved.

6. Coverage is More that Device/OS Combinations
6/12/2018 6© 2015, Perfecto Mobile Ltd. All Rights Reserved.

7. Real Life Example – Screen Size & Layout Implications on UX
6/12/2018 7© 2015, Perfecto Mobile Ltd. All Rights Reserved.

8. Mobile Test Coverage (Usage) – U.S, Q12018
6/12/2018 8© 2015, Perfecto Mobile Ltd. All Rights Reserved.

9. Coverage Methodology - Mobile
6/12/2018 9© 2015, Perfecto Mobile Ltd. All Rights Reserved.

10. Coverage Methodology - Web
6/12/2018 10© 2015, Perfecto Mobile Ltd. All Rights Reserved.

11. Coverage Throughout the DevOps Pipeline (Process)
6/12/2018 11© 2015, Perfecto Mobile Ltd. All Rights Reserved.
PLAN CODE BUILD TEST RUN
New Functionality
(Innovation)
Users
User experience

12. Dynamic Pipeline
CommitCode Build
Locally
Build
Project
Deploy
To staging
Deploy
To prod
Espresso
XCUItestunit
unit Lighthouse
Puppeteer
API
Espresso
XCUItest
Selenium
API
Local Local
Cloud
S
Espresso
XCUItest
Appium
Selenium
Cloud
M+WT
Espresso
XCUItest
Appium
Selenium
Cloud
L
Selenium
Appium
Cloud S
Monitoring
Pre
Commit
Dev Dev-Test-Ops
Pipeline Stages
Persona

13. Developers - Should be able to
• Execute latest code on real devices easily
• Execute advanced tests (XCUItest/ Espresso) from their IDE
• Access advanced options for debugging (get the network data)
• FAST
• CI reports / headless / Espresso / HAR

14. Dynamic Pipeline
CommitCode Build
Locally
Build
Project
Deploy
To staging
Deploy
To prod
Espresso
XCUItestunit
unit Lighthouse
Puppeteer
API
Espresso
XCUItest
Selenium
API
Local Local
Cloud
S
Espresso
XCUItest
Appium
Selenium
Cloud
M+WT
Espresso
XCUItest
Appium
Selenium
Cloud
L
Selenium
Appium
Cloud S
Monitoring
Pre
Commit
Dev Dev-Test-Ops
Pipeline Stages
Persona

15. DevTest/DevOps (automation Engineer) - Should be able to
• Develop standard automation testing (Appium / Selenium) scripts
• Execute scripts on a number of devices / browsers in parallel
• Connect to the standard DevOps tools (testNG / maven /Jenkins)
• Get fast feedback on the executions
• Drill down into a specific execution in case of error
• Parallel (power of could) , Side by side, drilldown

16. Dynamic Pipeline
CommitCode Build
Locally
Build
Project
Deploy
To staging
Deploy
To prod
Espresso
XCUItestunit
unit Lighthouse
Puppeteer
API
Espresso
XCUItest
Selenium
API
Local Local
Cloud
S
Espresso
XCUItest
Appium
Selenium
Cloud
M+WT
Espresso
XCUItest
Appium
Selenium
Cloud
L
Selenium
Appium
Cloud S
Monitoring
Pre
Commit
Dev Dev-Test-Ops
Pipeline Stages
Persona

17. Demo
• Execution & Scale using Quantum BDD

18. Giveaway for Webinar Attendees/ Q&A
Download from: http://bit.ly/2pkgmX1

19. Thank You