SlideShare ist ein Scribd-Unternehmen logo
1 von 41
Downloaden Sie, um offline zu lesen
Perfecto by Perforce © 2020 Perforce Software, Inc.
How to Prepare Your Apps for iOS 14:
Test Strategy, Coverage, & Best Practices
2 | Advanced Codeless Testing for Web Apps
Today’s Speakers:
Eran Kinsbruner
• Chief Evangelist and author at Perfecto
• Blogger and speaker
• 20+ years in development & testing
• Author of “The Digital Quality Handbook”
and “Continuous Testing for DevOps
Professionals”
• @ek121268
• https://www.linkedin.com/in/eran-kinsbruner-4b47a81/
Anand Bagmar
• Software Quality Evangelist at Applitools, blogger, and speaker
• Over 20+ years in software development and testing
• Specializes in product quality strategy & execution, and building
automated testing tools, infrastructure, and frameworks
• Built open source tools related to software testing: WAAT (Web Analytics
Automation Testing Framework), TaaS (for automating the integration
testing in disparate systems) and TTA (Test Trend Analyzer)
• https://in.linkedin.com/in/anandbagmar
• @BagmarAnand
perfecto.io3 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Today’s Agenda
1
3
4
Mobile Test Coverage Guidelines
iOS 14 Features Overview and Pitfalls
5
How to Combine Testing on iOS Simulators & Real Devices
Live Demo: iOS 13 vs. iOS 14 Issues (Appium)
6 Q&A
2 Functional & Visual Testing — Recommended Strategy
iOS 14: Key Features Overview
perfecto.io5 | Perfecto by Perforce © 2020 Perforce Software, Inc.
• New UI Enhancements
• Widgets
• App Library
• Messages
• Notifications
• New translation app
• Enhanced Siri
• New Safari browser (Safari 14)
• Car Key/Car Play
What’s New in iOS 14
perfecto.io6 | Perfecto by Perforce © 2020 Perforce Software, Inc.
What’s New in iOS 14 — Continued
• App Clips load within seconds and let users
complete specific tasks, like pay for parking using
Sign In With Apple and Apple Pay. App Clips can be
discovered and accessed by scanning Apple's new
"App Clip codes," or by using NFC and QR codes.
They can also be shared in Messages and Safari.
perfecto.io7 | Perfecto by Perforce © 2020 Perforce Software, Inc.
iOS 14 Collected Pitfalls: Functional, Memory, UI Issues
Works on iOS 13,
Crashes on iOS 14
Works on iOS 13,
Crashes on iOS 14
perfecto.io8 | Perfecto by Perforce © 2020 Perforce Software, Inc.
iOS 14 Collected Pitfalls: Functional, Memory, UI Issues
Looks Good on iOS 13 Text Field Truncated on iOS 14
Functional & Visual Strategy
perfecto.io10 | Perfecto by Perforce © 2020 Perforce Software, Inc.
• Quality Strategy = Testing + Automation + App Release Plan
Quality Strategy
perfecto.io11 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Quality Strategy
perfecto.io12 | Perfecto by Perforce © 2020 Perforce Software, Inc.
• Build in quality by testing early
• Feature kick-off
• Business requirements
• Story kick-off
• User impact
• Dev-Box testing
• Implement what was expected
• Thorough story testing & exploratory testing
• Test was was implemented
• Product owner sign-off per story & feature
• Involve everyone, quality is a team responsibility
Structured Way of Working
perfecto.io13 | Perfecto by Perforce © 2020 Perforce Software, Inc.
• Automate as much as you can (what brings relevant value)
• Unit tests
• Integration tests
• Functional tests (E2E) — focused on user-journeys
• Visual testing — user experience should be consistent, and as expected
• Analytics tests
Automation Is Key
perfecto.io14 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Value of Automation
Run the tests on every change — capture the
regression as soon as it is introduced in the code.
perfecto.io15 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Simulate real-user behavior/interactions.
Run the tests on simulators & real devices.
perfecto.io16 | Perfecto by Perforce © 2020 Perforce Software, Inc.
• In-house testing
• On-field testing (sanity)
• Staged releases
• Sentiment analysis
• Review comments (PlayStore/App Store)
• Social media (Twitter, Instagram, Facebook, etc.)
• Extensive monitoring of staged releases
• Analytics
• Crashes
• Support tickets
Release Approach
perfecto.io17 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Does your strategy change if a new version
of OS needs to be supported?
perfecto.io18 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Eran gave plenty of examples why it is necessary to keep the variables in mind!
YES!
perfecto.io19 | Perfecto by Perforce © 2020 Perforce Software, Inc.
• Validate compatibility of your product with the new iOS version, and quickly!
Key aspects to keep in mind in case of iOS 14.
perfecto.io20 | Perfecto by Perforce © 2020 Perforce Software, Inc.
• Functionality/gestures
• UI/UX
• Memory
• New installations vs. existing installation vs. upgrade app versions
• Integrations/permissions
• Caching/data storage
Challenges You May Face
perfecto.io21 | Perfecto by Perforce © 2020 Perforce Software, Inc.
• Executing automated tests
• Unit tests
• Integration tests
• Functional tests (E2E) — focused on user-journeys
• Visual testing — user experience should be consistent and as expected
• Exploratory testing — finding impact of iOS version change on your app
Strategy for iOS Version Change
Test Automation Coverage Guidelines
perfecto.io23 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Balancing Test Automation Coverage
TEST SCENARIO ONE
Test Case – 1 Test Case – 2 Test Case – 3 Test Case – N
2 sides of the same coin
perfecto.io24 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Test Coverage Fundamentals
Web Traffic Analytics
Selecting the Right Test Cases
perfecto.io25 | Perfecto by Perforce © 2020 Perforce Software, Inc.
iOS and iPadOS Testing Coverage
perfecto.io26 | Perfecto by Perforce © 2020 Perforce Software, Inc.
• iOS 13 (Latest–1) testing required on
• iPhone 11 series
• iPhone 6 and below
• iPad Air/Pro Series
• iOS 12.4.8 (Latest –2)
• iPhone 6
• iPad Mini 2
iOS and iPadOS Testing Coverage: GA, Latest-1, Latest-2
perfecto.io27 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Latest GA Versions:
• Chrome 84
• Firefox 79
• Edge 84
• Safari 13
• Safari 14 Beta*
Global Browser Market Share Update: Adoption Trends Vary
perfecto.io28 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Mobile Testing & Desktop Web Testing Are One
iOS Safari
Android Chrome
Desktop Web UI
Balancing Virtual Devices and Real Devices
perfecto.io30 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Virtual Platform Definitions
• Simulators
• iOS (Apple)
• A simulator is software that imitates the workings of
software on your system that was made for mobile.
• Mobile simulators can be used in app testing and cross-
browser or responsive testing to simulate a mobile device
and running your app or website in it.
• Emulators
• Android (Google)
• An emulator is software that imitates the working of
software on your system that was made for mobile.
• Emulators also take into consideration the hardware part
of the mobile device (memory, processor, battery
performance, etc.).
Real Device Behavior
perfecto.io31 | Perfecto by Perforce © 2019 Perforce Software, Inc.
Differences Between Android & iOS Virtual Platforms
perfecto.io32 | Perfecto by Perforce © 2019 Perforce Software, Inc.
Considerations
for Using iOS and
Android Virtual
Platforms vs. Real
Devices
Stage and activity in
the software
development cycle
Dev
Test
Debug
Design
Cost avoidance
Coverage
Platforms
Real user
conditions
Test types
Functional/Regression
/Integration Testing
Unit
Non Functional
Production Monitoring
perfecto.io33 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Perfecto’s Mobile Testing Pyramid Combo
Testing Pyramid Within Your DevOps Pipeline Requirements
U N I T T E S T S
M A N UA L
T E S T S
Testing isolated units of code.
I N T EG R AT I O N T E S T S
Testing across integrations of more than one system.
U I T E S T S
Testing through a user interface.
Per code commit/ Post commit
Build Acceptance/Regression Testing
E2E Testing
Exploratory/Manual Testing
Dev
Triggered
Mix Real Devices & Emu./Simu.
CI
Triggered+
Real Devices Only
CI
Triggered
Real Devices OnlyProd. Monitoring
Non Functional Testing:
Performance (UX)
Testing/Security
Real Devices Only
perfecto.io34 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Virtual Platforms
Mix of
Virtual Platforms & Real Devices
Only Real Devices
Pipeline Testing Coverage Example
Demos: Cross Platform Testing With Perfecto and Applitools
perfecto.io36 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Continuous Testing – Key Metrics/Categories
perfecto.io37 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Perfecto’s 4 Key Pillars of Continuous Testing in DevOps
This is where money is spent (Time, Tools, Resources)
This is where value is being
realized, quality is improved
Unified solution serves DevOps with greater effectiveness.
perfecto.io38 | Perfecto by Perforce © 2020 Perforce Software, Inc.
We Invented Visual AI that replicates the human eye and brain, looks at every screen
and page in seconds, and spots app regressions that truly matter.
We Help App Teams with their:
• Functional Testing & Visual Testing
• Web, Mobile, and UI/UX Testing
• Cross Browser & Device Testing
• Content Migration/OS version upgrades/browser version upgrades
• Compliance Testing, Localization, Accessibility, PDF, & More
Applitools Visual AI has analyzed one billion+ images with 99.9999% accuracy.
About Applitools
Visual AI
Industry’s only AI powered computer vision
replicates the human eye & brain.
SDKs & Integrations
SDKs to augment all modern test frameworks,
and integrations with popular source control,
CI, and defect tracking systems.
Perfection Across All Screens
Ultrafast Grid ensures visual perfection across
all browsers, screens, and viewports.
Ultrafast Grid Architecture >>
Speed of CI/CD
Execute tests in seconds vs minutes for faster
builds and on-time delivery.
Ultimate Efficiency
Create tests faster & with fewer brittle locators
and labels.
Increase Test Coverage
Open-ended, AI-powered assertions reduce
code and maintenance while increasing test
coverage.
Applitools Cloud
Visual AI Platform
One Intelligent Platform
Adding Applitools Visual AI to your existing test automation framework allows quality teams to release
perfect apps faster and at a reduced cost.
perfecto.io40 | Perfecto by Perforce © 2020 Perforce Software, Inc.
Thank You!
perfecto.io or follow us @perfectomobile
applitools.com / @applitools

Más contenido relacionado

Was ist angesagt?

apidays LIVE Australia - API Product for Business Ecosystems by Amancio Bouza
apidays LIVE Australia - API Product for Business Ecosystems by Amancio Bouzaapidays LIVE Australia - API Product for Business Ecosystems by Amancio Bouza
apidays LIVE Australia - API Product for Business Ecosystems by Amancio Bouzaapidays
 
apidays LIVE JAKARTA - GraphQL, gRPC, REST, Oh My! by Mike Amundsen
apidays LIVE JAKARTA - GraphQL, gRPC, REST, Oh My! by Mike Amundsenapidays LIVE JAKARTA - GraphQL, gRPC, REST, Oh My! by Mike Amundsen
apidays LIVE JAKARTA - GraphQL, gRPC, REST, Oh My! by Mike Amundsenapidays
 
Protech (Computer Vision, Machine Learning, Deep Learning, Software Development)
Protech (Computer Vision, Machine Learning, Deep Learning, Software Development)Protech (Computer Vision, Machine Learning, Deep Learning, Software Development)
Protech (Computer Vision, Machine Learning, Deep Learning, Software Development)Dusko Rakin
 
apidays LIVE Australia 2021 - The role and expectations of an API Product Man...
apidays LIVE Australia 2021 - The role and expectations of an API Product Man...apidays LIVE Australia 2021 - The role and expectations of an API Product Man...
apidays LIVE Australia 2021 - The role and expectations of an API Product Man...apidays
 
How to segment developers for your API strategy
How to segment developers for your API strategyHow to segment developers for your API strategy
How to segment developers for your API strategyApigee | Google Cloud
 
Protech Presentation
Protech PresentationProtech Presentation
Protech PresentationDusko Rakin
 
4 Low Code/ No Code Statistics That You Cannot Miss in 2021
4 Low Code/ No Code Statistics That You Cannot Miss in 2021 4 Low Code/ No Code Statistics That You Cannot Miss in 2021
4 Low Code/ No Code Statistics That You Cannot Miss in 2021 Maruti Techlabs
 
apidays LIVE Helsinki & North - Ideas around automating API Management by Mat...
apidays LIVE Helsinki & North - Ideas around automating API Management by Mat...apidays LIVE Helsinki & North - Ideas around automating API Management by Mat...
apidays LIVE Helsinki & North - Ideas around automating API Management by Mat...apidays
 
How to Navigate your Product Career and API Product Management by PayPal Sr PMs
How to Navigate your Product Career and API Product Management by PayPal Sr PMsHow to Navigate your Product Career and API Product Management by PayPal Sr PMs
How to Navigate your Product Career and API Product Management by PayPal Sr PMsProduct School
 
TMA Solutions Overview
TMA Solutions OverviewTMA Solutions Overview
TMA Solutions OverviewTMA Solutions
 
Migite presents iLeap, the premier low code application development platform
Migite presents iLeap, the premier low code application development platformMigite presents iLeap, the premier low code application development platform
Migite presents iLeap, the premier low code application development platformGejamuganLatsoomanan2
 
What is API Product Management by PayPal Director of Product
What is API Product Management by PayPal Director of ProductWhat is API Product Management by PayPal Director of Product
What is API Product Management by PayPal Director of ProductProduct School
 
7 drivers that will change the way we work
7 drivers that will change the way we work7 drivers that will change the way we work
7 drivers that will change the way we workTalent-Alpha
 
10 patterns in successful api programs 2
10 patterns in successful api programs 210 patterns in successful api programs 2
10 patterns in successful api programs 2Apigee | Google Cloud
 
Tekvana presentation ppt_final_blue 5.2.2021
Tekvana presentation ppt_final_blue 5.2.2021Tekvana presentation ppt_final_blue 5.2.2021
Tekvana presentation ppt_final_blue 5.2.2021MichaelNaccarato4
 

Was ist angesagt? (20)

apidays LIVE Australia - API Product for Business Ecosystems by Amancio Bouza
apidays LIVE Australia - API Product for Business Ecosystems by Amancio Bouzaapidays LIVE Australia - API Product for Business Ecosystems by Amancio Bouza
apidays LIVE Australia - API Product for Business Ecosystems by Amancio Bouza
 
apidays LIVE JAKARTA - GraphQL, gRPC, REST, Oh My! by Mike Amundsen
apidays LIVE JAKARTA - GraphQL, gRPC, REST, Oh My! by Mike Amundsenapidays LIVE JAKARTA - GraphQL, gRPC, REST, Oh My! by Mike Amundsen
apidays LIVE JAKARTA - GraphQL, gRPC, REST, Oh My! by Mike Amundsen
 
Protech (Computer Vision, Machine Learning, Deep Learning, Software Development)
Protech (Computer Vision, Machine Learning, Deep Learning, Software Development)Protech (Computer Vision, Machine Learning, Deep Learning, Software Development)
Protech (Computer Vision, Machine Learning, Deep Learning, Software Development)
 
TMA booklet
TMA bookletTMA booklet
TMA booklet
 
apidays LIVE Australia 2021 - The role and expectations of an API Product Man...
apidays LIVE Australia 2021 - The role and expectations of an API Product Man...apidays LIVE Australia 2021 - The role and expectations of an API Product Man...
apidays LIVE Australia 2021 - The role and expectations of an API Product Man...
 
Series A Deck
Series A DeckSeries A Deck
Series A Deck
 
How to segment developers for your API strategy
How to segment developers for your API strategyHow to segment developers for your API strategy
How to segment developers for your API strategy
 
Protech Presentation
Protech PresentationProtech Presentation
Protech Presentation
 
4 Low Code/ No Code Statistics That You Cannot Miss in 2021
4 Low Code/ No Code Statistics That You Cannot Miss in 2021 4 Low Code/ No Code Statistics That You Cannot Miss in 2021
4 Low Code/ No Code Statistics That You Cannot Miss in 2021
 
Migration to Liferay DXP - Digital Experience Platform | KNOWARTH
 Migration to Liferay DXP - Digital Experience Platform | KNOWARTH Migration to Liferay DXP - Digital Experience Platform | KNOWARTH
Migration to Liferay DXP - Digital Experience Platform | KNOWARTH
 
apidays LIVE Helsinki & North - Ideas around automating API Management by Mat...
apidays LIVE Helsinki & North - Ideas around automating API Management by Mat...apidays LIVE Helsinki & North - Ideas around automating API Management by Mat...
apidays LIVE Helsinki & North - Ideas around automating API Management by Mat...
 
How to Navigate your Product Career and API Product Management by PayPal Sr PMs
How to Navigate your Product Career and API Product Management by PayPal Sr PMsHow to Navigate your Product Career and API Product Management by PayPal Sr PMs
How to Navigate your Product Career and API Product Management by PayPal Sr PMs
 
TMA Solutions Overview
TMA Solutions OverviewTMA Solutions Overview
TMA Solutions Overview
 
Innominds - product engineering Services
Innominds - product engineering ServicesInnominds - product engineering Services
Innominds - product engineering Services
 
Migite presents iLeap, the premier low code application development platform
Migite presents iLeap, the premier low code application development platformMigite presents iLeap, the premier low code application development platform
Migite presents iLeap, the premier low code application development platform
 
What is API Product Management by PayPal Director of Product
What is API Product Management by PayPal Director of ProductWhat is API Product Management by PayPal Director of Product
What is API Product Management by PayPal Director of Product
 
What is no-code
What is no-codeWhat is no-code
What is no-code
 
7 drivers that will change the way we work
7 drivers that will change the way we work7 drivers that will change the way we work
7 drivers that will change the way we work
 
10 patterns in successful api programs 2
10 patterns in successful api programs 210 patterns in successful api programs 2
10 patterns in successful api programs 2
 
Tekvana presentation ppt_final_blue 5.2.2021
Tekvana presentation ppt_final_blue 5.2.2021Tekvana presentation ppt_final_blue 5.2.2021
Tekvana presentation ppt_final_blue 5.2.2021
 

Ähnlich wie How to Prepare Your Apps for iOS 14 - Test Strategy, Coverage, & Best Practices

How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...
How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...
How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...Perfecto by Perforce
 
5 Mobile App Trends & What They Mean for Dev & Testing
5 Mobile App Trends & What They Mean for Dev & Testing5 Mobile App Trends & What They Mean for Dev & Testing
5 Mobile App Trends & What They Mean for Dev & TestingPerfecto by Perforce
 
How to Scale Digital App Testing With Jenkins & Automation You Can Trust
How to Scale Digital App Testing With Jenkins & Automation You Can TrustHow to Scale Digital App Testing With Jenkins & Automation You Can Trust
How to Scale Digital App Testing With Jenkins & Automation You Can TrustPerfecto by Perforce
 
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...QA or the Highway
 
Best Practices for Shifting Left Performance and Accessibility Testing
Best Practices for Shifting Left Performance and Accessibility TestingBest Practices for Shifting Left Performance and Accessibility Testing
Best Practices for Shifting Left Performance and Accessibility TestingPerfecto by Perforce
 
Uncovering the unknowns of appium and beyond
Uncovering the unknowns of appium and beyondUncovering the unknowns of appium and beyond
Uncovering the unknowns of appium and beyondPerfecto by Perforce
 
Accelerating Digital Transformation With API Lifecycle & Test Automation
Accelerating Digital Transformation With API Lifecycle & Test AutomationAccelerating Digital Transformation With API Lifecycle & Test Automation
Accelerating Digital Transformation With API Lifecycle & Test AutomationPerfecto by Perforce
 
Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...
Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...
Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...Perfecto by Perforce
 
Cloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More AccessibleCloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More AccessiblePerfecto by Perforce
 
Mastering Cross-Browser Test Automation With Cypress and Selenium
Mastering Cross-Browser Test Automation With Cypress and SeleniumMastering Cross-Browser Test Automation With Cypress and Selenium
Mastering Cross-Browser Test Automation With Cypress and SeleniumPerfecto by Perforce
 
Fast Data, Fast Delivery: How Smart Analysis Accelerates App Testing
Fast Data, Fast Delivery: How Smart Analysis Accelerates App TestingFast Data, Fast Delivery: How Smart Analysis Accelerates App Testing
Fast Data, Fast Delivery: How Smart Analysis Accelerates App TestingPerfecto by Perforce
 
Keeping Your Continuous Test Automation Continuously Valuable
Keeping Your Continuous Test Automation Continuously ValuableKeeping Your Continuous Test Automation Continuously Valuable
Keeping Your Continuous Test Automation Continuously ValuablePerfecto by Perforce
 
How to Eliminate Escaped Defects With a Proven Test Automation Coverage Strategy
How to Eliminate Escaped Defects With a Proven Test Automation Coverage StrategyHow to Eliminate Escaped Defects With a Proven Test Automation Coverage Strategy
How to Eliminate Escaped Defects With a Proven Test Automation Coverage StrategyPerfecto by Perforce
 
Keeping Your Continuous Test Automation Suites Continuously Valuable in DevOps
Keeping Your Continuous Test Automation Suites Continuously Valuable in DevOpsKeeping Your Continuous Test Automation Suites Continuously Valuable in DevOps
Keeping Your Continuous Test Automation Suites Continuously Valuable in DevOpsPerfecto by Perforce
 
Deliver Flawless Mobile Apps Faster with CI/CD & CT
Deliver Flawless Mobile Apps Faster with CI/CD & CTDeliver Flawless Mobile Apps Faster with CI/CD & CT
Deliver Flawless Mobile Apps Faster with CI/CD & CTPerfecto by Perforce
 
Testing the UI of Mobile Applications
Testing the UI of Mobile ApplicationsTesting the UI of Mobile Applications
Testing the UI of Mobile ApplicationsMarco Torchiano
 
ganesh[5+ years] exp _Resume
ganesh[5+ years] exp _Resumeganesh[5+ years] exp _Resume
ganesh[5+ years] exp _Resumeganesh r
 
Mastering Mobile Test Automation with Appium
Mastering Mobile Test Automation with AppiumMastering Mobile Test Automation with Appium
Mastering Mobile Test Automation with AppiumPerfecto by Perforce
 
Trouble with Performance Debugging? Not Anymore with Choreo, the AI-Assisted ...
Trouble with Performance Debugging? Not Anymore with Choreo, the AI-Assisted ...Trouble with Performance Debugging? Not Anymore with Choreo, the AI-Assisted ...
Trouble with Performance Debugging? Not Anymore with Choreo, the AI-Assisted ...WSO2
 

Ähnlich wie How to Prepare Your Apps for iOS 14 - Test Strategy, Coverage, & Best Practices (20)

How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...
How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...
How to Create a Risk Based Testing Strategy With Simulators, Emulators, and R...
 
5 Mobile App Trends & What They Mean for Dev & Testing
5 Mobile App Trends & What They Mean for Dev & Testing5 Mobile App Trends & What They Mean for Dev & Testing
5 Mobile App Trends & What They Mean for Dev & Testing
 
How to Scale Digital App Testing With Jenkins & Automation You Can Trust
How to Scale Digital App Testing With Jenkins & Automation You Can TrustHow to Scale Digital App Testing With Jenkins & Automation You Can Trust
How to Scale Digital App Testing With Jenkins & Automation You Can Trust
 
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
Enhancing your Test automation Scenario Coverage Using Selenium by Eran Kinsb...
 
Best Practices for Shifting Left Performance and Accessibility Testing
Best Practices for Shifting Left Performance and Accessibility TestingBest Practices for Shifting Left Performance and Accessibility Testing
Best Practices for Shifting Left Performance and Accessibility Testing
 
Uncovering the unknowns of appium and beyond
Uncovering the unknowns of appium and beyondUncovering the unknowns of appium and beyond
Uncovering the unknowns of appium and beyond
 
Accelerating Digital Transformation With API Lifecycle & Test Automation
Accelerating Digital Transformation With API Lifecycle & Test AutomationAccelerating Digital Transformation With API Lifecycle & Test Automation
Accelerating Digital Transformation With API Lifecycle & Test Automation
 
Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...
Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...
Enhancing Your Test Automation Scenario Coverage with Selenium - QA or the Hi...
 
Cloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More AccessibleCloud Testing Has Never Been Easier or More Accessible
Cloud Testing Has Never Been Easier or More Accessible
 
Mastering Cross-Browser Test Automation With Cypress and Selenium
Mastering Cross-Browser Test Automation With Cypress and SeleniumMastering Cross-Browser Test Automation With Cypress and Selenium
Mastering Cross-Browser Test Automation With Cypress and Selenium
 
Fast Data, Fast Delivery: How Smart Analysis Accelerates App Testing
Fast Data, Fast Delivery: How Smart Analysis Accelerates App TestingFast Data, Fast Delivery: How Smart Analysis Accelerates App Testing
Fast Data, Fast Delivery: How Smart Analysis Accelerates App Testing
 
Keeping Your Continuous Test Automation Continuously Valuable
Keeping Your Continuous Test Automation Continuously ValuableKeeping Your Continuous Test Automation Continuously Valuable
Keeping Your Continuous Test Automation Continuously Valuable
 
How to Eliminate Escaped Defects With a Proven Test Automation Coverage Strategy
How to Eliminate Escaped Defects With a Proven Test Automation Coverage StrategyHow to Eliminate Escaped Defects With a Proven Test Automation Coverage Strategy
How to Eliminate Escaped Defects With a Proven Test Automation Coverage Strategy
 
Keeping Your Continuous Test Automation Suites Continuously Valuable in DevOps
Keeping Your Continuous Test Automation Suites Continuously Valuable in DevOpsKeeping Your Continuous Test Automation Suites Continuously Valuable in DevOps
Keeping Your Continuous Test Automation Suites Continuously Valuable in DevOps
 
Deliver Flawless Mobile Apps Faster with CI/CD & CT
Deliver Flawless Mobile Apps Faster with CI/CD & CTDeliver Flawless Mobile Apps Faster with CI/CD & CT
Deliver Flawless Mobile Apps Faster with CI/CD & CT
 
Testing the UI of Mobile Applications
Testing the UI of Mobile ApplicationsTesting the UI of Mobile Applications
Testing the UI of Mobile Applications
 
ganesh[5+ years] exp _Resume
ganesh[5+ years] exp _Resumeganesh[5+ years] exp _Resume
ganesh[5+ years] exp _Resume
 
Mastering Mobile Test Automation with Appium
Mastering Mobile Test Automation with AppiumMastering Mobile Test Automation with Appium
Mastering Mobile Test Automation with Appium
 
Madhusmita mohanty_MohantyCV
Madhusmita mohanty_MohantyCVMadhusmita mohanty_MohantyCV
Madhusmita mohanty_MohantyCV
 
Trouble with Performance Debugging? Not Anymore with Choreo, the AI-Assisted ...
Trouble with Performance Debugging? Not Anymore with Choreo, the AI-Assisted ...Trouble with Performance Debugging? Not Anymore with Choreo, the AI-Assisted ...
Trouble with Performance Debugging? Not Anymore with Choreo, the AI-Assisted ...
 

Mehr von Perfecto by Perforce

Is BDD Worth It? Considerations for Advanced Test Automation
Is BDD Worth It? Considerations for Advanced Test AutomationIs BDD Worth It? Considerations for Advanced Test Automation
Is BDD Worth It? Considerations for Advanced Test AutomationPerfecto by Perforce
 
Yoda debunks the top 5 challenges of continuous testing in the cloud
Yoda debunks the top 5 challenges of continuous testing in the cloudYoda debunks the top 5 challenges of continuous testing in the cloud
Yoda debunks the top 5 challenges of continuous testing in the cloudPerfecto by Perforce
 
The Rise and Benefits of Robotic Process Automation (RPA) - DevOps Next
The Rise and Benefits of Robotic Process Automation (RPA) - DevOps NextThe Rise and Benefits of Robotic Process Automation (RPA) - DevOps Next
The Rise and Benefits of Robotic Process Automation (RPA) - DevOps NextPerfecto by Perforce
 
Moving to Modern DevOps with Fuzzing and ML - DevOps Next
Moving to Modern DevOps with Fuzzing and ML - DevOps NextMoving to Modern DevOps with Fuzzing and ML - DevOps Next
Moving to Modern DevOps with Fuzzing and ML - DevOps NextPerfecto by Perforce
 
Leveraging AI and ML in Test Management Systems - DevOps Next
Leveraging AI and ML in Test Management Systems - DevOps NextLeveraging AI and ML in Test Management Systems - DevOps Next
Leveraging AI and ML in Test Management Systems - DevOps NextPerfecto by Perforce
 
How Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps Next
How Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps NextHow Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps Next
How Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps NextPerfecto by Perforce
 
Classification of Advanced AI and ML Testing Tools - DevOps Next
Classification of Advanced AI and ML Testing Tools - DevOps NextClassification of Advanced AI and ML Testing Tools - DevOps Next
Classification of Advanced AI and ML Testing Tools - DevOps NextPerfecto by Perforce
 
Automated Code Reviews with AI and ML - DevOps Next
Automated Code Reviews with AI and ML - DevOps NextAutomated Code Reviews with AI and ML - DevOps Next
Automated Code Reviews with AI and ML - DevOps NextPerfecto by Perforce
 
The Automation Firehose: Be Strategic & Tactical With Your Mobile & Web Testing
The Automation Firehose: Be Strategic & Tactical With Your Mobile & Web TestingThe Automation Firehose: Be Strategic & Tactical With Your Mobile & Web Testing
The Automation Firehose: Be Strategic & Tactical With Your Mobile & Web TestingPerfecto by Perforce
 
Why Mobile and Web Testing MUST Move to the Cloud
Why Mobile and Web Testing MUST Move to the CloudWhy Mobile and Web Testing MUST Move to the Cloud
Why Mobile and Web Testing MUST Move to the CloudPerfecto by Perforce
 
4 Testing Methods to Scale and Automate Your DevOps Pipeline
4 Testing Methods to Scale and Automate Your DevOps Pipeline4 Testing Methods to Scale and Automate Your DevOps Pipeline
4 Testing Methods to Scale and Automate Your DevOps PipelinePerfecto by Perforce
 
How to Guarantee Continuous Value from your Test Automation
How to Guarantee Continuous Value from your Test AutomationHow to Guarantee Continuous Value from your Test Automation
How to Guarantee Continuous Value from your Test AutomationPerfecto by Perforce
 
Everything You Need to Know About Testing i os 13
Everything You Need to Know About Testing i os 13Everything You Need to Know About Testing i os 13
Everything You Need to Know About Testing i os 13Perfecto by Perforce
 

Mehr von Perfecto by Perforce (13)

Is BDD Worth It? Considerations for Advanced Test Automation
Is BDD Worth It? Considerations for Advanced Test AutomationIs BDD Worth It? Considerations for Advanced Test Automation
Is BDD Worth It? Considerations for Advanced Test Automation
 
Yoda debunks the top 5 challenges of continuous testing in the cloud
Yoda debunks the top 5 challenges of continuous testing in the cloudYoda debunks the top 5 challenges of continuous testing in the cloud
Yoda debunks the top 5 challenges of continuous testing in the cloud
 
The Rise and Benefits of Robotic Process Automation (RPA) - DevOps Next
The Rise and Benefits of Robotic Process Automation (RPA) - DevOps NextThe Rise and Benefits of Robotic Process Automation (RPA) - DevOps Next
The Rise and Benefits of Robotic Process Automation (RPA) - DevOps Next
 
Moving to Modern DevOps with Fuzzing and ML - DevOps Next
Moving to Modern DevOps with Fuzzing and ML - DevOps NextMoving to Modern DevOps with Fuzzing and ML - DevOps Next
Moving to Modern DevOps with Fuzzing and ML - DevOps Next
 
Leveraging AI and ML in Test Management Systems - DevOps Next
Leveraging AI and ML in Test Management Systems - DevOps NextLeveraging AI and ML in Test Management Systems - DevOps Next
Leveraging AI and ML in Test Management Systems - DevOps Next
 
How Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps Next
How Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps NextHow Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps Next
How Does AIOps Benefit DevOps Pipeline and Software Quality? - DevOps Next
 
Classification of Advanced AI and ML Testing Tools - DevOps Next
Classification of Advanced AI and ML Testing Tools - DevOps NextClassification of Advanced AI and ML Testing Tools - DevOps Next
Classification of Advanced AI and ML Testing Tools - DevOps Next
 
Automated Code Reviews with AI and ML - DevOps Next
Automated Code Reviews with AI and ML - DevOps NextAutomated Code Reviews with AI and ML - DevOps Next
Automated Code Reviews with AI and ML - DevOps Next
 
The Automation Firehose: Be Strategic & Tactical With Your Mobile & Web Testing
The Automation Firehose: Be Strategic & Tactical With Your Mobile & Web TestingThe Automation Firehose: Be Strategic & Tactical With Your Mobile & Web Testing
The Automation Firehose: Be Strategic & Tactical With Your Mobile & Web Testing
 
Why Mobile and Web Testing MUST Move to the Cloud
Why Mobile and Web Testing MUST Move to the CloudWhy Mobile and Web Testing MUST Move to the Cloud
Why Mobile and Web Testing MUST Move to the Cloud
 
4 Testing Methods to Scale and Automate Your DevOps Pipeline
4 Testing Methods to Scale and Automate Your DevOps Pipeline4 Testing Methods to Scale and Automate Your DevOps Pipeline
4 Testing Methods to Scale and Automate Your DevOps Pipeline
 
How to Guarantee Continuous Value from your Test Automation
How to Guarantee Continuous Value from your Test AutomationHow to Guarantee Continuous Value from your Test Automation
How to Guarantee Continuous Value from your Test Automation
 
Everything You Need to Know About Testing i os 13
Everything You Need to Know About Testing i os 13Everything You Need to Know About Testing i os 13
Everything You Need to Know About Testing i os 13
 

Último

From the origin to the future of Open Source model and business
From the origin to the future of  Open Source model and businessFrom the origin to the future of  Open Source model and business
From the origin to the future of Open Source model and businessFrancesco Corti
 
UiPath Studio Web workshop series - Day 1
UiPath Studio Web workshop series  - Day 1UiPath Studio Web workshop series  - Day 1
UiPath Studio Web workshop series - Day 1DianaGray10
 
Stobox 4: Revolutionizing Investment in Real-World Assets Through Tokenization
Stobox 4: Revolutionizing Investment in Real-World Assets Through TokenizationStobox 4: Revolutionizing Investment in Real-World Assets Through Tokenization
Stobox 4: Revolutionizing Investment in Real-World Assets Through TokenizationStobox
 
3 Pitfalls Everyone Should Avoid with Cloud Data
3 Pitfalls Everyone Should Avoid with Cloud Data3 Pitfalls Everyone Should Avoid with Cloud Data
3 Pitfalls Everyone Should Avoid with Cloud DataEric D. Schabell
 
Trailblazer Community - Flows Workshop (Session 2)
Trailblazer Community - Flows Workshop (Session 2)Trailblazer Community - Flows Workshop (Session 2)
Trailblazer Community - Flows Workshop (Session 2)Muhammad Tiham Siddiqui
 
Technical SEO for Improved Accessibility WTS FEST
Technical SEO for Improved Accessibility  WTS FESTTechnical SEO for Improved Accessibility  WTS FEST
Technical SEO for Improved Accessibility WTS FESTBillieHyde
 
Webinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - Tech
Webinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - TechWebinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - Tech
Webinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - TechProduct School
 
Q4 2023 Quarterly Investor Presentation - FINAL - v1.pdf
Q4 2023 Quarterly Investor Presentation - FINAL - v1.pdfQ4 2023 Quarterly Investor Presentation - FINAL - v1.pdf
Q4 2023 Quarterly Investor Presentation - FINAL - v1.pdfTejal81
 
Automation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projectsAutomation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projectsDianaGray10
 
2024.03.12 Cost drivers of cultivated meat production.pdf
2024.03.12 Cost drivers of cultivated meat production.pdf2024.03.12 Cost drivers of cultivated meat production.pdf
2024.03.12 Cost drivers of cultivated meat production.pdfThe Good Food Institute
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
 
March Patch Tuesday
March Patch TuesdayMarch Patch Tuesday
March Patch TuesdayIvanti
 
Where developers are challenged, what developers want and where DevEx is going
Where developers are challenged, what developers want and where DevEx is goingWhere developers are challenged, what developers want and where DevEx is going
Where developers are challenged, what developers want and where DevEx is goingFrancesco Corti
 
My key hands-on projects in Quantum, and QAI
My key hands-on projects in Quantum, and QAIMy key hands-on projects in Quantum, and QAI
My key hands-on projects in Quantum, and QAIVijayananda Mohire
 
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptx
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptxEmil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptx
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptxNeo4j
 
EMEA What is ThousandEyes? Webinar
EMEA What is ThousandEyes? WebinarEMEA What is ThousandEyes? Webinar
EMEA What is ThousandEyes? WebinarThousandEyes
 
IT Service Management (ITSM) Best Practices for Advanced Computing
IT Service Management (ITSM) Best Practices for Advanced ComputingIT Service Management (ITSM) Best Practices for Advanced Computing
IT Service Management (ITSM) Best Practices for Advanced ComputingMAGNIntelligence
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightSafe Software
 
How to release an Open Source Dataweave Library
How to release an Open Source Dataweave LibraryHow to release an Open Source Dataweave Library
How to release an Open Source Dataweave Libraryshyamraj55
 
Flow Control | Block Size | ST Min | First Frame
Flow Control | Block Size | ST Min | First FrameFlow Control | Block Size | ST Min | First Frame
Flow Control | Block Size | ST Min | First FrameKapil Thakar
 

Último (20)

From the origin to the future of Open Source model and business
From the origin to the future of  Open Source model and businessFrom the origin to the future of  Open Source model and business
From the origin to the future of Open Source model and business
 
UiPath Studio Web workshop series - Day 1
UiPath Studio Web workshop series  - Day 1UiPath Studio Web workshop series  - Day 1
UiPath Studio Web workshop series - Day 1
 
Stobox 4: Revolutionizing Investment in Real-World Assets Through Tokenization
Stobox 4: Revolutionizing Investment in Real-World Assets Through TokenizationStobox 4: Revolutionizing Investment in Real-World Assets Through Tokenization
Stobox 4: Revolutionizing Investment in Real-World Assets Through Tokenization
 
3 Pitfalls Everyone Should Avoid with Cloud Data
3 Pitfalls Everyone Should Avoid with Cloud Data3 Pitfalls Everyone Should Avoid with Cloud Data
3 Pitfalls Everyone Should Avoid with Cloud Data
 
Trailblazer Community - Flows Workshop (Session 2)
Trailblazer Community - Flows Workshop (Session 2)Trailblazer Community - Flows Workshop (Session 2)
Trailblazer Community - Flows Workshop (Session 2)
 
Technical SEO for Improved Accessibility WTS FEST
Technical SEO for Improved Accessibility  WTS FESTTechnical SEO for Improved Accessibility  WTS FEST
Technical SEO for Improved Accessibility WTS FEST
 
Webinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - Tech
Webinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - TechWebinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - Tech
Webinar: The Art of Prioritizing Your Product Roadmap by AWS Sr PM - Tech
 
Q4 2023 Quarterly Investor Presentation - FINAL - v1.pdf
Q4 2023 Quarterly Investor Presentation - FINAL - v1.pdfQ4 2023 Quarterly Investor Presentation - FINAL - v1.pdf
Q4 2023 Quarterly Investor Presentation - FINAL - v1.pdf
 
Automation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projectsAutomation Ops Series: Session 2 - Governance for UiPath projects
Automation Ops Series: Session 2 - Governance for UiPath projects
 
2024.03.12 Cost drivers of cultivated meat production.pdf
2024.03.12 Cost drivers of cultivated meat production.pdf2024.03.12 Cost drivers of cultivated meat production.pdf
2024.03.12 Cost drivers of cultivated meat production.pdf
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
March Patch Tuesday
March Patch TuesdayMarch Patch Tuesday
March Patch Tuesday
 
Where developers are challenged, what developers want and where DevEx is going
Where developers are challenged, what developers want and where DevEx is goingWhere developers are challenged, what developers want and where DevEx is going
Where developers are challenged, what developers want and where DevEx is going
 
My key hands-on projects in Quantum, and QAI
My key hands-on projects in Quantum, and QAIMy key hands-on projects in Quantum, and QAI
My key hands-on projects in Quantum, and QAI
 
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptx
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptxEmil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptx
Emil Eifrem at GraphSummit Copenhagen 2024 - The Art of the Possible.pptx
 
EMEA What is ThousandEyes? Webinar
EMEA What is ThousandEyes? WebinarEMEA What is ThousandEyes? Webinar
EMEA What is ThousandEyes? Webinar
 
IT Service Management (ITSM) Best Practices for Advanced Computing
IT Service Management (ITSM) Best Practices for Advanced ComputingIT Service Management (ITSM) Best Practices for Advanced Computing
IT Service Management (ITSM) Best Practices for Advanced Computing
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
How to release an Open Source Dataweave Library
How to release an Open Source Dataweave LibraryHow to release an Open Source Dataweave Library
How to release an Open Source Dataweave Library
 
Flow Control | Block Size | ST Min | First Frame
Flow Control | Block Size | ST Min | First FrameFlow Control | Block Size | ST Min | First Frame
Flow Control | Block Size | ST Min | First Frame
 

How to Prepare Your Apps for iOS 14 - Test Strategy, Coverage, & Best Practices

  • 1. Perfecto by Perforce © 2020 Perforce Software, Inc. How to Prepare Your Apps for iOS 14: Test Strategy, Coverage, & Best Practices
  • 2. 2 | Advanced Codeless Testing for Web Apps Today’s Speakers: Eran Kinsbruner • Chief Evangelist and author at Perfecto • Blogger and speaker • 20+ years in development & testing • Author of “The Digital Quality Handbook” and “Continuous Testing for DevOps Professionals” • @ek121268 • https://www.linkedin.com/in/eran-kinsbruner-4b47a81/ Anand Bagmar • Software Quality Evangelist at Applitools, blogger, and speaker • Over 20+ years in software development and testing • Specializes in product quality strategy & execution, and building automated testing tools, infrastructure, and frameworks • Built open source tools related to software testing: WAAT (Web Analytics Automation Testing Framework), TaaS (for automating the integration testing in disparate systems) and TTA (Test Trend Analyzer) • https://in.linkedin.com/in/anandbagmar • @BagmarAnand
  • 3. perfecto.io3 | Perfecto by Perforce © 2020 Perforce Software, Inc. Today’s Agenda 1 3 4 Mobile Test Coverage Guidelines iOS 14 Features Overview and Pitfalls 5 How to Combine Testing on iOS Simulators & Real Devices Live Demo: iOS 13 vs. iOS 14 Issues (Appium) 6 Q&A 2 Functional & Visual Testing — Recommended Strategy
  • 4. iOS 14: Key Features Overview
  • 5. perfecto.io5 | Perfecto by Perforce © 2020 Perforce Software, Inc. • New UI Enhancements • Widgets • App Library • Messages • Notifications • New translation app • Enhanced Siri • New Safari browser (Safari 14) • Car Key/Car Play What’s New in iOS 14
  • 6. perfecto.io6 | Perfecto by Perforce © 2020 Perforce Software, Inc. What’s New in iOS 14 — Continued • App Clips load within seconds and let users complete specific tasks, like pay for parking using Sign In With Apple and Apple Pay. App Clips can be discovered and accessed by scanning Apple's new "App Clip codes," or by using NFC and QR codes. They can also be shared in Messages and Safari.
  • 7. perfecto.io7 | Perfecto by Perforce © 2020 Perforce Software, Inc. iOS 14 Collected Pitfalls: Functional, Memory, UI Issues Works on iOS 13, Crashes on iOS 14 Works on iOS 13, Crashes on iOS 14
  • 8. perfecto.io8 | Perfecto by Perforce © 2020 Perforce Software, Inc. iOS 14 Collected Pitfalls: Functional, Memory, UI Issues Looks Good on iOS 13 Text Field Truncated on iOS 14
  • 10. perfecto.io10 | Perfecto by Perforce © 2020 Perforce Software, Inc. • Quality Strategy = Testing + Automation + App Release Plan Quality Strategy
  • 11. perfecto.io11 | Perfecto by Perforce © 2020 Perforce Software, Inc. Quality Strategy
  • 12. perfecto.io12 | Perfecto by Perforce © 2020 Perforce Software, Inc. • Build in quality by testing early • Feature kick-off • Business requirements • Story kick-off • User impact • Dev-Box testing • Implement what was expected • Thorough story testing & exploratory testing • Test was was implemented • Product owner sign-off per story & feature • Involve everyone, quality is a team responsibility Structured Way of Working
  • 13. perfecto.io13 | Perfecto by Perforce © 2020 Perforce Software, Inc. • Automate as much as you can (what brings relevant value) • Unit tests • Integration tests • Functional tests (E2E) — focused on user-journeys • Visual testing — user experience should be consistent, and as expected • Analytics tests Automation Is Key
  • 14. perfecto.io14 | Perfecto by Perforce © 2020 Perforce Software, Inc. Value of Automation Run the tests on every change — capture the regression as soon as it is introduced in the code.
  • 15. perfecto.io15 | Perfecto by Perforce © 2020 Perforce Software, Inc. Simulate real-user behavior/interactions. Run the tests on simulators & real devices.
  • 16. perfecto.io16 | Perfecto by Perforce © 2020 Perforce Software, Inc. • In-house testing • On-field testing (sanity) • Staged releases • Sentiment analysis • Review comments (PlayStore/App Store) • Social media (Twitter, Instagram, Facebook, etc.) • Extensive monitoring of staged releases • Analytics • Crashes • Support tickets Release Approach
  • 17. perfecto.io17 | Perfecto by Perforce © 2020 Perforce Software, Inc. Does your strategy change if a new version of OS needs to be supported?
  • 18. perfecto.io18 | Perfecto by Perforce © 2020 Perforce Software, Inc. Eran gave plenty of examples why it is necessary to keep the variables in mind! YES!
  • 19. perfecto.io19 | Perfecto by Perforce © 2020 Perforce Software, Inc. • Validate compatibility of your product with the new iOS version, and quickly! Key aspects to keep in mind in case of iOS 14.
  • 20. perfecto.io20 | Perfecto by Perforce © 2020 Perforce Software, Inc. • Functionality/gestures • UI/UX • Memory • New installations vs. existing installation vs. upgrade app versions • Integrations/permissions • Caching/data storage Challenges You May Face
  • 21. perfecto.io21 | Perfecto by Perforce © 2020 Perforce Software, Inc. • Executing automated tests • Unit tests • Integration tests • Functional tests (E2E) — focused on user-journeys • Visual testing — user experience should be consistent and as expected • Exploratory testing — finding impact of iOS version change on your app Strategy for iOS Version Change
  • 23. perfecto.io23 | Perfecto by Perforce © 2020 Perforce Software, Inc. Balancing Test Automation Coverage TEST SCENARIO ONE Test Case – 1 Test Case – 2 Test Case – 3 Test Case – N 2 sides of the same coin
  • 24. perfecto.io24 | Perfecto by Perforce © 2020 Perforce Software, Inc. Test Coverage Fundamentals Web Traffic Analytics Selecting the Right Test Cases
  • 25. perfecto.io25 | Perfecto by Perforce © 2020 Perforce Software, Inc. iOS and iPadOS Testing Coverage
  • 26. perfecto.io26 | Perfecto by Perforce © 2020 Perforce Software, Inc. • iOS 13 (Latest–1) testing required on • iPhone 11 series • iPhone 6 and below • iPad Air/Pro Series • iOS 12.4.8 (Latest –2) • iPhone 6 • iPad Mini 2 iOS and iPadOS Testing Coverage: GA, Latest-1, Latest-2
  • 27. perfecto.io27 | Perfecto by Perforce © 2020 Perforce Software, Inc. Latest GA Versions: • Chrome 84 • Firefox 79 • Edge 84 • Safari 13 • Safari 14 Beta* Global Browser Market Share Update: Adoption Trends Vary
  • 28. perfecto.io28 | Perfecto by Perforce © 2020 Perforce Software, Inc. Mobile Testing & Desktop Web Testing Are One iOS Safari Android Chrome Desktop Web UI
  • 29. Balancing Virtual Devices and Real Devices
  • 30. perfecto.io30 | Perfecto by Perforce © 2020 Perforce Software, Inc. Virtual Platform Definitions • Simulators • iOS (Apple) • A simulator is software that imitates the workings of software on your system that was made for mobile. • Mobile simulators can be used in app testing and cross- browser or responsive testing to simulate a mobile device and running your app or website in it. • Emulators • Android (Google) • An emulator is software that imitates the working of software on your system that was made for mobile. • Emulators also take into consideration the hardware part of the mobile device (memory, processor, battery performance, etc.). Real Device Behavior
  • 31. perfecto.io31 | Perfecto by Perforce © 2019 Perforce Software, Inc. Differences Between Android & iOS Virtual Platforms
  • 32. perfecto.io32 | Perfecto by Perforce © 2019 Perforce Software, Inc. Considerations for Using iOS and Android Virtual Platforms vs. Real Devices Stage and activity in the software development cycle Dev Test Debug Design Cost avoidance Coverage Platforms Real user conditions Test types Functional/Regression /Integration Testing Unit Non Functional Production Monitoring
  • 33. perfecto.io33 | Perfecto by Perforce © 2020 Perforce Software, Inc. Perfecto’s Mobile Testing Pyramid Combo Testing Pyramid Within Your DevOps Pipeline Requirements U N I T T E S T S M A N UA L T E S T S Testing isolated units of code. I N T EG R AT I O N T E S T S Testing across integrations of more than one system. U I T E S T S Testing through a user interface. Per code commit/ Post commit Build Acceptance/Regression Testing E2E Testing Exploratory/Manual Testing Dev Triggered Mix Real Devices & Emu./Simu. CI Triggered+ Real Devices Only CI Triggered Real Devices OnlyProd. Monitoring Non Functional Testing: Performance (UX) Testing/Security Real Devices Only
  • 34. perfecto.io34 | Perfecto by Perforce © 2020 Perforce Software, Inc. Virtual Platforms Mix of Virtual Platforms & Real Devices Only Real Devices Pipeline Testing Coverage Example
  • 35. Demos: Cross Platform Testing With Perfecto and Applitools
  • 36. perfecto.io36 | Perfecto by Perforce © 2020 Perforce Software, Inc. Continuous Testing – Key Metrics/Categories
  • 37. perfecto.io37 | Perfecto by Perforce © 2020 Perforce Software, Inc. Perfecto’s 4 Key Pillars of Continuous Testing in DevOps This is where money is spent (Time, Tools, Resources) This is where value is being realized, quality is improved Unified solution serves DevOps with greater effectiveness.
  • 38. perfecto.io38 | Perfecto by Perforce © 2020 Perforce Software, Inc. We Invented Visual AI that replicates the human eye and brain, looks at every screen and page in seconds, and spots app regressions that truly matter. We Help App Teams with their: • Functional Testing & Visual Testing • Web, Mobile, and UI/UX Testing • Cross Browser & Device Testing • Content Migration/OS version upgrades/browser version upgrades • Compliance Testing, Localization, Accessibility, PDF, & More Applitools Visual AI has analyzed one billion+ images with 99.9999% accuracy. About Applitools
  • 39. Visual AI Industry’s only AI powered computer vision replicates the human eye & brain. SDKs & Integrations SDKs to augment all modern test frameworks, and integrations with popular source control, CI, and defect tracking systems. Perfection Across All Screens Ultrafast Grid ensures visual perfection across all browsers, screens, and viewports. Ultrafast Grid Architecture >> Speed of CI/CD Execute tests in seconds vs minutes for faster builds and on-time delivery. Ultimate Efficiency Create tests faster & with fewer brittle locators and labels. Increase Test Coverage Open-ended, AI-powered assertions reduce code and maintenance while increasing test coverage. Applitools Cloud Visual AI Platform One Intelligent Platform Adding Applitools Visual AI to your existing test automation framework allows quality teams to release perfect apps faster and at a reduced cost.
  • 40. perfecto.io40 | Perfecto by Perforce © 2020 Perforce Software, Inc.
  • 41. Thank You! perfecto.io or follow us @perfectomobile applitools.com / @applitools