Visual Validation - The missing tip of the automation pyramid @GoT2022
•
0 likes•34 views
Visual Validation - The missing tip of the automation pyramid @GoT 2022
Recommended
Recommended
More Related Content
Similar to Visual Validation - The missing tip of the automation pyramid @GoT2022
Similar to Visual Validation - The missing tip of the automation pyramid @GoT2022 (20)
More from Anand Bagmar
More from Anand Bagmar (15)
Recently uploaded
Recently uploaded (20)
Visual Validation - The missing tip of the automation pyramid @GoT2022
- 1. Visual Validation The Missing Tip of the Automation Pyramid @BagmarAnand Anand Bagmar Software Quality Evangelist
- 3. How do you test …. @BagmarAnand
- 4. @BagmarAnand
- 5. • Pen writes properly • Cap closes properly • Looks as expected • Can hold the pen properly • … • … @BagmarAnand Typical answers
- 7. @BagmarAnand
- 9. What is missing here? @BagmarAnand
- 10. How do you ensure what was working before, is working now as well! @BagmarAnand
- 13. @BagmarAnand
- 14. @BagmarAnand
- 15. @BagmarAnand
- 16. @BagmarAnand
- 18. Unit (xUnit / JavaScript) Manual / Exploratory Web Service UI / e2e Business-facing Tests Technology-facing Tests @BagmarAnand Test Pyramid Slow More integration Expensive Fast More isolation Cheap
- 19. Unit (xUnit / JavaScript) Manual / Exploratory Web Service UI / e2e Technology-facing Tests @BagmarAnand Test Pyramid Slow More integration Expensive Fast More isolation Cheap Workflow API Contract Consumer Provide r Business-facing Tests
- 20. @BagmarAnand Test Pyramid – Includes NFRs Unit (xUnit / JavaScript) Manual / Exploratory Web Service UI / e2e Performance Security Accessibility Analytics
- 23. @BagmarAnand
- 24. @BagmarAnand
- 25. @BagmarAnand
- 26. @BagmarAnand
- 27. It happens in Software too! @BagmarAnand https://cdn.pixabay.com/photo/2013/07/12/15/58/smiley-150663_1280.png Surprise
- 28. It happens to Instagram @BagmarAnand
- 29. It happens to Twitter @BagmarAnand
- 30. It happens to UPS @BagmarAnand
- 31. It happens to Financial Times @BagmarAnand
- 32. It Happens to Amazon @BagmarAnand
- 33. It happens to HDFC Bank @BagmarAnand
- 34. It happens to Southwest Airlines @BagmarAnand
- 35. It happens to Spicejet @BagmarAnand
- 36. It happens to Spicejet @BagmarAnand
- 37. Bugs escape because our approach to testing is incorrect @BagmarAnand
- 40. UX / Visual Testing The Missing Piece @BagmarAnand
- 41. • Business / Revenue loss • Brand / Credibility loss • You loose your users! @BagmarAnand If Visual Testing is NOT done …..
- 42. @BagmarAnand What is Visual Testing?
- 44. • Mostly done manually done @BagmarAnand Visual Testing
- 45. • Mostly done manually done @BagmarAnand Challenges of Visual Testing • tedious • very error prone • impossible to scale and repeat • blocker for CI-CD
- 46. • Mostly done manually done • tedious • very error prone • impossible to scale and repeat – especially in days of CD! • Functional Automation may help – a little @BagmarAnand Challenges of Visual Testing
- 48. • Create baselines by taking screenshots of expected UI • Compare screenshots • Whole page • Snippets • Update baselines as product evolves / changes @BagmarAnand How does it work?
- 49. Challenges of Automating Visual Testing @BagmarAnand
- 50. • False positives / negatives • Baseline creation and maintenance • Browsers • Devices • Resolutions / Viewports • Result analysis & identifying next steps @BagmarAnand Challenges of Automated Visual Validation
- 51. @BagmarAnand Challenges of Automated Visual Validation https://www.europarc.org/wp-content/uploads/2020/04/CicloSilvo_completo-ESP-ENG.png
- 52. @BagmarAnand Challenges of Automated Visual Validation https://www.europarc.org/wp-content/uploads/2020/04/CicloSilvo_completo-ESP-ENG.png
- 53. @BagmarAnand Challenges of Automated Visual Validation https://www.europarc.org/wp-content/uploads/2020/04/CicloSilvo_completo-ESP-ENG.png • Product evolves • Features • Functionality • Personalization • Contextual data • Experiments • Feature toggles
- 54. @BagmarAnand Challenges of Automated Visual Validation • Pixel comparison does not work
- 55. @BagmarAnand Challenges of Automated Visual Validation • Pixel comparison does not work
- 56. AI in Visual Test Automation @BagmarAnand
- 58. Test Automation Pyramid @BagmarAnand Unit (xUnit / JavaScript) Manual / Exploratory Web Service UI / e2e
- 59. @BagmarAnand Test Pyramid – Includes UX & NFRs Unit (xUnit / JavaScript) Manual / Exploratory Web Service UI / e2e Performance Security Accessibility Analytics UX
- 61. • Have a holistic Quality Strategy for your product • Shift-Left to get quick feedback • Include Visual Testing in your Automation Strategy @BagmarAnand Summary
- 62. • The Practical Test Pyramid - https://martinfowler.com/articles/practical-test-pyramid.html • Testing Pyramids & Ice-Cream Cones - https://watirmelon.blog/testing-pyramids/ • Applitools – www.applitools.com @BagmarAnand References