SlideShare ist ein Scribd-Unternehmen logo
1 von 21
QA is Dead!

Long live the
  new QA!
Ronen Bar Nahor, Yuval Yeret
      AgileSparks
 Challenging your comfort zone
        All Rights Reserved- AgileSparks
AgileSparks



 • We help companies improve by
    Adopting agile principles and practices.
 • We provide training and coaching to all organizational
   levels, from high management to developers.
 • Our team consists of Agile professionals with diverse
   expertise – several coaches participate in each
   implementation.
 • Successfully completed dozens of projects.




                      All Rights Reserved- AgileSparks
Agile is … Delighting Customers

 Deliver value to customers/users frequently,
 at a continuously sustainable pace, seeking
 constant feedback and welcoming direction
 changes in an UNCERTAIN DYNAMIC world




 *Maturity/Effectiveness of process is a factor of the frequency


                          All Rights Reserved- AgileSparks
Feature Teams
                                                        Testers
                                                        Developers




 •   Whole Team Approach
 •   Working Tested Software
 •   Build Quality In – Zero Defects
 •   Trusted / Empowered with Meaningful Goal

                     All Rights Reserved- AgileSparks
G-Forces of agility

                 Learn                    Idea




    Validate                                           Specify




                 Verify                  Code                                         Learn    Idea
                                                                                                                           Learn    Idea




                                                                                                                Validate                   Specify




                                                                                                                           Verify   Code

                                                                           Validate                   Specify




                                                                                      Verify   Code




                                                 All Rights Reserved- AgileSparks
http://www.slideshare.net/KentBeck/software-g-forces
Deployment to production: 1990




               Annual        Quarterly         Monthly                  Weekly      Daily   Hourly

                                                 All Rights Reserved- AgileSparks
http://www.slideshare.net/KentBeck/software-g-forces
Deployment to production : 2010




               Annual        Quarterly         Monthly                  Weekly      Daily   Hourly

                                                 All Rights Reserved- AgileSparks
http://www.slideshare.net/KentBeck/software-g-forces
Deployment to production : 2030




               Annual        Quarterly         Monthly                  Weekly      Daily   Hourly

                                                 All Rights Reserved- AgileSparks
http://www.slideshare.net/KentBeck/software-g-forces
Early Feedback – The Goal and the conflict…

                                     Improve – Reduce Testing Overhead

      Ideal Batch Size
            WITH                                          Ideal Batch        Traditional
      Great automation                                       W/O             Processes
                                                          Automation




                                         Earlier Feedback – Cheaper to change



                                             Lower Testing Overhead

  •   Even without reducing testing overhead it is usually more cost-effective to reduce batch size
  •   Aim to reduce testing overhead to reduce batch size even more and be even more cost-effective

                                          All Rights Reserved- AgileSparks
Automate at the right level
                                             Manual

                                                                            UI
                                                                            5%



                                                              Acceptance
           ROI
  Cost




                                                             (Service/API)
                                                                         15%


                                                               Unit Testing
                                                                         80%


                                                 All Rights Reserved- AgileSparks
http://www.mountaingoatsoftware.com/blog/the-forgotten-layer-of-the-test-automation-pyramid
How do we get these supermen testers?




             All Rights Reserved- AgileSparks
So what is the unique value of QA?




                 All Rights Reserved- AgileSparks
13


     Credit - Udi Weinberg – HP Software   All Rights Reserved- AgileSparks
Back to Basics – Minimize Quality Risks

 • Being Champions of the
   Product and the
   Customer/User.
 • Specializing in Performance/
   Security/Load/etc.
 • Shining light on where to
   focus quality efforts by
   analyzing risk probability
   and Impact.

                   All Rights Reserved- AgileSparks
Test for Value

          Deliver the RIGHT                                       it is
                even more important

         than doing                        it RIGHT
* Fit to Customer OVER Fit to Spec
                               All Rights Reserved- AgileSparks
New Perspective of QA’s Role




    Accountable to Quality:
    By Enabling it rather than Owning it




                All Rights Reserved- AgileSparks
Quality OVER Quantity - experts SUPPORTING delivery
                                                Test
                                         Experts/Architects



    Delivery Team
  Software Engineers                             Delivery Team
                                               Software Engineers




                Delivery Team                                       Choose where to be
              Software Engineers                                        involved


                                                               Delivery Team
     Delivery Team                                           Software Engineers
   Software Engineers
                          All Rights Reserved- AgileSparks
How will roles/ratios change over time?


                             Automation                           Test Engineers/
                              Experts                                 Experts

                             Testers




                                                                          SW Engineers

                SW Developers




      2005                       2010                             2015              2020
   *AgileSparks prediction             All Rights Reserved- AgileSparks
What do I do tomorrow?

 • Learn about post-agile QA.
 • Map Current State,
   Decide on Direction.
 • Work on
    – Effective whole team Automation/
      Continuous Integration/Deployment.
    – The “Test Engineer” Role –
      Identify, Gap Analysis,
      Establish plan for closing gaps.
    – Mindset/Doctrine and Processes/
      Policies to transition from Owning to
      Enabling at the teams level.

 • Proceed using small experiments or
   big revolution,
   depending on the context.


                          All Rights Reserved- AgileSparks
References




                                                         http://bit.ly/testisdeadGTAC11




                                                http://gojko.net/2012/05/08/redefin
                                                ing-software-quality/
             All Rights Reserved- AgileSparks
Questions? Ask us How

Ronen@AgileSparks.com
Yuval@AgileSparks.com
www.AgileSparks.com

Q&A at our booth




                    All Rights Reserved- AgileSparks

Weitere ähnliche Inhalte

Mehr von AgileSparks

Mehr von AgileSparks (20)

Jira Portfolio by Elad Ben-Noam
Jira Portfolio by Elad Ben-NoamJira Portfolio by Elad Ben-Noam
Jira Portfolio by Elad Ben-Noam
 
Agile Hiring at Scale by Yon Bergman
Agile Hiring at Scale by Yon Bergman Agile Hiring at Scale by Yon Bergman
Agile Hiring at Scale by Yon Bergman
 
Are We Really Using Our Resources in The Most Effective Way? by Perry Yaqubo...
Are We Really Using Our Resources in The Most Effective Way?  by Perry Yaqubo...Are We Really Using Our Resources in The Most Effective Way?  by Perry Yaqubo...
Are We Really Using Our Resources in The Most Effective Way? by Perry Yaqubo...
 
Honest Experimentation by Jonathan Bertfield
 Honest Experimentation by Jonathan Bertfield Honest Experimentation by Jonathan Bertfield
Honest Experimentation by Jonathan Bertfield
 
Pango Journey to an Agile Cloud by Yaniv Kalo
Pango Journey to an Agile Cloud by Yaniv KaloPango Journey to an Agile Cloud by Yaniv Kalo
Pango Journey to an Agile Cloud by Yaniv Kalo
 
ClickSoftware Agile Tranistion by Meny Duek
ClickSoftware Agile Tranistion by Meny DuekClickSoftware Agile Tranistion by Meny Duek
ClickSoftware Agile Tranistion by Meny Duek
 
Augury's Journey Towards CD by Assaf Mizrachi
Augury's Journey Towards CD by Assaf Mizrachi Augury's Journey Towards CD by Assaf Mizrachi
Augury's Journey Towards CD by Assaf Mizrachi
 
Kubernetes is Hard! Lessons Learned Taking Our Apps to Kubernetes by Eldad Assis
Kubernetes is Hard! Lessons Learned Taking Our Apps to Kubernetes by Eldad AssisKubernetes is Hard! Lessons Learned Taking Our Apps to Kubernetes by Eldad Assis
Kubernetes is Hard! Lessons Learned Taking Our Apps to Kubernetes by Eldad Assis
 
Creating a Culture of Ownership and Trust with Visibility and Transparency by...
Creating a Culture of Ownership and Trust with Visibility and Transparency by...Creating a Culture of Ownership and Trust with Visibility and Transparency by...
Creating a Culture of Ownership and Trust with Visibility and Transparency by...
 
Real Innovation is with Real Customers by Baat Enosh
Real Innovation is with Real Customers by Baat EnoshReal Innovation is with Real Customers by Baat Enosh
Real Innovation is with Real Customers by Baat Enosh
 
True Continuous Improvement with Toyota Kata by Jesper Boeg
True Continuous Improvement with Toyota Kata by Jesper BoegTrue Continuous Improvement with Toyota Kata by Jesper Boeg
True Continuous Improvement with Toyota Kata by Jesper Boeg
 
Homo-Adaptus Agile Worker by Lior Frenkel
Homo-Adaptus Agile Worker by Lior FrenkelHomo-Adaptus Agile Worker by Lior Frenkel
Homo-Adaptus Agile Worker by Lior Frenkel
 
Intel CHD Case Study by Ronen Ezra
Intel CHD Case Study by Ronen EzraIntel CHD Case Study by Ronen Ezra
Intel CHD Case Study by Ronen Ezra
 
Leading Innovation by Jonathan Bertfield
Leading Innovation by Jonathan BertfieldLeading Innovation by Jonathan Bertfield
Leading Innovation by Jonathan Bertfield
 
Organization architecture autonomy and accountability
Organization architecture autonomy and accountability Organization architecture autonomy and accountability
Organization architecture autonomy and accountability
 
Tribal Unity, Agile Israel 2017
Tribal Unity, Agile Israel 2017Tribal Unity, Agile Israel 2017
Tribal Unity, Agile Israel 2017
 
The mindful manager, Agile Israel 2017
The mindful manager, Agile Israel 2017The mindful manager, Agile Israel 2017
The mindful manager, Agile Israel 2017
 
Agile Israel 2017 bugs zero by Arlo Belshee
Agile Israel 2017 bugs zero by Arlo BelsheeAgile Israel 2017 bugs zero by Arlo Belshee
Agile Israel 2017 bugs zero by Arlo Belshee
 
Agile בעידן הדיגיטלי
Agile בעידן הדיגיטליAgile בעידן הדיגיטלי
Agile בעידן הדיגיטלי
 
Agile Israel 2017 by VO
Agile Israel 2017 by VO Agile Israel 2017 by VO
Agile Israel 2017 by VO
 

Kürzlich hochgeladen

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Kürzlich hochgeladen (20)

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 

QA is Dead - Long Live the New QA!

  • 1. QA is Dead! Long live the new QA! Ronen Bar Nahor, Yuval Yeret AgileSparks Challenging your comfort zone All Rights Reserved- AgileSparks
  • 2. AgileSparks • We help companies improve by Adopting agile principles and practices. • We provide training and coaching to all organizational levels, from high management to developers. • Our team consists of Agile professionals with diverse expertise – several coaches participate in each implementation. • Successfully completed dozens of projects. All Rights Reserved- AgileSparks
  • 3. Agile is … Delighting Customers Deliver value to customers/users frequently, at a continuously sustainable pace, seeking constant feedback and welcoming direction changes in an UNCERTAIN DYNAMIC world *Maturity/Effectiveness of process is a factor of the frequency All Rights Reserved- AgileSparks
  • 4. Feature Teams Testers Developers • Whole Team Approach • Working Tested Software • Build Quality In – Zero Defects • Trusted / Empowered with Meaningful Goal All Rights Reserved- AgileSparks
  • 5. G-Forces of agility Learn Idea Validate Specify Verify Code Learn Idea Learn Idea Validate Specify Verify Code Validate Specify Verify Code All Rights Reserved- AgileSparks http://www.slideshare.net/KentBeck/software-g-forces
  • 6. Deployment to production: 1990 Annual Quarterly Monthly Weekly Daily Hourly All Rights Reserved- AgileSparks http://www.slideshare.net/KentBeck/software-g-forces
  • 7. Deployment to production : 2010 Annual Quarterly Monthly Weekly Daily Hourly All Rights Reserved- AgileSparks http://www.slideshare.net/KentBeck/software-g-forces
  • 8. Deployment to production : 2030 Annual Quarterly Monthly Weekly Daily Hourly All Rights Reserved- AgileSparks http://www.slideshare.net/KentBeck/software-g-forces
  • 9. Early Feedback – The Goal and the conflict… Improve – Reduce Testing Overhead Ideal Batch Size WITH Ideal Batch Traditional Great automation W/O Processes Automation Earlier Feedback – Cheaper to change Lower Testing Overhead • Even without reducing testing overhead it is usually more cost-effective to reduce batch size • Aim to reduce testing overhead to reduce batch size even more and be even more cost-effective All Rights Reserved- AgileSparks
  • 10. Automate at the right level Manual UI 5% Acceptance ROI Cost (Service/API) 15% Unit Testing 80% All Rights Reserved- AgileSparks http://www.mountaingoatsoftware.com/blog/the-forgotten-layer-of-the-test-automation-pyramid
  • 11. How do we get these supermen testers? All Rights Reserved- AgileSparks
  • 12. So what is the unique value of QA? All Rights Reserved- AgileSparks
  • 13. 13 Credit - Udi Weinberg – HP Software All Rights Reserved- AgileSparks
  • 14. Back to Basics – Minimize Quality Risks • Being Champions of the Product and the Customer/User. • Specializing in Performance/ Security/Load/etc. • Shining light on where to focus quality efforts by analyzing risk probability and Impact. All Rights Reserved- AgileSparks
  • 15. Test for Value Deliver the RIGHT it is even more important than doing it RIGHT * Fit to Customer OVER Fit to Spec All Rights Reserved- AgileSparks
  • 16. New Perspective of QA’s Role Accountable to Quality: By Enabling it rather than Owning it All Rights Reserved- AgileSparks
  • 17. Quality OVER Quantity - experts SUPPORTING delivery Test Experts/Architects Delivery Team Software Engineers Delivery Team Software Engineers Delivery Team Choose where to be Software Engineers involved Delivery Team Delivery Team Software Engineers Software Engineers All Rights Reserved- AgileSparks
  • 18. How will roles/ratios change over time? Automation Test Engineers/ Experts Experts Testers SW Engineers SW Developers 2005 2010 2015 2020 *AgileSparks prediction All Rights Reserved- AgileSparks
  • 19. What do I do tomorrow? • Learn about post-agile QA. • Map Current State, Decide on Direction. • Work on – Effective whole team Automation/ Continuous Integration/Deployment. – The “Test Engineer” Role – Identify, Gap Analysis, Establish plan for closing gaps. – Mindset/Doctrine and Processes/ Policies to transition from Owning to Enabling at the teams level. • Proceed using small experiments or big revolution, depending on the context. All Rights Reserved- AgileSparks
  • 20. References http://bit.ly/testisdeadGTAC11 http://gojko.net/2012/05/08/redefin ing-software-quality/ All Rights Reserved- AgileSparks
  • 21. Questions? Ask us How Ronen@AgileSparks.com Yuval@AgileSparks.com www.AgileSparks.com Q&A at our booth All Rights Reserved- AgileSparks

Hinweis der Redaktion

  1. The problem with small stories and continous testing and re-test  setup costCompressed Cycle compared to waterfallSymptom:everything slows down (“we don’t have time to develop anything, we test 50% of the time”)Done is not really Done. PSP==Potentially S#!*ty ProductNeed to minimize cost of stuff repeated per iteration – enable effective small batches