Agile QA 2.0

Matthew Philip
Matthew PhilipSenior Director um Pfizer
Agile QA 2.0
@aceconf
@mattphilip
Agile QA 2.0
Agile QA 2.0
Why this talk?
1.  Agile QA 1.0 never
made it past “staging”
Why this talk?
1.  Agile QA 1.0 never
made it past “staging”
2.  Call-to-action to
reinvigorate the state
of the practice
Why this talk?
1.  Agile QA 1.0 never
made it past “staging”
2.  Call-to-action to
reinvigorate the state
of the practice
3.  Work together to
come up
with better ways
So what have
we learned?
-- Barry Boehm (1981)
Eliminate the need for massive
inspection by building quality into the
product in the first place.
-- Edwards Deming (1982)
So what have
we learned?
”
“
Handoffs are waste.
-- Mary Poppendieck (2003)
So what have
we learned?
Move testing to the
front of the
development process
-- Agile Testing (2009)
So what have
we learned?
”
“
Kanban doesn’t mean a return to
waterfall.
-- David Anderson (paraphrase, 2013)
So what have
we learned?
So of course what do our card walls look like?
Agile QA 2.0
Agile QA 2.0
Agile QA 2.0
Agile QA 2.0
Agile QA 2.0
Agile QA 2.0
How did this happen?
We simply repeat the same process
that we've always done
QAs aren’t assertive enough to ask for change
We figure that, if we don’t, the QA
won't have anything to do (resource
efficiency)
#1
#2
#3
But why is this
a problem?
End-‐of-‐cycle testing (mini waterfalls)
#1 Creates too long a feedback loop
#2 Virtually ensures that our testing efforts are
misaligned with value 
#3 Reinforces gatekeeper role (oppositional)
#4 Creates inefficient test suite
But why is this
a problem?
Limits
options to
checking
through
GUI
Creates inefficient test suite
Which
leads to
this
So how do
we remedy
these problems?
Agile QA 2.0
Remedies Bring QA Forward
#1 Bring QA forward
* QA and devs collaborate to determine the
right places to test
Remedies QA and devs collaborate to determine the
right place to test#1 Bring QA forward
Many
here
Some
here
A few
here
Remedies Bring QA Forward
#1 Bring QA forward
* QA and devs collaborate to determine the
right places to test
* Specify acceptance tests up-front
(Acceptance-Test-Driven Development)
Remedies Acceptance-‐Test-‐Driven Development
Development
Iterations
Development
Engine
Write Story and Scenarios
Business Showcase
Story Testing
Story Planning Session
BA / QA Signoff on Dev Box
Daily BA/QA demo
Tester
Dev
BA
TesterDev
Tester BADev
Tester BADev
BABusiness
Tester
Start
Here
System
Testing
Implement Functionality
BABusiness
Implement Automated
Acceptance Tests
Dev
End Development Iteration
Start Development
Iteration
#1 Bring QA forward
Remedies Bring QA Forward
#1 Bring QA forward
* QA and devs collaborate to determine the
right places to test
* Testing efforts are aligned with business
needs and risk
* Specify acceptance tests up-front
(Acceptance-Test-Driven Development)
Remedies Re-‐start by mapping your done list to the wall
#1 Bring QA forward
#2 Map done list to the wall * Simple value-stream
* Lets the team take a conscious role in
defining its wall
Remedies Include QA in Work-‐In-‐Progress Limits
#1 Bring QA forward
#2 Map done list to the wall
#3 Include QA in WIP limits
Expand
this…… to
include this
* Encourages whole-team approach
Where do our biggest handoffs occur?
Here?Here?
Agile QA 2.0
Other considerations Quality Advocacy
Quality Advocacy
* Consultative
* Service provider
* Enabling and informing (not gatekeeping)
* Big picture-oriented
* Polyskilled and skill sharer
* Courageous
Other considerations Integrated QA:
QA is nowhere – and everywhereQuality Advocacy
Integrated QA * Remove Test/QA as a separate column altogether
* QA provides real-time, zero-cycle-time feedback
* Decouples what from who,
decreases bottleneck
* Commits devs and testers
toward same goal:
working, tested software
So do we have a place for
any kind of end-of-cycle testing?
Agile QA 2.0
Other considerations Exploratory Testing as First-‐Class Practice
Quality Advocacy
Integrated QA
Exploratory testing
* Not simply “clickin’ around” but
highly-skilled discipline
* Anyone with the right skill, independence can do it
* Model it on the wall
So what are you
going to do starting Wednesday?
References
§  Alister Scott, http://watirmelon.com/2013/02/28/the-new-qa-the-quality-advocate/
§  Barry Boehm, Software Engineering Economics
§  Martin Fowler, http://martinfowler.com/bliki/TestPyramid.html
§  InfoQ, http://www.infoq.com/articles/David-Anderson-Kanban
§  Deming Institute, http://deming.org/
mphilip@thoughtworks.com
@mattphilip
1 von 39

Recomendados

Role Of Qa And Testing In Agile 1225221397167302 8 von
Role Of Qa And Testing In Agile 1225221397167302 8Role Of Qa And Testing In Agile 1225221397167302 8
Role Of Qa And Testing In Agile 1225221397167302 8a34sharm
2.3K views23 Folien
Introducing QA Into an Agile Environment von
Introducing QA Into an Agile EnvironmentIntroducing QA Into an Agile Environment
Introducing QA Into an Agile EnvironmentJoseph Beale
508 views30 Folien
QA Best Practices in Agile World_new von
QA Best Practices in Agile World_newQA Best Practices in Agile World_new
QA Best Practices in Agile World_newPraveen Dosapati (CSM)
1.4K views25 Folien
Agile QA presentation von
Agile QA presentationAgile QA presentation
Agile QA presentationCarl Bruiners
15.4K views29 Folien
Agile testing principles and practices - Anil Karade von
Agile testing principles and practices - Anil KaradeAgile testing principles and practices - Anil Karade
Agile testing principles and practices - Anil KaradeIndicThreads
9K views36 Folien
Scrum Testing Methodology von
Scrum Testing MethodologyScrum Testing Methodology
Scrum Testing MethodologyGaya1985
29K views11 Folien

Más contenido relacionado

Was ist angesagt?

Agile Testing – embedding testing into agile software development lifecycle von
Agile Testing – embedding testing into agile software development lifecycle Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Kari Kakkonen
2.9K views52 Folien
Optimising Quality Assurance in an Agile World von
Optimising Quality Assurance in an Agile WorldOptimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile WorldOriginal Software
1.5K views22 Folien
How to Build in Quality from Day 1 using Lean QA and Agile Testing von
How to Build in Quality from Day 1 using Lean QA and Agile TestingHow to Build in Quality from Day 1 using Lean QA and Agile Testing
How to Build in Quality from Day 1 using Lean QA and Agile TestingAtlassian
6.4K views78 Folien
Shift left as first transformation step into Quality Assurance von
Shift left as first transformation step into Quality AssuranceShift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality AssuranceZbyszek Mockun
877 views29 Folien
Agile testing von
Agile testingAgile testing
Agile testingYogita patil
1.4K views29 Folien
Agile testing - Testing From Day 1 von
Agile testing - Testing From Day 1Agile testing - Testing From Day 1
Agile testing - Testing From Day 1Kaizenko
2.2K views64 Folien

Was ist angesagt?(20)

Agile Testing – embedding testing into agile software development lifecycle von Kari Kakkonen
Agile Testing – embedding testing into agile software development lifecycle Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle
Kari Kakkonen2.9K views
Optimising Quality Assurance in an Agile World von Original Software
Optimising Quality Assurance in an Agile WorldOptimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile World
Original Software1.5K views
How to Build in Quality from Day 1 using Lean QA and Agile Testing von Atlassian
How to Build in Quality from Day 1 using Lean QA and Agile TestingHow to Build in Quality from Day 1 using Lean QA and Agile Testing
How to Build in Quality from Day 1 using Lean QA and Agile Testing
Atlassian6.4K views
Shift left as first transformation step into Quality Assurance von Zbyszek Mockun
Shift left as first transformation step into Quality AssuranceShift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality Assurance
Zbyszek Mockun877 views
Agile testing - Testing From Day 1 von Kaizenko
Agile testing - Testing From Day 1Agile testing - Testing From Day 1
Agile testing - Testing From Day 1
Kaizenko2.2K views
Testing strategy for agile projects updated von Tharinda Liyanage
Testing strategy for agile projects updatedTesting strategy for agile projects updated
Testing strategy for agile projects updated
Tharinda Liyanage2.4K views
Agile Testing Introduction von Hai Tran Son
Agile Testing IntroductionAgile Testing Introduction
Agile Testing Introduction
Hai Tran Son1.1K views
Optimizing Your Agile Testing Processes von Stanton Champion
Optimizing Your Agile Testing ProcessesOptimizing Your Agile Testing Processes
Optimizing Your Agile Testing Processes
Stanton Champion3.2K views
Agile QA: Redefining Quality in the Wild West von Ford Prior
Agile QA: Redefining Quality in the Wild WestAgile QA: Redefining Quality in the Wild West
Agile QA: Redefining Quality in the Wild West
Ford Prior218 views
The Three Pillars Approach to Your Agile Test Strategy von TechWell
The Three Pillars Approach to Your Agile Test StrategyThe Three Pillars Approach to Your Agile Test Strategy
The Three Pillars Approach to Your Agile Test Strategy
TechWell2.7K views
Introduction to Agile Testing von vodQA
Introduction to Agile TestingIntroduction to Agile Testing
Introduction to Agile Testing
vodQA1.1K views
ISTQB agile tester exam - Conclusions about Certification von Michał Dudziak
ISTQB agile tester exam - Conclusions about CertificationISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about Certification
Michał Dudziak627 views
Agile tour ncr test360_degree - agile testing on steroids von Vipul Gupta
Agile tour ncr test360_degree - agile testing on steroidsAgile tour ncr test360_degree - agile testing on steroids
Agile tour ncr test360_degree - agile testing on steroids
Vipul Gupta10.6K views
Agile Testing - presentation for Agile User Group von suwalki24.pl
Agile Testing - presentation for Agile User GroupAgile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User Group
suwalki24.pl3.2K views

Destacado

Agile Qa Framework Jacky Wu von
Agile Qa Framework Jacky WuAgile Qa Framework Jacky Wu
Agile Qa Framework Jacky WuJacky Wu
5.9K views22 Folien
Testing Best Practices von
Testing Best PracticesTesting Best Practices
Testing Best PracticesAxway Appcelerator
3.1K views27 Folien
Workplay: The gamified future of agile development (Agile India 2012) von
Workplay: The gamified future of agile development (Agile India 2012)Workplay: The gamified future of agile development (Agile India 2012)
Workplay: The gamified future of agile development (Agile India 2012)Matthew Philip
3.8K views44 Folien
Ugly Truths About Scaling Agile von
Ugly Truths About Scaling AgileUgly Truths About Scaling Agile
Ugly Truths About Scaling AgileCprime
953 views20 Folien
Scaling Agile at Spotify (representation) von
Scaling Agile at Spotify (representation)Scaling Agile at Spotify (representation)
Scaling Agile at Spotify (representation)Vlad Mysla
46.1K views91 Folien
Agile QA Process von
Agile QA ProcessAgile QA Process
Agile QA ProcessAnand Bagmar
75K views12 Folien

Destacado(6)

Agile Qa Framework Jacky Wu von Jacky Wu
Agile Qa Framework Jacky WuAgile Qa Framework Jacky Wu
Agile Qa Framework Jacky Wu
Jacky Wu5.9K views
Workplay: The gamified future of agile development (Agile India 2012) von Matthew Philip
Workplay: The gamified future of agile development (Agile India 2012)Workplay: The gamified future of agile development (Agile India 2012)
Workplay: The gamified future of agile development (Agile India 2012)
Matthew Philip3.8K views
Ugly Truths About Scaling Agile von Cprime
Ugly Truths About Scaling AgileUgly Truths About Scaling Agile
Ugly Truths About Scaling Agile
Cprime953 views
Scaling Agile at Spotify (representation) von Vlad Mysla
Scaling Agile at Spotify (representation)Scaling Agile at Spotify (representation)
Scaling Agile at Spotify (representation)
Vlad Mysla46.1K views

Similar a Agile QA 2.0

Moving Towards Zero Defects with Specification by Example von
Moving Towards Zero Defects with Specification by ExampleMoving Towards Zero Defects with Specification by Example
Moving Towards Zero Defects with Specification by ExampleSteve Rogalsky
6.9K views33 Folien
Using flow approaches to effectively manage agile testing at the enterprise l... von
Using flow approaches to effectively manage agile testing at the enterprise l...Using flow approaches to effectively manage agile testing at the enterprise l...
Using flow approaches to effectively manage agile testing at the enterprise l...Yuval Yeret
1.2K views49 Folien
Iakiv Kramarenko: “Quality Driven Development” von
Iakiv Kramarenko: “Quality Driven Development” Iakiv Kramarenko: “Quality Driven Development”
Iakiv Kramarenko: “Quality Driven Development” Dakiry
46 views73 Folien
Ethan huang 全民qa von
Ethan huang   全民qaEthan huang   全民qa
Ethan huang 全民qaOdd-e
337 views30 Folien
Continuous delivery its not about the technology, its about the people. von
Continuous delivery its not about the technology, its about the people.Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.Tomas Riha
1.5K views31 Folien
Developing Quality Products Quickly through a Culture of CI/CD von
Developing Quality Products Quickly through a Culture of CI/CDDeveloping Quality Products Quickly through a Culture of CI/CD
Developing Quality Products Quickly through a Culture of CI/CDPaul Hepworth
69 views78 Folien

Similar a Agile QA 2.0(20)

Moving Towards Zero Defects with Specification by Example von Steve Rogalsky
Moving Towards Zero Defects with Specification by ExampleMoving Towards Zero Defects with Specification by Example
Moving Towards Zero Defects with Specification by Example
Steve Rogalsky6.9K views
Using flow approaches to effectively manage agile testing at the enterprise l... von Yuval Yeret
Using flow approaches to effectively manage agile testing at the enterprise l...Using flow approaches to effectively manage agile testing at the enterprise l...
Using flow approaches to effectively manage agile testing at the enterprise l...
Yuval Yeret1.2K views
Iakiv Kramarenko: “Quality Driven Development” von Dakiry
Iakiv Kramarenko: “Quality Driven Development” Iakiv Kramarenko: “Quality Driven Development”
Iakiv Kramarenko: “Quality Driven Development”
Dakiry46 views
Ethan huang 全民qa von Odd-e
Ethan huang   全民qaEthan huang   全民qa
Ethan huang 全民qa
Odd-e337 views
Continuous delivery its not about the technology, its about the people. von Tomas Riha
Continuous delivery its not about the technology, its about the people.Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.
Tomas Riha1.5K views
Developing Quality Products Quickly through a Culture of CI/CD von Paul Hepworth
Developing Quality Products Quickly through a Culture of CI/CDDeveloping Quality Products Quickly through a Culture of CI/CD
Developing Quality Products Quickly through a Culture of CI/CD
Paul Hepworth69 views
Test Improvement - Any place, anytime, any where von Ruud Teunissen
Test Improvement - Any place, anytime, any whereTest Improvement - Any place, anytime, any where
Test Improvement - Any place, anytime, any where
Ruud Teunissen224 views
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps von KMS Technology
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
KMS Technology839 views
Testing in a DevOps team von Laurent PY
Testing in a DevOps teamTesting in a DevOps team
Testing in a DevOps team
Laurent PY1.2K views
Continuous delivery is more than dev ops von Agile Montréal
Continuous delivery is more than dev opsContinuous delivery is more than dev ops
Continuous delivery is more than dev ops
Agile Montréal273 views
The DevOps Dance - Shift Left, Shift Right - Get It Right von Inflectra
The DevOps Dance - Shift Left, Shift Right - Get It RightThe DevOps Dance - Shift Left, Shift Right - Get It Right
The DevOps Dance - Shift Left, Shift Right - Get It Right
Inflectra385 views
'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference... von ColomboCampsCommunity
'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference...'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference...
'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference...
Testing Sap: Modern Methodology von Ethan Jewett
Testing Sap: Modern MethodologyTesting Sap: Modern Methodology
Testing Sap: Modern Methodology
Ethan Jewett14.2K views
Will The Test Leaders Stand Up? von Paul Gerrard
Will The Test Leaders Stand Up?Will The Test Leaders Stand Up?
Will The Test Leaders Stand Up?
Paul Gerrard1.2K views
Keeping Your DevOps Transformation From Crushing Your Ops Capacity von Rundeck
Keeping Your DevOps Transformation From Crushing Your Ops Capacity Keeping Your DevOps Transformation From Crushing Your Ops Capacity
Keeping Your DevOps Transformation From Crushing Your Ops Capacity
Rundeck1.7K views
Beyond TDD: Enabling Your Team to Continuously Deliver Software von Chris Weldon
Beyond TDD: Enabling Your Team to Continuously Deliver SoftwareBeyond TDD: Enabling Your Team to Continuously Deliver Software
Beyond TDD: Enabling Your Team to Continuously Deliver Software
Chris Weldon1.5K views
Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019 von Agile India
Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019
Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019
Agile India1.2K views

Más de Matthew Philip

Metrics at Every (Flight) Level von
Metrics at Every (Flight) LevelMetrics at Every (Flight) Level
Metrics at Every (Flight) LevelMatthew Philip
123 views51 Folien
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022] von
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]Matthew Philip
233 views108 Folien
The 8 Stances of 
a Transformational Leader von
The 8 Stances of 
a Transformational LeaderThe 8 Stances of 
a Transformational Leader
The 8 Stances of 
a Transformational LeaderMatthew Philip
2.4K views35 Folien
Strategy Deployment: Aligning Action to Vision von
Strategy Deployment: Aligning Action to VisionStrategy Deployment: Aligning Action to Vision
Strategy Deployment: Aligning Action to VisionMatthew Philip
201 views19 Folien
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf] von
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]Matthew Philip
1.1K views40 Folien
Stop writing stories, start validating working software von
 Stop writing stories, start validating working software Stop writing stories, start validating working software
Stop writing stories, start validating working softwareMatthew Philip
258 views56 Folien

Más de Matthew Philip(20)

Metrics at Every (Flight) Level von Matthew Philip
Metrics at Every (Flight) LevelMetrics at Every (Flight) Level
Metrics at Every (Flight) Level
Matthew Philip123 views
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022] von Matthew Philip
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
Matthew Philip233 views
The 8 Stances of 
a Transformational Leader von Matthew Philip
The 8 Stances of 
a Transformational LeaderThe 8 Stances of 
a Transformational Leader
The 8 Stances of 
a Transformational Leader
Matthew Philip2.4K views
Strategy Deployment: Aligning Action to Vision von Matthew Philip
Strategy Deployment: Aligning Action to VisionStrategy Deployment: Aligning Action to Vision
Strategy Deployment: Aligning Action to Vision
Matthew Philip201 views
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf] von Matthew Philip
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
Matthew Philip1.1K views
Stop writing stories, start validating working software von Matthew Philip
 Stop writing stories, start validating working software Stop writing stories, start validating working software
Stop writing stories, start validating working software
Matthew Philip258 views
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference] von Matthew Philip
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
Matthew Philip460 views
From Andon to Yokoten: Japanese for Agilists von Matthew Philip
From Andon to Yokoten: Japanese for AgilistsFrom Andon to Yokoten: Japanese for Agilists
From Andon to Yokoten: Japanese for Agilists
Matthew Philip210 views
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon] von Matthew Philip
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]
Matthew Philip260 views
Leadership at every level [prdc2019] von Matthew Philip
Leadership at every level [prdc2019]Leadership at every level [prdc2019]
Leadership at every level [prdc2019]
Matthew Philip292 views
No (Lab) Jacket Required [Agile Midwest Conference] von Matthew Philip
No (Lab) Jacket Required [Agile Midwest Conference]No (Lab) Jacket Required [Agile Midwest Conference]
No (Lab) Jacket Required [Agile Midwest Conference]
Matthew Philip394 views
Leadership at Every Level: Practices for Aligned Autonomy von Matthew Philip
Leadership at Every Level: Practices for Aligned AutonomyLeadership at Every Level: Practices for Aligned Autonomy
Leadership at Every Level: Practices for Aligned Autonomy
Matthew Philip1.4K views
Portfolio kanban (St. Louis Agile Product Ownership Meetup) von Matthew Philip
Portfolio kanban (St. Louis Agile Product Ownership Meetup)Portfolio kanban (St. Louis Agile Product Ownership Meetup)
Portfolio kanban (St. Louis Agile Product Ownership Meetup)
Matthew Philip521 views
Culture add over culture fit [flowcon 2018] von Matthew Philip
Culture add over culture fit [flowcon 2018]Culture add over culture fit [flowcon 2018]
Culture add over culture fit [flowcon 2018]
Matthew Philip970 views
The Service Delivery Review: The Missing Agile Feedback Loop von Matthew Philip
The Service Delivery Review: The Missing Agile Feedback LoopThe Service Delivery Review: The Missing Agile Feedback Loop
The Service Delivery Review: The Missing Agile Feedback Loop
Matthew Philip539 views
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018) von Matthew Philip
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
Matthew Philip747 views
Leadership at Every Level: Intent-Based Leadership Practices von Matthew Philip
Leadership at Every Level: Intent-Based Leadership PracticesLeadership at Every Level: Intent-Based Leadership Practices
Leadership at Every Level: Intent-Based Leadership Practices
Matthew Philip557 views
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex... von Matthew Philip
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...
Matthew Philip409 views
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan... von Matthew Philip
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...
Matthew Philip407 views

Último

Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda... von
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...ShapeBlue
120 views13 Folien
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ... von
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...ShapeBlue
146 views15 Folien
Cencora Executive Symposium von
Cencora Executive SymposiumCencora Executive Symposium
Cencora Executive Symposiummarketingcommunicati21
139 views14 Folien
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ... von
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...ShapeBlue
123 views28 Folien
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti... von
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...ShapeBlue
98 views29 Folien
CryptoBotsAI von
CryptoBotsAICryptoBotsAI
CryptoBotsAIchandureddyvadala199
40 views5 Folien

Último(20)

Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda... von ShapeBlue
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...
Hypervisor Agnostic DRS in CloudStack - Brief overview & demo - Vishesh Jinda...
ShapeBlue120 views
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ... von ShapeBlue
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
ShapeBlue146 views
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ... von ShapeBlue
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
ShapeBlue123 views
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti... von ShapeBlue
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...
ShapeBlue98 views
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue von ShapeBlue
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlueElevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlue
ShapeBlue179 views
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas... von Bernd Ruecker
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
Bernd Ruecker50 views
"Surviving highload with Node.js", Andrii Shumada von Fwdays
"Surviving highload with Node.js", Andrii Shumada "Surviving highload with Node.js", Andrii Shumada
"Surviving highload with Node.js", Andrii Shumada
Fwdays53 views
NTGapps NTG LowCode Platform von Mustafa Kuğu
NTGapps NTG LowCode Platform NTGapps NTG LowCode Platform
NTGapps NTG LowCode Platform
Mustafa Kuğu365 views
Business Analyst Series 2023 - Week 4 Session 7 von DianaGray10
Business Analyst Series 2023 -  Week 4 Session 7Business Analyst Series 2023 -  Week 4 Session 7
Business Analyst Series 2023 - Week 4 Session 7
DianaGray10126 views
KVM Security Groups Under the Hood - Wido den Hollander - Your.Online von ShapeBlue
KVM Security Groups Under the Hood - Wido den Hollander - Your.OnlineKVM Security Groups Under the Hood - Wido den Hollander - Your.Online
KVM Security Groups Under the Hood - Wido den Hollander - Your.Online
ShapeBlue181 views
What’s New in CloudStack 4.19 - Abhishek Kumar - ShapeBlue von ShapeBlue
What’s New in CloudStack 4.19 - Abhishek Kumar - ShapeBlueWhat’s New in CloudStack 4.19 - Abhishek Kumar - ShapeBlue
What’s New in CloudStack 4.19 - Abhishek Kumar - ShapeBlue
ShapeBlue222 views
DRBD Deep Dive - Philipp Reisner - LINBIT von ShapeBlue
DRBD Deep Dive - Philipp Reisner - LINBITDRBD Deep Dive - Philipp Reisner - LINBIT
DRBD Deep Dive - Philipp Reisner - LINBIT
ShapeBlue140 views
Why and How CloudStack at weSystems - Stephan Bienek - weSystems von ShapeBlue
Why and How CloudStack at weSystems - Stephan Bienek - weSystemsWhy and How CloudStack at weSystems - Stephan Bienek - weSystems
Why and How CloudStack at weSystems - Stephan Bienek - weSystems
ShapeBlue197 views
Webinar : Desperately Seeking Transformation - Part 2: Insights from leading... von The Digital Insurer
Webinar : Desperately Seeking Transformation - Part 2:  Insights from leading...Webinar : Desperately Seeking Transformation - Part 2:  Insights from leading...
Webinar : Desperately Seeking Transformation - Part 2: Insights from leading...
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit... von ShapeBlue
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...
ShapeBlue117 views
Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O... von ShapeBlue
Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O...Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O...
Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O...
ShapeBlue88 views

Agile QA 2.0

  • 4. Why this talk? 1.  Agile QA 1.0 never made it past “staging”
  • 5. Why this talk? 1.  Agile QA 1.0 never made it past “staging” 2.  Call-to-action to reinvigorate the state of the practice
  • 6. Why this talk? 1.  Agile QA 1.0 never made it past “staging” 2.  Call-to-action to reinvigorate the state of the practice 3.  Work together to come up with better ways
  • 7. So what have we learned? -- Barry Boehm (1981)
  • 8. Eliminate the need for massive inspection by building quality into the product in the first place. -- Edwards Deming (1982) So what have we learned? ” “
  • 9. Handoffs are waste. -- Mary Poppendieck (2003) So what have we learned?
  • 10. Move testing to the front of the development process -- Agile Testing (2009) So what have we learned? ” “
  • 11. Kanban doesn’t mean a return to waterfall. -- David Anderson (paraphrase, 2013) So what have we learned?
  • 12. So of course what do our card walls look like?
  • 19. How did this happen? We simply repeat the same process that we've always done QAs aren’t assertive enough to ask for change We figure that, if we don’t, the QA won't have anything to do (resource efficiency) #1 #2 #3
  • 20. But why is this a problem? End-‐of-‐cycle testing (mini waterfalls) #1 Creates too long a feedback loop #2 Virtually ensures that our testing efforts are misaligned with value  #3 Reinforces gatekeeper role (oppositional) #4 Creates inefficient test suite
  • 21. But why is this a problem? Limits options to checking through GUI Creates inefficient test suite Which leads to this
  • 22. So how do we remedy these problems?
  • 24. Remedies Bring QA Forward #1 Bring QA forward * QA and devs collaborate to determine the right places to test
  • 25. Remedies QA and devs collaborate to determine the right place to test#1 Bring QA forward Many here Some here A few here
  • 26. Remedies Bring QA Forward #1 Bring QA forward * QA and devs collaborate to determine the right places to test * Specify acceptance tests up-front (Acceptance-Test-Driven Development)
  • 27. Remedies Acceptance-‐Test-‐Driven Development Development Iterations Development Engine Write Story and Scenarios Business Showcase Story Testing Story Planning Session BA / QA Signoff on Dev Box Daily BA/QA demo Tester Dev BA TesterDev Tester BADev Tester BADev BABusiness Tester Start Here System Testing Implement Functionality BABusiness Implement Automated Acceptance Tests Dev End Development Iteration Start Development Iteration #1 Bring QA forward
  • 28. Remedies Bring QA Forward #1 Bring QA forward * QA and devs collaborate to determine the right places to test * Testing efforts are aligned with business needs and risk * Specify acceptance tests up-front (Acceptance-Test-Driven Development)
  • 29. Remedies Re-‐start by mapping your done list to the wall #1 Bring QA forward #2 Map done list to the wall * Simple value-stream * Lets the team take a conscious role in defining its wall
  • 30. Remedies Include QA in Work-‐In-‐Progress Limits #1 Bring QA forward #2 Map done list to the wall #3 Include QA in WIP limits Expand this…… to include this * Encourages whole-team approach
  • 31. Where do our biggest handoffs occur? Here?Here?
  • 33. Other considerations Quality Advocacy Quality Advocacy * Consultative * Service provider * Enabling and informing (not gatekeeping) * Big picture-oriented * Polyskilled and skill sharer * Courageous
  • 34. Other considerations Integrated QA: QA is nowhere – and everywhereQuality Advocacy Integrated QA * Remove Test/QA as a separate column altogether * QA provides real-time, zero-cycle-time feedback * Decouples what from who, decreases bottleneck * Commits devs and testers toward same goal: working, tested software
  • 35. So do we have a place for any kind of end-of-cycle testing?
  • 37. Other considerations Exploratory Testing as First-‐Class Practice Quality Advocacy Integrated QA Exploratory testing * Not simply “clickin’ around” but highly-skilled discipline * Anyone with the right skill, independence can do it * Model it on the wall
  • 38. So what are you going to do starting Wednesday?
  • 39. References §  Alister Scott, http://watirmelon.com/2013/02/28/the-new-qa-the-quality-advocate/ §  Barry Boehm, Software Engineering Economics §  Martin Fowler, http://martinfowler.com/bliki/TestPyramid.html §  InfoQ, http://www.infoq.com/articles/David-Anderson-Kanban §  Deming Institute, http://deming.org/ mphilip@thoughtworks.com @mattphilip