SlideShare ist ein Scribd-Unternehmen logo
1 von 31
Downloaden Sie, um offline zu lesen
Testing Missions in Context:
                   From Checking to Assessment
                           Created for:




                                     By:

                              Scott Barber
                              Chief Technologist
                              PerfTestPlus, Inc.
Testing Missions in Context                        © 2012 PerfTestPlus, Inc. All rights reserved.
Testing Missions in Context
                        From Checking to Assessment


                              Scott Barber
                              Chief Technologist, PerfTestPlus, Inc.
                                 sbarber@perftestplus.com
                                 www.perftestplus.com
                                 @sbarber
                              Co-Founder: Workshop On Performance and Reliability
                                 www.performance-workshop.org

        Author:               Co-Author:               Contributing Author:




 Books: www.perftestplus.com/pubs                  About me: about.me/scott.barber
Testing Missions in Context                                 © 2012 PerfTestPlus, Inc. All rights reserved.
Experiential Drivers For This Talk
Teacher’s Child
      Good Enough, Good, Best; Question the Answer
BS Civil Engineering:
      Systems Thinking; Design of Experiments, Testing & Inspections;
      Project Management; Regulatory Compliance
U.S Army Officer:
      Management of Things; Skills, Tasks, Roles & Missions;
      Responsibility, Accountability & Leadership
Information Engineer:
      Real Value, Business Modeling, Operational Efficiencies
MS Information Technology:
      Tech Management/Leadership
Business Owner/Executive Consulting:
      Value, Business Decision Drivers, Expectations
Testing Missions in Context                     © 2012 PerfTestPlus, Inc. All rights reserved.
Incoming Transmission




Testing Missions in Context   © 2012 PerfTestPlus, Inc. All rights reserved.
Good morning Scott,

This just in from “The PM”:

Your mission, should you choose to accept it,
is to test a website on desktop, tablet, and
mobile platforms, across all modern browsers to
ensure operational and visual consistency
compared to the baseline IE9 deployment and to
provide a detailed report of all discrepancies.
Any discrepancies found in production will be
blamed entirely on you.

Do you accept this mission?


                         Yes
Testing Missions in Context
                                No
                                © 2012 PerfTestPlus, Inc. All rights reserved.
What Was *That* All About?
Not so different than client calls:
      Problem to solve not revealed
      Solution presumed
      Value for cost questionable (at best)

Highlights common perception of the tester’s role:
      Unfortunately necessary
      To mechanically check against expectations
      To be held accountable for “bad stuff”…
      Without being responsible for “good stuff”
      Not seen as a “real” stakeholder

Epic Fail as a Mission:
      That was a task, not a mission.

Testing Missions in Context                   © 2012 PerfTestPlus, Inc. All rights reserved.
Agenda
Exploring the Power of Missions:
      My experience: Task Complete => Epic Mission Fail
      Translating that experience into “tester-speak”
Near Ubiquitous Context-Driver:
      Businesses pay for testing
      Business Value == Good Testing
Purpose, Role, Assignment, and Tasks (oh my!):
      A heuristic model for classifying testing tasks
      Value proposition of “titled Testers”?
Preview; A Business Value Oriented, Context-Driven Model:
      Base assumption
      The model (a collaborative work in progress)
Q&A, Praise and/or Public Shredding of Scott’s Model
Testing Missions in Context                        © 2012 PerfTestPlus, Inc. All rights reserved.
“Take that hill!”
Mission: Secure hilltop 42 NLT 0545 tomorrow.




Testing Missions in Context                   © 2012 PerfTestPlus, Inc. All rights reserved.
“Take that hill!”
Mission: Secure hilltop 42 NLT 0545 tomorrow.




Testing Missions in Context                   © 2012 PerfTestPlus, Inc. All rights reserved.
Testing Missions in Context   © 2012 PerfTestPlus, Inc. All rights reserved.
LT Barber,
                                   Front And
                                   Center!




Testing Missions in Context   © 2012 PerfTestPlus, Inc. All rights reserved.
After Action Review
Commander’s Intent: It is my intent that the supply convoy
  safely cross the bridge spanning the gorge between
  hilltop 42 and hilltop 57 between 0553 and 0558 tomorrow.




Testing Missions in Context               © 2012 PerfTestPlus, Inc. All rights reserved.
Testing Efforts Can Fail Similarly…
Even if Good Testing is accomplished due to:

      Not knowing/accepting the higher mission:
           “The boss says ship date is most important, but obviously,
           this bug overrides that!”
      Assuming the logic behind assignment(s):
           “Clearly we’ve been asked to cross-platform testing to ensure
           consistency.”
      Focusing on the assignment role over the mission:
           “My job is to find and report problems, not to concern myself
           with competitive landscapes”
      Treating tasks as missions:
           “I know the other team is behind, but I can’t help until I finish
           automating these regression tests.”
Testing Missions in Context                          © 2012 PerfTestPlus, Inc. All rights reserved.
To Avoid…
                                          Test Team,
                                          In my office,
                                          NOW!




Testing Missions in Context               © 2012 PerfTestPlus, Inc. All rights reserved.
…Get The Mission Right
Purpose: “…two command levels higher…”
      • The higher mission IS your mission
      • Coordinate with adjacent & dependent groups to improve
        chances of mission accomplished
                                                                   Inspired by:
Role(s): Based on…
      • Needs of the mission first
      • Specific skill areas second
      • Individual preference when you’re lucky

Assignment(s): “Yours supports theirs, not vice versa”
      • Intermediate goal(s) supporting the larger mission

Task(s):
      • Activities necessary to mission success
      • Often turn out to be quite different than anticipated

Testing Missions in Context                       © 2012 PerfTestPlus, Inc. All rights reserved.
Context-Driven ≠ Context Driver
The most relevant context drivers come from “higher
command”:


My experience suggests that for testing, “higher command”
equates to:

      “The Business”…………………………………………(~95%)
      Teacher/Professor/Certifier…………………………….(~3%)
      Self………………………………………………………….(~1%)
      Obscure scenarios only people at CAST or Let’s Test
      would challenge a keynote presenter with………….(<1%)


Testing Missions in Context            © 2012 PerfTestPlus, Inc. All rights reserved.
Common Context Driver “The Business”
     No business *wants* to have to pay for testing!
Business only pays for testing because it believes it is
cheaper to pay for testing than not to pay for it.
      In the eyes of business, testers are a necessary evil.

If you wish to continue being paid to test…
      I’m guessing you wouldn’t be here otherwise.

… you must validate that belief…
      And do so in a way the business understands.

… by helping them succeed.
      To a business, success = $

Testing Missions in Context                       © 2012 PerfTestPlus, Inc. All rights reserved.
Purpose
   The general purpose of testing in business is to:

• Provide as much information as possible…
• For a reasonable cost…
• To stakeholders involved with developing, customizing,
  implementing, assessing, managing, and/or making business
  decisions…
• Related to the relevant product
• Where that information allows the product to start generating,
  protecting, or supporting revenue more quickly and cheaply
• Than it would if the business had *not* done testing.


Testing Missions in Context                © 2012 PerfTestPlus, Inc. All rights reserved.
Role




Testing Missions in Context          © 2012 PerfTestPlus, Inc. All rights reserved.
Assignment
             An Assignment, as it relates to testing:
• Is often mis-labeled as a mission unto itself (but it isn’t)
• In some cases, is viewed as a subordinate/supporting mission
• Distinct from core mission in that Assignments:
      • Identifies who is to take charge of
      • Completing one or more intermediate steps
      • Progressing toward core mission accomplishment
• Includes freedom, responsibility, and accountability to adapt
  as situation (context) changes to better support purpose and
  mission
• Typically relates to groups vs. individuals

Testing Missions in Context                   © 2012 PerfTestPlus, Inc. All rights reserved.
Task
  Self-Managed, individual or small group activity in scope
       of assignment supporting purpose and mission.




               Check                        Test                 Assess



                              Demonstrate          Field Study




      Scott’s Heuristic Model for Test Task Categorization
Testing Missions in Context                                © 2012 PerfTestPlus, Inc. All rights reserved.
Building a Testing Mission
     2 Higher Mission:
     Grow a successful business by increasing net profit by
     producing products and/or services considered valuable for
     the price.
     1 Higher Mission:
     Produce product/service X, as quickly and cheaply as
     possible considered valuable at target price.
     Testing Mission:
     Support the product/service development team by
     identifying, assessing against, and generally assisting to
     deliver the easiest quality bar associated with “valuable at
     the target price” as quickly and cheaply as possible.

Testing Missions in Context                   © 2012 PerfTestPlus, Inc. All rights reserved.
Given this Testing Mission…
     Is there intrinsic value to an identified “Test Group”?
         On what context considerations is your opinion based?
         If the context could be changed, would your opinion?
     Is there intrinsic value to “Titled Testers”?
          Is there individual/personal value?
          Context considerations?
          In the “proper context” how would the title “Product
          Delivery Team Member” feel?
     Scott’s Point of View
          Title detracts from collaborative work
          Title detracts from focus on business value
          Title (currently) enhances executive misunderstanding &
          micro-management.
Testing Missions in Context                    © 2012 PerfTestPlus, Inc. All rights reserved.
Incoming Transmission




Testing Missions in Context   © 2012 PerfTestPlus, Inc. All rights reserved.
Good morning Scott,

“The Boss” has been watching your presentation
and sends the following:

Your mission, should you choose to accept it,
is to, by any means necessary, tune this message
for all product/service delivery roles, and
share the message as broadly as possible with
the goals of increasing the realized business
value of testing and generally improving the
balance of cost, quality, and time to market.

Do you accept this mission?


                         Yes
Testing Missions in Context
                                No
                                © 2012 PerfTestPlus, Inc. All rights reserved.
A Work In Progress
       Imagine, if you will, a “testing” model that is:

• Business-Value Centric
• Business-Risk Focused
• Mission-Driven
• Comprehensive
• SDLC Agnostic
• Executive Language Compliant
• Context-Driven
• Built by Synthesizing Lessons from Established Industries
• Reflects the Complexity of, and Skill needed to do well…

Testing Missions in Context                    © 2012 PerfTestPlus, Inc. All rights reserved.
Software System Readiness Assessment: Model




Testing Missions in Context    © 2012 PerfTestPlus, Inc. All rights reserved.
Software System Readiness Assessment Types




Testing Missions in Context     © 2012 PerfTestPlus, Inc. All rights reserved.
Software System Assessment Report Card




 Follow http://scott-barber.blogspot.com for more!
Testing Missions in Context       © 2012 PerfTestPlus, Inc. All rights reserved.
Questions




Testing Missions in Context               © 2012 PerfTestPlus, Inc. All rights reserved.
Contact Info

                             Scott Barber
                          Chief Technologist
                              PerfTestPlus, Inc

  E-mail:                                Web Site:
  sbarber@perftestplus.com               www.PerfTestPlus.com

  Blog:                                  Twitter:
  scott-barber.blogspot.com              @sbarber

Testing Missions in Context                    © 2012 PerfTestPlus, Inc. All rights reserved.

Weitere ähnliche Inhalte

Was ist angesagt?

Evolving Team Structure in DevOps
Evolving Team Structure in DevOpsEvolving Team Structure in DevOps
Evolving Team Structure in DevOpsSherry Chang
 
Seven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing TransitionSeven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing TransitionTechWell
 
Application Performance Testing: A Simplified Universal Approach
Application Performance Testing: A Simplified Universal ApproachApplication Performance Testing: A Simplified Universal Approach
Application Performance Testing: A Simplified Universal ApproachTechWell
 
Building a DevOps Team that isn't Evil
Building a DevOps Team that isn't EvilBuilding a DevOps Team that isn't Evil
Building a DevOps Team that isn't EvilIBM UrbanCode Products
 
Advancing Testing Using Axioms
Advancing Testing Using AxiomsAdvancing Testing Using Axioms
Advancing Testing Using AxiomsPaul Gerrard
 
Agile testing overview
Agile testing overviewAgile testing overview
Agile testing overviewraianup
 
DOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy Environments
DOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy EnvironmentsDOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy Environments
DOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy EnvironmentsGene Kim
 
"Deploy. Sneller." Webinar Slides (Dutch webinar)
"Deploy. Sneller." Webinar Slides (Dutch webinar)"Deploy. Sneller." Webinar Slides (Dutch webinar)
"Deploy. Sneller." Webinar Slides (Dutch webinar)XebiaLabs
 
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014Jwooldridge
 
Qa team sport
Qa team sportQa team sport
Qa team sportLeanDog
 
Acceptance testfurureinmind
Acceptance testfurureinmindAcceptance testfurureinmind
Acceptance testfurureinmindLeanDog
 
Design for Reliability (DfR) Seminar
Design for Reliability (DfR) SeminarDesign for Reliability (DfR) Seminar
Design for Reliability (DfR) SeminarAccendo Reliability
 
Shirly Ronen - A practical view on Agile Testing Maturity Levels
Shirly Ronen - A practical view on Agile Testing Maturity LevelsShirly Ronen - A practical view on Agile Testing Maturity Levels
Shirly Ronen - A practical view on Agile Testing Maturity LevelsAgileSparks
 
Will The Test Leaders Stand Up?
Will The Test Leaders Stand Up?Will The Test Leaders Stand Up?
Will The Test Leaders Stand Up?Paul Gerrard
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing ExplainedTechWell
 
DevOps in Practice: When does "Practice" Become "Doing"?
DevOps in Practice: When does "Practice" Become "Doing"?DevOps in Practice: When does "Practice" Become "Doing"?
DevOps in Practice: When does "Practice" Become "Doing"?Michael Elder
 
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...Puppet
 
Our Journey Down the Yellow Brick Road (Agile Adoption @ Directi)
Our Journey Down the Yellow Brick Road (Agile Adoption @ Directi)Our Journey Down the Yellow Brick Road (Agile Adoption @ Directi)
Our Journey Down the Yellow Brick Road (Agile Adoption @ Directi)Directi Group
 
DOES15 - Scott Prugh & Erica Morrison - Conway & Taylor Meet the Strangler (v...
DOES15 - Scott Prugh & Erica Morrison - Conway & Taylor Meet the Strangler (v...DOES15 - Scott Prugh & Erica Morrison - Conway & Taylor Meet the Strangler (v...
DOES15 - Scott Prugh & Erica Morrison - Conway & Taylor Meet the Strangler (v...Gene Kim
 
Business Value of Agile Testing: Using TDD, CI, CD, & DevOps
Business Value of Agile Testing: Using TDD, CI, CD, & DevOpsBusiness Value of Agile Testing: Using TDD, CI, CD, & DevOps
Business Value of Agile Testing: Using TDD, CI, CD, & DevOpsDavid Rico
 

Was ist angesagt? (20)

Evolving Team Structure in DevOps
Evolving Team Structure in DevOpsEvolving Team Structure in DevOps
Evolving Team Structure in DevOps
 
Seven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing TransitionSeven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing Transition
 
Application Performance Testing: A Simplified Universal Approach
Application Performance Testing: A Simplified Universal ApproachApplication Performance Testing: A Simplified Universal Approach
Application Performance Testing: A Simplified Universal Approach
 
Building a DevOps Team that isn't Evil
Building a DevOps Team that isn't EvilBuilding a DevOps Team that isn't Evil
Building a DevOps Team that isn't Evil
 
Advancing Testing Using Axioms
Advancing Testing Using AxiomsAdvancing Testing Using Axioms
Advancing Testing Using Axioms
 
Agile testing overview
Agile testing overviewAgile testing overview
Agile testing overview
 
DOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy Environments
DOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy EnvironmentsDOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy Environments
DOES14 - Scott Prugh - CSG - DevOps and Lean in Legacy Environments
 
"Deploy. Sneller." Webinar Slides (Dutch webinar)
"Deploy. Sneller." Webinar Slides (Dutch webinar)"Deploy. Sneller." Webinar Slides (Dutch webinar)
"Deploy. Sneller." Webinar Slides (Dutch webinar)
 
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
Enterprise Devops Presentation @ Magentys Seminar London May 15 2014
 
Qa team sport
Qa team sportQa team sport
Qa team sport
 
Acceptance testfurureinmind
Acceptance testfurureinmindAcceptance testfurureinmind
Acceptance testfurureinmind
 
Design for Reliability (DfR) Seminar
Design for Reliability (DfR) SeminarDesign for Reliability (DfR) Seminar
Design for Reliability (DfR) Seminar
 
Shirly Ronen - A practical view on Agile Testing Maturity Levels
Shirly Ronen - A practical view on Agile Testing Maturity LevelsShirly Ronen - A practical view on Agile Testing Maturity Levels
Shirly Ronen - A practical view on Agile Testing Maturity Levels
 
Will The Test Leaders Stand Up?
Will The Test Leaders Stand Up?Will The Test Leaders Stand Up?
Will The Test Leaders Stand Up?
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
 
DevOps in Practice: When does "Practice" Become "Doing"?
DevOps in Practice: When does "Practice" Become "Doing"?DevOps in Practice: When does "Practice" Become "Doing"?
DevOps in Practice: When does "Practice" Become "Doing"?
 
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...
Demystifying DevOps for Ops - Including Findings from the 2015 State of DevOp...
 
Our Journey Down the Yellow Brick Road (Agile Adoption @ Directi)
Our Journey Down the Yellow Brick Road (Agile Adoption @ Directi)Our Journey Down the Yellow Brick Road (Agile Adoption @ Directi)
Our Journey Down the Yellow Brick Road (Agile Adoption @ Directi)
 
DOES15 - Scott Prugh & Erica Morrison - Conway & Taylor Meet the Strangler (v...
DOES15 - Scott Prugh & Erica Morrison - Conway & Taylor Meet the Strangler (v...DOES15 - Scott Prugh & Erica Morrison - Conway & Taylor Meet the Strangler (v...
DOES15 - Scott Prugh & Erica Morrison - Conway & Taylor Meet the Strangler (v...
 
Business Value of Agile Testing: Using TDD, CI, CD, & DevOps
Business Value of Agile Testing: Using TDD, CI, CD, & DevOpsBusiness Value of Agile Testing: Using TDD, CI, CD, & DevOps
Business Value of Agile Testing: Using TDD, CI, CD, & DevOps
 

Ähnlich wie Testing Missions in Context From Checking to Assessment

Simple2rocketscience 120513214533 Phpapp01
Simple2rocketscience 120513214533 Phpapp01Simple2rocketscience 120513214533 Phpapp01
Simple2rocketscience 120513214533 Phpapp01Archana Survase
 
Ptformanagersppt - Scott Barber
Ptformanagersppt - Scott BarberPtformanagersppt - Scott Barber
Ptformanagersppt - Scott BarberArchana Survase
 
Performance Testing for Managers
Performance Testing for ManagersPerformance Testing for Managers
Performance Testing for ManagersScott Barber
 
Soumya_4yrs_Automation(Selenium) Testing
Soumya_4yrs_Automation(Selenium) TestingSoumya_4yrs_Automation(Selenium) Testing
Soumya_4yrs_Automation(Selenium) Testingsoumya mohanty
 
Webinar - Maximizing Requirements Value Throughout the Product Lifecycle
Webinar - Maximizing Requirements Value Throughout the Product Lifecycle Webinar - Maximizing Requirements Value Throughout the Product Lifecycle
Webinar - Maximizing Requirements Value Throughout the Product Lifecycle Seapine Software
 
Principles and Practices of Performance-Based Project Management®
Principles and Practices of Performance-Based Project Management®Principles and Practices of Performance-Based Project Management®
Principles and Practices of Performance-Based Project Management®Glen Alleman
 
Testing – Why We Do It Badly2
Testing – Why We Do It Badly2Testing – Why We Do It Badly2
Testing – Why We Do It Badly2adevney
 
Software testing-in-gurgaon
Software testing-in-gurgaonSoftware testing-in-gurgaon
Software testing-in-gurgaonAP EDUSOFT
 
Managing The Delivery Of Zero Defect Software
Managing The Delivery Of Zero Defect SoftwareManaging The Delivery Of Zero Defect Software
Managing The Delivery Of Zero Defect Softwaresrikanthrao14
 
NUS-ISS Learning Day 2019-Site Reliability Engineering – The Modern Method fo...
NUS-ISS Learning Day 2019-Site Reliability Engineering – The Modern Method fo...NUS-ISS Learning Day 2019-Site Reliability Engineering – The Modern Method fo...
NUS-ISS Learning Day 2019-Site Reliability Engineering – The Modern Method fo...NUS-ISS
 
Agile Testing 20021015
Agile Testing 20021015Agile Testing 20021015
Agile Testing 20021015Raghu Karnati
 
Hands On Test Customer Presentation
Hands On Test Customer PresentationHands On Test Customer Presentation
Hands On Test Customer Presentationcoreytowe
 
Hands On Test Customer Presentation
Hands On Test Customer PresentationHands On Test Customer Presentation
Hands On Test Customer Presentationcoreytowe
 

Ähnlich wie Testing Missions in Context From Checking to Assessment (20)

Simple2rocketscience 120513214533 Phpapp01
Simple2rocketscience 120513214533 Phpapp01Simple2rocketscience 120513214533 Phpapp01
Simple2rocketscience 120513214533 Phpapp01
 
Interviewing for Results - Eaton Corporation
Interviewing for Results - Eaton CorporationInterviewing for Results - Eaton Corporation
Interviewing for Results - Eaton Corporation
 
Ptformanagersppt - Scott Barber
Ptformanagersppt - Scott BarberPtformanagersppt - Scott Barber
Ptformanagersppt - Scott Barber
 
Performance Testing for Managers
Performance Testing for ManagersPerformance Testing for Managers
Performance Testing for Managers
 
Soumya_4yrs_Automation(Selenium) Testing
Soumya_4yrs_Automation(Selenium) TestingSoumya_4yrs_Automation(Selenium) Testing
Soumya_4yrs_Automation(Selenium) Testing
 
Keshav cv
Keshav cvKeshav cv
Keshav cv
 
Webinar - Maximizing Requirements Value Throughout the Product Lifecycle
Webinar - Maximizing Requirements Value Throughout the Product Lifecycle Webinar - Maximizing Requirements Value Throughout the Product Lifecycle
Webinar - Maximizing Requirements Value Throughout the Product Lifecycle
 
Building a culture of testing like lucid
Building a culture of testing like lucidBuilding a culture of testing like lucid
Building a culture of testing like lucid
 
Principles and Practices of Performance-Based Project Management®
Principles and Practices of Performance-Based Project Management®Principles and Practices of Performance-Based Project Management®
Principles and Practices of Performance-Based Project Management®
 
Testing – Why We Do It Badly2
Testing – Why We Do It Badly2Testing – Why We Do It Badly2
Testing – Why We Do It Badly2
 
Software testing-in-gurgaon
Software testing-in-gurgaonSoftware testing-in-gurgaon
Software testing-in-gurgaon
 
W13
W13W13
W13
 
[Paul Holland] Trends in Software Testing
[Paul Holland] Trends in Software Testing[Paul Holland] Trends in Software Testing
[Paul Holland] Trends in Software Testing
 
Managing The Delivery Of Zero Defect Software
Managing The Delivery Of Zero Defect SoftwareManaging The Delivery Of Zero Defect Software
Managing The Delivery Of Zero Defect Software
 
Eswaranand Attuluri CV
Eswaranand Attuluri CVEswaranand Attuluri CV
Eswaranand Attuluri CV
 
Tpl agile processes
Tpl agile processesTpl agile processes
Tpl agile processes
 
NUS-ISS Learning Day 2019-Site Reliability Engineering – The Modern Method fo...
NUS-ISS Learning Day 2019-Site Reliability Engineering – The Modern Method fo...NUS-ISS Learning Day 2019-Site Reliability Engineering – The Modern Method fo...
NUS-ISS Learning Day 2019-Site Reliability Engineering – The Modern Method fo...
 
Agile Testing 20021015
Agile Testing 20021015Agile Testing 20021015
Agile Testing 20021015
 
Hands On Test Customer Presentation
Hands On Test Customer PresentationHands On Test Customer Presentation
Hands On Test Customer Presentation
 
Hands On Test Customer Presentation
Hands On Test Customer PresentationHands On Test Customer Presentation
Hands On Test Customer Presentation
 

Kürzlich hochgeladen

"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 

Kürzlich hochgeladen (20)

"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 

Testing Missions in Context From Checking to Assessment

  • 1. Testing Missions in Context: From Checking to Assessment Created for: By: Scott Barber Chief Technologist PerfTestPlus, Inc. Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 2. Testing Missions in Context From Checking to Assessment Scott Barber Chief Technologist, PerfTestPlus, Inc. sbarber@perftestplus.com www.perftestplus.com @sbarber Co-Founder: Workshop On Performance and Reliability www.performance-workshop.org Author: Co-Author: Contributing Author: Books: www.perftestplus.com/pubs About me: about.me/scott.barber Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 3. Experiential Drivers For This Talk Teacher’s Child Good Enough, Good, Best; Question the Answer BS Civil Engineering: Systems Thinking; Design of Experiments, Testing & Inspections; Project Management; Regulatory Compliance U.S Army Officer: Management of Things; Skills, Tasks, Roles & Missions; Responsibility, Accountability & Leadership Information Engineer: Real Value, Business Modeling, Operational Efficiencies MS Information Technology: Tech Management/Leadership Business Owner/Executive Consulting: Value, Business Decision Drivers, Expectations Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 4. Incoming Transmission Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 5. Good morning Scott, This just in from “The PM”: Your mission, should you choose to accept it, is to test a website on desktop, tablet, and mobile platforms, across all modern browsers to ensure operational and visual consistency compared to the baseline IE9 deployment and to provide a detailed report of all discrepancies. Any discrepancies found in production will be blamed entirely on you. Do you accept this mission? Yes Testing Missions in Context No © 2012 PerfTestPlus, Inc. All rights reserved.
  • 6. What Was *That* All About? Not so different than client calls: Problem to solve not revealed Solution presumed Value for cost questionable (at best) Highlights common perception of the tester’s role: Unfortunately necessary To mechanically check against expectations To be held accountable for “bad stuff”… Without being responsible for “good stuff” Not seen as a “real” stakeholder Epic Fail as a Mission: That was a task, not a mission. Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 7. Agenda Exploring the Power of Missions: My experience: Task Complete => Epic Mission Fail Translating that experience into “tester-speak” Near Ubiquitous Context-Driver: Businesses pay for testing Business Value == Good Testing Purpose, Role, Assignment, and Tasks (oh my!): A heuristic model for classifying testing tasks Value proposition of “titled Testers”? Preview; A Business Value Oriented, Context-Driven Model: Base assumption The model (a collaborative work in progress) Q&A, Praise and/or Public Shredding of Scott’s Model Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 8. “Take that hill!” Mission: Secure hilltop 42 NLT 0545 tomorrow. Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 9. “Take that hill!” Mission: Secure hilltop 42 NLT 0545 tomorrow. Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 10. Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 11. LT Barber, Front And Center! Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 12. After Action Review Commander’s Intent: It is my intent that the supply convoy safely cross the bridge spanning the gorge between hilltop 42 and hilltop 57 between 0553 and 0558 tomorrow. Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 13. Testing Efforts Can Fail Similarly… Even if Good Testing is accomplished due to: Not knowing/accepting the higher mission: “The boss says ship date is most important, but obviously, this bug overrides that!” Assuming the logic behind assignment(s): “Clearly we’ve been asked to cross-platform testing to ensure consistency.” Focusing on the assignment role over the mission: “My job is to find and report problems, not to concern myself with competitive landscapes” Treating tasks as missions: “I know the other team is behind, but I can’t help until I finish automating these regression tests.” Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 14. To Avoid… Test Team, In my office, NOW! Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 15. …Get The Mission Right Purpose: “…two command levels higher…” • The higher mission IS your mission • Coordinate with adjacent & dependent groups to improve chances of mission accomplished Inspired by: Role(s): Based on… • Needs of the mission first • Specific skill areas second • Individual preference when you’re lucky Assignment(s): “Yours supports theirs, not vice versa” • Intermediate goal(s) supporting the larger mission Task(s): • Activities necessary to mission success • Often turn out to be quite different than anticipated Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 16. Context-Driven ≠ Context Driver The most relevant context drivers come from “higher command”: My experience suggests that for testing, “higher command” equates to: “The Business”…………………………………………(~95%) Teacher/Professor/Certifier…………………………….(~3%) Self………………………………………………………….(~1%) Obscure scenarios only people at CAST or Let’s Test would challenge a keynote presenter with………….(<1%) Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 17. Common Context Driver “The Business” No business *wants* to have to pay for testing! Business only pays for testing because it believes it is cheaper to pay for testing than not to pay for it. In the eyes of business, testers are a necessary evil. If you wish to continue being paid to test… I’m guessing you wouldn’t be here otherwise. … you must validate that belief… And do so in a way the business understands. … by helping them succeed. To a business, success = $ Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 18. Purpose The general purpose of testing in business is to: • Provide as much information as possible… • For a reasonable cost… • To stakeholders involved with developing, customizing, implementing, assessing, managing, and/or making business decisions… • Related to the relevant product • Where that information allows the product to start generating, protecting, or supporting revenue more quickly and cheaply • Than it would if the business had *not* done testing. Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 19. Role Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 20. Assignment An Assignment, as it relates to testing: • Is often mis-labeled as a mission unto itself (but it isn’t) • In some cases, is viewed as a subordinate/supporting mission • Distinct from core mission in that Assignments: • Identifies who is to take charge of • Completing one or more intermediate steps • Progressing toward core mission accomplishment • Includes freedom, responsibility, and accountability to adapt as situation (context) changes to better support purpose and mission • Typically relates to groups vs. individuals Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 21. Task Self-Managed, individual or small group activity in scope of assignment supporting purpose and mission. Check Test Assess Demonstrate Field Study Scott’s Heuristic Model for Test Task Categorization Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 22. Building a Testing Mission 2 Higher Mission: Grow a successful business by increasing net profit by producing products and/or services considered valuable for the price. 1 Higher Mission: Produce product/service X, as quickly and cheaply as possible considered valuable at target price. Testing Mission: Support the product/service development team by identifying, assessing against, and generally assisting to deliver the easiest quality bar associated with “valuable at the target price” as quickly and cheaply as possible. Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 23. Given this Testing Mission… Is there intrinsic value to an identified “Test Group”? On what context considerations is your opinion based? If the context could be changed, would your opinion? Is there intrinsic value to “Titled Testers”? Is there individual/personal value? Context considerations? In the “proper context” how would the title “Product Delivery Team Member” feel? Scott’s Point of View Title detracts from collaborative work Title detracts from focus on business value Title (currently) enhances executive misunderstanding & micro-management. Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 24. Incoming Transmission Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 25. Good morning Scott, “The Boss” has been watching your presentation and sends the following: Your mission, should you choose to accept it, is to, by any means necessary, tune this message for all product/service delivery roles, and share the message as broadly as possible with the goals of increasing the realized business value of testing and generally improving the balance of cost, quality, and time to market. Do you accept this mission? Yes Testing Missions in Context No © 2012 PerfTestPlus, Inc. All rights reserved.
  • 26. A Work In Progress Imagine, if you will, a “testing” model that is: • Business-Value Centric • Business-Risk Focused • Mission-Driven • Comprehensive • SDLC Agnostic • Executive Language Compliant • Context-Driven • Built by Synthesizing Lessons from Established Industries • Reflects the Complexity of, and Skill needed to do well… Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 27. Software System Readiness Assessment: Model Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 28. Software System Readiness Assessment Types Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 29. Software System Assessment Report Card Follow http://scott-barber.blogspot.com for more! Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 30. Questions Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.
  • 31. Contact Info Scott Barber Chief Technologist PerfTestPlus, Inc E-mail: Web Site: sbarber@perftestplus.com www.PerfTestPlus.com Blog: Twitter: scott-barber.blogspot.com @sbarber Testing Missions in Context © 2012 PerfTestPlus, Inc. All rights reserved.