SlideShare ist ein Scribd-Unternehmen logo
1 von 18
Downloaden Sie, um offline zu lesen
“Houston, we have a problem”


SofTec Asia 2011, Bangalore


T Ashok
Founder & CEO, STAG Software
  in.linkedin.com/in/AshokSTAG
  ash_thiru
A radio transmission by Lovell, "Houston, we've had a problem", has
become widely misquoted in popular culture as,"Houston, we have a
problem".

                                                                     Apollo 13 was the third manned
                                                                     mission by NASA intended to land on
                                                                     the moon, but experienced a mid-
                                                                     mission technical malfunction that
                                                                     forced the lunar landing to be aborted.
                                                                     The crew was Commander James A.
                                                                     Lovell, Command Module pilot John L.
                                                                     "Jack" Swigert, and Lunar Module
                                                                     pilot Fred W. Haise.
  HOUSTON, WE HAVE A PROBLEM




Copyright 2011 STAG Software Private Limited. All rights reserved.                                      www.stagsoftware.com
What is this picture?




                                                                     Bengaluru
                                                                     Level -1




Copyright 2011 STAG Software Private Limited. All rights reserved.          www.stagsoftware.com
What is this picture?




                                                                     Ulsoor lake
                                                                      Level 2




Copyright 2011 STAG Software Private Limited. All rights reserved.             www.stagsoftware.com
Moving to next level of detail...




                                                                      Dirty water in
                                                                         part of
                                                                       Ulsoor lake
                                                                        Level 3




 Copyright 2011 STAG Software Private Limited. All rights reserved.            www.stagsoftware.com
What do we learn from this?

     Higher the elevation,
     the more we see.




     At lower levels,
     we see more.



                                                                     Hmm. Common sensical.
Copyright 2011 STAG Software Private Limited. All rights reserved.                           www.stagsoftware.com
What else?


  We see different problems at different levels!




  Receding green cover seen at higher altitude.
  High density population seen at next level.
  Dirty water seen at the lower level.




Copyright 2011 STAG Software Private Limited. All rights reserved.   www.stagsoftware.com
So what does this mean for “Testing?”

                                                                                       High altitude
                          “Properties of the system”
                             Cleanliness criteria                        End user expectations


                                                         “affected by”


                                                                                       Low altitude
                                                                         Issues in specifications,
                          Potential Defect Types (PDT)                   structure, environment
                                                                              and behavior


Copyright 2011 STAG Software Private Limited. All rights reserved.                                  www.stagsoftware.com
Different types of defects at
Different levels
Need different granularity of information.
                                                Expectations          “Properties of the system”
                                                                         Cleanliness criteria
                                                      Needs

                                                    Features

                                                Environment                        “impedes”
                                                    Behavior

                                                   Structure
                                                                             Potential Defect Types (PDT)
                                                    Material



                                                                                  Expectations delivered
                                                                                  by Needs (Requirements)
                                                                                  via Features
                                                                                  that display Behavior
                                                                                  constructed from Materials
                                                                                  in accordance to a Structure
                                                                                  in a given Environment
 Copyright 2011 STAG Software Private Limited. All rights reserved.                                   www.stagsoftware.com
How do we uncover the
different defect types

           Identify the different types
           Classify them
           Separate them


                Hmmm.
                This means that the system under
                test is “mixture” of defects.

                How can we separate these?

Copyright 2011 STAG Software Private Limited. All rights reserved.   www.stagsoftware.com
Fractional Distillation - Remember this?

                                                                       A technique to separate mixtures
                                                                      that have components of different
                                                                                boiling points


                                                                       Think!
                                                                       There are a variety of defect
                                                                       types that may be present in the
                                                                       system.

                                                                       To optimally uncover the
From : http://withfriendship.com                                       defects, can we separate these
                                                                       types of defects on the basis of
                                                                       certain properties and
                                                                       optimally uncover the defects?


 Copyright 2011 STAG Software Private Limited. All rights reserved.                               www.stagsoftware.com
So, how do we identify the various types of defects?
 Seems like it requires experience.


             What if I do NOT have prior experience?
             Well, you can logically deduce this.




Copyright 2011 STAG Software Private Limited. All rights reserved.   www.stagsoftware.com
Sherlock Holmes - The Master Logician


                                                                     Focus on intellectual power to solve mysteries.

                                                                     Strong application of deductive logic.



                                                                         Think!
                                                                         Can we hypothesize as to what can go
                                                                         wrong and prove/disprove?

                                                                         Hypothesize potential defect types and
                                                                         prove presence of instances. If they are
                                                                         not present, can we reason their
                                                                         absence?



Copyright 2011 STAG Software Private Limited. All rights reserved.                                            www.stagsoftware.com
Quality Levels, Aspects & Issues
                                                                       Aspect               Issues

                                                                      Usage
L9        End user value                                              User flows, experience

                                                                      Environment, Data, Logic
L8        Clean Deployment                                            Compatibility, migration
                                                                      Structure, Logic, Usage
L7        Attributes met                                              Performance, security, volume, load...
                                                                      Environment
L6        Environment cleanliness                                     Resource leaks, Compatibility...

                                                                      Logic, Environment
L5        Robustness                                                  Error handling
                                                                      Data, Logic
L4        Behavior correctness                                        Functionality

L3        Structural integrity                                        Structure
                                                                      Internal structural issues
                                                                      Structure, Usage
L2        Input interface cleanliness                                 UI issues

                                                                      Data
L1        Input cleanliness
                                                                      Input data handling
                                                                                             Source: HBT: Hypothesis Based Testing
 Copyright 2011 STAG Software Private Limited. All rights reserved.                                             www.stagsoftware.com
HBT - Hypothesis Based Testing
     Cleanliness criteria                              Potential defect types



                                                         Staged & purposeful
                                                              detection

           Expectations

                                                         Complete test cases



           Goal directed                                Sensible automation
            measures




Personal scientific test methodology
powered by STEMTM the defect detection technology.

Six stages to clean software, powered by EIGHT scientific
thinking disciplines enabled by 32 core concepts.

Consists of a 9-stage filter to remove defects Each stage
different “levels” of information to identify defects.
 Copyright 2011 STAG Software Private Limited. All rights reserved.             www.stagsoftware.com
Apollo 13: “Successful Failure”

Cause of the problem
Oxygen tank exploded.
Cause of explosion was an exposed electrical wiring.
When switch to stir the cryo-tank was flipped to stir the tank, fans
turned, wires short-circuited and teflon insulation caught fire.
The fire spread and blew the Oxygen tank.

Ground controllers had asked cryo-tank to be stirred, as they had
noticed some issues before take-off.




 Copyright 2011 STAG Software Private Limited. All rights reserved.   www.stagsoftware.com
“Houston, we have a problem”
                        Concluding...
                         Small problems noticed pre-launch were “patched” leading to a
     1                   propagation that culminated in a near catastrophe.


                      Controllers at Houston came up with makeshift adapter from
                      materials that astronauts had on board, to enable lowering C02.
     2                The solution was possible due to years of serious engineering,
                      practice and experience. It was not luck!


                      We are on test professionals on ground and the our
     3                customers far away from us in the business space.
                      Remember the risk we put them into!


Copyright 2011 STAG Software Private Limited. All rights reserved.             www.stagsoftware.com
Thank you. Have a great conference.

    Follow us                                     @stagsoft




Copyright 2011 STAG Software Private Limited. All rights reserved.   www.stagsoftware.com

Weitere ähnliche Inhalte

Mehr von STAG Software Private Limited

Application Scenarios of "doSmartQA -Smart Probing Assistant"
Application Scenarios of "doSmartQA -Smart Probing Assistant"Application Scenarios of "doSmartQA -Smart Probing Assistant"
Application Scenarios of "doSmartQA -Smart Probing Assistant"STAG Software Private Limited
 
Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)STAG Software Private Limited
 
Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)STAG Software Private Limited
 
Deliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolDeliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolSTAG Software Private Limited
 
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...STAG Software Private Limited
 
Think better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachThink better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachSTAG Software Private Limited
 

Mehr von STAG Software Private Limited (20)

Application Scenarios of "doSmartQA -Smart Probing Assistant"
Application Scenarios of "doSmartQA -Smart Probing Assistant"Application Scenarios of "doSmartQA -Smart Probing Assistant"
Application Scenarios of "doSmartQA -Smart Probing Assistant"
 
Choked by technical debt?
Choked by technical debt?Choked by technical debt?
Choked by technical debt?
 
Are your quality metrics insightful?
Are your quality metrics insightful?Are your quality metrics insightful?
Are your quality metrics insightful?
 
Weighed down by automation?
Weighed down by automation?Weighed down by automation?
Weighed down by automation?
 
Covid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & CriteriaCovid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & Criteria
 
Seven Thinking Tools to Test Rapidly
Seven Thinking Tools to Test RapidlySeven Thinking Tools to Test Rapidly
Seven Thinking Tools to Test Rapidly
 
How to test less and accomplish more
How to test less and accomplish moreHow to test less and accomplish more
How to test less and accomplish more
 
Is regression hindering your progression?
Is regression hindering your progression?Is regression hindering your progression?
Is regression hindering your progression?
 
The Power of Checklist
The Power of ChecklistThe Power of Checklist
The Power of Checklist
 
The power of checklist
The power of checklist The power of checklist
The power of checklist
 
Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing
 
Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)
 
Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)
 
Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)
 
Language shapes the way you think
Language shapes the way you thinkLanguage shapes the way you think
Language shapes the way you think
 
Deliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolDeliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization Tool
 
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
 
Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?
 
Think better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachThink better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” Approach
 
Improving Defect Yield - a three step approach
Improving Defect Yield - a three step approachImproving Defect Yield - a three step approach
Improving Defect Yield - a three step approach
 

Kürzlich hochgeladen

Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxRemote DBA Services
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistandanishmna97
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamUiPathCommunity
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfOrbitshub
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 

Kürzlich hochgeladen (20)

Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 

Houston, We Have a Problem

  • 1. “Houston, we have a problem” SofTec Asia 2011, Bangalore T Ashok Founder & CEO, STAG Software in.linkedin.com/in/AshokSTAG ash_thiru
  • 2. A radio transmission by Lovell, "Houston, we've had a problem", has become widely misquoted in popular culture as,"Houston, we have a problem". Apollo 13 was the third manned mission by NASA intended to land on the moon, but experienced a mid- mission technical malfunction that forced the lunar landing to be aborted. The crew was Commander James A. Lovell, Command Module pilot John L. "Jack" Swigert, and Lunar Module pilot Fred W. Haise. HOUSTON, WE HAVE A PROBLEM Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 3. What is this picture? Bengaluru Level -1 Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 4. What is this picture? Ulsoor lake Level 2 Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 5. Moving to next level of detail... Dirty water in part of Ulsoor lake Level 3 Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 6. What do we learn from this? Higher the elevation, the more we see. At lower levels, we see more. Hmm. Common sensical. Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 7. What else? We see different problems at different levels! Receding green cover seen at higher altitude. High density population seen at next level. Dirty water seen at the lower level. Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 8. So what does this mean for “Testing?” High altitude “Properties of the system” Cleanliness criteria End user expectations “affected by” Low altitude Issues in specifications, Potential Defect Types (PDT) structure, environment and behavior Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 9. Different types of defects at Different levels Need different granularity of information. Expectations “Properties of the system” Cleanliness criteria Needs Features Environment “impedes” Behavior Structure Potential Defect Types (PDT) Material Expectations delivered by Needs (Requirements) via Features that display Behavior constructed from Materials in accordance to a Structure in a given Environment Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 10. How do we uncover the different defect types Identify the different types Classify them Separate them Hmmm. This means that the system under test is “mixture” of defects. How can we separate these? Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 11. Fractional Distillation - Remember this? A technique to separate mixtures that have components of different boiling points Think! There are a variety of defect types that may be present in the system. To optimally uncover the From : http://withfriendship.com defects, can we separate these types of defects on the basis of certain properties and optimally uncover the defects? Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 12. So, how do we identify the various types of defects? Seems like it requires experience. What if I do NOT have prior experience? Well, you can logically deduce this. Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 13. Sherlock Holmes - The Master Logician Focus on intellectual power to solve mysteries. Strong application of deductive logic. Think! Can we hypothesize as to what can go wrong and prove/disprove? Hypothesize potential defect types and prove presence of instances. If they are not present, can we reason their absence? Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 14. Quality Levels, Aspects & Issues Aspect Issues Usage L9 End user value User flows, experience Environment, Data, Logic L8 Clean Deployment Compatibility, migration Structure, Logic, Usage L7 Attributes met Performance, security, volume, load... Environment L6 Environment cleanliness Resource leaks, Compatibility... Logic, Environment L5 Robustness Error handling Data, Logic L4 Behavior correctness Functionality L3 Structural integrity Structure Internal structural issues Structure, Usage L2 Input interface cleanliness UI issues Data L1 Input cleanliness Input data handling Source: HBT: Hypothesis Based Testing Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 15. HBT - Hypothesis Based Testing Cleanliness criteria Potential defect types Staged & purposeful detection Expectations Complete test cases Goal directed Sensible automation measures Personal scientific test methodology powered by STEMTM the defect detection technology. Six stages to clean software, powered by EIGHT scientific thinking disciplines enabled by 32 core concepts. Consists of a 9-stage filter to remove defects Each stage different “levels” of information to identify defects. Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 16. Apollo 13: “Successful Failure” Cause of the problem Oxygen tank exploded. Cause of explosion was an exposed electrical wiring. When switch to stir the cryo-tank was flipped to stir the tank, fans turned, wires short-circuited and teflon insulation caught fire. The fire spread and blew the Oxygen tank. Ground controllers had asked cryo-tank to be stirred, as they had noticed some issues before take-off. Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 17. “Houston, we have a problem” Concluding... Small problems noticed pre-launch were “patched” leading to a 1 propagation that culminated in a near catastrophe. Controllers at Houston came up with makeshift adapter from materials that astronauts had on board, to enable lowering C02. 2 The solution was possible due to years of serious engineering, practice and experience. It was not luck! We are on test professionals on ground and the our 3 customers far away from us in the business space. Remember the risk we put them into! Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com
  • 18. Thank you. Have a great conference. Follow us @stagsoft Copyright 2011 STAG Software Private Limited. All rights reserved. www.stagsoftware.com