SlideShare ist ein Scribd-Unternehmen logo
1 von 10
By Rohan Kachewar
What is an automation framework
 Theoretical definition: A test automation framework is a
  set of assumptions, concepts and tools that provide support
  for automated software testing.
 My perception: A good test automation framework is a
  skeleton structure which facilitates easy maintenance ,
  reuse, execution of tests and report generation.
 There are many more parameters than this but listed above
  would be the major ones.
Automate at what level?
Issues with Agile Environments
 Today’s competitive world:
    Each product based company tries to cater multiple
     customers

    They end up maintaining numerous customer specific
     branches/builds.

    Maintaining different tests scripts for each customer

    Conclusion: This requires again branch specific:
      Storage of test scripts/executables
      Test case related Meta data.
      Also for same branch (Customer), different version specific
       categorization of above data.
Primitive solution
                 Hard Code the tests
                 Write separate test suite
                  for each customer
                 Write Never ending
                  decision statements to
                  remember which suite to
                  execute on which branch
                  or simply remember this
                  suite to branch mapping
                  .
New Approach: The Chameleon
Model
                Features:
                Separate the test data
                 from tests
                The overhead logic of
                 deciding which tests to
                 execute is passed on to
                 build system instead of
                 Test framework
Block Diagram and Work Flow
Build
 Build/automation
                                                Execute Test
                                                Case
                 32 bit

    Generi
      c                                             Target
                                    Results

  Test Case       Meta
  ID File         Data
                                     Platform
                                     Check



SVN/automation

  64 bit
    64 bit
              32 bit
                32 bit
                           Test
                          Harness                   Scheduler
  Generi Test
   Generi Test
    c
      c Binary
           Binary
Test Case      Meta
IDTest Case
   File         Meta
               Data
  ID File       Data                                   User

                                                                8
Conclusion
 This chameleon model as name suggests, is highly flexible
  / adaptable so as to integrate ever changing test cases
  dynamically in today’s customer centric testing
  environment.
 The framework design also facilitates easier addition of test
  cases and test data for the Manual QA team thus reducing
  the dependency on dedicated automation team (which
  might lack the knowledge to define which tests to run for
  which customer). Thus reducing the communication gap
  and achieving more focused testing.
 Also this framework model facilitates QA to dynamically
  create test suites containing the test cases they want to run
  as per the different builds/branches
Questions

 Thanks


 Rohan.r.kachewar@gmail.com

Weitere ähnliche Inhalte

Was ist angesagt?

Beginners - Get Started With Unit Testing in .NET
Beginners - Get Started With Unit Testing in .NETBeginners - Get Started With Unit Testing in .NET
Beginners - Get Started With Unit Testing in .NETBaskar K
 
Roy Osherove on Unit Testing Good Practices and Horrible Mistakes
Roy Osherove on Unit Testing Good Practices and Horrible MistakesRoy Osherove on Unit Testing Good Practices and Horrible Mistakes
Roy Osherove on Unit Testing Good Practices and Horrible MistakesRoy Osherove
 
Unit Testing Fundamentals
Unit Testing FundamentalsUnit Testing Fundamentals
Unit Testing FundamentalsRichard Paul
 
Unit testing best practices
Unit testing best practicesUnit testing best practices
Unit testing best practicesnickokiss
 
Unit Tests And Automated Testing
Unit Tests And Automated TestingUnit Tests And Automated Testing
Unit Tests And Automated TestingLee Englestone
 
Unit Testing Done Right
Unit Testing Done RightUnit Testing Done Right
Unit Testing Done RightBrian Fenton
 
Understanding Unit Testing
Understanding Unit TestingUnderstanding Unit Testing
Understanding Unit Testingikhwanhayat
 
White boxvsblackbox
White boxvsblackboxWhite boxvsblackbox
White boxvsblackboxsanerjjd
 
Embrace Unit Testing
Embrace Unit TestingEmbrace Unit Testing
Embrace Unit Testingalessiopace
 
White Box Testing
White Box TestingWhite Box Testing
White Box TestingAlisha Roy
 
Keyword Driven Automation
Keyword Driven AutomationKeyword Driven Automation
Keyword Driven AutomationPankaj Goel
 
Model Based Software Testing
Model Based Software TestingModel Based Software Testing
Model Based Software TestingEsin Karaman
 

Was ist angesagt? (20)

Unit Testing
Unit TestingUnit Testing
Unit Testing
 
Beginners - Get Started With Unit Testing in .NET
Beginners - Get Started With Unit Testing in .NETBeginners - Get Started With Unit Testing in .NET
Beginners - Get Started With Unit Testing in .NET
 
Roy Osherove on Unit Testing Good Practices and Horrible Mistakes
Roy Osherove on Unit Testing Good Practices and Horrible MistakesRoy Osherove on Unit Testing Good Practices and Horrible Mistakes
Roy Osherove on Unit Testing Good Practices and Horrible Mistakes
 
Unit Testing Fundamentals
Unit Testing FundamentalsUnit Testing Fundamentals
Unit Testing Fundamentals
 
Unit testing best practices
Unit testing best practicesUnit testing best practices
Unit testing best practices
 
Workshop unit test
Workshop   unit testWorkshop   unit test
Workshop unit test
 
Unit Tests And Automated Testing
Unit Tests And Automated TestingUnit Tests And Automated Testing
Unit Tests And Automated Testing
 
Unit testing with JUnit
Unit testing with JUnitUnit testing with JUnit
Unit testing with JUnit
 
Unit Testing Done Right
Unit Testing Done RightUnit Testing Done Right
Unit Testing Done Right
 
Understanding Unit Testing
Understanding Unit TestingUnderstanding Unit Testing
Understanding Unit Testing
 
White boxvsblackbox
White boxvsblackboxWhite boxvsblackbox
White boxvsblackbox
 
Embrace Unit Testing
Embrace Unit TestingEmbrace Unit Testing
Embrace Unit Testing
 
White Box Testing
White Box TestingWhite Box Testing
White Box Testing
 
Keyword Driven Automation
Keyword Driven AutomationKeyword Driven Automation
Keyword Driven Automation
 
Model Based Software Testing
Model Based Software TestingModel Based Software Testing
Model Based Software Testing
 
Black box software testing
Black box software testingBlack box software testing
Black box software testing
 
Unit test
Unit testUnit test
Unit test
 
Unit Testing 101
Unit Testing 101Unit Testing 101
Unit Testing 101
 
Tdd & unit test
Tdd & unit testTdd & unit test
Tdd & unit test
 
Unit Testing
Unit TestingUnit Testing
Unit Testing
 

Ähnlich wie Chameleon Model

SUMMIT 09 - Startegic Choice Of Test Automation Framework
SUMMIT 09 - Startegic Choice Of Test Automation FrameworkSUMMIT 09 - Startegic Choice Of Test Automation Framework
SUMMIT 09 - Startegic Choice Of Test Automation FrameworkLavanya Lakshman
 
Planning & building scalable test infrastructure
Planning  & building scalable test infrastructurePlanning  & building scalable test infrastructure
Planning & building scalable test infrastructureVijayan Reddy
 
Visual Studio 2010 Testing Overview
Visual Studio 2010 Testing OverviewVisual Studio 2010 Testing Overview
Visual Studio 2010 Testing OverviewSteve Lange
 
Microsoft Fakes, Unit Testing the (almost) Untestable Code
Microsoft Fakes, Unit Testing the (almost) Untestable CodeMicrosoft Fakes, Unit Testing the (almost) Untestable Code
Microsoft Fakes, Unit Testing the (almost) Untestable CodeAleksandar Bozinovski
 
Test Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.comTest Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.comIdexcel Technologies
 
Automation Framework Presentation
Automation Framework PresentationAutomation Framework Presentation
Automation Framework PresentationBen Ngo
 
How Manual Testers Can Break into Automation Without Programming Skills
How Manual Testers Can Break into Automation Without Programming SkillsHow Manual Testers Can Break into Automation Without Programming Skills
How Manual Testers Can Break into Automation Without Programming SkillsRanorex
 
Gredy - test automation management and team collaboration
Gredy - test automation management and team collaborationGredy - test automation management and team collaboration
Gredy - test automation management and team collaborationGredy
 
Centralized test automation framework implementation
Centralized test automation framework implementationCentralized test automation framework implementation
Centralized test automation framework implementationBharathi Krishnamurthi
 
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...Soham Mondal
 
Презентация
ПрезентацияПрезентация
Презентацияguest22d71d
 
Overview of Lab Management and TFS
Overview of Lab Management and TFSOverview of Lab Management and TFS
Overview of Lab Management and TFSChris Kadel, MBA
 
Queuing model based load testing of large enterprise applications
Queuing model based load testing of large enterprise applicationsQueuing model based load testing of large enterprise applications
Queuing model based load testing of large enterprise applicationsLeonid Grinshpan, Ph.D.
 
Testware Hierarchy for Test Automation
Testware Hierarchy for Test AutomationTestware Hierarchy for Test Automation
Testware Hierarchy for Test AutomationGregory Solovey
 

Ähnlich wie Chameleon Model (20)

SUMMIT 09 - Startegic Choice Of Test Automation Framework
SUMMIT 09 - Startegic Choice Of Test Automation FrameworkSUMMIT 09 - Startegic Choice Of Test Automation Framework
SUMMIT 09 - Startegic Choice Of Test Automation Framework
 
Planning & building scalable test infrastructure
Planning  & building scalable test infrastructurePlanning  & building scalable test infrastructure
Planning & building scalable test infrastructure
 
Visual Studio 2010 Testing Overview
Visual Studio 2010 Testing OverviewVisual Studio 2010 Testing Overview
Visual Studio 2010 Testing Overview
 
Microsoft Fakes, Unit Testing the (almost) Untestable Code
Microsoft Fakes, Unit Testing the (almost) Untestable CodeMicrosoft Fakes, Unit Testing the (almost) Untestable Code
Microsoft Fakes, Unit Testing the (almost) Untestable Code
 
Unit Tests with Microsoft Fakes
Unit Tests with Microsoft FakesUnit Tests with Microsoft Fakes
Unit Tests with Microsoft Fakes
 
Test Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.comTest Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.com
 
Automation Framework Presentation
Automation Framework PresentationAutomation Framework Presentation
Automation Framework Presentation
 
How Manual Testers Can Break into Automation Without Programming Skills
How Manual Testers Can Break into Automation Without Programming SkillsHow Manual Testers Can Break into Automation Without Programming Skills
How Manual Testers Can Break into Automation Without Programming Skills
 
Gredy - test automation management and team collaboration
Gredy - test automation management and team collaborationGredy - test automation management and team collaboration
Gredy - test automation management and team collaboration
 
05 test infrastructure
05   test infrastructure05   test infrastructure
05 test infrastructure
 
Centralized test automation framework implementation
Centralized test automation framework implementationCentralized test automation framework implementation
Centralized test automation framework implementation
 
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
 
Презентация
ПрезентацияПрезентация
Презентация
 
Overview of Lab Management and TFS
Overview of Lab Management and TFSOverview of Lab Management and TFS
Overview of Lab Management and TFS
 
Queuing model based load testing of large enterprise applications
Queuing model based load testing of large enterprise applicationsQueuing model based load testing of large enterprise applications
Queuing model based load testing of large enterprise applications
 
Introduction to Parasoft C++TEST
Introduction to Parasoft C++TEST Introduction to Parasoft C++TEST
Introduction to Parasoft C++TEST
 
Test automation
Test automationTest automation
Test automation
 
Manualtestingppt
ManualtestingpptManualtestingppt
Manualtestingppt
 
Introduction & Manual Testing
Introduction & Manual TestingIntroduction & Manual Testing
Introduction & Manual Testing
 
Testware Hierarchy for Test Automation
Testware Hierarchy for Test AutomationTestware Hierarchy for Test Automation
Testware Hierarchy for Test Automation
 

Chameleon Model

  • 2. What is an automation framework  Theoretical definition: A test automation framework is a set of assumptions, concepts and tools that provide support for automated software testing.  My perception: A good test automation framework is a skeleton structure which facilitates easy maintenance , reuse, execution of tests and report generation.  There are many more parameters than this but listed above would be the major ones.
  • 4. Issues with Agile Environments  Today’s competitive world:  Each product based company tries to cater multiple customers  They end up maintaining numerous customer specific branches/builds.  Maintaining different tests scripts for each customer  Conclusion: This requires again branch specific:  Storage of test scripts/executables  Test case related Meta data.  Also for same branch (Customer), different version specific categorization of above data.
  • 5. Primitive solution  Hard Code the tests  Write separate test suite for each customer  Write Never ending decision statements to remember which suite to execute on which branch or simply remember this suite to branch mapping .
  • 6. New Approach: The Chameleon Model  Features:  Separate the test data from tests  The overhead logic of deciding which tests to execute is passed on to build system instead of Test framework
  • 7.
  • 8. Block Diagram and Work Flow Build Build/automation Execute Test Case 32 bit Generi c Target Results Test Case Meta ID File Data Platform Check SVN/automation 64 bit 64 bit 32 bit 32 bit Test Harness Scheduler Generi Test Generi Test c c Binary Binary Test Case Meta IDTest Case File Meta Data ID File Data User 8
  • 9. Conclusion  This chameleon model as name suggests, is highly flexible / adaptable so as to integrate ever changing test cases dynamically in today’s customer centric testing environment.  The framework design also facilitates easier addition of test cases and test data for the Manual QA team thus reducing the dependency on dedicated automation team (which might lack the knowledge to define which tests to run for which customer). Thus reducing the communication gap and achieving more focused testing.  Also this framework model facilitates QA to dynamically create test suites containing the test cases they want to run as per the different builds/branches