SlideShare ist ein Scribd-Unternehmen logo
1 von 14
Automated test strategy Ingve Brunvoll
What to automate?
Test quadrants -Test coverage Supporting the team   System tests Critique product Business tests Unit tests Technological
Test quadrants – test strategy
Test design Ingve Brunvoll
Method 1. Create a test plan for the area 2. Analyze existing test coverage and tests 2. Gather required coverage and missing tests 4. Determine test cases to develop 5. Determine what test oracles to use 6. Automate? = Yes: Develop tests using keywords. No: Improve manual test forms.
A functional test case Is an instance of a low level Use Case Is one of the pathways through a test scenario Can combine several positive, or at least one negative outcome Can operate on four test levels: Unit: Calling/Checking an atomic function Integration: Calling/Checking internal functions that again calls other functions System:  Calling/Checking several functions when doing a specified user task Acceptance: How the functions/tasks and appearance are supporting the actual customers processes/needs
Use case vs test case
How to find Test oracles History versions Company image Comparable products Claims/documentation User expectations Product itself Purpose Statutes
Test cases – base them on structured analysis Decision tables State charts User scenarios Boundary value analysis Careful and Un-ambigous Input/output value selection
Best practise - automated test design Think broad, start small Use keywords for maintainability Risk based – start with the subset of tests that usually breaks and hurts most
Automated test framework Ingve Brunvoll
Test execution in framework Test case 1 Test case 2 Goal: Make each test independent of each other, and ensure they are not breaking each other, for max integrity & test confidence, reproducable in the simplest way, and ensure a detailed product status quality feedback to the team
Keyword driven testing One test case consist of one or more keywords Keywords are used by the test driver to run specific test scripts Can represent technical concepts, functions, or be more abstract. i.e. represent a business model. Abstract keywords are more maintainable Keyword instances does not embed scripts itself Keywords  and scripts can be reused by several test scenarios and test cases Are defined in XML templates and used by test cases in a decoupled fasion Keyword inherrits data driven testing, by sending parameters when invoking a keyword script library

Weitere ähnliche Inhalte

Was ist angesagt?

Best Practices for Writing and Organizing QA Tests
Best Practices for Writing and Organizing QA TestsBest Practices for Writing and Organizing QA Tests
Best Practices for Writing and Organizing QA Tests
Sarah Goldberg
 
Reporting On The Testing Process
Reporting On The Testing ProcessReporting On The Testing Process
Reporting On The Testing Process
gavhays
 
Test case design_the_basicsv0.4
Test case design_the_basicsv0.4Test case design_the_basicsv0.4
Test case design_the_basicsv0.4
guest31fced
 
Odd E验收测试驱动开发实战
Odd E验收测试驱动开发实战Odd E验收测试驱动开发实战
Odd E验收测试驱动开发实战
George Ang
 
Exploring Exploratory Testing
Exploring Exploratory TestingExploring Exploratory Testing
Exploring Exploratory Testing
nazeer pasha
 
Unit testing
Unit testingUnit testing
Unit testing
medsherb
 

Was ist angesagt? (20)

Salient tips for writing effective test cases
Salient tips for writing effective test casesSalient tips for writing effective test cases
Salient tips for writing effective test cases
 
Sample test-plan-template
Sample test-plan-templateSample test-plan-template
Sample test-plan-template
 
Hunt On The White Rabbit 10 A Eng
Hunt On The White Rabbit 10 A EngHunt On The White Rabbit 10 A Eng
Hunt On The White Rabbit 10 A Eng
 
Test case design
Test case designTest case design
Test case design
 
Best Practices for Writing and Organizing QA Tests
Best Practices for Writing and Organizing QA TestsBest Practices for Writing and Organizing QA Tests
Best Practices for Writing and Organizing QA Tests
 
Erik Boelen - Testing, The Next Level
Erik Boelen - Testing, The Next LevelErik Boelen - Testing, The Next Level
Erik Boelen - Testing, The Next Level
 
Reporting On The Testing Process
Reporting On The Testing ProcessReporting On The Testing Process
Reporting On The Testing Process
 
Test case design_the_basicsv0.4
Test case design_the_basicsv0.4Test case design_the_basicsv0.4
Test case design_the_basicsv0.4
 
Unit testing
Unit testingUnit testing
Unit testing
 
Mutation Testing
Mutation TestingMutation Testing
Mutation Testing
 
Odd E验收测试驱动开发实战
Odd E验收测试驱动开发实战Odd E验收测试驱动开发实战
Odd E验收测试驱动开发实战
 
Introduction to testing.
Introduction to testing.Introduction to testing.
Introduction to testing.
 
Agile Mumbai 2020 Conference | How to get the best ROI on Your Test Automati...
Agile Mumbai 2020 Conference |  How to get the best ROI on Your Test Automati...Agile Mumbai 2020 Conference |  How to get the best ROI on Your Test Automati...
Agile Mumbai 2020 Conference | How to get the best ROI on Your Test Automati...
 
White box testing
White box testing White box testing
White box testing
 
Effective Test Cases & Introduction to Hexawise
Effective Test Cases & Introduction to HexawiseEffective Test Cases & Introduction to Hexawise
Effective Test Cases & Introduction to Hexawise
 
Exploring Exploratory Testing
Exploring Exploratory TestingExploring Exploratory Testing
Exploring Exploratory Testing
 
Testing
TestingTesting
Testing
 
Beata Karpinska - Testing and Lean Principles - EuroSTAR 2010
Beata Karpinska - Testing and Lean Principles - EuroSTAR 2010Beata Karpinska - Testing and Lean Principles - EuroSTAR 2010
Beata Karpinska - Testing and Lean Principles - EuroSTAR 2010
 
Unit testing
Unit testingUnit testing
Unit testing
 
Implementing test scripting Ian McDonald updated (minor changes) 26-04-2013
Implementing test scripting   Ian McDonald updated (minor changes) 26-04-2013Implementing test scripting   Ian McDonald updated (minor changes) 26-04-2013
Implementing test scripting Ian McDonald updated (minor changes) 26-04-2013
 

Andere mochten auch

Andere mochten auch (12)

Kongre yönetim sistemi
Kongre yönetim sistemiKongre yönetim sistemi
Kongre yönetim sistemi
 
Virtual Tech Days Spot The Bug Handout
Virtual Tech Days Spot The Bug HandoutVirtual Tech Days Spot The Bug Handout
Virtual Tech Days Spot The Bug Handout
 
Meekro-adventures
Meekro-adventuresMeekro-adventures
Meekro-adventures
 
RECOPILACION DE FOTOS DE LA WEB
RECOPILACION DE FOTOS DE LA WEBRECOPILACION DE FOTOS DE LA WEB
RECOPILACION DE FOTOS DE LA WEB
 
Top Ten List
Top Ten ListTop Ten List
Top Ten List
 
Nu Creature Portfolio
Nu Creature PortfolioNu Creature Portfolio
Nu Creature Portfolio
 
Consumer preferences of small car in india
Consumer preferences of small car in indiaConsumer preferences of small car in india
Consumer preferences of small car in india
 
Iso Analyse Kpi
Iso Analyse KpiIso Analyse Kpi
Iso Analyse Kpi
 
New Year's card
New Year's cardNew Year's card
New Year's card
 
Measure A Status Report, 2010
Measure A Status Report, 2010Measure A Status Report, 2010
Measure A Status Report, 2010
 
SEO Life Cycle
SEO Life CycleSEO Life Cycle
SEO Life Cycle
 
Measure A Status Report, 2010
Measure A Status Report, 2010Measure A Status Report, 2010
Measure A Status Report, 2010
 

Ähnlich wie Automated

Test Cases Maintaining & Documenting
Test Cases Maintaining & DocumentingTest Cases Maintaining & Documenting
Test Cases Maintaining & Documenting
Seyed Ali Marjaie
 
Software testing
Software testingSoftware testing
Software testing
thaneofife
 
Test Management introduction
Test Management introductionTest Management introduction
Test Management introduction
Oana Feidi
 
Test management
Test managementTest management
Test management
Oana Feidi
 
object oriented system analysis and design
object oriented system analysis and designobject oriented system analysis and design
object oriented system analysis and design
wekineheshete
 

Ähnlich wie Automated (20)

Software Test Automation - Best Practices
Software Test Automation - Best PracticesSoftware Test Automation - Best Practices
Software Test Automation - Best Practices
 
Istqb lesson1
Istqb lesson1Istqb lesson1
Istqb lesson1
 
QA process Presentation
QA process PresentationQA process Presentation
QA process Presentation
 
Test Cases Maintaining & Documenting
Test Cases Maintaining & DocumentingTest Cases Maintaining & Documenting
Test Cases Maintaining & Documenting
 
Writing Test Cases in Agile
Writing Test Cases in AgileWriting Test Cases in Agile
Writing Test Cases in Agile
 
types of testing with descriptions and examples
types of testing with descriptions and examplestypes of testing with descriptions and examples
types of testing with descriptions and examples
 
System Testingin Agile Environment
System Testingin Agile EnvironmentSystem Testingin Agile Environment
System Testingin Agile Environment
 
Exploratory Testing - A Whitepaper by RapidValue
Exploratory Testing -  A Whitepaper by RapidValueExploratory Testing -  A Whitepaper by RapidValue
Exploratory Testing - A Whitepaper by RapidValue
 
Object Oriented Testing
Object Oriented TestingObject Oriented Testing
Object Oriented Testing
 
Software testing
Software testingSoftware testing
Software testing
 
Test Management introduction
Test Management introductionTest Management introduction
Test Management introduction
 
Test management
Test managementTest management
Test management
 
C:\documents and settings\selvam.mc\my documents\automation testing process
C:\documents and settings\selvam.mc\my documents\automation testing processC:\documents and settings\selvam.mc\my documents\automation testing process
C:\documents and settings\selvam.mc\my documents\automation testing process
 
Automation Concepts
Automation ConceptsAutomation Concepts
Automation Concepts
 
Iml v1.5 open-source version
Iml v1.5   open-source versionIml v1.5   open-source version
Iml v1.5 open-source version
 
Automated Testing Tutorial
Automated Testing TutorialAutomated Testing Tutorial
Automated Testing Tutorial
 
03 test specification and execution
03   test specification and execution03   test specification and execution
03 test specification and execution
 
Quality assurance tests
Quality assurance testsQuality assurance tests
Quality assurance tests
 
Effective Testing fo Startups
Effective Testing fo StartupsEffective Testing fo Startups
Effective Testing fo Startups
 
object oriented system analysis and design
object oriented system analysis and designobject oriented system analysis and design
object oriented system analysis and design
 

Automated

  • 1. Automated test strategy Ingve Brunvoll
  • 3. Test quadrants -Test coverage Supporting the team System tests Critique product Business tests Unit tests Technological
  • 4. Test quadrants – test strategy
  • 5. Test design Ingve Brunvoll
  • 6. Method 1. Create a test plan for the area 2. Analyze existing test coverage and tests 2. Gather required coverage and missing tests 4. Determine test cases to develop 5. Determine what test oracles to use 6. Automate? = Yes: Develop tests using keywords. No: Improve manual test forms.
  • 7. A functional test case Is an instance of a low level Use Case Is one of the pathways through a test scenario Can combine several positive, or at least one negative outcome Can operate on four test levels: Unit: Calling/Checking an atomic function Integration: Calling/Checking internal functions that again calls other functions System: Calling/Checking several functions when doing a specified user task Acceptance: How the functions/tasks and appearance are supporting the actual customers processes/needs
  • 8. Use case vs test case
  • 9. How to find Test oracles History versions Company image Comparable products Claims/documentation User expectations Product itself Purpose Statutes
  • 10. Test cases – base them on structured analysis Decision tables State charts User scenarios Boundary value analysis Careful and Un-ambigous Input/output value selection
  • 11. Best practise - automated test design Think broad, start small Use keywords for maintainability Risk based – start with the subset of tests that usually breaks and hurts most
  • 12. Automated test framework Ingve Brunvoll
  • 13. Test execution in framework Test case 1 Test case 2 Goal: Make each test independent of each other, and ensure they are not breaking each other, for max integrity & test confidence, reproducable in the simplest way, and ensure a detailed product status quality feedback to the team
  • 14. Keyword driven testing One test case consist of one or more keywords Keywords are used by the test driver to run specific test scripts Can represent technical concepts, functions, or be more abstract. i.e. represent a business model. Abstract keywords are more maintainable Keyword instances does not embed scripts itself Keywords and scripts can be reused by several test scenarios and test cases Are defined in XML templates and used by test cases in a decoupled fasion Keyword inherrits data driven testing, by sending parameters when invoking a keyword script library

Hinweis der Redaktion

  1. Structure: What it is/each part made of?Functions: What it does?Data: how it does it?Platform: what it depends upon?Operations: how it is used?Time: howit is affected by time?
  2. Unit tests and functional system test are the obvious choice for automation. 70 % unit tests& 30% functional system tests will be optimal.