SlideShare ist ein Scribd-Unternehmen logo
1 von 27
HowManualTestersCan
BreakintoTestAutomation
WithoutProgramming
Skills
JimTrentadue
Account / Sales Manager - Ranorex
jtrentadue@ranorex.com
Agenda
3
Agenda
» Test Automation Industry recap
» Test Automation Industry outlook
» Review of an AutomatedTest Lifecycle Methodology
(ATLM)
» Three categories of supporting and working inTest
Automation:
» Preparation, Execution and Analysis
» Nine areas for manual testers to work on withinTest
Automation
» Session recap
TestAutomationIndustryRecap
5
TestAutomationIndustryRecap
» First Record  Playback tools appeared about 20-25
years ago
» The primary objective was to test desktop
applications. Some tools could test broken URL
links, but not dig into the objects
» The tester was required to have scripting or
programming knowledge to make the tests run
effectively, even in Record  Playback
6
TestAutomationIndustryRecap
» Below is an evolution ofTest Automation
Frameworks:
Record 
Playback
Structured
Testing
(invokes
more
conditions)
Data Driven
Keyword
Driven
Model /
Object
Based
Actions
Based
Hybrid
(combines 2
or more of
the previous
frameworks)
TestAutomation IndustryOutlook
8
TestAutomationIndustryOutlook
» Number of test automation tools have increased to
over 25-30, primarily focused on taking the scripting
/ programming out of the equation for the manual
testers
» Technical complexities have increased considerably
to cover the following:
9
TestAutomationIndustryOutlook
» License models now offer aTest Execution only
component, apart from the license to create and
maintain the automated tests and object repository
» Tools have the capability to integrate with various
Continuous Integration tools andTest Management
solutions
ReviewofanAutomatedTest
LifecycleMethodology(ATLM)
11
MappinganATLMagainstanSDLC
Automated Software Testing: Introduction, Management and Performance – Dustin, Rashka, Paul
Illustration of how typical
activities of an ATLM align with
SDLC activities
D. System Design & Development C. SmallTool Pilot/Prototype
A. System Life-Cycle ProcessF. Production and Maintenance
B.BusinessAnalysisandRequirements
E.IntegrationandTest
CategorizingtheAreasRequiredfor
TestAutomation
13
WorkingCategoriesforTestAutomation
• Planning test
automation activities
into your testing process
• Creating data sheets or
SQL statements for
data-driving your tests
• Editing existing manual
test cases for
automation
Preparation
• Learning how objects are
recognized within test
automation
• Working with the object
repository and organizing
this
• Building test automation
actions from the ground
up
Execution • Adding error-handling in
your testing flow
• Knowing how to step into
test cases and debug
• Reading report results and
interpreting this
Analysis
Grouping activities in Preparation, Execution & Analysis
NineAreasforManualTesterstoWork
onWithinTestAutomation
15
Preparation
Outline the scope of automation in the ReleaseTest Plan
Divide test scenarios:Automated vs. Manual
cases
Prepare the automated test workflow
with error-handling (new and
regression)
Record your modules,
ensuring all objects have
been recognized
Replay until test
executes as
expected
Check-in to
CM solution
Planning test automation activities into your testing process
Project
Initiation
Test
Strategy
Analysis
Design
Develop
Testing
Deploy
Test
Scenarios
Test
Cases
Test
Scripts
Test
Results
Test
Summary
Test Automation activities:
16
Preparation
Login ID Password LoginType
TestUser1 Password123# StandardUser
TestUser2 Password456% Supervisor
TestUser3 Password789$ Manager
Excel example
• Login ID
• Password
MyApplication
SELECT * from Logins
where LoginType = Manager
SQL data retrieval
3. Map your
data source
columns to
the defined
variables
2. Link to
your data
source
where the
data will be
1. Create a
variable on
what you
want to
data-drive
Simplified Data-Driven setup in aTest Automation solution
Creating data sheets or SQL statement for data-driving your automation
17
Preparation
Test Steps
• Limit the verbiage to just Actions and
Events / Sequences
• 1. Mouse Click
• 2. Key Sequence Value
Test Data
• Avoid hard-coding any values unless
mandatory
• Better to maintain to controlled data
in an external format
Test Results
• Best practice to separate your results
from any planning info
• Results will fail automatically if
recordings/validations don’t match
Concentrate on just two areas for editing
1. Test Steps
2. Test Data
Editing existing manual test cases for automation
18
Execution
• Login ID
• Password
MyApplication
Learning how objects are recognized within test automation
19
Execution
Working with the object repository and organizing this
Features form
» Buttons
» Download FreeTrial button
» Join a FreeWebinar button
Pricing form
» Buttons
» Links
» Edit Boxes
Support form
20
Execution
Building test automation actions from the ground up
Desktop
Web
Mobile
TC1: Desktop
TC1.1: Start App
TC1.2:Add User
TC1.3: CloseApp
TC2:Web
TC2.1: Open
Browser
TC3: Mobile
TC2.1: StartApp
TC2.2: Navigate
1. Record all of your steps first
2. Focus on a quality recording, not
naming each test case first and
knowing the initial content
21
Analysis
Adding error-handling in your testing flow
What happens if…
An unexpected window
appears in the middle of the
test?
Objects are moved, added,
removed or changed?
Objects are delayed in
appearing in the automated
test run?
Additional steps need to be
added to your test automation
recording?
Robust Error-
Handling
22
Analysis
Adding error-handling in your testing flow
Typical options for debugging automated test cases
Set your
breakpoint
Chose the ‘Step’
for the breakpoint
Execute the
test case to
Breakpoint
Debugging allows
you to watch where
exactly the test case
may have issues.
This could
be with the
application
or the test
recording
23
Analysis
Reading report results and interpreting this
Sample manual test case, includes both
planning steps and execution results
Sample test automation result file shows execution results,
but links to the recordings. Information in the run below:
 System information like:
o Execution time, machine name, operating system,
screen dimensions, language, duration, total errors
and total warnings
 Global parameter values
 Ability to Jump to the failed step
 Total number of iteration runs and report on each data
element
 Container of screenshot information along the
execution
SessionRecap
25
SessionRecap
» TheTest Automation industry focused on desktop,
but is driving to multi-technology stacks to cover a
large amount of platforms
» Primary skillset for those working in test automation
was Programming or Scripting, but solutions are
available for those without these skills
» Map aTest Automation methodology to existing
SDLC orTesting workflow processes; same general
structure would apply
26
SessionRecap
» Understand where your contributions to the test
automation initiative are mapped to – either
Preparation, Execution or Analysis
» Review the areas where manual testers can work in,
focusing on automation structure, object
recognition and results interpretation
SayHellotoTruly
Automated
Awesomeness!
ranorex.com/why
JimTrentadue
Account / Sales Manager - Ranorex
jtrentadue@ranorex.com

Weitere ähnliche Inhalte

Was ist angesagt?

Ranorex presentation
Ranorex presentationRanorex presentation
Ranorex presentation
ISsoft
 
WSO2Con Asia 2014 - Effective Test Automation in an Agile Environment
WSO2Con Asia 2014 - Effective Test Automation in an Agile EnvironmentWSO2Con Asia 2014 - Effective Test Automation in an Agile Environment
WSO2Con Asia 2014 - Effective Test Automation in an Agile Environment
WSO2
 
Automation Framework/QTP Framework
Automation Framework/QTP FrameworkAutomation Framework/QTP Framework
Automation Framework/QTP Framework
HeyDay Software Solutions
 
Test Automation - Keytorc Approach
Test Automation - Keytorc Approach Test Automation - Keytorc Approach
Test Automation - Keytorc Approach
Keytorc Software Testing Services
 
Introduction to Back End Automation Testing - Nguyen Vu Hoang, Hoang Phi
Introduction to Back End Automation Testing - Nguyen Vu Hoang, Hoang PhiIntroduction to Back End Automation Testing - Nguyen Vu Hoang, Hoang Phi
Introduction to Back End Automation Testing - Nguyen Vu Hoang, Hoang Phi
Ho Chi Minh City Software Testing Club
 

Was ist angesagt? (20)

Ranorex presentation
Ranorex presentationRanorex presentation
Ranorex presentation
 
Key Factors To Ensure Test Automation Framework Success
Key Factors To Ensure Test Automation Framework SuccessKey Factors To Ensure Test Automation Framework Success
Key Factors To Ensure Test Automation Framework Success
 
Mobile Video Games Testing Principles - Benjamin Poirrier
Mobile Video Games Testing Principles - Benjamin PoirrierMobile Video Games Testing Principles - Benjamin Poirrier
Mobile Video Games Testing Principles - Benjamin Poirrier
 
Test Automation
Test AutomationTest Automation
Test Automation
 
Selecting the Right Automated Testing tool
Selecting the Right Automated Testing tool Selecting the Right Automated Testing tool
Selecting the Right Automated Testing tool
 
Automation Tools Overview
Automation Tools OverviewAutomation Tools Overview
Automation Tools Overview
 
Performance Testing
Performance TestingPerformance Testing
Performance Testing
 
Introduction to Ranorex: Components & Features
Introduction to Ranorex: Components & FeaturesIntroduction to Ranorex: Components & Features
Introduction to Ranorex: Components & Features
 
WSO2Con Asia 2014 - Effective Test Automation in an Agile Environment
WSO2Con Asia 2014 - Effective Test Automation in an Agile EnvironmentWSO2Con Asia 2014 - Effective Test Automation in an Agile Environment
WSO2Con Asia 2014 - Effective Test Automation in an Agile Environment
 
Automation Framework/QTP Framework
Automation Framework/QTP FrameworkAutomation Framework/QTP Framework
Automation Framework/QTP Framework
 
Selenium RC, Selenium WebDriver and HP LoadRunner
Selenium RC, Selenium WebDriver and HP LoadRunnerSelenium RC, Selenium WebDriver and HP LoadRunner
Selenium RC, Selenium WebDriver and HP LoadRunner
 
Automated vs manual testing
Automated vs manual testingAutomated vs manual testing
Automated vs manual testing
 
Test Automation - Everything You Need To Know
Test Automation - Everything You Need To KnowTest Automation - Everything You Need To Know
Test Automation - Everything You Need To Know
 
A Novel Approach of Automation Test for Software Monitoring Solution - Tran S...
A Novel Approach of Automation Test for Software Monitoring Solution - Tran S...A Novel Approach of Automation Test for Software Monitoring Solution - Tran S...
A Novel Approach of Automation Test for Software Monitoring Solution - Tran S...
 
Automation Tool Overview
Automation Tool OverviewAutomation Tool Overview
Automation Tool Overview
 
Test Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.comTest Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.com
 
Test Automation
Test AutomationTest Automation
Test Automation
 
Test Automation - Keytorc Approach
Test Automation - Keytorc Approach Test Automation - Keytorc Approach
Test Automation - Keytorc Approach
 
Designing a Test Automation Framework By Quontra solutions
Designing a Test Automation Framework By Quontra solutionsDesigning a Test Automation Framework By Quontra solutions
Designing a Test Automation Framework By Quontra solutions
 
Introduction to Back End Automation Testing - Nguyen Vu Hoang, Hoang Phi
Introduction to Back End Automation Testing - Nguyen Vu Hoang, Hoang PhiIntroduction to Back End Automation Testing - Nguyen Vu Hoang, Hoang Phi
Introduction to Back End Automation Testing - Nguyen Vu Hoang, Hoang Phi
 

Andere mochten auch

Manual testing concepts course 1
Manual testing concepts course 1Manual testing concepts course 1
Manual testing concepts course 1
Raghu Kiran
 
Testing documents
Testing documentsTesting documents
Testing documents
suhasreddy1
 
TESTING LIFE CYCLE PPT
TESTING LIFE CYCLE PPTTESTING LIFE CYCLE PPT
TESTING LIFE CYCLE PPT
suhasreddy1
 

Andere mochten auch (19)

Regression Test Automation Framework
Regression Test Automation Framework Regression Test Automation Framework
Regression Test Automation Framework
 
AQA TALKS 4 - AUTOMATION TEST REPORTER
AQA TALKS 4 - AUTOMATION TEST REPORTERAQA TALKS 4 - AUTOMATION TEST REPORTER
AQA TALKS 4 - AUTOMATION TEST REPORTER
 
Qtp Scripts
Qtp ScriptsQtp Scripts
Qtp Scripts
 
New features in qtp11
New features in qtp11New features in qtp11
New features in qtp11
 
Functions
FunctionsFunctions
Functions
 
Qtp 92 Tutorial
Qtp 92 TutorialQtp 92 Tutorial
Qtp 92 Tutorial
 
Manual testing concepts course 1
Manual testing concepts course 1Manual testing concepts course 1
Manual testing concepts course 1
 
Test Automation in Agile
Test Automation in AgileTest Automation in Agile
Test Automation in Agile
 
Manual QA Testing Interview Questions From H2KInfosys
Manual QA Testing Interview Questions From H2KInfosysManual QA Testing Interview Questions From H2KInfosys
Manual QA Testing Interview Questions From H2KInfosys
 
Testing documents
Testing documentsTesting documents
Testing documents
 
Patterns of a “good” test automation framework
Patterns of a “good” test automation frameworkPatterns of a “good” test automation framework
Patterns of a “good” test automation framework
 
Manual testing-training-institute-in-marathahalli
Manual testing-training-institute-in-marathahalliManual testing-training-institute-in-marathahalli
Manual testing-training-institute-in-marathahalli
 
Test Life Cycle - Manual Testing Concept.
Test Life Cycle - Manual Testing Concept.Test Life Cycle - Manual Testing Concept.
Test Life Cycle - Manual Testing Concept.
 
Fresher testing cv
Fresher testing cvFresher testing cv
Fresher testing cv
 
TESTING LIFE CYCLE PPT
TESTING LIFE CYCLE PPTTESTING LIFE CYCLE PPT
TESTING LIFE CYCLE PPT
 
Appium: Prime Cuts
Appium: Prime CutsAppium: Prime Cuts
Appium: Prime Cuts
 
Manual Testing
Manual TestingManual Testing
Manual Testing
 
Manual testing interview question by INFOTECH
Manual testing interview question by INFOTECHManual testing interview question by INFOTECH
Manual testing interview question by INFOTECH
 
Test Automation Framework Designs
Test Automation Framework DesignsTest Automation Framework Designs
Test Automation Framework Designs
 

Ähnlich wie How Manual Testers Can Break into Automation Without Programming Skills

Mercury Testdirector8.0 using Slides
Mercury Testdirector8.0 using SlidesMercury Testdirector8.0 using Slides
Mercury Testdirector8.0 using Slides
telab
 
Automated Software Testing Framework Training by Quontra Solutions
Automated Software Testing Framework Training by Quontra SolutionsAutomated Software Testing Framework Training by Quontra Solutions
Automated Software Testing Framework Training by Quontra Solutions
Quontra Solutions
 
OS-Final-Transform-Manual-Testing-Processes-to-incorporate-Automatio....pptx
OS-Final-Transform-Manual-Testing-Processes-to-incorporate-Automatio....pptxOS-Final-Transform-Manual-Testing-Processes-to-incorporate-Automatio....pptx
OS-Final-Transform-Manual-Testing-Processes-to-incorporate-Automatio....pptx
ShivareddyGangam
 
SAP Testing Services
SAP Testing ServicesSAP Testing Services
SAP Testing Services
r_shanki
 
Less01 1 introduction_module
Less01 1 introduction_moduleLess01 1 introduction_module
Less01 1 introduction_module
Suresh Mishra
 

Ähnlich wie How Manual Testers Can Break into Automation Without Programming Skills (20)

Test Automation for QTP
Test Automation for QTPTest Automation for QTP
Test Automation for QTP
 
Test Automation
Test AutomationTest Automation
Test Automation
 
Mercury Testdirector8.0 using Slides
Mercury Testdirector8.0 using SlidesMercury Testdirector8.0 using Slides
Mercury Testdirector8.0 using Slides
 
The Automation Firehose: Be Strategic and Tactical by Thomas Haver
The Automation Firehose: Be Strategic and Tactical by Thomas HaverThe Automation Firehose: Be Strategic and Tactical by Thomas Haver
The Automation Firehose: Be Strategic and Tactical by Thomas Haver
 
Automated Software Testing Framework Training by Quontra Solutions
Automated Software Testing Framework Training by Quontra SolutionsAutomated Software Testing Framework Training by Quontra Solutions
Automated Software Testing Framework Training by Quontra Solutions
 
Best Practices for Testing in salesforce.com
Best Practices for Testing in salesforce.comBest Practices for Testing in salesforce.com
Best Practices for Testing in salesforce.com
 
OS-Final-Transform-Manual-Testing-Processes-to-incorporate-Automatio....pptx
OS-Final-Transform-Manual-Testing-Processes-to-incorporate-Automatio....pptxOS-Final-Transform-Manual-Testing-Processes-to-incorporate-Automatio....pptx
OS-Final-Transform-Manual-Testing-Processes-to-incorporate-Automatio....pptx
 
M. Holovaty, Концепции автоматизированного тестирования
M. Holovaty, Концепции автоматизированного тестированияM. Holovaty, Концепции автоматизированного тестирования
M. Holovaty, Концепции автоматизированного тестирования
 
Automation Best Practices.pptx
Automation Best Practices.pptxAutomation Best Practices.pptx
Automation Best Practices.pptx
 
SAP Testing Services
SAP Testing ServicesSAP Testing Services
SAP Testing Services
 
Automation Framework Presentation
Automation Framework PresentationAutomation Framework Presentation
Automation Framework Presentation
 
The Importance of Performance Testing Theory and Practice - QueBIT Consulting...
The Importance of Performance Testing Theory and Practice - QueBIT Consulting...The Importance of Performance Testing Theory and Practice - QueBIT Consulting...
The Importance of Performance Testing Theory and Practice - QueBIT Consulting...
 
04 test controlling and tracking
04   test controlling and tracking04   test controlling and tracking
04 test controlling and tracking
 
Lecture #6. automation testing (andrey oleynik)
Lecture #6. automation testing (andrey oleynik)Lecture #6. automation testing (andrey oleynik)
Lecture #6. automation testing (andrey oleynik)
 
Chapter 6 - Test Tools and Automation
Chapter 6 - Test Tools and AutomationChapter 6 - Test Tools and Automation
Chapter 6 - Test Tools and Automation
 
Modeling and Testing Dovetail in MagicDraw
Modeling and Testing Dovetail in MagicDrawModeling and Testing Dovetail in MagicDraw
Modeling and Testing Dovetail in MagicDraw
 
Less01 1 introduction_module
Less01 1 introduction_moduleLess01 1 introduction_module
Less01 1 introduction_module
 
Test Automation Frameworks Final
Test Automation Frameworks   FinalTest Automation Frameworks   Final
Test Automation Frameworks Final
 
But Did You Test It
But Did You Test ItBut Did You Test It
But Did You Test It
 
Test automation
Test automationTest automation
Test automation
 

Kürzlich hochgeladen

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Kürzlich hochgeladen (20)

The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 

How Manual Testers Can Break into Automation Without Programming Skills

  • 3. 3 Agenda » Test Automation Industry recap » Test Automation Industry outlook » Review of an AutomatedTest Lifecycle Methodology (ATLM) » Three categories of supporting and working inTest Automation: » Preparation, Execution and Analysis » Nine areas for manual testers to work on withinTest Automation » Session recap
  • 5. 5 TestAutomationIndustryRecap » First Record Playback tools appeared about 20-25 years ago » The primary objective was to test desktop applications. Some tools could test broken URL links, but not dig into the objects » The tester was required to have scripting or programming knowledge to make the tests run effectively, even in Record Playback
  • 6. 6 TestAutomationIndustryRecap » Below is an evolution ofTest Automation Frameworks: Record Playback Structured Testing (invokes more conditions) Data Driven Keyword Driven Model / Object Based Actions Based Hybrid (combines 2 or more of the previous frameworks)
  • 8. 8 TestAutomationIndustryOutlook » Number of test automation tools have increased to over 25-30, primarily focused on taking the scripting / programming out of the equation for the manual testers » Technical complexities have increased considerably to cover the following:
  • 9. 9 TestAutomationIndustryOutlook » License models now offer aTest Execution only component, apart from the license to create and maintain the automated tests and object repository » Tools have the capability to integrate with various Continuous Integration tools andTest Management solutions
  • 11. 11 MappinganATLMagainstanSDLC Automated Software Testing: Introduction, Management and Performance – Dustin, Rashka, Paul Illustration of how typical activities of an ATLM align with SDLC activities D. System Design & Development C. SmallTool Pilot/Prototype A. System Life-Cycle ProcessF. Production and Maintenance B.BusinessAnalysisandRequirements E.IntegrationandTest
  • 13. 13 WorkingCategoriesforTestAutomation • Planning test automation activities into your testing process • Creating data sheets or SQL statements for data-driving your tests • Editing existing manual test cases for automation Preparation • Learning how objects are recognized within test automation • Working with the object repository and organizing this • Building test automation actions from the ground up Execution • Adding error-handling in your testing flow • Knowing how to step into test cases and debug • Reading report results and interpreting this Analysis Grouping activities in Preparation, Execution & Analysis
  • 15. 15 Preparation Outline the scope of automation in the ReleaseTest Plan Divide test scenarios:Automated vs. Manual cases Prepare the automated test workflow with error-handling (new and regression) Record your modules, ensuring all objects have been recognized Replay until test executes as expected Check-in to CM solution Planning test automation activities into your testing process Project Initiation Test Strategy Analysis Design Develop Testing Deploy Test Scenarios Test Cases Test Scripts Test Results Test Summary Test Automation activities:
  • 16. 16 Preparation Login ID Password LoginType TestUser1 Password123# StandardUser TestUser2 Password456% Supervisor TestUser3 Password789$ Manager Excel example • Login ID • Password MyApplication SELECT * from Logins where LoginType = Manager SQL data retrieval 3. Map your data source columns to the defined variables 2. Link to your data source where the data will be 1. Create a variable on what you want to data-drive Simplified Data-Driven setup in aTest Automation solution Creating data sheets or SQL statement for data-driving your automation
  • 17. 17 Preparation Test Steps • Limit the verbiage to just Actions and Events / Sequences • 1. Mouse Click • 2. Key Sequence Value Test Data • Avoid hard-coding any values unless mandatory • Better to maintain to controlled data in an external format Test Results • Best practice to separate your results from any planning info • Results will fail automatically if recordings/validations don’t match Concentrate on just two areas for editing 1. Test Steps 2. Test Data Editing existing manual test cases for automation
  • 18. 18 Execution • Login ID • Password MyApplication Learning how objects are recognized within test automation
  • 19. 19 Execution Working with the object repository and organizing this Features form » Buttons » Download FreeTrial button » Join a FreeWebinar button Pricing form » Buttons » Links » Edit Boxes Support form
  • 20. 20 Execution Building test automation actions from the ground up Desktop Web Mobile TC1: Desktop TC1.1: Start App TC1.2:Add User TC1.3: CloseApp TC2:Web TC2.1: Open Browser TC3: Mobile TC2.1: StartApp TC2.2: Navigate 1. Record all of your steps first 2. Focus on a quality recording, not naming each test case first and knowing the initial content
  • 21. 21 Analysis Adding error-handling in your testing flow What happens if… An unexpected window appears in the middle of the test? Objects are moved, added, removed or changed? Objects are delayed in appearing in the automated test run? Additional steps need to be added to your test automation recording? Robust Error- Handling
  • 22. 22 Analysis Adding error-handling in your testing flow Typical options for debugging automated test cases Set your breakpoint Chose the ‘Step’ for the breakpoint Execute the test case to Breakpoint Debugging allows you to watch where exactly the test case may have issues. This could be with the application or the test recording
  • 23. 23 Analysis Reading report results and interpreting this Sample manual test case, includes both planning steps and execution results Sample test automation result file shows execution results, but links to the recordings. Information in the run below:  System information like: o Execution time, machine name, operating system, screen dimensions, language, duration, total errors and total warnings  Global parameter values  Ability to Jump to the failed step  Total number of iteration runs and report on each data element  Container of screenshot information along the execution
  • 25. 25 SessionRecap » TheTest Automation industry focused on desktop, but is driving to multi-technology stacks to cover a large amount of platforms » Primary skillset for those working in test automation was Programming or Scripting, but solutions are available for those without these skills » Map aTest Automation methodology to existing SDLC orTesting workflow processes; same general structure would apply
  • 26. 26 SessionRecap » Understand where your contributions to the test automation initiative are mapped to – either Preparation, Execution or Analysis » Review the areas where manual testers can work in, focusing on automation structure, object recognition and results interpretation