SlideShare ist ein Scribd-Unternehmen logo
1 von 25
How to automate your QA process?
Add-on Discovery Day
Sergio Freire
Xray’s Product Manager
Xray for JIRA empowers test teams to manage and deliver rock solid software solutions
Agenda
1. QA challenges
2. Test Automation
3. Automation on workflows
4. Automation on reporting
5. Live showcase
6. Wrap-up
1. QA challenges
Xray for JIRA
1. Releasing faster (speed vs quality)
2. Manual and automated testing
3. Fast feedback, where you need it
4. Integration with many different automation frameworks
5. Easy integration
6. Support for different methodologies (waterfall, Agile, “hybrid”)
7. Losing time doing all kinds of extra stuff
QA Challenges (well… some of them)
1. Releasing faster
Speed vs Quality - are they real enemies?
Let these help you out:
• Agile
• DevOps, DevTestOps
• Continuous Integration
• Automated Testing
• Continuous Testing
• Continuous Delivery
Release often, with confidence. Motivate your team, make your customers happy.
Image by www.genalice.com.
2. Test Automation
Xray for JIRA
Can you automate everything? Or should you?
• Tests can be automated but choose well what to automate
• Defect creation and analysis will be manual (AI will take time to achieve
this goal)
• Some collateral activities can be automated (e.g. environment setup,
reporting, etc)
• Try to focus on what gives you most value and automate the repetitive
tasks
Automation
The cost of bugs
Code Complete, Steve McConnell, 2004
• The cost of fixing bugs grows exponentially depending on the phase in which
they are detected
• The fix cost also depends on the stage where bugs are initially introduced
=> Automated testing to the rescue!
Phase in which a Defect is
introduced
Phase in which a Defect is detected
Supported formats
• Xray JSON
• Cucumber
• Behave
• JUnit
• Nunit
• Robot framework
• Calabash
• … more to come
Automation in mind…
Integrating with automated test frameworks
Enabling Automated Tests
Fitting all together
3. Automation on workflows
Xray for JIRA
Possible scenarios
• Disallow executions with workflow statuses
• For Test Executions in specific
status
• In progress Test Execution workflow status
• After the first run
• Resolved Test Execution workflow status
• When all runs are in final status
• Resolution for Resolved Test Execution
Workflow automation example for Test Executions
Manage execution life-cyle
3. “Automation” on reporting
Xray for JIRA
Real status of requirements with in-context information
With Xray:
• Real-time information about the
coverage status of the requirement
for a given version
• Real-time information about the
associated test results, for a given
version
• A ”requirement” may be any issue
type you may have; test coverage
can be made in any issue type
Provides a quick way of evaluating the current (coverage) status of your project's
requirements, so you will be able to see if they are ready to be or not.
JIRA Dasboards: Requirement Coverage Gadgets
Useful, yet lack quality related information.
Standard Agile Boards
Xray gives you visibility of your testing results and its progress.
Enhanced Agile Boards with Xray
Use Xporter to generate fully customizable Word, Excel or PDF files with your testing
reports to give to your management, colleagues or to your customers
(e.g. Test specification, Test Execution progress and respective results, Test Plan details).
Reports as deliverable assets
5. Live showcase
Xray for JIRA
1. Integrating with Junit automated tests
• Automatic report sent to email using Xporter
2. Automated testing using BDD with Cucumber
3. Consolidated results in Test Plan
Live showcase
• Cucumber supported natively
• BDD – Specify tests in a business-readable domain-specific language
• Test definition serves as documentation
• Automated test steps may be implemented in Ruby, Java, .Net, etc
• Export specification and execute it during Continuous Integration
Specifying “Automated Cucumber Tests”
6. Wrap-up
Xray for JIRA
1. Use JIRA with Xray for managing the complete lifecycle of your software projects
2. Xray is the perfect tool for Test Management inside JIRA, enabling automation features
3. Xporter complements Xray, enabling advanced reports in Word, Excel, PDF with custom layouts
Deliver faster and better releases with JIRA and Xray
Xray for JIRA empowers test teams to manage and deliver rock solid software solutions
w w w. x p a n d - a d d o n s . c o m
Thank you.
sergio.freire@xpand-it.com

Weitere ähnliche Inhalte

Was ist angesagt?

Introduction to JIRA
Introduction to JIRAIntroduction to JIRA
Introduction to JIRA
Rozi khan
 
Agile Testing Strategy
Agile Testing StrategyAgile Testing Strategy
Agile Testing Strategy
tharindakasun
 

Was ist angesagt? (20)

Xporter for Jira - Overview
Xporter for Jira - OverviewXporter for Jira - Overview
Xporter for Jira - Overview
 
Agile Test Management Using Jira and Zephyr
Agile Test Management Using Jira and ZephyrAgile Test Management Using Jira and Zephyr
Agile Test Management Using Jira and Zephyr
 
Jira
JiraJira
Jira
 
Introduction to Jira - Bug Tracking tool
Introduction to Jira - Bug Tracking toolIntroduction to Jira - Bug Tracking tool
Introduction to Jira - Bug Tracking tool
 
Agile testing principles and practices - Anil Karade
Agile testing principles and practices - Anil KaradeAgile testing principles and practices - Anil Karade
Agile testing principles and practices - Anil Karade
 
Jira Training
Jira TrainingJira Training
Jira Training
 
QA metrics in Agile (GUIDE)
QA metrics in Agile (GUIDE)QA metrics in Agile (GUIDE)
QA metrics in Agile (GUIDE)
 
Jira-Zephyr_Training.pptx
Jira-Zephyr_Training.pptxJira-Zephyr_Training.pptx
Jira-Zephyr_Training.pptx
 
Katalon Studio - GUI Overview
Katalon Studio - GUI OverviewKatalon Studio - GUI Overview
Katalon Studio - GUI Overview
 
Jira 101
Jira 101Jira 101
Jira 101
 
Test Automation Best Practices (with SOA test approach)
Test Automation Best Practices (with SOA test approach)Test Automation Best Practices (with SOA test approach)
Test Automation Best Practices (with SOA test approach)
 
BDD with Cucumber
BDD with CucumberBDD with Cucumber
BDD with Cucumber
 
Introduction to JIRA
Introduction to JIRAIntroduction to JIRA
Introduction to JIRA
 
Agile Testing Strategy
Agile Testing StrategyAgile Testing Strategy
Agile Testing Strategy
 
Jira fundamentals and bug tracking tool Guide
Jira fundamentals and bug tracking tool GuideJira fundamentals and bug tracking tool Guide
Jira fundamentals and bug tracking tool Guide
 
Introduction to Agile Testing
Introduction to Agile TestingIntroduction to Agile Testing
Introduction to Agile Testing
 
Introduction to JIRA & Agile Project Management
Introduction to JIRA & Agile Project ManagementIntroduction to JIRA & Agile Project Management
Introduction to JIRA & Agile Project Management
 
Jira Basic Concepts
Jira Basic ConceptsJira Basic Concepts
Jira Basic Concepts
 
Jira training
Jira trainingJira training
Jira training
 
Jira fundamentals
Jira fundamentalsJira fundamentals
Jira fundamentals
 

Ähnlich wie Xray for Jira - How to automate your QA process

RTTS - the Software Quality Experts
RTTS - the Software Quality ExpertsRTTS - the Software Quality Experts
RTTS - the Software Quality Experts
RTTS
 
Agile_Jira_Presentation_1.pptx
Agile_Jira_Presentation_1.pptxAgile_Jira_Presentation_1.pptx
Agile_Jira_Presentation_1.pptx
knowworld
 
Testing in an Open Source Middleware Platform Space The WSO2 Way.
Testing in an Open Source Middleware Platform Space  The WSO2 Way.Testing in an Open Source Middleware Platform Space  The WSO2 Way.
Testing in an Open Source Middleware Platform Space The WSO2 Way.
WSO2
 
Cerberus_Presentation1
Cerberus_Presentation1Cerberus_Presentation1
Cerberus_Presentation1
CIVEL Benoit
 

Ähnlich wie Xray for Jira - How to automate your QA process (20)

Implementation of Agile SDLC with JIRA and CICD.pptx
Implementation of  Agile SDLC with JIRA and CICD.pptxImplementation of  Agile SDLC with JIRA and CICD.pptx
Implementation of Agile SDLC with JIRA and CICD.pptx
 
Test Automation using UiPath Test Suite - Developer Circle Part-2.pdf
Test Automation using UiPath Test Suite - Developer Circle Part-2.pdfTest Automation using UiPath Test Suite - Developer Circle Part-2.pdf
Test Automation using UiPath Test Suite - Developer Circle Part-2.pdf
 
Qa case study
Qa case studyQa case study
Qa case study
 
Salesforce Continuous Integration with AutoRABIT
Salesforce Continuous Integration with AutoRABITSalesforce Continuous Integration with AutoRABIT
Salesforce Continuous Integration with AutoRABIT
 
QASymphony Atlanta Customer User Group Fall 2017
QASymphony Atlanta Customer User Group Fall 2017QASymphony Atlanta Customer User Group Fall 2017
QASymphony Atlanta Customer User Group Fall 2017
 
The QA/Testing Process
The QA/Testing ProcessThe QA/Testing Process
The QA/Testing Process
 
RTTS - the Software Quality Experts
RTTS - the Software Quality ExpertsRTTS - the Software Quality Experts
RTTS - the Software Quality Experts
 
Accelerating Your Test Execution Pipeline
Accelerating Your Test Execution PipelineAccelerating Your Test Execution Pipeline
Accelerating Your Test Execution Pipeline
 
QA Process Overview for Firefox OS 2014
QA Process Overview for Firefox OS 2014QA Process Overview for Firefox OS 2014
QA Process Overview for Firefox OS 2014
 
Agile_Jira_Presentation_1.pptx
Agile_Jira_Presentation_1.pptxAgile_Jira_Presentation_1.pptx
Agile_Jira_Presentation_1.pptx
 
Test automation lesson
Test automation lessonTest automation lesson
Test automation lesson
 
Logic Atollic True Verifier
Logic Atollic True VerifierLogic Atollic True Verifier
Logic Atollic True Verifier
 
(Agile) engineering best practices - What every project manager should know
(Agile) engineering best practices - What every project manager should know(Agile) engineering best practices - What every project manager should know
(Agile) engineering best practices - What every project manager should know
 
Accelerating Your Test Execution Pipeline
Accelerating Your Test Execution PipelineAccelerating Your Test Execution Pipeline
Accelerating Your Test Execution Pipeline
 
Testing in an Open Source Middleware Platform Space The WSO2 Way.
Testing in an Open Source Middleware Platform Space  The WSO2 Way.Testing in an Open Source Middleware Platform Space  The WSO2 Way.
Testing in an Open Source Middleware Platform Space The WSO2 Way.
 
KrishnaToolComparisionPPT.pdf
KrishnaToolComparisionPPT.pdfKrishnaToolComparisionPPT.pdf
KrishnaToolComparisionPPT.pdf
 
Cerberus : Framework for Manual and Automated Testing (Web Application)
Cerberus : Framework for Manual and Automated Testing (Web Application)Cerberus : Framework for Manual and Automated Testing (Web Application)
Cerberus : Framework for Manual and Automated Testing (Web Application)
 
Cerberus_Presentation1
Cerberus_Presentation1Cerberus_Presentation1
Cerberus_Presentation1
 
Agile Engineering Sparker GLASScon 2015
Agile Engineering Sparker GLASScon 2015Agile Engineering Sparker GLASScon 2015
Agile Engineering Sparker GLASScon 2015
 
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-54&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
4&5.pptx SOFTWARE TESTING UNIT-4 AND UNIT-5
 

Mehr von Xpand IT

Mehr von Xpand IT (20)

Using Xamarin for your Mobile+ Apps – Xamarin Experience London 2017
Using Xamarin for your Mobile+ Apps – Xamarin Experience London 2017Using Xamarin for your Mobile+ Apps – Xamarin Experience London 2017
Using Xamarin for your Mobile+ Apps – Xamarin Experience London 2017
 
Xpand Addons - Addon Discovery Day 2017
Xpand Addons - Addon Discovery Day 2017Xpand Addons - Addon Discovery Day 2017
Xpand Addons - Addon Discovery Day 2017
 
Xporter for Jira - Advanced topics
Xporter for Jira  - Advanced topicsXporter for Jira  - Advanced topics
Xporter for Jira - Advanced topics
 
Keynote - Xamarin Experience London 2017
Keynote - Xamarin Experience London 2017 Keynote - Xamarin Experience London 2017
Keynote - Xamarin Experience London 2017
 
Welcome & Introduction – Xamarin Experience London 2017
Welcome & Introduction – Xamarin Experience London 2017 Welcome & Introduction – Xamarin Experience London 2017
Welcome & Introduction – Xamarin Experience London 2017
 
Gathering Customer Insights with Sitecore - Xamarin Experience London 2017
Gathering Customer Insights with Sitecore - Xamarin Experience London 2017Gathering Customer Insights with Sitecore - Xamarin Experience London 2017
Gathering Customer Insights with Sitecore - Xamarin Experience London 2017
 
Why Speed Matters in Mobile Apps – Xamarin Experience London 2017
Why Speed Matters in Mobile Apps – Xamarin Experience London 2017Why Speed Matters in Mobile Apps – Xamarin Experience London 2017
Why Speed Matters in Mobile Apps – Xamarin Experience London 2017
 
Mobile & Cognitive Services | Harnessing the Power of IoT – Xamarin Experienc...
Mobile & Cognitive Services | Harnessing the Power of IoT – Xamarin Experienc...Mobile & Cognitive Services | Harnessing the Power of IoT – Xamarin Experienc...
Mobile & Cognitive Services | Harnessing the Power of IoT – Xamarin Experienc...
 
Atlassian Tools in Practice: A Customer Success Story – Xpand IT & Atlassian ...
Atlassian Tools in Practice: A Customer Success Story – Xpand IT & Atlassian ...Atlassian Tools in Practice: A Customer Success Story – Xpand IT & Atlassian ...
Atlassian Tools in Practice: A Customer Success Story – Xpand IT & Atlassian ...
 
The Secret Sauce of Successful Teams - Xpand IT & Atlassian JAM Sessions 2017
The Secret Sauce of Successful Teams - Xpand IT & Atlassian JAM Sessions 2017The Secret Sauce of Successful Teams - Xpand IT & Atlassian JAM Sessions 2017
The Secret Sauce of Successful Teams - Xpand IT & Atlassian JAM Sessions 2017
 
Improved Reporting with JIRA Add-ons - Xpand IT & Atlassian JAM Sessions 2017
Improved Reporting with JIRA Add-ons - Xpand IT & Atlassian JAM Sessions 2017Improved Reporting with JIRA Add-ons - Xpand IT & Atlassian JAM Sessions 2017
Improved Reporting with JIRA Add-ons - Xpand IT & Atlassian JAM Sessions 2017
 
How our Team Collaborates with Atlassian Tools - Xpand IT & Atlassian JAM Ses...
How our Team Collaborates with Atlassian Tools - Xpand IT & Atlassian JAM Ses...How our Team Collaborates with Atlassian Tools - Xpand IT & Atlassian JAM Ses...
How our Team Collaborates with Atlassian Tools - Xpand IT & Atlassian JAM Ses...
 
Welcome & Introduction - Xpand IT & Atlassian JAM Sessions 2017
Welcome & Introduction - Xpand IT & Atlassian JAM Sessions 2017 Welcome & Introduction - Xpand IT & Atlassian JAM Sessions 2017
Welcome & Introduction - Xpand IT & Atlassian JAM Sessions 2017
 
The Real World with OpenShift - Red Hat DevOps & Microservices Conference 2017
The Real World with OpenShift - Red Hat DevOps & Microservices Conference 2017 The Real World with OpenShift - Red Hat DevOps & Microservices Conference 2017
The Real World with OpenShift - Red Hat DevOps & Microservices Conference 2017
 
Red Hat Value Proposition - Red Hat DevOps & Microservices Conference 2017
Red Hat Value Proposition - Red Hat DevOps & Microservices Conference 2017Red Hat Value Proposition - Red Hat DevOps & Microservices Conference 2017
Red Hat Value Proposition - Red Hat DevOps & Microservices Conference 2017
 
Adopting a PaaS Solution (Part 2) - Red Hat DevOps & Microservices Conference...
Adopting a PaaS Solution (Part 2) - Red Hat DevOps & Microservices Conference...Adopting a PaaS Solution (Part 2) - Red Hat DevOps & Microservices Conference...
Adopting a PaaS Solution (Part 2) - Red Hat DevOps & Microservices Conference...
 
Adopting a PaaS Solution (Part 1) - Red Hat DevOps & Microservices Conference...
Adopting a PaaS Solution (Part 1) - Red Hat DevOps & Microservices Conference...Adopting a PaaS Solution (Part 1) - Red Hat DevOps & Microservices Conference...
Adopting a PaaS Solution (Part 1) - Red Hat DevOps & Microservices Conference...
 
The DevOps Challenge - Red Hat DevOps & Microservices Conference 2017
The DevOps Challenge - Red Hat DevOps & Microservices Conference 2017The DevOps Challenge - Red Hat DevOps & Microservices Conference 2017
The DevOps Challenge - Red Hat DevOps & Microservices Conference 2017
 
Welcome & Introduction - Red Hat DevOps & Microservices Conference 2017
Welcome & Introduction - Red Hat DevOps & Microservices Conference 2017 Welcome & Introduction - Red Hat DevOps & Microservices Conference 2017
Welcome & Introduction - Red Hat DevOps & Microservices Conference 2017
 
Keynote - Xamarin Experience 2017
Keynote - Xamarin Experience 2017 Keynote - Xamarin Experience 2017
Keynote - Xamarin Experience 2017
 

Kürzlich hochgeladen

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Kürzlich hochgeladen (20)

Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 

Xray for Jira - How to automate your QA process

  • 1. How to automate your QA process? Add-on Discovery Day Sergio Freire Xray’s Product Manager Xray for JIRA empowers test teams to manage and deliver rock solid software solutions
  • 2. Agenda 1. QA challenges 2. Test Automation 3. Automation on workflows 4. Automation on reporting 5. Live showcase 6. Wrap-up
  • 4. 1. Releasing faster (speed vs quality) 2. Manual and automated testing 3. Fast feedback, where you need it 4. Integration with many different automation frameworks 5. Easy integration 6. Support for different methodologies (waterfall, Agile, “hybrid”) 7. Losing time doing all kinds of extra stuff QA Challenges (well… some of them)
  • 5. 1. Releasing faster Speed vs Quality - are they real enemies? Let these help you out: • Agile • DevOps, DevTestOps • Continuous Integration • Automated Testing • Continuous Testing • Continuous Delivery Release often, with confidence. Motivate your team, make your customers happy. Image by www.genalice.com.
  • 7. Can you automate everything? Or should you? • Tests can be automated but choose well what to automate • Defect creation and analysis will be manual (AI will take time to achieve this goal) • Some collateral activities can be automated (e.g. environment setup, reporting, etc) • Try to focus on what gives you most value and automate the repetitive tasks Automation
  • 8. The cost of bugs Code Complete, Steve McConnell, 2004 • The cost of fixing bugs grows exponentially depending on the phase in which they are detected • The fix cost also depends on the stage where bugs are initially introduced => Automated testing to the rescue! Phase in which a Defect is introduced Phase in which a Defect is detected
  • 9. Supported formats • Xray JSON • Cucumber • Behave • JUnit • Nunit • Robot framework • Calabash • … more to come Automation in mind… Integrating with automated test frameworks
  • 12. 3. Automation on workflows Xray for JIRA
  • 13. Possible scenarios • Disallow executions with workflow statuses • For Test Executions in specific status • In progress Test Execution workflow status • After the first run • Resolved Test Execution workflow status • When all runs are in final status • Resolution for Resolved Test Execution Workflow automation example for Test Executions Manage execution life-cyle
  • 14. 3. “Automation” on reporting Xray for JIRA
  • 15. Real status of requirements with in-context information With Xray: • Real-time information about the coverage status of the requirement for a given version • Real-time information about the associated test results, for a given version • A ”requirement” may be any issue type you may have; test coverage can be made in any issue type
  • 16. Provides a quick way of evaluating the current (coverage) status of your project's requirements, so you will be able to see if they are ready to be or not. JIRA Dasboards: Requirement Coverage Gadgets
  • 17. Useful, yet lack quality related information. Standard Agile Boards
  • 18. Xray gives you visibility of your testing results and its progress. Enhanced Agile Boards with Xray
  • 19. Use Xporter to generate fully customizable Word, Excel or PDF files with your testing reports to give to your management, colleagues or to your customers (e.g. Test specification, Test Execution progress and respective results, Test Plan details). Reports as deliverable assets
  • 21. 1. Integrating with Junit automated tests • Automatic report sent to email using Xporter 2. Automated testing using BDD with Cucumber 3. Consolidated results in Test Plan Live showcase
  • 22. • Cucumber supported natively • BDD – Specify tests in a business-readable domain-specific language • Test definition serves as documentation • Automated test steps may be implemented in Ruby, Java, .Net, etc • Export specification and execute it during Continuous Integration Specifying “Automated Cucumber Tests”
  • 24. 1. Use JIRA with Xray for managing the complete lifecycle of your software projects 2. Xray is the perfect tool for Test Management inside JIRA, enabling automation features 3. Xporter complements Xray, enabling advanced reports in Word, Excel, PDF with custom layouts Deliver faster and better releases with JIRA and Xray Xray for JIRA empowers test teams to manage and deliver rock solid software solutions
  • 25. w w w. x p a n d - a d d o n s . c o m Thank you. sergio.freire@xpand-it.com

Hinweis der Redaktion

  1. 1. You your managers want to release faster while at the same time achieve quality (show next slide) 2. Dealing simultaneously with manual and automated tests in a seamless way 3. Getting feedback should not be something you have to ask. It should be something out-of-the-box, natural, by seeing in-context information where you need it 4. A software project is composed of multiple components, using different frameworks and languages, so automated tests may also be written in different frameworks and using all sorts of test runners 5.Implementing continuous integration should be easy to setup. You want your team to get feedback on the quality of their code, as fast as possible and you don’t want the process of setting this up be an excuse to not setting it up at all 6. Every organization, every team is different; you need to be able to adapt to how teams prefer to manage and optimize their workflow 7. You need many and clean testing environments, you need to set them up.. You also need to generate all sorts of reports for different stakeholders. You loose time in many extra tasks
  2. Not really. You can achieve both if you adopt practices such as Agile, DevOps, Continuous Integration/Testing for example. They can be used to ensure quality while allowing you release often.
  3. All results related with a given test specification are always reported to the same Test entity Runs history, comments, etc, all will be in the same entity Tests may be added to Test Sets, Test Plans and may be part of Test Executions Tests may be linked with requirements test results will be reflected on requirements
  4. Standard agile board lacks crucial information about the real progress of user stories and testing progress. So it seems you would need to do something in order to obtain this information right? Well, actually you don’t.
  5. In-context information of the real coverage and testing status of your requirements, in the Agile boards. You can also track the progress of your testing execution and plans in the board. This is valuable information that is shown you, without effort.
  6. 1. Show VM with bamboo & Junit