SlideShare ist ein Scribd-Unternehmen logo
1 von 23
Downloaden Sie, um offline zu lesen
© 2014 IBM Corporation
Deployment of a test
management solution for a
defence project using an
integrated tool chain
Code 1183
Dr. Einar Karlsen (IBM, Co-Speaker)
Thomas Schöning (Airbus DS)
1
Introduction
Dr. Einar Karlsen (IBM)
-Technical Solution Architect
Thomas Schöning (Airbus Defence and Space)
- Integration and Test Manager
Thomas Südbröcker (IBM)
- Technical Sales and Solutions + Community of Practices
Leader Quality Management (Germany)
2
• Subcontractor in a NATO Project with requirement based development,
test and formal verification of a complex system entity
• Find a proper tooling solution for test and verification process using the
IBM Rational tooling chain (Jazz Platform)
– Support for relevant standards ISO/IEE 15288, ISO/IEEE 12207,
ISO 9001, ISO/IEC 9126
– Support for relevant process: Waterfall (V-Model) with incremental
SW Development
– Integration with IBM Rational DOORS to accommodate for
requirement traceability
– Automatic document generation for requirements, design and test
artefacts (plans, procedures, reports)
– Insight into status and trend of the testing efforts (metrics)
Setting the Scene – Situation
3
• Challenge
– Unknown effort to adequately install, integrate and customize the
whole tooling chain to perform modelling, implementation, and test
management
– Appropriate test management support (planning, execution,
reporting, document generation, etc) according to required
process?
• Improvements
– Decrease of costs, risks, inconsistencies and time-to-market
through automatic generation of project deliverables
– Collection of metrics to measure test design progress,
requirements coverage
– Online/Offline determination of test results while performing the test
Setting the Scene – Risk and Opportunity
4
• Profound orientation for configuration and customization of IBM
Rational Tools for a tool-aided test management solution (planning,
execution, reporting, documentation) for similar test activities
1. Start early to implement test management prototyping to better
estimate the effort to adapt the tools to the project needs
2. Invite technical professionals to have guidance and avoid pitfalls
3. Perform team training
4. Look at the deliverables before customizing your tool chain
Setting the Scene – Position and Benefits
5
• Introduction
– Programme Overview
– Test and Evaluation Strategy
• Test management
– Solution Overview
– Solution Architecture
– Document Generation
– Metrics and Dashboards
• Summary
Agenda
6
• Confidential, multinational NATO C4ISR Project (C4ISR=Command,
Control, Communications, Computers, Intelligence, Surveillance, and
Reconnaissance)
– Unmanned Air, Command and Control Entities
– Transportable and Mobile Ground Stations for data exception,
processing, and archiving facilities
– Communication links to other NATO and interoperable national
ground stations, and to NATO and national Command and Control
systems
– Exchange of standardized data via different interfaces and
communication lines
• Airbus DS responsible for development, test and formal verification of a
system entity consisting of several Subsystems
Programme Overview
Test and Evaluation Strategy
Verification
Development
Testing
Entity
Subsystems
CSCIsHWCIs
ServicesComponents
Development
Testing
Development
TestingTest
Test
Test
Verification
Integration
8
• Requirements of System Entity, Subsystems, Computer Software
Configuration Items (CSCIs), and Hardware Configuration Items
(HWCIs) are kept in DOORS database with traceable entries
• Testing/Verification is classified either to be
– Informal Tests
• conduct informal tests throughout the system development
– Subcontractor Development Tests
• For CSCI, HWCI, HW/CSCI groupings, Subsystem level,
Entities and Integration testing
– Formal Verification
• Verification of allocated customer requirements based on proof
of derived requirements (Entity, Subsystem, HW/CSCI
groupings)
Test and Evaluation Strategy
Test Management – Solution Overview
9
10
Test Management – Solution Overview
• Test Plan
– consists of a number of Test Cases used to proof requirements
– is linked with one or more Requirements Modules (Test Plan views)
coverage and traceability (verification level)
• Test Case
– is linked to one or more particular requirements belonging to the
requirements view(s) proofing requirements on different levels
• Test Script
– keeps the Test Procedure with single steps for test execution
• Test Case Execution Record/Test Case Result
– container to keep the Test Case results depending on iteration
(integration, dry-run, acceptance) and test environment
• PTR (=Problem Trouble Report)
– keeps the defects occurred during Test Case execution
Test Management – Solution Architecture
11
IBM Rational
DOORS
IBM Rational Insight
IBM Rational Publishing Engine
REST, ETL REST, ETL
IBM Rational
Quality Manager
IBM Rational
Team Concert
REST, ETL
Dashboards, Status and trend reports
Test Plans, Procedures and Reports
(Project Deliverables)
RESTREST REST
OSLC
links
OSLC
links
12
Test Management – Test Document Generation
Test Document Generation – Master Test List
Test Document Generation – Test Case Details
15
• Metrics: What you can measure that can be done!
• Metric types: Project, Product, Process, and Personnel
• Definition of metrics for monitoring and control test planning, design,
development and execution
– test planning
• Percentage of requirements having a test case
– test design (analysis and concept)
• Percentage of test case with different status (draft, ready for
review, approved)
– test development
• Percentage of test scripts with different status (draft, ready for
review, approved)
– test execution
• Percentage of planned test cases being executed (passed,
passed with condition, failed, blocked, error)
Test Management – Metrics and Dashboards
16
Metrics and Dashboards – Test Case Design
17
Metrics and Dashboards – Test Case Execution
18
• Tooling Solution (Jazz platform) for test management process
with combined DT&E strategy (Informal, Development Tests,
Formal Verification) applied for system entity (NATO Project)
• Test Management Solution (Overview and Architecture)
– Test Plans linked with requirements view
– Test Cases linked with requirements
– Test Execution Records keeping the results for each Iteration
– Definition of timelines, iterations to support test planning and
execution
• Test Document Generation
– Tooling adaption for artefact templates (Test Plan, Test Case)
– Examples (Master Test List, Test Case Details)
• Metrics and Dashboards
– metrics for monitoring and control test planning, design,
development and execution
Summary
Articles on developerWorks
• RQM Template authoring articles
on developer Works.
– Using IBM Rational Publishing
Engine to generate compliance
documents: Report generation
for Rational Quality Manager,
introducing REST service
URLs, importing schemas, and
basic template authoring
– Using IBM Rational Publishing
Engine to generate compliance
documents: Part 2. Report
generation for Rational Quality
Manager, showing how to
extract information from grid
sections and report on test
results and related defects
Thank You!
Your Feedback is Important!
Access the Innovate agenda tool to complete your
session surveys from your smartphone, laptop or
conference kiosk.
21
• Test Plan:
– Artifact Templates (keep Test Cases and TCERs only)
– Artifact Categories (manufacturer, part number, type) to distinguish
between different plans (system, software,etc)
• Test Case:
– Artifact Template has been customized to the documentation
format needs (Test Plan, Test Procedure)
– Artifact Categories (test area, test method, test event, test type)
and RQM section (description, test objective, requirement links,
estimation) are used to appropriately keep Test Case data
• Timelines (Development and Production Phase)
• Iteration Types (Milestone, Software Test, System Test)
• Iteration
– directly corresponds with incremental software development
(integration tests, dry run, acceptance test)
– support generation of TCER
Test Management – Tooling adaption
22
• Administration of project requirements and test cases as well as the
creation of bi-directional dependencies between them
• Planning test effort and milestones
• Defining test goals, acceptance and quality criteria
• Deriving test cases derived from requirement specifications
• Estimation of the effort of the test activities
• Definition of a time plan for each test iteration with finish dates of key
activities
• Collection of different test environments and the generation of test
configurations
• Creation and administration of test cases (manual and automated tests)
• Recording test results, creating defect and evaluating reports
• Support review and release process for the test plan and individual test
cases.
IBM Rational Tools – Usage

Weitere ähnliche Inhalte

Was ist angesagt?

Rit 8.5.0 virtualization training slides
Rit 8.5.0 virtualization training slidesRit 8.5.0 virtualization training slides
Rit 8.5.0 virtualization training slidesDarrel Rader
 
Sample Capstone Projects from 2005
Sample Capstone Projects from 2005Sample Capstone Projects from 2005
Sample Capstone Projects from 2005butest
 
Dynamic DSM Features - Measures
Dynamic DSM Features - MeasuresDynamic DSM Features - Measures
Dynamic DSM Features - MeasuresDynamic DSM
 
The road ahead for architectural languages [ACVI 2016]
The road ahead for architectural languages [ACVI 2016]The road ahead for architectural languages [ACVI 2016]
The road ahead for architectural languages [ACVI 2016]Ivano Malavolta
 
Dynamic DSM Features - Data Integration
Dynamic DSM Features - Data IntegrationDynamic DSM Features - Data Integration
Dynamic DSM Features - Data IntegrationDynamic DSM
 
Architectural Design in Software Engineering SE10
Architectural Design in Software Engineering SE10Architectural Design in Software Engineering SE10
Architectural Design in Software Engineering SE10koolkampus
 
Thinking Outside the Box – Server Design for #DataCenter Optimization
Thinking Outside the Box – Server Design for #DataCenter OptimizationThinking Outside the Box – Server Design for #DataCenter Optimization
Thinking Outside the Box – Server Design for #DataCenter OptimizationRobert Schmidt
 
PeopleSoft WorkCenter Presentation 20150901
PeopleSoft WorkCenter Presentation 20150901PeopleSoft WorkCenter Presentation 20150901
PeopleSoft WorkCenter Presentation 20150901Telly Ipock
 
Automatic measurements of use cases with cosmic thomas fehlmann
Automatic measurements of use cases with cosmic   thomas fehlmannAutomatic measurements of use cases with cosmic   thomas fehlmann
Automatic measurements of use cases with cosmic thomas fehlmannIWSM Mensura
 
Developing multithreaded database application using java tools and oracle dat...
Developing multithreaded database application using java tools and oracle dat...Developing multithreaded database application using java tools and oracle dat...
Developing multithreaded database application using java tools and oracle dat...csandit
 
IT 505 Final Submission Operating System Upgrade Implementation Brief
IT 505 Final Submission Operating System Upgrade Implementation BriefIT 505 Final Submission Operating System Upgrade Implementation Brief
IT 505 Final Submission Operating System Upgrade Implementation BriefEmmaDrinmk
 
DQ Product Usage Methodology Highlights_v6_ltd
DQ Product Usage Methodology Highlights_v6_ltdDQ Product Usage Methodology Highlights_v6_ltd
DQ Product Usage Methodology Highlights_v6_ltdDigendra Vir Singh (DV)
 
SimulationX Meets Office
SimulationX Meets OfficeSimulationX Meets Office
SimulationX Meets OfficeSimulationX
 

Was ist angesagt? (19)

Aggreagate awareness
Aggreagate awarenessAggreagate awareness
Aggreagate awareness
 
Rit 8.5.0 virtualization training slides
Rit 8.5.0 virtualization training slidesRit 8.5.0 virtualization training slides
Rit 8.5.0 virtualization training slides
 
1 introduction of OOAD
1 introduction of OOAD1 introduction of OOAD
1 introduction of OOAD
 
Software architecture
Software architectureSoftware architecture
Software architecture
 
Sample Capstone Projects from 2005
Sample Capstone Projects from 2005Sample Capstone Projects from 2005
Sample Capstone Projects from 2005
 
Dynamic DSM Features - Measures
Dynamic DSM Features - MeasuresDynamic DSM Features - Measures
Dynamic DSM Features - Measures
 
The road ahead for architectural languages [ACVI 2016]
The road ahead for architectural languages [ACVI 2016]The road ahead for architectural languages [ACVI 2016]
The road ahead for architectural languages [ACVI 2016]
 
Dynamic DSM Features - Data Integration
Dynamic DSM Features - Data IntegrationDynamic DSM Features - Data Integration
Dynamic DSM Features - Data Integration
 
Architectural Design in Software Engineering SE10
Architectural Design in Software Engineering SE10Architectural Design in Software Engineering SE10
Architectural Design in Software Engineering SE10
 
Thinking Outside the Box – Server Design for #DataCenter Optimization
Thinking Outside the Box – Server Design for #DataCenter OptimizationThinking Outside the Box – Server Design for #DataCenter Optimization
Thinking Outside the Box – Server Design for #DataCenter Optimization
 
Database testing
Database testingDatabase testing
Database testing
 
Pr full uml
Pr full umlPr full uml
Pr full uml
 
PeopleSoft WorkCenter Presentation 20150901
PeopleSoft WorkCenter Presentation 20150901PeopleSoft WorkCenter Presentation 20150901
PeopleSoft WorkCenter Presentation 20150901
 
Automatic measurements of use cases with cosmic thomas fehlmann
Automatic measurements of use cases with cosmic   thomas fehlmannAutomatic measurements of use cases with cosmic   thomas fehlmann
Automatic measurements of use cases with cosmic thomas fehlmann
 
Developing multithreaded database application using java tools and oracle dat...
Developing multithreaded database application using java tools and oracle dat...Developing multithreaded database application using java tools and oracle dat...
Developing multithreaded database application using java tools and oracle dat...
 
Lab5 RTC reports and Dashboards
Lab5 RTC reports and DashboardsLab5 RTC reports and Dashboards
Lab5 RTC reports and Dashboards
 
IT 505 Final Submission Operating System Upgrade Implementation Brief
IT 505 Final Submission Operating System Upgrade Implementation BriefIT 505 Final Submission Operating System Upgrade Implementation Brief
IT 505 Final Submission Operating System Upgrade Implementation Brief
 
DQ Product Usage Methodology Highlights_v6_ltd
DQ Product Usage Methodology Highlights_v6_ltdDQ Product Usage Methodology Highlights_v6_ltd
DQ Product Usage Methodology Highlights_v6_ltd
 
SimulationX Meets Office
SimulationX Meets OfficeSimulationX Meets Office
SimulationX Meets Office
 

Andere mochten auch

RQM in scrum agile testing - Raj kumar
RQM in scrum agile testing - Raj kumarRQM in scrum agile testing - Raj kumar
RQM in scrum agile testing - Raj kumarRoopa Nadkarni
 
Improving Defence Program Execution
Improving Defence Program ExecutionImproving Defence Program Execution
Improving Defence Program ExecutionIBMGovernmentCA
 
Embedded software validation best practices with NI and RQM
Embedded software validation best practices with NI and RQMEmbedded software validation best practices with NI and RQM
Embedded software validation best practices with NI and RQMPaul Urban
 
IBM Rational App Scan Tester Edition and Quality Manager
IBM Rational App Scan Tester Edition and Quality ManagerIBM Rational App Scan Tester Edition and Quality Manager
IBM Rational App Scan Tester Edition and Quality ManagerАлександр Шамрай
 
1 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 20091 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 2009Pepe
 
Continuous Integration for z using Test Data Management and Application D...
Continuous  Integration for z  using  Test Data Management  and Application D...Continuous  Integration for z  using  Test Data Management  and Application D...
Continuous Integration for z using Test Data Management and Application D...DevOps for Enterprise Systems
 
Dmt 5899 workshop - Learn to Collaborate, Trace, Review and Reuse Your Requir...
Dmt 5899 workshop - Learn to Collaborate, Trace, Review and Reuse Your Requir...Dmt 5899 workshop - Learn to Collaborate, Trace, Review and Reuse Your Requir...
Dmt 5899 workshop - Learn to Collaborate, Trace, Review and Reuse Your Requir...IBM Rational software
 
Rational Quality Manager
Rational Quality ManagerRational Quality Manager
Rational Quality ManagerAlan Kan
 
IBM Collaborative Lifecycle Management
IBM Collaborative Lifecycle ManagementIBM Collaborative Lifecycle Management
IBM Collaborative Lifecycle ManagementAlan Kan
 
Chicago Rational User Group 02112009
Chicago Rational User Group 02112009Chicago Rational User Group 02112009
Chicago Rational User Group 02112009Daniel Gilio
 
IBM Rational Developer for System z Quick Start Sales Presentation
IBM Rational Developer for System z Quick Start Sales PresentationIBM Rational Developer for System z Quick Start Sales Presentation
IBM Rational Developer for System z Quick Start Sales PresentationIBM Rational software
 
Token Deployment Services Offerings from Rational Lab Services
Token Deployment Services Offerings from Rational Lab ServicesToken Deployment Services Offerings from Rational Lab Services
Token Deployment Services Offerings from Rational Lab ServicesIBM Rational software
 
IBM UrbanCode Deploy Quick Start Service Offering
IBM UrbanCode Deploy Quick Start Service OfferingIBM UrbanCode Deploy Quick Start Service Offering
IBM UrbanCode Deploy Quick Start Service OfferingIBM Rational software
 
Assisted deployment services offering overview
Assisted deployment services offering overviewAssisted deployment services offering overview
Assisted deployment services offering overviewIBM Rational software
 

Andere mochten auch (20)

RQM in scrum agile testing - Raj kumar
RQM in scrum agile testing - Raj kumarRQM in scrum agile testing - Raj kumar
RQM in scrum agile testing - Raj kumar
 
Improving Defence Program Execution
Improving Defence Program ExecutionImproving Defence Program Execution
Improving Defence Program Execution
 
Embedded software validation best practices with NI and RQM
Embedded software validation best practices with NI and RQMEmbedded software validation best practices with NI and RQM
Embedded software validation best practices with NI and RQM
 
IBM Rational App Scan Tester Edition and Quality Manager
IBM Rational App Scan Tester Edition and Quality ManagerIBM Rational App Scan Tester Edition and Quality Manager
IBM Rational App Scan Tester Edition and Quality Manager
 
1 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 20091 Ibm Solo Pruebas 2009
1 Ibm Solo Pruebas 2009
 
Collaborative Quality Management
Collaborative Quality ManagementCollaborative Quality Management
Collaborative Quality Management
 
Rational Quality Manager af Lars Stensig Olesen, IBM Danmark
Rational Quality Manager af Lars Stensig Olesen, IBM DanmarkRational Quality Manager af Lars Stensig Olesen, IBM Danmark
Rational Quality Manager af Lars Stensig Olesen, IBM Danmark
 
Continuous Integration for z using Test Data Management and Application D...
Continuous  Integration for z  using  Test Data Management  and Application D...Continuous  Integration for z  using  Test Data Management  and Application D...
Continuous Integration for z using Test Data Management and Application D...
 
Dmt 5899 workshop - Learn to Collaborate, Trace, Review and Reuse Your Requir...
Dmt 5899 workshop - Learn to Collaborate, Trace, Review and Reuse Your Requir...Dmt 5899 workshop - Learn to Collaborate, Trace, Review and Reuse Your Requir...
Dmt 5899 workshop - Learn to Collaborate, Trace, Review and Reuse Your Requir...
 
Rational Quality Manager
Rational Quality ManagerRational Quality Manager
Rational Quality Manager
 
IBM Collaborative Lifecycle Management
IBM Collaborative Lifecycle ManagementIBM Collaborative Lifecycle Management
IBM Collaborative Lifecycle Management
 
Rational Quality Manager
Rational Quality ManagerRational Quality Manager
Rational Quality Manager
 
Rational CLM at a glance
Rational CLM at a glanceRational CLM at a glance
Rational CLM at a glance
 
Demystifying Devops - Uday kumar
Demystifying Devops - Uday kumarDemystifying Devops - Uday kumar
Demystifying Devops - Uday kumar
 
Chicago Rational User Group 02112009
Chicago Rational User Group 02112009Chicago Rational User Group 02112009
Chicago Rational User Group 02112009
 
IBM Rational Developer for System z Quick Start Sales Presentation
IBM Rational Developer for System z Quick Start Sales PresentationIBM Rational Developer for System z Quick Start Sales Presentation
IBM Rational Developer for System z Quick Start Sales Presentation
 
Token Deployment Services Offerings from Rational Lab Services
Token Deployment Services Offerings from Rational Lab ServicesToken Deployment Services Offerings from Rational Lab Services
Token Deployment Services Offerings from Rational Lab Services
 
IBM UrbanCode Deploy Quick Start Service Offering
IBM UrbanCode Deploy Quick Start Service OfferingIBM UrbanCode Deploy Quick Start Service Offering
IBM UrbanCode Deploy Quick Start Service Offering
 
Application slides
Application slidesApplication slides
Application slides
 
Assisted deployment services offering overview
Assisted deployment services offering overviewAssisted deployment services offering overview
Assisted deployment services offering overview
 

Ähnlich wie Deployment of a test management solution for a defence project using an integrated tool chain

jimmy vale csv ln
jimmy vale csv lnjimmy vale csv ln
jimmy vale csv lnjimmy vale
 
Tammy Clark Resume - Final
Tammy Clark Resume - FinalTammy Clark Resume - Final
Tammy Clark Resume - FinalTammy Clark
 
SAP Testing Services
SAP Testing ServicesSAP Testing Services
SAP Testing Servicesr_shanki
 
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010TEST Huddle
 
Architecting Design Development Test Request System in Aras
Architecting Design Development Test Request System in ArasArchitecting Design Development Test Request System in Aras
Architecting Design Development Test Request System in ArasAras
 
[2015/2016] Software development process
[2015/2016] Software development process[2015/2016] Software development process
[2015/2016] Software development processIvano Malavolta
 
ISTQBCH2.ppt
ISTQBCH2.pptISTQBCH2.ppt
ISTQBCH2.pptghkadous
 
Software management framework
Software management frameworkSoftware management framework
Software management frameworkKuppusamy P
 
Software development PROCESS
Software development PROCESSSoftware development PROCESS
Software development PROCESSIvano Malavolta
 
Donald_L_Loocke_Resume_TEr3
Donald_L_Loocke_Resume_TEr3Donald_L_Loocke_Resume_TEr3
Donald_L_Loocke_Resume_TEr3dloocke
 
The QA/Testing Process
The QA/Testing ProcessThe QA/Testing Process
The QA/Testing ProcessSynerzip
 

Ähnlich wie Deployment of a test management solution for a defence project using an integrated tool chain (20)

Sar
SarSar
Sar
 
jimmy vale csv ln
jimmy vale csv lnjimmy vale csv ln
jimmy vale csv ln
 
Tammy Clark Resume - Final
Tammy Clark Resume - FinalTammy Clark Resume - Final
Tammy Clark Resume - Final
 
SAP Testing Services
SAP Testing ServicesSAP Testing Services
SAP Testing Services
 
Plaksienko Sergei-Aug 2015
Plaksienko Sergei-Aug 2015Plaksienko Sergei-Aug 2015
Plaksienko Sergei-Aug 2015
 
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010
 
Architecting Design Development Test Request System in Aras
Architecting Design Development Test Request System in ArasArchitecting Design Development Test Request System in Aras
Architecting Design Development Test Request System in Aras
 
Ruchika_Mittal_Resume
Ruchika_Mittal_ResumeRuchika_Mittal_Resume
Ruchika_Mittal_Resume
 
Ayaz Qureshi
Ayaz QureshiAyaz Qureshi
Ayaz Qureshi
 
Test Center
Test CenterTest Center
Test Center
 
Meenakshi Pal_16
Meenakshi Pal_16Meenakshi Pal_16
Meenakshi Pal_16
 
Gilbert_Benitez_Jr
Gilbert_Benitez_JrGilbert_Benitez_Jr
Gilbert_Benitez_Jr
 
[2015/2016] Software development process
[2015/2016] Software development process[2015/2016] Software development process
[2015/2016] Software development process
 
Sakshi Tripathi Resume
Sakshi Tripathi ResumeSakshi Tripathi Resume
Sakshi Tripathi Resume
 
ISTQBCH2.ppt
ISTQBCH2.pptISTQBCH2.ppt
ISTQBCH2.ppt
 
ISTQBCH2.ppt
ISTQBCH2.pptISTQBCH2.ppt
ISTQBCH2.ppt
 
Software management framework
Software management frameworkSoftware management framework
Software management framework
 
Software development PROCESS
Software development PROCESSSoftware development PROCESS
Software development PROCESS
 
Donald_L_Loocke_Resume_TEr3
Donald_L_Loocke_Resume_TEr3Donald_L_Loocke_Resume_TEr3
Donald_L_Loocke_Resume_TEr3
 
The QA/Testing Process
The QA/Testing ProcessThe QA/Testing Process
The QA/Testing Process
 

Mehr von Einar Karlsen

A case study in using ibm watson studio machine learning services ibm devel...
A case study in using ibm watson studio machine learning services   ibm devel...A case study in using ibm watson studio machine learning services   ibm devel...
A case study in using ibm watson studio machine learning services ibm devel...Einar Karlsen
 
Weather data meets ibm cloud. part 4 analysis and visualization of weather ...
Weather data meets ibm cloud. part 4   analysis and visualization of weather ...Weather data meets ibm cloud. part 4   analysis and visualization of weather ...
Weather data meets ibm cloud. part 4 analysis and visualization of weather ...Einar Karlsen
 
Weather data meets ibm cloud. part 3 transformation and aggregation of weat...
Weather data meets ibm cloud. part 3   transformation and aggregation of weat...Weather data meets ibm cloud. part 3   transformation and aggregation of weat...
Weather data meets ibm cloud. part 3 transformation and aggregation of weat...Einar Karlsen
 
Weather data meets ibm cloud. part 2 storage and query of weather data - ib...
Weather data meets ibm cloud. part 2   storage and query of weather data - ib...Weather data meets ibm cloud. part 2   storage and query of weather data - ib...
Weather data meets ibm cloud. part 2 storage and query of weather data - ib...Einar Karlsen
 
Weather data meets ibm cloud. part 1 ingestion and processing of weather da...
Weather data meets ibm cloud. part 1   ingestion and processing of weather da...Weather data meets ibm cloud. part 1   ingestion and processing of weather da...
Weather data meets ibm cloud. part 1 ingestion and processing of weather da...Einar Karlsen
 
IBM Innovate2012 - CIO Cockpit for Integrated Planning, Controlling and Analysis
IBM Innovate2012 - CIO Cockpit for Integrated Planning, Controlling and AnalysisIBM Innovate2012 - CIO Cockpit for Integrated Planning, Controlling and Analysis
IBM Innovate2012 - CIO Cockpit for Integrated Planning, Controlling and AnalysisEinar Karlsen
 

Mehr von Einar Karlsen (6)

A case study in using ibm watson studio machine learning services ibm devel...
A case study in using ibm watson studio machine learning services   ibm devel...A case study in using ibm watson studio machine learning services   ibm devel...
A case study in using ibm watson studio machine learning services ibm devel...
 
Weather data meets ibm cloud. part 4 analysis and visualization of weather ...
Weather data meets ibm cloud. part 4   analysis and visualization of weather ...Weather data meets ibm cloud. part 4   analysis and visualization of weather ...
Weather data meets ibm cloud. part 4 analysis and visualization of weather ...
 
Weather data meets ibm cloud. part 3 transformation and aggregation of weat...
Weather data meets ibm cloud. part 3   transformation and aggregation of weat...Weather data meets ibm cloud. part 3   transformation and aggregation of weat...
Weather data meets ibm cloud. part 3 transformation and aggregation of weat...
 
Weather data meets ibm cloud. part 2 storage and query of weather data - ib...
Weather data meets ibm cloud. part 2   storage and query of weather data - ib...Weather data meets ibm cloud. part 2   storage and query of weather data - ib...
Weather data meets ibm cloud. part 2 storage and query of weather data - ib...
 
Weather data meets ibm cloud. part 1 ingestion and processing of weather da...
Weather data meets ibm cloud. part 1   ingestion and processing of weather da...Weather data meets ibm cloud. part 1   ingestion and processing of weather da...
Weather data meets ibm cloud. part 1 ingestion and processing of weather da...
 
IBM Innovate2012 - CIO Cockpit for Integrated Planning, Controlling and Analysis
IBM Innovate2012 - CIO Cockpit for Integrated Planning, Controlling and AnalysisIBM Innovate2012 - CIO Cockpit for Integrated Planning, Controlling and Analysis
IBM Innovate2012 - CIO Cockpit for Integrated Planning, Controlling and Analysis
 

Kürzlich hochgeladen

UNIT4_ESD_wfffffggggggggggggith_ARM.pptx
UNIT4_ESD_wfffffggggggggggggith_ARM.pptxUNIT4_ESD_wfffffggggggggggggith_ARM.pptx
UNIT4_ESD_wfffffggggggggggggith_ARM.pptxrealme6igamerr
 
me3493 manufacturing technology unit 1 Part A
me3493 manufacturing technology unit 1 Part Ame3493 manufacturing technology unit 1 Part A
me3493 manufacturing technology unit 1 Part Akarthi keyan
 
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...Sean Meyn
 
ChatGPT-and-Generative-AI-Landscape Working of generative ai search
ChatGPT-and-Generative-AI-Landscape Working of generative ai searchChatGPT-and-Generative-AI-Landscape Working of generative ai search
ChatGPT-and-Generative-AI-Landscape Working of generative ai searchrohitcse52
 
Nodal seismic construction requirements.pptx
Nodal seismic construction requirements.pptxNodal seismic construction requirements.pptx
Nodal seismic construction requirements.pptxwendy cai
 
Guardians and Glitches: Navigating the Duality of Gen AI in AppSec
Guardians and Glitches: Navigating the Duality of Gen AI in AppSecGuardians and Glitches: Navigating the Duality of Gen AI in AppSec
Guardians and Glitches: Navigating the Duality of Gen AI in AppSecTrupti Shiralkar, CISSP
 
Clutches and brkesSelect any 3 position random motion out of real world and d...
Clutches and brkesSelect any 3 position random motion out of real world and d...Clutches and brkesSelect any 3 position random motion out of real world and d...
Clutches and brkesSelect any 3 position random motion out of real world and d...sahb78428
 
nvidia AI-gtc 2024 partial slide deck.pptx
nvidia AI-gtc 2024 partial slide deck.pptxnvidia AI-gtc 2024 partial slide deck.pptx
nvidia AI-gtc 2024 partial slide deck.pptxjasonsedano2
 
Landsman converter for power factor improvement
Landsman converter for power factor improvementLandsman converter for power factor improvement
Landsman converter for power factor improvementVijayMuni2
 
solar wireless electric vechicle charging system
solar wireless electric vechicle charging systemsolar wireless electric vechicle charging system
solar wireless electric vechicle charging systemgokuldongala
 
sdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdf
sdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdfsdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdf
sdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdfJulia Kaye
 
Vertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptx
Vertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptxVertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptx
Vertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptxLMW Machine Tool Division
 
Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...
Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...
Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...Amil baba
 
SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....
SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....
SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....santhyamuthu1
 
Test of Significance of Large Samples for Mean = µ.pptx
Test of Significance of Large Samples for Mean = µ.pptxTest of Significance of Large Samples for Mean = µ.pptx
Test of Significance of Large Samples for Mean = µ.pptxHome
 
Technology Features of Apollo HDD Machine, Its Technical Specification with C...
Technology Features of Apollo HDD Machine, Its Technical Specification with C...Technology Features of Apollo HDD Machine, Its Technical Specification with C...
Technology Features of Apollo HDD Machine, Its Technical Specification with C...Apollo Techno Industries Pvt Ltd
 

Kürzlich hochgeladen (20)

Lecture 4 .pdf
Lecture 4                              .pdfLecture 4                              .pdf
Lecture 4 .pdf
 
UNIT4_ESD_wfffffggggggggggggith_ARM.pptx
UNIT4_ESD_wfffffggggggggggggith_ARM.pptxUNIT4_ESD_wfffffggggggggggggith_ARM.pptx
UNIT4_ESD_wfffffggggggggggggith_ARM.pptx
 
me3493 manufacturing technology unit 1 Part A
me3493 manufacturing technology unit 1 Part Ame3493 manufacturing technology unit 1 Part A
me3493 manufacturing technology unit 1 Part A
 
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...
Quasi-Stochastic Approximation: Algorithm Design Principles with Applications...
 
計劃趕得上變化
計劃趕得上變化計劃趕得上變化
計劃趕得上變化
 
Litature Review: Research Paper work for Engineering
Litature Review: Research Paper work for EngineeringLitature Review: Research Paper work for Engineering
Litature Review: Research Paper work for Engineering
 
ChatGPT-and-Generative-AI-Landscape Working of generative ai search
ChatGPT-and-Generative-AI-Landscape Working of generative ai searchChatGPT-and-Generative-AI-Landscape Working of generative ai search
ChatGPT-and-Generative-AI-Landscape Working of generative ai search
 
Nodal seismic construction requirements.pptx
Nodal seismic construction requirements.pptxNodal seismic construction requirements.pptx
Nodal seismic construction requirements.pptx
 
Guardians and Glitches: Navigating the Duality of Gen AI in AppSec
Guardians and Glitches: Navigating the Duality of Gen AI in AppSecGuardians and Glitches: Navigating the Duality of Gen AI in AppSec
Guardians and Glitches: Navigating the Duality of Gen AI in AppSec
 
Lecture 2 .pdf
Lecture 2                           .pdfLecture 2                           .pdf
Lecture 2 .pdf
 
Clutches and brkesSelect any 3 position random motion out of real world and d...
Clutches and brkesSelect any 3 position random motion out of real world and d...Clutches and brkesSelect any 3 position random motion out of real world and d...
Clutches and brkesSelect any 3 position random motion out of real world and d...
 
nvidia AI-gtc 2024 partial slide deck.pptx
nvidia AI-gtc 2024 partial slide deck.pptxnvidia AI-gtc 2024 partial slide deck.pptx
nvidia AI-gtc 2024 partial slide deck.pptx
 
Landsman converter for power factor improvement
Landsman converter for power factor improvementLandsman converter for power factor improvement
Landsman converter for power factor improvement
 
solar wireless electric vechicle charging system
solar wireless electric vechicle charging systemsolar wireless electric vechicle charging system
solar wireless electric vechicle charging system
 
sdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdf
sdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdfsdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdf
sdfsadopkjpiosufoiasdoifjasldkjfl a asldkjflaskdjflkjsdsdf
 
Vertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptx
Vertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptxVertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptx
Vertical- Machining - Center - VMC -LMW-Machine-Tool-Division.pptx
 
Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...
Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...
Popular-NO1 Kala Jadu Expert Specialist In Germany Kala Jadu Expert Specialis...
 
SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....
SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....
SATELITE COMMUNICATION UNIT 1 CEC352 REGULATION 2021 PPT BASICS OF SATELITE ....
 
Test of Significance of Large Samples for Mean = µ.pptx
Test of Significance of Large Samples for Mean = µ.pptxTest of Significance of Large Samples for Mean = µ.pptx
Test of Significance of Large Samples for Mean = µ.pptx
 
Technology Features of Apollo HDD Machine, Its Technical Specification with C...
Technology Features of Apollo HDD Machine, Its Technical Specification with C...Technology Features of Apollo HDD Machine, Its Technical Specification with C...
Technology Features of Apollo HDD Machine, Its Technical Specification with C...
 

Deployment of a test management solution for a defence project using an integrated tool chain

  • 1. © 2014 IBM Corporation Deployment of a test management solution for a defence project using an integrated tool chain Code 1183 Dr. Einar Karlsen (IBM, Co-Speaker) Thomas Schöning (Airbus DS)
  • 2. 1 Introduction Dr. Einar Karlsen (IBM) -Technical Solution Architect Thomas Schöning (Airbus Defence and Space) - Integration and Test Manager Thomas Südbröcker (IBM) - Technical Sales and Solutions + Community of Practices Leader Quality Management (Germany)
  • 3. 2 • Subcontractor in a NATO Project with requirement based development, test and formal verification of a complex system entity • Find a proper tooling solution for test and verification process using the IBM Rational tooling chain (Jazz Platform) – Support for relevant standards ISO/IEE 15288, ISO/IEEE 12207, ISO 9001, ISO/IEC 9126 – Support for relevant process: Waterfall (V-Model) with incremental SW Development – Integration with IBM Rational DOORS to accommodate for requirement traceability – Automatic document generation for requirements, design and test artefacts (plans, procedures, reports) – Insight into status and trend of the testing efforts (metrics) Setting the Scene – Situation
  • 4. 3 • Challenge – Unknown effort to adequately install, integrate and customize the whole tooling chain to perform modelling, implementation, and test management – Appropriate test management support (planning, execution, reporting, document generation, etc) according to required process? • Improvements – Decrease of costs, risks, inconsistencies and time-to-market through automatic generation of project deliverables – Collection of metrics to measure test design progress, requirements coverage – Online/Offline determination of test results while performing the test Setting the Scene – Risk and Opportunity
  • 5. 4 • Profound orientation for configuration and customization of IBM Rational Tools for a tool-aided test management solution (planning, execution, reporting, documentation) for similar test activities 1. Start early to implement test management prototyping to better estimate the effort to adapt the tools to the project needs 2. Invite technical professionals to have guidance and avoid pitfalls 3. Perform team training 4. Look at the deliverables before customizing your tool chain Setting the Scene – Position and Benefits
  • 6. 5 • Introduction – Programme Overview – Test and Evaluation Strategy • Test management – Solution Overview – Solution Architecture – Document Generation – Metrics and Dashboards • Summary Agenda
  • 7. 6 • Confidential, multinational NATO C4ISR Project (C4ISR=Command, Control, Communications, Computers, Intelligence, Surveillance, and Reconnaissance) – Unmanned Air, Command and Control Entities – Transportable and Mobile Ground Stations for data exception, processing, and archiving facilities – Communication links to other NATO and interoperable national ground stations, and to NATO and national Command and Control systems – Exchange of standardized data via different interfaces and communication lines • Airbus DS responsible for development, test and formal verification of a system entity consisting of several Subsystems Programme Overview
  • 8. Test and Evaluation Strategy Verification Development Testing Entity Subsystems CSCIsHWCIs ServicesComponents Development Testing Development TestingTest Test Test Verification Integration
  • 9. 8 • Requirements of System Entity, Subsystems, Computer Software Configuration Items (CSCIs), and Hardware Configuration Items (HWCIs) are kept in DOORS database with traceable entries • Testing/Verification is classified either to be – Informal Tests • conduct informal tests throughout the system development – Subcontractor Development Tests • For CSCI, HWCI, HW/CSCI groupings, Subsystem level, Entities and Integration testing – Formal Verification • Verification of allocated customer requirements based on proof of derived requirements (Entity, Subsystem, HW/CSCI groupings) Test and Evaluation Strategy
  • 10. Test Management – Solution Overview 9
  • 11. 10 Test Management – Solution Overview • Test Plan – consists of a number of Test Cases used to proof requirements – is linked with one or more Requirements Modules (Test Plan views) coverage and traceability (verification level) • Test Case – is linked to one or more particular requirements belonging to the requirements view(s) proofing requirements on different levels • Test Script – keeps the Test Procedure with single steps for test execution • Test Case Execution Record/Test Case Result – container to keep the Test Case results depending on iteration (integration, dry-run, acceptance) and test environment • PTR (=Problem Trouble Report) – keeps the defects occurred during Test Case execution
  • 12. Test Management – Solution Architecture 11 IBM Rational DOORS IBM Rational Insight IBM Rational Publishing Engine REST, ETL REST, ETL IBM Rational Quality Manager IBM Rational Team Concert REST, ETL Dashboards, Status and trend reports Test Plans, Procedures and Reports (Project Deliverables) RESTREST REST OSLC links OSLC links
  • 13. 12 Test Management – Test Document Generation
  • 14. Test Document Generation – Master Test List
  • 15. Test Document Generation – Test Case Details
  • 16. 15 • Metrics: What you can measure that can be done! • Metric types: Project, Product, Process, and Personnel • Definition of metrics for monitoring and control test planning, design, development and execution – test planning • Percentage of requirements having a test case – test design (analysis and concept) • Percentage of test case with different status (draft, ready for review, approved) – test development • Percentage of test scripts with different status (draft, ready for review, approved) – test execution • Percentage of planned test cases being executed (passed, passed with condition, failed, blocked, error) Test Management – Metrics and Dashboards
  • 17. 16 Metrics and Dashboards – Test Case Design
  • 18. 17 Metrics and Dashboards – Test Case Execution
  • 19. 18 • Tooling Solution (Jazz platform) for test management process with combined DT&E strategy (Informal, Development Tests, Formal Verification) applied for system entity (NATO Project) • Test Management Solution (Overview and Architecture) – Test Plans linked with requirements view – Test Cases linked with requirements – Test Execution Records keeping the results for each Iteration – Definition of timelines, iterations to support test planning and execution • Test Document Generation – Tooling adaption for artefact templates (Test Plan, Test Case) – Examples (Master Test List, Test Case Details) • Metrics and Dashboards – metrics for monitoring and control test planning, design, development and execution Summary
  • 20. Articles on developerWorks • RQM Template authoring articles on developer Works. – Using IBM Rational Publishing Engine to generate compliance documents: Report generation for Rational Quality Manager, introducing REST service URLs, importing schemas, and basic template authoring – Using IBM Rational Publishing Engine to generate compliance documents: Part 2. Report generation for Rational Quality Manager, showing how to extract information from grid sections and report on test results and related defects
  • 21. Thank You! Your Feedback is Important! Access the Innovate agenda tool to complete your session surveys from your smartphone, laptop or conference kiosk.
  • 22. 21 • Test Plan: – Artifact Templates (keep Test Cases and TCERs only) – Artifact Categories (manufacturer, part number, type) to distinguish between different plans (system, software,etc) • Test Case: – Artifact Template has been customized to the documentation format needs (Test Plan, Test Procedure) – Artifact Categories (test area, test method, test event, test type) and RQM section (description, test objective, requirement links, estimation) are used to appropriately keep Test Case data • Timelines (Development and Production Phase) • Iteration Types (Milestone, Software Test, System Test) • Iteration – directly corresponds with incremental software development (integration tests, dry run, acceptance test) – support generation of TCER Test Management – Tooling adaption
  • 23. 22 • Administration of project requirements and test cases as well as the creation of bi-directional dependencies between them • Planning test effort and milestones • Defining test goals, acceptance and quality criteria • Deriving test cases derived from requirement specifications • Estimation of the effort of the test activities • Definition of a time plan for each test iteration with finish dates of key activities • Collection of different test environments and the generation of test configurations • Creation and administration of test cases (manual and automated tests) • Recording test results, creating defect and evaluating reports • Support review and release process for the test plan and individual test cases. IBM Rational Tools – Usage