SlideShare ist ein Scribd-Unternehmen logo
1 von 19
T12: Exploitation testing
For testing Service Level Agreements

                  based on a best practice at

1 december 2009
Agenda

• Understanding Exploitation
  testing
• Best practice at APG
• Service Level
  Management and Testing
• Using State Transition Test
  to test Availability
Understanding Exploitation testing

• Based on Dutch term ‘Exploitatie test’
• Definition:
       Check whether the agreed or expected
       Service level related to IT infrastructures
       can be achieved.
• Those agreements and/or expectations
  are formalized in Service Level Agreements (SLA)
• Represents a group of quality attributes
Service Level Agreement (SLA)

• A negotiated agreement between two parties
   • customer and service provider
• Containing measurable KPI’s, such as:
   • 99.9% uptime per month => max. downtime: 43.2 minutes

   • 95% of transactions completed within 1 second

   • Mean Time To Recovery of 4 hours

   • 98% of batch jobs executed within batch window

   • Maximum response time of 30 minutes
Trends in IT service providing




Formalization of SLA’s, due to:
   • Increased Integration of systems
   • Globalization (higher availability demands)
   • Third party involvement
   • Growing complexity of infrastructures and
     architectures
   • Etc…
Agenda

• Understanding Exploitation
  testing
• Best practice at APG
• Service Level
  Management and Testing
• Using State Transition Test
  to test Availability
All Pension Group

• Pension provider for international pension funds
• Approximately 4000 staff provide pensions
  for around 4 million participants
• Internal IT department (CIS) exists of:
   • Application Services (AS) – Software development

   • Exploitation Services (ES) – Service management

   • And others, like QA and Financial control


• Mission of CIS: Allow business to excel by
  delivering ICT services
Test optimization

• One of the optimization targets:
       Involve ES in an earlier stage in project and incorporate

       a formal test approach
• Implemented elements:
   • Involvement at reviews of specifications

   • Introduction of Test specification techniques at Exploitation tests
• Result:
   • Improved the quality of advice given to stakeholders

   • Better understanding of the software and daily tasks

   • Increased confidence
Agenda

• Understanding Exploitation
  testing
• Best practice at APG
• Service Level
  Management and Testing
• Using State Transition Test
  to test Availability
Short view on ITIL v3




                    Service Validation and Testing
ITIL version 2
                                      Service Support
                             Incident             Operational
                            Management
            Release                         Problem
          Management   Software     testing
                                          Management


             Configuration             Change
Support      Management              Management              Security
 desk                                                       management
                                     Service Delivery
                         Service level               Strategic
                            Management
           Financial                      Availability
          Management                      Management


               Continuity             Capacity
              Management             Management
Exploitation test within the V-model
                                          Exploitation           User
  Business
                                          Acceptance          Acceptance
requirements                 Business        Test                Test




                 SLA
                             IT Service   Exploitation
                                             Test
                           Management
      System
               UC/   OLA      System                     System
   specifications                                         Test
                            Integration
       System                 System              System
    specifications          Integration            Test



               Technical                  Technical
                design
                            Component       Test
                           Development


                           Development
                                          UC = Underpinning contract
                                          OLA = Operational Level Agreement
Stakeholders
SLA items versus Software testing

SLA Items               Quality attributes         Test approach
Availability            Maturity /                 State Transition Test
                        Fault tolerance
Down/maintenance time   Maintainability /          Review /
                        Recoverability             During availability test
Security                Security                   Review / ‘hack test’
Capability              Efficiency                 Performance and
                                                   stress test

Service related Items   Quality attributes         Test approach
Verifiability           Understandability / During availability
                        Analyzability       Test
Serviceability          Operability                Scenario / Real life test
                        (IT Service perspective)
Agenda

• Understanding Exploitation
  testing
• Best practice at APG
• Service Level
  Management and Testing
• Using State Transition Test
  to test Availability
Use of State Transition Testing

Test specification steps:
1. Specify the system components influencing the
   availability of the system
2. Specify the failures that may occur
3. Specify the measures taken to prevent these
   failures
4. Conduct State Transition Diagram
   a.   Define the states in relation to these measures

   b.   Visualize the status and transitions between
5. Specify the test cases
Example State Transition Testing (1)

              1.   Critical system component: application and database servers

              2.   Business risk: systems unavailable, due to AC power break

              3.   Preventive measure: uninterruptible power supply (UPS)

              4.   State Transition Diagram
                                         AC Power break
                                      Supply power via UPS

               Normal                                             ON
                power
                                          End of AC power break         15% of battery
Charged UPS
                                           Supply power via AC            energy left
  Start up                                                                Shut down
  Systems                                                                  Systems



              Charging                                            OFF
                                    End of AC power break
                                        Charge UPS
Example State Transition Testing (2)

                5.     Specify test cases
              TC1                   TC2                     TC3                  TC4                         TC5

Start State   Normal power          ON                      OFF                  CHARGING                    ON

Trigger       AC Power break        15% energy left         End of AC power break 20% charged UPS            End of AC power break

Action        Supply power via UPS Shut down systems        Charge of UPS        Start up systems            Supply power via AC

End State     ON                    OFF                     CHARGING             Normal power                Stand By

Expectation   Servers are operating Administrator is notified UPS is charging    Servers are started up      Servers are operating
              Routers are operating Related systems are       Systems are down   Temp. data is reprocessed   Routers are operating
              UPS is active         notified                  Routers are down   Routers are started up      UPS is in standby
                                    Routers are shutdown                         Related systems are         modus
                                    Active processes are                         notified
                                    stopped
                                    Temporary data is saved
                                    Servers are shut down




                                                                                                    [Based on a 0-switch coverage]
Questions

Weitere ähnliche Inhalte

Was ist angesagt?

Application of kalman filtering in delta v
Application of kalman filtering in delta vApplication of kalman filtering in delta v
Application of kalman filtering in delta vEmerson Exchange
 
Addressing control applications using wireless hart devices
Addressing control applications using wireless hart devicesAddressing control applications using wireless hart devices
Addressing control applications using wireless hart devicesEmerson Exchange
 
Aplication of on line data analytics to a continuous process polybetene unit
Aplication of on line data analytics to a continuous process polybetene unitAplication of on line data analytics to a continuous process polybetene unit
Aplication of on line data analytics to a continuous process polybetene unitEmerson Exchange
 
Application of online data analytics to a continuous process polybutene unit
Application of online data analytics to a continuous process polybutene unitApplication of online data analytics to a continuous process polybutene unit
Application of online data analytics to a continuous process polybutene unitEmerson Exchange
 
ABB Consulting and Full Service-The road to efficiency and reliability-april2013
ABB Consulting and Full Service-The road to efficiency and reliability-april2013ABB Consulting and Full Service-The road to efficiency and reliability-april2013
ABB Consulting and Full Service-The road to efficiency and reliability-april2013Sammy Saba
 
Utilizing DeltaV Advanced Control Innovations to Improve Control Performance
Utilizing DeltaV Advanced Control Innovations to Improve Control PerformanceUtilizing DeltaV Advanced Control Innovations to Improve Control Performance
Utilizing DeltaV Advanced Control Innovations to Improve Control PerformanceEmerson Exchange
 
Improving continuous process operation using data analytics delta v applicati...
Improving continuous process operation using data analytics delta v applicati...Improving continuous process operation using data analytics delta v applicati...
Improving continuous process operation using data analytics delta v applicati...Emerson Exchange
 
EEQA and EHM Background
EEQA and EHM BackgroundEEQA and EHM Background
EEQA and EHM Backgroundcrispieg
 
Control using wireless measurements
Control using wireless measurementsControl using wireless measurements
Control using wireless measurementsEmerson Exchange
 
RELIABILITY CENTERED MAINTAINANCE
RELIABILITY CENTERED MAINTAINANCERELIABILITY CENTERED MAINTAINANCE
RELIABILITY CENTERED MAINTAINANCEkifayat ullah
 
Control loop_foundation_overview
 Control  loop_foundation_overview Control  loop_foundation_overview
Control loop_foundation_overviewEmerson Exchange
 
NG BB 27 Process Capability
NG BB 27 Process CapabilityNG BB 27 Process Capability
NG BB 27 Process CapabilityLeanleaders.org
 
Bli.it concepts-regarding-gamp-guide-en
Bli.it concepts-regarding-gamp-guide-enBli.it concepts-regarding-gamp-guide-en
Bli.it concepts-regarding-gamp-guide-enBLI.IT
 
Using Risk Management for Validation
Using Risk Management for ValidationUsing Risk Management for Validation
Using Risk Management for ValidationRobert Sturm
 
Transition to online AMS reduces maintenance costs and improves operations
Transition to online AMS reduces maintenance costs and improves operationsTransition to online AMS reduces maintenance costs and improves operations
Transition to online AMS reduces maintenance costs and improves operationsEmerson Exchange
 
Informatica certification
Informatica certificationInformatica certification
Informatica certificationbnjkukunuri
 
World Class Manufacturing Asset Utilization
World Class Manufacturing Asset UtilizationWorld Class Manufacturing Asset Utilization
World Class Manufacturing Asset Utilizationlksnyder
 
PROSA - A Framework for Online Failure Prediction through Online Testing
PROSA - A Framework for Online Failure Prediction through Online TestingPROSA - A Framework for Online Failure Prediction through Online Testing
PROSA - A Framework for Online Failure Prediction through Online Testingosammodi
 
Plan of Action and Milestones (POA&M)
Plan of Action and Milestones (POA&M)Plan of Action and Milestones (POA&M)
Plan of Action and Milestones (POA&M)GovCloud Network
 

Was ist angesagt? (20)

Application of kalman filtering in delta v
Application of kalman filtering in delta vApplication of kalman filtering in delta v
Application of kalman filtering in delta v
 
Addressing control applications using wireless hart devices
Addressing control applications using wireless hart devicesAddressing control applications using wireless hart devices
Addressing control applications using wireless hart devices
 
Aplication of on line data analytics to a continuous process polybetene unit
Aplication of on line data analytics to a continuous process polybetene unitAplication of on line data analytics to a continuous process polybetene unit
Aplication of on line data analytics to a continuous process polybetene unit
 
Application of online data analytics to a continuous process polybutene unit
Application of online data analytics to a continuous process polybutene unitApplication of online data analytics to a continuous process polybutene unit
Application of online data analytics to a continuous process polybutene unit
 
ABB Consulting and Full Service-The road to efficiency and reliability-april2013
ABB Consulting and Full Service-The road to efficiency and reliability-april2013ABB Consulting and Full Service-The road to efficiency and reliability-april2013
ABB Consulting and Full Service-The road to efficiency and reliability-april2013
 
Utilizing DeltaV Advanced Control Innovations to Improve Control Performance
Utilizing DeltaV Advanced Control Innovations to Improve Control PerformanceUtilizing DeltaV Advanced Control Innovations to Improve Control Performance
Utilizing DeltaV Advanced Control Innovations to Improve Control Performance
 
Improving continuous process operation using data analytics delta v applicati...
Improving continuous process operation using data analytics delta v applicati...Improving continuous process operation using data analytics delta v applicati...
Improving continuous process operation using data analytics delta v applicati...
 
Dcscourse doc
Dcscourse docDcscourse doc
Dcscourse doc
 
EEQA and EHM Background
EEQA and EHM BackgroundEEQA and EHM Background
EEQA and EHM Background
 
Control using wireless measurements
Control using wireless measurementsControl using wireless measurements
Control using wireless measurements
 
RELIABILITY CENTERED MAINTAINANCE
RELIABILITY CENTERED MAINTAINANCERELIABILITY CENTERED MAINTAINANCE
RELIABILITY CENTERED MAINTAINANCE
 
Control loop_foundation_overview
 Control  loop_foundation_overview Control  loop_foundation_overview
Control loop_foundation_overview
 
NG BB 27 Process Capability
NG BB 27 Process CapabilityNG BB 27 Process Capability
NG BB 27 Process Capability
 
Bli.it concepts-regarding-gamp-guide-en
Bli.it concepts-regarding-gamp-guide-enBli.it concepts-regarding-gamp-guide-en
Bli.it concepts-regarding-gamp-guide-en
 
Using Risk Management for Validation
Using Risk Management for ValidationUsing Risk Management for Validation
Using Risk Management for Validation
 
Transition to online AMS reduces maintenance costs and improves operations
Transition to online AMS reduces maintenance costs and improves operationsTransition to online AMS reduces maintenance costs and improves operations
Transition to online AMS reduces maintenance costs and improves operations
 
Informatica certification
Informatica certificationInformatica certification
Informatica certification
 
World Class Manufacturing Asset Utilization
World Class Manufacturing Asset UtilizationWorld Class Manufacturing Asset Utilization
World Class Manufacturing Asset Utilization
 
PROSA - A Framework for Online Failure Prediction through Online Testing
PROSA - A Framework for Online Failure Prediction through Online TestingPROSA - A Framework for Online Failure Prediction through Online Testing
PROSA - A Framework for Online Failure Prediction through Online Testing
 
Plan of Action and Milestones (POA&M)
Plan of Action and Milestones (POA&M)Plan of Action and Milestones (POA&M)
Plan of Action and Milestones (POA&M)
 

Ähnlich wie T12 exploitation testing - presentation 1.2

T12 Exploitation Testing Presentation 1.2
T12   Exploitation Testing   Presentation 1.2T12   Exploitation Testing   Presentation 1.2
T12 Exploitation Testing Presentation 1.2Edwin Loon, van
 
Edwin Van Loon - Exploitation Testing revised
Edwin Van Loon - Exploitation Testing revisedEdwin Van Loon - Exploitation Testing revised
Edwin Van Loon - Exploitation Testing revisedTEST Huddle
 
Overseeing it process implementations with project managemen tv1.0
Overseeing it process implementations with project managemen tv1.0Overseeing it process implementations with project managemen tv1.0
Overseeing it process implementations with project managemen tv1.0anusharaju38
 
In Sync Running Apps On Oracle
In Sync  Running Apps On OracleIn Sync  Running Apps On Oracle
In Sync Running Apps On OracleInSync Conference
 
Neotys PAC 2018 - Ramya Ramalinga Moorthy
Neotys PAC 2018 - Ramya Ramalinga MoorthyNeotys PAC 2018 - Ramya Ramalinga Moorthy
Neotys PAC 2018 - Ramya Ramalinga MoorthyNeotys_Partner
 
ITIL involvement in itil processes
ITIL involvement in itil processesITIL involvement in itil processes
ITIL involvement in itil processesbrunodeepak
 
20110812 CyberTAN presentation
20110812 CyberTAN presentation20110812 CyberTAN presentation
20110812 CyberTAN presentationRichard Hsu
 
Software test management overview for managers
Software test management overview for managersSoftware test management overview for managers
Software test management overview for managersTJamesLeDoux
 
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010TEST Huddle
 
Test result abstraction
Test result abstractionTest result abstraction
Test result abstractionJohan Hoberg
 
Metasolv Post Implementation Services
Metasolv Post Implementation ServicesMetasolv Post Implementation Services
Metasolv Post Implementation ServicesProdapt Solutions
 

Ähnlich wie T12 exploitation testing - presentation 1.2 (20)

T12 Exploitation Testing Presentation 1.2
T12   Exploitation Testing   Presentation 1.2T12   Exploitation Testing   Presentation 1.2
T12 Exploitation Testing Presentation 1.2
 
Edwin Van Loon - Exploitation Testing revised
Edwin Van Loon - Exploitation Testing revisedEdwin Van Loon - Exploitation Testing revised
Edwin Van Loon - Exploitation Testing revised
 
Testing Process
Testing ProcessTesting Process
Testing Process
 
Overseeing it process implementations with project managemen tv1.0
Overseeing it process implementations with project managemen tv1.0Overseeing it process implementations with project managemen tv1.0
Overseeing it process implementations with project managemen tv1.0
 
Testing & Quality Assurance
Testing & Quality AssuranceTesting & Quality Assurance
Testing & Quality Assurance
 
In Sync Running Apps On Oracle
In Sync  Running Apps On OracleIn Sync  Running Apps On Oracle
In Sync Running Apps On Oracle
 
Neotys PAC 2018 - Ramya Ramalinga Moorthy
Neotys PAC 2018 - Ramya Ramalinga MoorthyNeotys PAC 2018 - Ramya Ramalinga Moorthy
Neotys PAC 2018 - Ramya Ramalinga Moorthy
 
ITIL involvement in itil processes
ITIL involvement in itil processesITIL involvement in itil processes
ITIL involvement in itil processes
 
20110812 CyberTAN presentation
20110812 CyberTAN presentation20110812 CyberTAN presentation
20110812 CyberTAN presentation
 
Performance testing
Performance testingPerformance testing
Performance testing
 
Software test management overview for managers
Software test management overview for managersSoftware test management overview for managers
Software test management overview for managers
 
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010
C.V, Narayanan - Open Source Tools for Test Management - EuroSTAR 2010
 
Software Processes
Software Processes Software Processes
Software Processes
 
Test result abstraction
Test result abstractionTest result abstraction
Test result abstraction
 
Metasolv Post Implementation Services
Metasolv Post Implementation ServicesMetasolv Post Implementation Services
Metasolv Post Implementation Services
 
Software Tesitng Institutes Pune
Software Tesitng Institutes PuneSoftware Tesitng Institutes Pune
Software Tesitng Institutes Pune
 
Software Testing Trainng And Placements In Pune
Software Testing Trainng And Placements In PuneSoftware Testing Trainng And Placements In Pune
Software Testing Trainng And Placements In Pune
 
Software Testing Courses In Pune
Software Testing Courses In PuneSoftware Testing Courses In Pune
Software Testing Courses In Pune
 
Software Testing Training Institutes In Pune
Software Testing Training Institutes In PuneSoftware Testing Training Institutes In Pune
Software Testing Training Institutes In Pune
 
Software Testing Training Institutes In Pune
Software Testing Training Institutes In PuneSoftware Testing Training Institutes In Pune
Software Testing Training Institutes In Pune
 

Kürzlich hochgeladen

Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?SANGHEE SHIN
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
GenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncGenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncObject Automation
 
Babel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxBabel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxYounusS2
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdfJamie (Taka) Wang
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.francesco barbera
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 

Kürzlich hochgeladen (20)

Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
GenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncGenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation Inc
 
Babel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptxBabel Compiler - Transforming JavaScript for All Browsers.pptx
Babel Compiler - Transforming JavaScript for All Browsers.pptx
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.Digital magic. A small project for controlling smart light bulbs.
Digital magic. A small project for controlling smart light bulbs.
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 

T12 exploitation testing - presentation 1.2

  • 1. T12: Exploitation testing For testing Service Level Agreements based on a best practice at 1 december 2009
  • 2. Agenda • Understanding Exploitation testing • Best practice at APG • Service Level Management and Testing • Using State Transition Test to test Availability
  • 3. Understanding Exploitation testing • Based on Dutch term ‘Exploitatie test’ • Definition: Check whether the agreed or expected Service level related to IT infrastructures can be achieved. • Those agreements and/or expectations are formalized in Service Level Agreements (SLA) • Represents a group of quality attributes
  • 4. Service Level Agreement (SLA) • A negotiated agreement between two parties • customer and service provider • Containing measurable KPI’s, such as: • 99.9% uptime per month => max. downtime: 43.2 minutes • 95% of transactions completed within 1 second • Mean Time To Recovery of 4 hours • 98% of batch jobs executed within batch window • Maximum response time of 30 minutes
  • 5. Trends in IT service providing Formalization of SLA’s, due to: • Increased Integration of systems • Globalization (higher availability demands) • Third party involvement • Growing complexity of infrastructures and architectures • Etc…
  • 6. Agenda • Understanding Exploitation testing • Best practice at APG • Service Level Management and Testing • Using State Transition Test to test Availability
  • 7. All Pension Group • Pension provider for international pension funds • Approximately 4000 staff provide pensions for around 4 million participants • Internal IT department (CIS) exists of: • Application Services (AS) – Software development • Exploitation Services (ES) – Service management • And others, like QA and Financial control • Mission of CIS: Allow business to excel by delivering ICT services
  • 8. Test optimization • One of the optimization targets: Involve ES in an earlier stage in project and incorporate a formal test approach • Implemented elements: • Involvement at reviews of specifications • Introduction of Test specification techniques at Exploitation tests • Result: • Improved the quality of advice given to stakeholders • Better understanding of the software and daily tasks • Increased confidence
  • 9. Agenda • Understanding Exploitation testing • Best practice at APG • Service Level Management and Testing • Using State Transition Test to test Availability
  • 10. Short view on ITIL v3 Service Validation and Testing
  • 11. ITIL version 2 Service Support Incident Operational Management Release Problem Management Software testing Management Configuration Change Support Management Management Security desk management Service Delivery Service level Strategic Management Financial Availability Management Management Continuity Capacity Management Management
  • 12. Exploitation test within the V-model Exploitation User Business Acceptance Acceptance requirements Business Test Test SLA IT Service Exploitation Test Management System UC/ OLA System System specifications Test Integration System System System specifications Integration Test Technical Technical design Component Test Development Development UC = Underpinning contract OLA = Operational Level Agreement
  • 14. SLA items versus Software testing SLA Items Quality attributes Test approach Availability Maturity / State Transition Test Fault tolerance Down/maintenance time Maintainability / Review / Recoverability During availability test Security Security Review / ‘hack test’ Capability Efficiency Performance and stress test Service related Items Quality attributes Test approach Verifiability Understandability / During availability Analyzability Test Serviceability Operability Scenario / Real life test (IT Service perspective)
  • 15. Agenda • Understanding Exploitation testing • Best practice at APG • Service Level Management and Testing • Using State Transition Test to test Availability
  • 16. Use of State Transition Testing Test specification steps: 1. Specify the system components influencing the availability of the system 2. Specify the failures that may occur 3. Specify the measures taken to prevent these failures 4. Conduct State Transition Diagram a. Define the states in relation to these measures b. Visualize the status and transitions between 5. Specify the test cases
  • 17. Example State Transition Testing (1) 1. Critical system component: application and database servers 2. Business risk: systems unavailable, due to AC power break 3. Preventive measure: uninterruptible power supply (UPS) 4. State Transition Diagram AC Power break Supply power via UPS Normal ON power End of AC power break 15% of battery Charged UPS Supply power via AC energy left Start up Shut down Systems Systems Charging OFF End of AC power break Charge UPS
  • 18. Example State Transition Testing (2) 5. Specify test cases TC1 TC2 TC3 TC4 TC5 Start State Normal power ON OFF CHARGING ON Trigger AC Power break 15% energy left End of AC power break 20% charged UPS End of AC power break Action Supply power via UPS Shut down systems Charge of UPS Start up systems Supply power via AC End State ON OFF CHARGING Normal power Stand By Expectation Servers are operating Administrator is notified UPS is charging Servers are started up Servers are operating Routers are operating Related systems are Systems are down Temp. data is reprocessed Routers are operating UPS is active notified Routers are down Routers are started up UPS is in standby Routers are shutdown Related systems are modus Active processes are notified stopped Temporary data is saved Servers are shut down [Based on a 0-switch coverage]

Hinweis der Redaktion

  1. Turned to power down during a test?