Testing cloud services - EuroSTAR
•
0 gefällt mir•339 views
The document discusses testing measures for cloud services. It outlines various types of testing that should be performed at different stages, including performance testing, security testing, manageability testing, availability and continuity testing, functional testing, migration testing, and testing required due to legislation and regulations. The testing measures are developed by identifying risks and mapping them to individual test cases. Testing is a continuous process that starts early and never ends.
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (20)
Andere mochten auch
Andere mochten auch (8)
Ähnlich wie Testing cloud services - EuroSTAR
Ähnlich wie Testing cloud services - EuroSTAR (20)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
Testing cloud services - EuroSTAR
- 1. Testing of Cloud Services The Approach: From Risks to Test Measures Kees Blokland and Jeroen Mengerink, Polteq @esconfs www.eurostarconferences.com #esconfs
- 2. Testing of Cloud Services The Approach: From Risks to Test Measures Kees Blokland Jeroen Mengerink Polteq Test Services BV The Netherlands
- 4. searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, analyzing, transmitting, learning, controlling, purchasing, testing, alarming, changing, updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meeting, gambling, shopping, storing, cross checking, retrieving, configuring, sketching, saving, accelerating, enhancing, creating, growing, checking in, checking out, finding out, reaching, denying, talking, designing, making, verifying, measuring
- 5. Develop and Test Email Surf Transfer Operate and Manage Store 5
- 6. Develop and Test Email Surf Transfer redundancy limitations 80% unused storage claim environmentally unfriendly Operate and Manage Store 6
- 7. Develop and Test Email Surf Transfer SOA internet technology virtualization standard software bandwidth Operate and Manage Store 7
- 8. searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, analyzing, Test Develop and transmitting, learning, controlling, Email Surf purchasing, testing, alarming, changing, updating, Transfer deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meeting, gambling, shopping, storing, cross checking, retrieving, configuring, sketching, saving, accelerating, enhancing, creating, growing,Store Operate and Manage checking in, checking out, finding out, reaching, denying, talking, designing, making, verifying, measuring 8
- 10. Essential characteristics On-demand service Self service provisioning, pay-per-use No human interaction US: National Institute of Standards and Technology http://www.nist.gov
- 11. Essential characteristics On-demand service Broad network access Standard mechanisms over networks “Any” client US: National Institute of Standards and Technology http://www.nist.gov
- 12. Essential characteristics On-demand service Broad network access Resource pooling Multi-tenant Storage, processing, memory, virtual machines, … Location independent US: National Institute of Standards and Technology http://www.nist.gov
- 13. Essential characteristics On-demand service Broad network access Resource pooling Rapid elasticity Rapid scale in and out “Any quantity” at any time US: National Institute of Standards and Technology http://www.nist.gov
- 14. Essential characteristics On-demand service Broad network access Resource pooling Rapid elasticity Measured service Controlled resource use Transparency, pay-per-use US: National Institute of Standards and Technology http://www.nist.gov
- 15. Essential characteristics On-demand service Broad network access Deployment models Resource pooling – private cloud – community cloud Rapid elasticity – public cloud Measured service – hybrid cloud Service Models Software as a Service Platform as a Service Infrastructure as a Service US: National Institute of Standards and Technology http://www.nist.gov
- 16. Standards Cyber crime Continuity Privacy Legislation Multi platform Impact organisation 143
- 17. Performance Standards Security Cyber crime Continuïty Availability & Continuity Functionality Privacy Legislation Manageability Multi platform Legislation & Regulations Risks Impact organisation Suppliers & Outsourcing
- 18. Performance YOUR Operational Profile Security Availability & Continuity Functionality Other customers Manageability Legislation & Regulations Risks YOUR Operational Profile Suppliers & Outsourcing PLUS 19
- 19. Performance The idea: “it’s safe” Security Availability & Continuity Functionality Everything over the web Manageability Legislation & Regulations Risks Home ground for hackers 20 Suppliers & Outsourcing
- 20. Performance No free choice of device. Security Availability & Continuity Functionality Bring Your Own Device Manageability Legislation & Regulations Risks Endless possibilities. 21 Suppliers & Outsourcing
- 21. Performance Taken care of. Security Availability & Continuity Functionality Backup and recovery Manageability Legislation & Regulations Risks Who will support me? 22 Suppliers & Outsourcing
- 22. Performance Planned and controlled Security Availability & Continuity Functionality Updates, patches, fixes, … Manageability Legislation & Regulations Risks Do I have a choice? 23 Suppliers & Outsourcing
- 23. Performance In house. Security Availability & Continuity Where is my data? Functionality Is it OK? Manageability Legislation & Regulations Risks Somewhere… 24 Suppliers & Outsourcing
- 24. Performance Security Availability & Continuity Functionality Manageability Legislation & Regulations Risks 25 Suppliers & Outsourcing
- 25. Testing? Interview Check Trial Proof of concept Intake 26
- 26. Testing! Interview Check Trial Proof of concept Proof ofInterview Proef concept Testen Intake Intake 27
- 27. Te s t M e a s u r e s Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Testing Proof ofInterview Proef concept Testen Functional Testing Intake Migration Testing Testing caused by Legislation & Regulations 28 Testing in Production
- 28. Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused by Risks Legislation & Regulations 29 Suppliers & Outsourcing Testing in Production
- 29. Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused by Risks Legislation & Regulations 30 Suppliers & Outsourcing Testing in Production
- 30. Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused by Risks Legislation & Regulations 31 Suppliers & Outsourcing Testing in Production
- 31. Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Architecture Manageability Testing Availability & Continuity Functionality Testing From “individual” risks Functional Testing Manageability to “individual” test measures Migration Testing Legislation & Regulations Testing caused by Risks Legislation & Regulations 32 Suppliers & Outsourcing Testing in Production
- 32. Te s t M e a s u r e s Testing during Selection Performance Testing Selection Security Testing Manageability Testing Availability & Continuity Implementation Testing Functional Testing Migration Testing Production Testing caused by Legislation & Regulations 33 Testing in Production
- 33. Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused by Risks Legislation & Regulations 34 Suppliers & Outsourcing Testing in Production
- 34. Te s t M e a s u r e s Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Selection Criteria Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations 35 Testing in Production
- 35. Te s t M e a s u r e s Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Proof of Concept Testing Functional Testing Migration Testing Testing caused by Legislation & Regulations 36 Testing in Production
- 36. Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused by Risks Legislation & Regulations 37 Suppliers & Outsourcing Testing in Production
- 37. Te s t M e a s u r e s Testing during Selection Performance Testing Security Testing Known measures Manageability Testing tuned and tweaked Availability & Continuity Testing Functional Testing New measures developed Migration Testing Testing caused by Legislation & Regulations 38 Testing in Production
- 38. Te s t M e a s u r e s Testing during Selection YOUR Operational Profile Performance Testing Security Testing Manageability Testing Availability & Continuity Load Testing Testing Functional Testing Migration Testing YOUR Testing caused by Operational Profile Legislation & Regulations PLUS 39 ACTUAL MOMENT Testing in Production
- 39. Te s t M e a s u r e s Testing during Selection Performance Testing Security Testing Manageability Testing Availability & Continuity Online – Offline Testing Functional Testing Migration Testing Testing caused by Use case testing. Legislation & Regulations Global testing. 40 Testing in Production
- 40. Te s t M e a s u r e s Testing during Selection Multiplatform testing. Performance Testing Security Testing Manageability Testing Availability & Continuity Any device – any platform Testing Functional Testing Migration Testing Testing caused by Multiplatform Legislation & Regulations testing. 41 Testing in Production
- 41. Windows XP Internet Explorer 6 Internet Explorer 7 Windows Vista Internet Explorer 8 Windows 7 Firefox 3.5 Windows 2003 server Firefox 3.6 Windows 8 Browsers Firefox 4 Safari 4 Windows CE Safari 5 Linux Operating Systems Chrome11 Unix Opera11 Mac OS Lion Multiplatform PC Mac OS Snowleopard SUN iOS Computer Macintosh Android iPhone .. Windows Mobile Samsung … Devices Mobile NOKIA … Xxx … ASUS.. Blackberry… Tablet MOTOROLA… Xxx … 42
- 42. Te s t M e a s u r e s Testing during Selection Multiplatform testing. Performance Testing Security Testing Manageability Testing Availability & Continuity Any device – any platform Testing Functional Testing Migration Testing Testing caused by Multiplatform Legislation & Regulations testing. 43 Testing in Production
- 43. Te s t M e a s u r e s Testing during Selection Incidental testing. Performance Testing Security Testing Manageability Testing Legislation + Regulations Availability & Continuity = Testing Test basis Functional Testing Migration Testing Testing caused by Legislation & Regulations Compliancy testing. 44 Testing in Production
- 44. European Commissioner Kroes, Sept 27 • Strategy document to promote cloud computing • 2,5 million jobs, 160 billion Euros • Major barriers: – Many different standards – Contract issues – Many different rules and policies • Privacy legislation: differences in 27(!) EU-countries 45
- 45. Te s t M e a s u r e s Testing during Selection Incidental testing. Performance Testing Security Testing Manageability Testing Legislation + Regulations Availability & Continuity = Testing Test basis Functional Testing Migration Testing Testing caused by Legislation & Regulations Compliancy testing. 46 Testing in Production
- 46. Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused by Risks Legislation & Regulations 47 Suppliers & Outsourcing Testing in Production
- 47. Te s t M e a s u r e s Testing during Selection Performance Testing Continuous Security Testing End-to-End Test Manageability Testing Availability & Continuity Testing Functionals Functional Testing and non-functionals Migration Testing Testing caused by Legislation & Regulations 48 Testing in Production
- 48. Standards Cyber crime Check Continuity Interview Privacy Legislation Trial Proof of concept Multi platform Intake Impact organisation
- 49. Standards Cyber crime Check Continuity Interview Privacy Legislation Trial Proof of concept Multi platform Intake Impact organisation
- 50. Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Architecture Manageability Testing Functionality starts earlier Test Availability & Continuity Testing From “individual” risks Test scope is widened Functional Testing Test will never stop Manageability to “individual” test measures Migration Testing Legislation & Regulations Testing caused by Risks Legislation & Regulations 51 Suppliers & Outsourcing Testing in Production
- 51. 52
- 52. Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Questions? Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused by Risks Legislation & Regulations 53 Suppliers & Outsourcing Testing in Production
- 53. Te s t M e a s u r e s Performance Testing during Selection Performance Testing Security Security Testing Availability & Continuity Manageability Testing Availability & Continuity Functionality Testing Thank you! Functional Testing Manageability Migration Testing Legislation & Regulations Testing caused by Risks Legislation & Regulations 54 Suppliers & Outsourcing Testing in Production