Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Mehr von TechWell
Mehr von TechWell (20)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
The Boss Chose the Cloud: What Does that Mean for You?
- 1. T16 Cloud Testing 10/6/16 13:30 The Boss Chose the Cloud: What Does that Mean for You? Presented by: Martin Pol & Jeroen Mengerink Polteq Testing Services B.V. Brought to you by: 350 Corporate Way, Suite 400, Orange Park, FL 32073 888-‐-‐-‐268-‐-‐-‐8770 ·∙·∙ 904-‐-‐-‐278-‐-‐-‐0524 -‐ info@techwell.com -‐ http://www.starwest.techwell.com/
- 2. Martin Pol Polteq Testing Services B.V. Martin Pol has played a significant role in raising the awareness and improving the performance of testing worldwide. Martin is experienced in managing testing processes and implementing and improving structured testing in many organizations. He was responsible for creating the structured testing approach TMap¨ (Test Management Approach) and TPI¨Ê (Test Process Improvement), which have both become world standards. As the architect of the method, Martin recently coauthored Testing Cloud Services. A highly regarded presenter at conferences and training sessions on five continents, he remains active in the practice of testing every day.
- 3. The Boss Chose the Cloud: What Does that Mean for You? Martin Pol Jeroen Mengerink www.polteq.com
- 4. Topics • The Cloud • You! • Risks • Measures • Cases • Q & A Traditional New “Cloud related” Ways to test Ways to help reduce the risks
- 6. Email Surf Transfer Develop and Test Operate and Manage Store
- 7. Email Surf Transfer Develop and Test Operate and Manage Store storage claim 80% unused redundancy limitations ecological unfriendly
- 8. Email Surf Transfer Develop and Test Operate and Manage Store standard software bandwidth internet technologySOA virtualization
- 9. searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, analyzing, transmitting, learning, controlling, purchasing, testing, alarming, changing, updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meeting, gambling, shopping, storing, cross checking, retrieving, configuring, sketching, saving, accelerating, enhancing, creating, growing, checking in, checking out, finding out, reaching, denying, talking, designing, making Email Surf Transfer Develop and Test Operate and Manage Store
- 10. NIST Working Definition of Cloud Computing Essential characteristics On-demand service Broad network access Resource pooling Rapid elasticity Measured service Deployment models – private cloud – community cloud – public cloud – hybrid cloud Service Models Software as a Service Platform as a Service Infrastructure as a Service The Cloud?
- 11. What is “done” in the cloud? Application, Audit Back office, Billing Communications Desktop, Data Email, Environment File transfer Governance Hardware Infrastructure, IT, ID JAVA Knowledge base Learning Music AaaS BaaS CaaS DaaS EaaS FaaS GaaS HaaS IaaS JaaS KaaS LaaS MaaS Network Operations Platform QA R&D Storage, Software Testing User management V&V Windows, Workspace Anything/Everything Youtube, Yum Zenoss, Zscaler NaaS OaaS PaaS QaaS RaaS SaaS TaaS UaaS VaaS WaaS XaaS Yaas ZaaS
- 12. Customer Business oriented Supplier IT oriented QA and Test Test manager Test engineer Selection Introduction Integration E2E test Transformation Production Project manager Business analyst Operations Product owner Sales Project manager Business analyst Operations Product owner Purchasing Marketing Development Research Releasing Beta tests Infrastructure Test management Risk analysis “Testing” Reporting The Boss Chose the Cloud: What Does that Mean for You?
- 13. How to test Cloud Services? • As we always did: – Bridging risks to measures – By using – Your skills – Your peers – Heuristics – The Book • New Risks • New Measures • Testing during Selection • Continuous (E2E) Testing in Production and
- 14. Security Continuity Privacy Multi platform Impact organisation Standards 143 Cloud related Risks?
- 16. Cloud related Risks Test measures Security Continuity Privacy Multi platform Impact organisation Standards Check Review Monitor Interview Proof of concept
- 17. Practical grouping of Cloud related Risks • Performance • Security • Availability & Continuity • Functionality • Maintainability • Legislation & Regulations • Suppliers & Outsourcing Security Continuity Privacy Multi platform Impact organisation Standards
- 18. Wider Scope of Testing • Selection • Implementation • Production
- 19. Testing during Selection • Fighting in • Selection criteria • Completeness • Controllability • ……………
- 20. Testing in Production • Continuous change • Continuous End-to-End Testing
- 21. Performance • Risk: Service might not perform well due to other (unknown) users • Problem: You don’t know the load of the other users • Solution: Perform your tests at the time that the scenarios are relevant • Payroll systems usually have more load at the end of the month. Execute your load test in that period. The other customers of the service will have their peak load at that point in time.
- 22. Security • Risk: The system is as secure as its weakest part • Problem: People connect their (personal) devices to the cloud service(s) • Solution: Create a policy that allows only certain kinds of devices • Solution: Enforce encryption on the connected devices • Solution: Have an external company audit the security • Solution: Look at security at multiple parts of the system Beware that the weakest link of your system is usually the user
- 23. Availability & Continuity • Risk: Service provider files for bankruptcy • Problem: How to get your data • Solution: Define the divorce before the marriage
- 24. Storage in the cloud • As a growing company, we would like to store our data in the cloud, so that all our employees have easy access to it. • Some employees already used Dropbox, so we just started using it. • But what are the risks? • Performance: How much data will we put there and will it be fast enough? • Security: Can nobody else access our data? • Availability & Continuity: Can we always get access to our data? • Functionality: Does it work everywhere in the world? • Maintainability: Who do we contact when we have a problem? • Legislation & Regulations: What laws apply to our data and are we allowed to store it online? • Suppliers & Outsourcing: What is in the terms and conditions of Dropbox?
- 25. Storage in the cloud – Security • Problem: Users can share links to data • Solution: – Test authentication and authorization and check what can be configured – Dropbox: Not configurable, only option is to select another service – Currently transitioning to OneDrive
- 26. Storage in the cloud – Functionality • Problem: In China, Dropbox behaved strange • Solution: – Test the software at the places where you want it to work – Create test scenarios (think of online vs offline scenarios) – Execute them at different (global) locations
- 27. Storage in the cloud – Functionality • Problem: Can every employee connect his device(s) • Solution: – Multi platform testing – Use a device analysis to test with the proper devices – Make use of device labs
- 28. Storage in the cloud – Functionality: 3997 distinct Android devices in 2012 http://opensignal.com/reports/fragmentation.php
- 29. Storage in the cloud – Functionality: 18796 distinct Android devices in 2014 http://opensignal.com/reports/2014/android-fragmentation/
- 30. Storage in the cloud – Maintainability • Problem: – One connected account had ransomware. – Ransomed files got synced to all other connected accounts • Solution: – Verify that there is a way to get in contact with the provider – Check that documentation on the use of the service is present (and up-to-date) – Dropbox help center provided useful information – Dropbox employees helped to restore our data
- 31. Storage in the cloud – Suppliers & Outsourcing Compliance with Laws and Law Enforcement Requests; Protection of Dropbox's Rights. We may disclose to parties outside Dropbox files stored in your Dropbox and information about you that we collect when we have a good faith belief that disclosure is reasonably necessary to (a) comply with a law, regulation or compulsory legal request; (b) protect the safety of any person from death or serious bodily injury; (c) prevent fraud or abuse of Dropbox or its users; or (d) to protect Dropbox’s property rights. If we provide your Dropbox files to a law enforcement agency as set forth above, we will remove Dropbox’s encryption from the files before providing them to law enforcement. However, Dropbox will not be able to decrypt any files that you encrypted prior to storing them on Dropbox. • Solution: Read the terms and conditions before selecting a service
- 32. Continuity Privacy Multi platform Legislation Impact organisation Standards Check Intake Monitor Interview Proof of concept Summarizing
- 33. How to test Cloud Services? • As we always did: – Bridging risks to measures – By using – Your skills – Your peers – Heuristics – The Book • New Risks • New Measures • Testing during Selection • Continuous (E2E) Testing in Production and