Diese Präsentation wurde erfolgreich gemeldet.
Wir verwenden Ihre LinkedIn Profilangaben und Informationen zu Ihren Aktivitäten, um Anzeigen zu personalisieren und Ihnen relevantere Inhalte anzuzeigen. Sie können Ihre Anzeigeneinstellungen jederzeit ändern.

Smart testing using virtual environments

Ähnliche Bücher

Kostenlos mit einer 30-tägigen Testversion von Scribd

Alle anzeigen

Ähnliche Hörbücher

Kostenlos mit einer 30-tägigen Testversion von Scribd

Alle anzeigen
  • Als Erste(r) kommentieren

Smart testing using virtual environments

  1. 1. Testing for Highly Distributed Service-Oriented Systems using Virtual Environments <ul><li>Faris Nizamic, PhD student at Distributed Systems research group </li></ul><ul><li>Rix Groenboom, Parasoft Netherlands B.V. </li></ul><ul><li>Alexander Lazovik, University of Groningen </li></ul>29-11-2011 17th Dutch Testing Day University of Twente, Enschede
  2. 2. Smart testing? <ul><li>On March 11, 2009, twenty five residents of Kaag en Braassem in the Netherlands unexpectedly received a certificate that they were married , died or had registered a newborn </li></ul><ul><li>What happened? </li></ul>
  3. 3. Highly Distributed Service-Oriented Systems <ul><li>Service Oriented Architecture </li></ul><ul><li>Business functionalities </li></ul><ul><li>Loosely-coupled services </li></ul><ul><li>Uniform communication </li></ul><ul><li>No single ownership </li></ul>
  4. 4. The facts <ul><li>Software is continuously evolving </li></ul><ul><li>Functionality is spread across the network </li></ul><ul><li>However, testing software implicitly assumes full control </li></ul>
  5. 5. Problem statement <ul><li>Tester’s perspective </li></ul><ul><ul><li>Fighting for a shared resources </li></ul></ul><ul><ul><li>Dependent on deployment team </li></ul></ul><ul><ul><li>Testing needs to be more agile </li></ul></ul><ul><ul><li>Availability of external services </li></ul></ul><ul><ul><li>No control over data - h ard to produce desired behavior of external services </li></ul></ul>
  6. 6. Problem statement <ul><li>Companies’ perspective </li></ul><ul><ul><li>Tests that interfere with the real world </li></ul></ul><ul><ul><li>Costs of having multiple testing environments </li></ul></ul><ul><ul><li>Effort of maintenance of testing environments </li></ul></ul><ul><li>Infrastructure is new bottleneck for competitive advantage </li></ul>
  7. 7. Testing and full control
  8. 8. Testing today
  9. 9. Testing tomorrow
  10. 10. Solution <ul><li>Simulate external services with virtual assets (VA) </li></ul><ul><li>Model behavior of external systems </li></ul><ul><li>Gain control over external systems and their data </li></ul>
  11. 11. Still a problem? <ul><li>Tester’s perspective </li></ul><ul><ul><li>Fighting for a shared resources </li></ul></ul><ul><ul><li>Dependent on deployment team </li></ul></ul><ul><ul><li>Testing needs to be more agile </li></ul></ul><ul><ul><li>Availability of external services </li></ul></ul><ul><ul><li>No control over data </li></ul></ul><ul><li>Companies’ perspective </li></ul><ul><ul><li>Tests that interfere with the real world </li></ul></ul><ul><ul><li>Costs of having multiple testing environments </li></ul></ul><ul><ul><li>Effort of maintenance of testing environments </li></ul></ul>
  12. 12. Case study <ul><li>WMO (Wet Maatschappelijke Ondersteuning) </li></ul><ul><ul><li>Dutch law for supporting people that have a chronic disease or disability </li></ul></ul><ul><li>The responsibility for a WMO request lies with the Dutch municipalities, they handle the complete business process. </li></ul><ul><li>Support provided by the WMO: </li></ul><ul><ul><li>transportation (e.g. taxi) </li></ul></ul><ul><ul><li>wheelchair </li></ul></ul><ul><ul><li>home modification (e.g. “traplift”) </li></ul></ul><ul><ul><li>domestic care </li></ul></ul>
  13. 13. WMO services
  14. 14. WMO business process (simplified main flow)
  15. 15. Virtualize-Model-Test idea Execute the tests and automatically generate the report Generate Virtual E nvironment for testing Populate the system with the test-data Environment created! System populated ! Tests executed !
  16. 16. Generation of a Virtual Environment <ul><li>What? </li></ul><ul><ul><li>Generation and deployment of virtual assets </li></ul></ul><ul><li>How? </li></ul><ul><ul><li>Semi-automatic: using WSDLs or log files as an input </li></ul></ul>
  17. 17. <ul><li>Prepare a WSDL </li></ul>
  18. 18. <ul><li>Choose a method for Virtual Asset generation </li></ul>
  19. 19. <ul><li>Deploy a Virtual Assets </li></ul>
  20. 20. Population of a system with a test-data <ul><li>What? </li></ul><ul><ul><li>Tests-data that will verify all basic functionalities </li></ul></ul><ul><ul><li>Input given only one time </li></ul></ul><ul><li>How? </li></ul><ul><ul><li>Business logic need to be provided by testers </li></ul></ul><ul><ul><li>Tests compiled as a combination of test-data and message structure </li></ul></ul>
  21. 21. <ul><li>Choose a data source </li></ul>
  22. 22. <ul><li>Model a behaviour of an external system </li></ul>
  23. 23. Test execution and automated report generation <ul><li>What? </li></ul><ul><ul><li>Test execution </li></ul></ul><ul><ul><li>Automated report generation </li></ul></ul><ul><li>How? </li></ul><ul><ul><li>Compiled tests executed on system that is connected to Virtual Environment </li></ul></ul><ul><ul><li>Automated report generated in various forms as comparison of observed result and defined assertions </li></ul></ul>
  24. 24. <ul><li>Execute a test against a generated Virtual Environment </li></ul>
  25. 25. <ul><li>T est case 1 </li></ul>
  26. 26. <ul><li>T est case 2 </li></ul>
  27. 27. <ul><li>Automatically generate a report </li></ul>
  28. 28. The Research <ul><li>Motivation </li></ul><ul><ul><li>Evident problem without unified solution </li></ul></ul><ul><ul><li>Huge demand from industry for agile testing solution </li></ul></ul><ul><ul><li>Surprisingly not too many research projects in this field </li></ul></ul><ul><li>Aim </li></ul><ul><ul><li>Define unified environment which will simplify automate testing of highly distributed service-oriented systems </li></ul></ul><ul><ul><li>Identify the processes that need to stay manual </li></ul></ul>
  29. 29. Summary <ul><li>Kaag en Braassem example </li></ul><ul><li>Current testing problems from a different perspectives </li></ul><ul><li>Solution using virtualization </li></ul><ul><li>Virtualize-Model-Test idea </li></ul><ul><li>WMO case study </li></ul>
  30. 30. Next steps <ul><li>A pproach companies for appropriate systems (highly distributed service-oriented) </li></ul><ul><li>Experiments </li></ul><ul><ul><li>Create Virtual Environment </li></ul></ul><ul><ul><li>Model the behavior of external systems </li></ul></ul><ul><ul><li>Prove that most of issues can be resolved by this method </li></ul></ul><ul><ul><li>Improve methodology and tools </li></ul></ul>
  31. 31. Big idea <ul><li>Simple switching between staged environments in the Cloud </li></ul><ul><li>Merging testing and infrastructure knowledge </li></ul><ul><li>Agile support for TestOps team </li></ul>
  32. 32. Thank you for your attention ! [email_address] 29-11-2011 17th Dutch Testing Day University of Twente, Enschede
  33. 33. How to keep Virtual Assets up-to-date with real services? <ul><li>Automatic deployment </li></ul><ul><ul><li>New code </li></ul></ul><ul><ul><li>Configuration files </li></ul></ul><ul><ul><li>Execute deployment scripts </li></ul></ul>

×