SlideShare ist ein Scribd-Unternehmen logo
1 von 14
Downloaden Sie, um offline zu lesen
 
	
  
	
  
	
  
	
  
W8	
  
Test	
  Techniques	
  
10/4/17	
  13:45	
  
	
  
	
  
	
  
	
  
Service	
  Virtualization:	
  What,	
  Who,	
  
When,	
  and	
  How	
  
	
  
Presented	
  by:	
  
	
  
Kenneth	
  Merkel	
  
	
  CA	
  Technologies	
  
	
  
Brought	
  to	
  you	
  by:	
  	
  
	
  	
  
	
  
	
  
	
  
	
  
	
  
350	
  Corporate	
  Way,	
  Suite	
  400,	
  Orange	
  Park,	
  FL	
  32073	
  	
  
888-­‐-­‐-­‐268-­‐-­‐-­‐8770	
  ·∙·∙	
  904-­‐-­‐-­‐278-­‐-­‐-­‐0524	
  -­‐	
  info@techwell.com	
  -­‐	
  http://www.starwest.techwell.com/	
  	
  	
  
	
  
	
  	
  
	
  
 
Kenneth	
  Merkel	
  
CA	
  Technologies	
  
	
  
Kenneth	
  Merkel’s	
  twenty-­‐two	
  year	
  IT	
  career	
  has	
  covered	
  development,	
  test,	
  and	
  
operations.	
  From	
  developing	
  in	
  the	
  telecommunications	
  industry	
  to	
  helping	
  
customers	
  with	
  development	
  platforms,	
  testing	
  frameworks,	
  and	
  operations	
  
platforms	
  for	
  monitoring	
  applications,	
  Kenneth	
  has	
  spanned	
  the	
  entire	
  SDLC.	
  For	
  
the	
  past	
  seven	
  years	
  Kenneth	
  has	
  focused	
  on	
  service	
  virtualization	
  at	
  both	
  iTKO	
  
and	
  now	
  CA	
  following	
  the	
  acquisition.	
  Kenneth	
  has	
  been	
  addressing	
  customers	
  in	
  
multiple	
  industries	
  about	
  the	
  need	
  for	
  service	
  virtualization,	
  which	
  he	
  views	
  as	
  
the	
  cornerstone	
  for	
  continuous	
  delivery	
  and	
  continuous	
  testing.	
  Kenneth	
  enjoys	
  
spending	
  time	
  with	
  his	
  wife	
  and	
  four-­‐year-­‐old	
  daughter—with	
  an	
  occasional	
  
round	
  of	
  golf	
  thrown	
  in.	
  
	
  
1
The What, Why, Who and How of
Service Virtualization
October 2017
Removing Constraints for Continuous Testing
© 2017 CA. Confidential. All rights reserved.
About Me!
•  21 year IT career
–  development, test, and operations.
•  Past 7 years focused on Service Virtualization
•  Addressing customers in multiple industries about the
need for service virtualization
–  The cornerstone for continuous delivery and continuous testing.
•  Fun = time with wife + 4 Yr. old daughter ~ occasional
round of golf
2
© 2017 CA. Confidential. All rights reserved.
About You…
How many Developers?
Integration vs. Performance…?
How many Testers?
© 2017 CA. Confidential. All rights reserved.
Agenda
WHAT IS SERVICE VIRTUALIZATION?
WHY DO I NEED SERVICE VIRTUALIZATION?
WHO BENEFITS FROM SERVICE VIRTUALIZATION?
HOW DO I BUILD VIRTUAL SERVICES?
1
2
3
4
3
Application
Complexity
•  Distributed System Progression
•  Integration of Legacy/3rd Party Systems
•  Agile Development Methods
•  Continuous Testing
•  Continuous Delivery
What
4
© 2017 CA. Confidential. All rights reserved.
Service Virtualization
Key Benefits
•  Provide testers and developers with access to “life-like” production systems
•  Replicate production like dependencies for testing
•  Mobile, Web, Middleware, Mainframe, 3rd Party Services and API’s
•  Test components out of order
•  Capture behavior data and performance characteristics of composite applications
•  Avoid manual repetitive development and management of wrappers, stubs & mocks
•  Eliminate false failures
•  Test earlier and reduce the amount of rework that has to be done in production
Wikipedia - Service virtualization emulates the behavior of software components to
remove dependency constraints on development and testing teams. Service virtualization
extends across all aspects of composite applications: services, APIs, databases,
mainframes, ESBs, and other components that communicate using common messaging
protocols.
© 2017 CA. Confidential. All rights reserved.
Service Virtualization Basics
TAKEAWAY
§  Service Virtualization Improves
–  Environment Availability
–  Load and Performance Testing
–  Data and Test Scenario Management
–  Delivery Schedules
MESSAGE
§  Service Virtualization removes constraints by
simulating constrained or unavailable
systems. Development and test teams are
able to work in a constraint-free
environments and experience significant
gains in efficiency
§  Service Virtualization creates an accurate
rendering of dependent systems allowing
developments team to find and resolve
defects earlier in the SDLC, saving time and
money.
METRICS
§  25-50% reduction in application development schedule
§  60-90% more defects detected at least one step earlier
in the software development lifecycle
§  Customers have saved millions of dollars,
in development and test lab hardware, software,
maintenance, and 3rd party access fees
5
© 2017 CA. Confidential. All rights reserved.
What’s the Difference Between
Stubs, Mocks, and Service Virtualization?
© 2017 CA. Confidential. All rights reserved.
Service Virtualization Destroys Stubs and Mocks
Critical Dev./Test Feature
Service
Virtualization
Stubs and
Mocks
Reduce dependencies and constraints in application development
Automated creation of simulated system
Rich test data for comprehensive testing early in SDLC
Share virtual services across entire development team—not trapped in a
single sandbox
Know that your code will scale in production
Changes to any dependent systems (mainframe, ERP, middleware, 3rd
party) are automatically synced…teams focus on building solutions vs.
maintenance
Wizard-based UI for use by all team members regardless of coding skill
6
Why
© 2017 CA. Confidential. All rights reserved.
Service Virtualization: Why It’s Needed
“I can’t do anything
until I have everything
…
and I never have
everything!”
Data
Constraints
System
Constraints
Cost
Constraints
Development
Constraints
Bottlenecks
Everywhere
ESB
of teams experience
delays in development and
QA due to unavailable
dependencies*
Over
80%
79%
of teams face prohibitive
restrictions, time limits or
access fees on needed 3rd
party services*
*Source: voke Market Snapshot TM Report: ServiceVirtualization  – January 2015
AccesstoTest
Environments/
BrittleStubs&
Mocks
Developers
Deadlocked
7
© 2017 CA. Confidential. All rights reserved.
7 Common Service Virtualization Use Cases
Training Environments
Create complete and comprehensive
virtual training environments
“Business In a Box”
Use SV for Integration constraints
3rd Party APIs
Use SV to remove access and cost
constraints.
Mainframe Constraints
Eliminate mainframe constraints for both
distributed and mainframe development
Negative Scenarios
Use SV to enable Negative Scenario
Testing
Performance Constraints
Stress test applications components
using virtual services
Time Constraints
Use SV to “Shift-Left” your SDLC,
customers have shown 25%-50% faster
© 2017 CA. Confidential. All rights reserved.
EMA – DevOps/CD Tooling Survey
Of the following application delivery-related practices and capabilities, please indicate the top 3
that are most important to your company's Digital Business?
Enterprise Management Associates - Analyst Deck – April 2017
32%
30%
28%
26%
25%
25%
24%
24%
20%
19%
18%
DevOps
Integrations unifying and/or sharing data in existing mgt. tools across
stages of the app lifecycle
Continuous Delivery of new code and features into production
Integrations capable of unifying and/or sharing data during production
Process and/or workflow automation
Deployment automation
Agile Development
Automated Application Performance Management (APM) tools
supporting production applications
Continuous delivery-related productivity metrics
Development-related productivity metrics
Structured, predictable Release Management processes
8
© 2017 CA. Confidential. All rights reserved.
Distributed Teams
•  Remove constraints with virtual services
•  Test components out of order
•  Capture behavior data and performance characteristics
of composite applications
•  Avoid manual repetitive development of stubs or
mockups
•  Mobile, Web, Middleware, Mainframe, 3rd Party Services
and API’s
Virtual
Services
Components Set-Up Test
Environment
Test
Data
Systems
and
Services
Integration Testing
Create test environments that exactly replicate production infrastructure.
•  Cut integration time from three days to three hours
•  Avoided $300,000 in test hardware and software costs
•  Decreased software defects by 25 percent hours
AutoTrader STABILITY
“CA Service Virtualization gives
us a more stable and available
environment for Testing”
Increase availability
of testing platforms
up to 90%
Enable Agile
Testing Sprints
KPN Telecommunications
Save $2.5 million
in infrastructure
Cut overall
development cycle by
66%
NordstromForrester TEI Study November 2015
© 2017 CA. Confidential. All rights reserved.
ü  Use the same tests used for functional test
ü  Virtual services for performance
ü  Engineering
ü  Simulate backend load
ü  Outlier conditions
ü  Mobile experience
Establish IT as an
Enabler of growth
1 x 500 throughput
increase in testing
Eliminate
capacity constraints for
performance testing
Reduce delays
with high-performance
masking and sub-setting, and
automated data discovery
Nordstrom SPEED
“CA Service Virtualization helps us bring better
applications to market faster and establish our IT
function as an enabler of business growth”
•  Reduced performance testing time from 3 months to
an average of 4 days
•  Cut overall development cycle by 66%
Application “X”
BillMeLater
PayPal
TNT Express
3rd Party Service
Current Testing
Tools
Thousands of
transactions
Test Data
Performance Testing
Innovate Faster while Delivering a High Quality Experience
9
© 2017 CA. Confidential. All rights reserved.
New Innovation Paradigm
“Shift-left” the SDLC
Without SV
WITH SV
Dev1
Dev2
Dev3
System Test
Integration
Performance Test
UAT
System
Dev
1
Dev
2
Dev
1
Dev
3
Dev
2
Dev
3 Integration Performance UAT…
Uncertain delivery schedule – defects persist until UAT
Typical composite app today
waits for whole assembly to begin
With Service Virtualization quality
effort moved earlier in the lifecycle
Reduction in SDLC
Faster Delivery
Accelerate
Delivery
Increase
Quality
Who
10
© 2017 CA. Confidential. All rights reserved.
•  Enable Parallel
Development
•  Eliminate Mocking/
Stubbing
•  Build True Release
Candidate
•  Reproduce
Production Defects
•  Minimize System
Availability Wait
Time
DEVELOPERS
•  Eliminate Wait Time
•  Minimize Test Data
Setup
•  Eliminate Test Data
Burn
•  Negative Test
Coverage
•  Provide Stable Test
Environment
INTEGRATION
TESTER
•  Reduce
Infrastructure Costs
•  Eliminate
Environment
Sharing
•  Improved
Scalability
•  Reduce Transaction
Costs
PERFORMANCE
TESTER
Who Benefits from Service Virtualization
How
11
© 2017 CA. Confidential. All rights reserved.
Service Virtualization
Having Everything you need, when you need them.
Front End Back End
Internet of Things
Mobile
SaaS/Cloud
Partner
Ecosystems
External
Developers
Secure
Environments
Applications
ERP/SAP
Mainframe
3rd Party/APIs
Orchestration
Layer
Performance Testing
§  Provide end-to-end security for apps, mobile, and IoT
§  Control access with SSO and identity management
§  Protect against threads and OWASP vulnerabilities
Integration Testing
§  Remove constraints with virtual services
§  Avoid manual repetitive development of stubs/mocks
§  Simulate web services, Middleware, 3rd Party, APIs, or
Mainframe
Better Quality
§  Test sooner and more often
§  Increase test coverage and negative testing
capabilities
§  Find up to 90% more defects at least one cycle earlier
Faster Time to Market
§  Always available resources to continue work
§  No waiting for backend or 3rd party resources needed
§  Speed Software Development Lifecycle by up to 50%
© 2017 CA. Confidential. All rights reserved.
Service Virtualization: How Does it Work?
Evaluate data and protocols
Convert into live-like model
“Make it easy” for developers
Consistent interface across
supported protocols
CAPTURE PROCESS MODEL
Record traffic between existing
systems
Create from engineering specs
Draw from sources such as log
files, sample data, packet
capture, and CA APIM Gateway
Living, breathing, “live” model
Sophisticated, contextual
behavior
Automatic handling for dynamic
properties
“Any sufficiently advanced technology is indistinguishable from magic.”
- Arthur C. Clarke
12
Thank You.

Weitere ähnliche Inhalte

Was ist angesagt?

Testing as a Managed Service using SLAs and KPIs
Testing as a Managed Service using SLAs and KPIsTesting as a Managed Service using SLAs and KPIs
Testing as a Managed Service using SLAs and KPIsProlifics
 
Implementing SRE practices: SLI/SLO deep dive - David Blank-Edelman - DevOpsD...
Implementing SRE practices: SLI/SLO deep dive - David Blank-Edelman - DevOpsD...Implementing SRE practices: SLI/SLO deep dive - David Blank-Edelman - DevOpsD...
Implementing SRE practices: SLI/SLO deep dive - David Blank-Edelman - DevOpsD...DevOpsDays Tel Aviv
 
Building a CICD pipeline for deploying to containers
Building a CICD pipeline for deploying to containersBuilding a CICD pipeline for deploying to containers
Building a CICD pipeline for deploying to containersAmazon Web Services
 
Benefits of integration with the Mulesoft Anypoint Platform
Benefits of integration with the Mulesoft Anypoint PlatformBenefits of integration with the Mulesoft Anypoint Platform
Benefits of integration with the Mulesoft Anypoint PlatformCloud Analogy
 
Managed Test Services - Maveric Systems
Managed Test Services - Maveric SystemsManaged Test Services - Maveric Systems
Managed Test Services - Maveric SystemsMaveric Systems
 
Ch 1-Non-functional Requirements.ppt
Ch 1-Non-functional Requirements.pptCh 1-Non-functional Requirements.ppt
Ch 1-Non-functional Requirements.pptbalewayalew
 
DevOps Maturity Curve v5
DevOps Maturity Curve v5DevOps Maturity Curve v5
DevOps Maturity Curve v5Paul Peissner
 
Non Functional Requirement.
Non Functional Requirement.Non Functional Requirement.
Non Functional Requirement.Khushboo Shaukat
 
SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...
SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...
SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...Tori Wieldt
 
Integrating Automated Testing into DevOps
Integrating Automated Testing into DevOpsIntegrating Automated Testing into DevOps
Integrating Automated Testing into DevOpsTechWell
 
Chaos Engineering - The Art of Breaking Things in Production
Chaos Engineering - The Art of Breaking Things in ProductionChaos Engineering - The Art of Breaking Things in Production
Chaos Engineering - The Art of Breaking Things in ProductionKeet Sugathadasa
 
Gap Assessment for DevOps
Gap Assessment   for DevOpsGap Assessment   for DevOps
Gap Assessment for DevOpsMarc Hornbeek
 
Incident Management in the Age of DevOps and SRE
Incident Management in the Age of DevOps and SRE Incident Management in the Age of DevOps and SRE
Incident Management in the Age of DevOps and SRE Rundeck
 
Site Reliability Engineering: An Enterprise Adoption Story (an ITSM Academy W...
Site Reliability Engineering: An Enterprise Adoption Story (an ITSM Academy W...Site Reliability Engineering: An Enterprise Adoption Story (an ITSM Academy W...
Site Reliability Engineering: An Enterprise Adoption Story (an ITSM Academy W...ITSM Academy, Inc.
 
MuleSoft Surat Meetup#54 - MuleSoft Automation
MuleSoft Surat Meetup#54 - MuleSoft AutomationMuleSoft Surat Meetup#54 - MuleSoft Automation
MuleSoft Surat Meetup#54 - MuleSoft AutomationJitendra Bafna
 

Was ist angesagt? (20)

Testing as a Managed Service using SLAs and KPIs
Testing as a Managed Service using SLAs and KPIsTesting as a Managed Service using SLAs and KPIs
Testing as a Managed Service using SLAs and KPIs
 
Implementing SRE practices: SLI/SLO deep dive - David Blank-Edelman - DevOpsD...
Implementing SRE practices: SLI/SLO deep dive - David Blank-Edelman - DevOpsD...Implementing SRE practices: SLI/SLO deep dive - David Blank-Edelman - DevOpsD...
Implementing SRE practices: SLI/SLO deep dive - David Blank-Edelman - DevOpsD...
 
Building a CICD pipeline for deploying to containers
Building a CICD pipeline for deploying to containersBuilding a CICD pipeline for deploying to containers
Building a CICD pipeline for deploying to containers
 
Benefits of integration with the Mulesoft Anypoint Platform
Benefits of integration with the Mulesoft Anypoint PlatformBenefits of integration with the Mulesoft Anypoint Platform
Benefits of integration with the Mulesoft Anypoint Platform
 
Managed Test Services - Maveric Systems
Managed Test Services - Maveric SystemsManaged Test Services - Maveric Systems
Managed Test Services - Maveric Systems
 
Ch 1-Non-functional Requirements.ppt
Ch 1-Non-functional Requirements.pptCh 1-Non-functional Requirements.ppt
Ch 1-Non-functional Requirements.ppt
 
DevOps Maturity Curve v5
DevOps Maturity Curve v5DevOps Maturity Curve v5
DevOps Maturity Curve v5
 
Introduction to Chaos Engineering
Introduction to Chaos EngineeringIntroduction to Chaos Engineering
Introduction to Chaos Engineering
 
Non Functional Requirement.
Non Functional Requirement.Non Functional Requirement.
Non Functional Requirement.
 
SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...
SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...
SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...
 
Integrating Automated Testing into DevOps
Integrating Automated Testing into DevOpsIntegrating Automated Testing into DevOps
Integrating Automated Testing into DevOps
 
Chaos Engineering - The Art of Breaking Things in Production
Chaos Engineering - The Art of Breaking Things in ProductionChaos Engineering - The Art of Breaking Things in Production
Chaos Engineering - The Art of Breaking Things in Production
 
QA Center Of Excellence (TCoE)
QA Center Of Excellence (TCoE)QA Center Of Excellence (TCoE)
QA Center Of Excellence (TCoE)
 
Gap Assessment for DevOps
Gap Assessment   for DevOpsGap Assessment   for DevOps
Gap Assessment for DevOps
 
DevOps explained
DevOps explainedDevOps explained
DevOps explained
 
Incident Management in the Age of DevOps and SRE
Incident Management in the Age of DevOps and SRE Incident Management in the Age of DevOps and SRE
Incident Management in the Age of DevOps and SRE
 
Industrialization of testing
Industrialization of testing Industrialization of testing
Industrialization of testing
 
Site Reliability Engineering: An Enterprise Adoption Story (an ITSM Academy W...
Site Reliability Engineering: An Enterprise Adoption Story (an ITSM Academy W...Site Reliability Engineering: An Enterprise Adoption Story (an ITSM Academy W...
Site Reliability Engineering: An Enterprise Adoption Story (an ITSM Academy W...
 
Testing Centre Of Excellence From AppLabs
Testing Centre Of Excellence From AppLabsTesting Centre Of Excellence From AppLabs
Testing Centre Of Excellence From AppLabs
 
MuleSoft Surat Meetup#54 - MuleSoft Automation
MuleSoft Surat Meetup#54 - MuleSoft AutomationMuleSoft Surat Meetup#54 - MuleSoft Automation
MuleSoft Surat Meetup#54 - MuleSoft Automation
 

Ähnlich wie Service Virtualization: What, Who, When, and How

SV Training Intro - 20181129 4.pptx
SV Training Intro - 20181129 4.pptxSV Training Intro - 20181129 4.pptx
SV Training Intro - 20181129 4.pptxCAIKYPALLETAMOURALIM
 
CWIN17 london delivering devops and release automation in fs - duncan bradf...
CWIN17 london   delivering devops and release automation in fs - duncan bradf...CWIN17 london   delivering devops and release automation in fs - duncan bradf...
CWIN17 london delivering devops and release automation in fs - duncan bradf...Capgemini
 
TELUS Implements End-to-End Testing to Ensure Customer First Strategy and Cus...
TELUS Implements End-to-End Testing to Ensure Customer First Strategy and Cus...TELUS Implements End-to-End Testing to Ensure Customer First Strategy and Cus...
TELUS Implements End-to-End Testing to Ensure Customer First Strategy and Cus...CA Technologies
 
Continuous Testing through Service Virtualization
Continuous Testing through Service VirtualizationContinuous Testing through Service Virtualization
Continuous Testing through Service VirtualizationTechWell
 
Service Virtualization: What Testers Need to Know
Service Virtualization: What Testers Need to KnowService Virtualization: What Testers Need to Know
Service Virtualization: What Testers Need to KnowTechWell
 
Continuous Testing through Service Virtualization
Continuous Testing through Service VirtualizationContinuous Testing through Service Virtualization
Continuous Testing through Service VirtualizationTechWell
 
Accelerated Quality with CA Technologies Testing Solutions
Accelerated Quality with CA Technologies Testing SolutionsAccelerated Quality with CA Technologies Testing Solutions
Accelerated Quality with CA Technologies Testing SolutionsCA Technologies
 
Develop an Enterprise-wide Cloud Adoption Strategy – Chris Merrigan
Develop an Enterprise-wide Cloud Adoption Strategy – Chris MerriganDevelop an Enterprise-wide Cloud Adoption Strategy – Chris Merrigan
Develop an Enterprise-wide Cloud Adoption Strategy – Chris MerriganAmazon Web Services
 
Curiosity Software, Infuse and Kumoco present: The Democratisation of Testing
Curiosity Software, Infuse and Kumoco present: The Democratisation of TestingCuriosity Software, Infuse and Kumoco present: The Democratisation of Testing
Curiosity Software, Infuse and Kumoco present: The Democratisation of TestingCuriosity Software Ireland
 
How To Sell Into Insurance with Perfecto
How To Sell Into Insurance with PerfectoHow To Sell Into Insurance with Perfecto
How To Sell Into Insurance with PerfectoLizzy Guido (she/her)
 
Microservices Testing Strategies: The Good, the Bad, and the Reality
Microservices Testing Strategies: The Good, the Bad, and the RealityMicroservices Testing Strategies: The Good, the Bad, and the Reality
Microservices Testing Strategies: The Good, the Bad, and the RealityTechWell
 
Test Automation: Investment Today Pays Back Tomorrow
Test Automation: Investment Today Pays Back TomorrowTest Automation: Investment Today Pays Back Tomorrow
Test Automation: Investment Today Pays Back TomorrowTechWell
 
Devops transformation in the Rational Collaborative Lifecycle Organization
Devops transformation in the Rational Collaborative Lifecycle OrganizationDevops transformation in the Rational Collaborative Lifecycle Organization
Devops transformation in the Rational Collaborative Lifecycle OrganizationRobbie Minshall
 
Laurie Henderson Seaton Software QA Tester Current
Laurie Henderson Seaton Software QA Tester CurrentLaurie Henderson Seaton Software QA Tester Current
Laurie Henderson Seaton Software QA Tester CurrentLaurie Seaton
 
Quality at the speed of digital
Quality   at the speed of digitalQuality   at the speed of digital
Quality at the speed of digitalrajni singh
 
Continuous Integration and Continuous Delivery to Facilitate Web Service Testing
Continuous Integration and Continuous Delivery to Facilitate Web Service TestingContinuous Integration and Continuous Delivery to Facilitate Web Service Testing
Continuous Integration and Continuous Delivery to Facilitate Web Service TestingCognizant
 
Test Data Management and Its Role in DevOps
Test Data Management and Its Role in DevOpsTest Data Management and Its Role in DevOps
Test Data Management and Its Role in DevOpsTechWell
 

Ähnlich wie Service Virtualization: What, Who, When, and How (20)

SV Training Intro - 20181129 4.pptx
SV Training Intro - 20181129 4.pptxSV Training Intro - 20181129 4.pptx
SV Training Intro - 20181129 4.pptx
 
CWIN17 london delivering devops and release automation in fs - duncan bradf...
CWIN17 london   delivering devops and release automation in fs - duncan bradf...CWIN17 london   delivering devops and release automation in fs - duncan bradf...
CWIN17 london delivering devops and release automation in fs - duncan bradf...
 
TELUS Implements End-to-End Testing to Ensure Customer First Strategy and Cus...
TELUS Implements End-to-End Testing to Ensure Customer First Strategy and Cus...TELUS Implements End-to-End Testing to Ensure Customer First Strategy and Cus...
TELUS Implements End-to-End Testing to Ensure Customer First Strategy and Cus...
 
Continuous Testing through Service Virtualization
Continuous Testing through Service VirtualizationContinuous Testing through Service Virtualization
Continuous Testing through Service Virtualization
 
Service Virtualization: What Testers Need to Know
Service Virtualization: What Testers Need to KnowService Virtualization: What Testers Need to Know
Service Virtualization: What Testers Need to Know
 
Continuous Testing through Service Virtualization
Continuous Testing through Service VirtualizationContinuous Testing through Service Virtualization
Continuous Testing through Service Virtualization
 
Accelerated Quality with CA Technologies Testing Solutions
Accelerated Quality with CA Technologies Testing SolutionsAccelerated Quality with CA Technologies Testing Solutions
Accelerated Quality with CA Technologies Testing Solutions
 
CLOUD TESTING MODEL – BENEFITS, LIMITATIONS AND CHALLENGES
CLOUD TESTING MODEL – BENEFITS, LIMITATIONS AND CHALLENGESCLOUD TESTING MODEL – BENEFITS, LIMITATIONS AND CHALLENGES
CLOUD TESTING MODEL – BENEFITS, LIMITATIONS AND CHALLENGES
 
Develop an Enterprise-wide Cloud Adoption Strategy – Chris Merrigan
Develop an Enterprise-wide Cloud Adoption Strategy – Chris MerriganDevelop an Enterprise-wide Cloud Adoption Strategy – Chris Merrigan
Develop an Enterprise-wide Cloud Adoption Strategy – Chris Merrigan
 
Curiosity Software, Infuse and Kumoco present: The Democratisation of Testing
Curiosity Software, Infuse and Kumoco present: The Democratisation of TestingCuriosity Software, Infuse and Kumoco present: The Democratisation of Testing
Curiosity Software, Infuse and Kumoco present: The Democratisation of Testing
 
How To Sell Into Insurance with Perfecto
How To Sell Into Insurance with PerfectoHow To Sell Into Insurance with Perfecto
How To Sell Into Insurance with Perfecto
 
Microservices Testing Strategies: The Good, the Bad, and the Reality
Microservices Testing Strategies: The Good, the Bad, and the RealityMicroservices Testing Strategies: The Good, the Bad, and the Reality
Microservices Testing Strategies: The Good, the Bad, and the Reality
 
Test Automation: Investment Today Pays Back Tomorrow
Test Automation: Investment Today Pays Back TomorrowTest Automation: Investment Today Pays Back Tomorrow
Test Automation: Investment Today Pays Back Tomorrow
 
Devops transformation in the Rational Collaborative Lifecycle Organization
Devops transformation in the Rational Collaborative Lifecycle OrganizationDevops transformation in the Rational Collaborative Lifecycle Organization
Devops transformation in the Rational Collaborative Lifecycle Organization
 
Laurie Henderson Seaton Software QA Tester Current
Laurie Henderson Seaton Software QA Tester CurrentLaurie Henderson Seaton Software QA Tester Current
Laurie Henderson Seaton Software QA Tester Current
 
Microservices
MicroservicesMicroservices
Microservices
 
Quality at the speed of digital
Quality   at the speed of digitalQuality   at the speed of digital
Quality at the speed of digital
 
Ta3s - Testing Banking and Finance Applications
Ta3s - Testing Banking and Finance ApplicationsTa3s - Testing Banking and Finance Applications
Ta3s - Testing Banking and Finance Applications
 
Continuous Integration and Continuous Delivery to Facilitate Web Service Testing
Continuous Integration and Continuous Delivery to Facilitate Web Service TestingContinuous Integration and Continuous Delivery to Facilitate Web Service Testing
Continuous Integration and Continuous Delivery to Facilitate Web Service Testing
 
Test Data Management and Its Role in DevOps
Test Data Management and Its Role in DevOpsTest Data Management and Its Role in DevOps
Test Data Management and Its Role in DevOps
 

Mehr von TechWell

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and RecoveringTechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization TechWell
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTechWell
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartTechWell
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyTechWell
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTechWell
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowTechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityTechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyTechWell
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTechWell
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipTechWell
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsTechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GameTechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsTechWell
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationTechWell
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessTechWell
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateTechWell
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessTechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTechWell
 

Mehr von TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 

Kürzlich hochgeladen

%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...masabamasaba
 
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...Jittipong Loespradit
 
WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...
WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...
WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...WSO2
 
WSO2CON 2024 Slides - Open Source to SaaS
WSO2CON 2024 Slides - Open Source to SaaSWSO2CON 2024 Slides - Open Source to SaaS
WSO2CON 2024 Slides - Open Source to SaaSWSO2
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...Health
 
What Goes Wrong with Language Definitions and How to Improve the Situation
What Goes Wrong with Language Definitions and How to Improve the SituationWhat Goes Wrong with Language Definitions and How to Improve the Situation
What Goes Wrong with Language Definitions and How to Improve the SituationJuha-Pekka Tolvanen
 
WSO2CON2024 - It's time to go Platformless
WSO2CON2024 - It's time to go PlatformlessWSO2CON2024 - It's time to go Platformless
WSO2CON2024 - It's time to go PlatformlessWSO2
 
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfonteinmasabamasaba
 
Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...
Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...
Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...Bert Jan Schrijver
 
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...masabamasaba
 
%in Benoni+277-882-255-28 abortion pills for sale in Benoni
%in Benoni+277-882-255-28 abortion pills for sale in Benoni%in Benoni+277-882-255-28 abortion pills for sale in Benoni
%in Benoni+277-882-255-28 abortion pills for sale in Benonimasabamasaba
 
Announcing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK SoftwareAnnouncing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK SoftwareJim McKeeth
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisamasabamasaba
 
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...SelfMade bd
 
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...masabamasaba
 
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
Direct Style Effect Systems -The Print[A] Example- A Comprehension AidDirect Style Effect Systems -The Print[A] Example- A Comprehension Aid
Direct Style Effect Systems - The Print[A] Example - A Comprehension AidPhilip Schwarz
 
%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrandmasabamasaba
 
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...WSO2
 
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2
 
WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open Source
WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open SourceWSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open Source
WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open SourceWSO2
 

Kürzlich hochgeladen (20)

%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
 
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
 
WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...
WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...
WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...
 
WSO2CON 2024 Slides - Open Source to SaaS
WSO2CON 2024 Slides - Open Source to SaaSWSO2CON 2024 Slides - Open Source to SaaS
WSO2CON 2024 Slides - Open Source to SaaS
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 
What Goes Wrong with Language Definitions and How to Improve the Situation
What Goes Wrong with Language Definitions and How to Improve the SituationWhat Goes Wrong with Language Definitions and How to Improve the Situation
What Goes Wrong with Language Definitions and How to Improve the Situation
 
WSO2CON2024 - It's time to go Platformless
WSO2CON2024 - It's time to go PlatformlessWSO2CON2024 - It's time to go Platformless
WSO2CON2024 - It's time to go Platformless
 
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
 
Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...
Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...
Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...
 
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
 
%in Benoni+277-882-255-28 abortion pills for sale in Benoni
%in Benoni+277-882-255-28 abortion pills for sale in Benoni%in Benoni+277-882-255-28 abortion pills for sale in Benoni
%in Benoni+277-882-255-28 abortion pills for sale in Benoni
 
Announcing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK SoftwareAnnouncing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK Software
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
 
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
 
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
 
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
Direct Style Effect Systems -The Print[A] Example- A Comprehension AidDirect Style Effect Systems -The Print[A] Example- A Comprehension Aid
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
 
%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand
 
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
 
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
 
WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open Source
WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open SourceWSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open Source
WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open Source
 

Service Virtualization: What, Who, When, and How

  • 1.           W8   Test  Techniques   10/4/17  13:45           Service  Virtualization:  What,  Who,   When,  and  How     Presented  by:     Kenneth  Merkel    CA  Technologies     Brought  to  you  by:                   350  Corporate  Way,  Suite  400,  Orange  Park,  FL  32073     888-­‐-­‐-­‐268-­‐-­‐-­‐8770  ·∙·∙  904-­‐-­‐-­‐278-­‐-­‐-­‐0524  -­‐  info@techwell.com  -­‐  http://www.starwest.techwell.com/              
  • 2.   Kenneth  Merkel   CA  Technologies     Kenneth  Merkel’s  twenty-­‐two  year  IT  career  has  covered  development,  test,  and   operations.  From  developing  in  the  telecommunications  industry  to  helping   customers  with  development  platforms,  testing  frameworks,  and  operations   platforms  for  monitoring  applications,  Kenneth  has  spanned  the  entire  SDLC.  For   the  past  seven  years  Kenneth  has  focused  on  service  virtualization  at  both  iTKO   and  now  CA  following  the  acquisition.  Kenneth  has  been  addressing  customers  in   multiple  industries  about  the  need  for  service  virtualization,  which  he  views  as   the  cornerstone  for  continuous  delivery  and  continuous  testing.  Kenneth  enjoys   spending  time  with  his  wife  and  four-­‐year-­‐old  daughter—with  an  occasional   round  of  golf  thrown  in.    
  • 3. 1 The What, Why, Who and How of Service Virtualization October 2017 Removing Constraints for Continuous Testing © 2017 CA. Confidential. All rights reserved. About Me! •  21 year IT career –  development, test, and operations. •  Past 7 years focused on Service Virtualization •  Addressing customers in multiple industries about the need for service virtualization –  The cornerstone for continuous delivery and continuous testing. •  Fun = time with wife + 4 Yr. old daughter ~ occasional round of golf
  • 4. 2 © 2017 CA. Confidential. All rights reserved. About You… How many Developers? Integration vs. Performance…? How many Testers? © 2017 CA. Confidential. All rights reserved. Agenda WHAT IS SERVICE VIRTUALIZATION? WHY DO I NEED SERVICE VIRTUALIZATION? WHO BENEFITS FROM SERVICE VIRTUALIZATION? HOW DO I BUILD VIRTUAL SERVICES? 1 2 3 4
  • 5. 3 Application Complexity •  Distributed System Progression •  Integration of Legacy/3rd Party Systems •  Agile Development Methods •  Continuous Testing •  Continuous Delivery What
  • 6. 4 © 2017 CA. Confidential. All rights reserved. Service Virtualization Key Benefits •  Provide testers and developers with access to “life-like” production systems •  Replicate production like dependencies for testing •  Mobile, Web, Middleware, Mainframe, 3rd Party Services and API’s •  Test components out of order •  Capture behavior data and performance characteristics of composite applications •  Avoid manual repetitive development and management of wrappers, stubs & mocks •  Eliminate false failures •  Test earlier and reduce the amount of rework that has to be done in production Wikipedia - Service virtualization emulates the behavior of software components to remove dependency constraints on development and testing teams. Service virtualization extends across all aspects of composite applications: services, APIs, databases, mainframes, ESBs, and other components that communicate using common messaging protocols. © 2017 CA. Confidential. All rights reserved. Service Virtualization Basics TAKEAWAY §  Service Virtualization Improves –  Environment Availability –  Load and Performance Testing –  Data and Test Scenario Management –  Delivery Schedules MESSAGE §  Service Virtualization removes constraints by simulating constrained or unavailable systems. Development and test teams are able to work in a constraint-free environments and experience significant gains in efficiency §  Service Virtualization creates an accurate rendering of dependent systems allowing developments team to find and resolve defects earlier in the SDLC, saving time and money. METRICS §  25-50% reduction in application development schedule §  60-90% more defects detected at least one step earlier in the software development lifecycle §  Customers have saved millions of dollars, in development and test lab hardware, software, maintenance, and 3rd party access fees
  • 7. 5 © 2017 CA. Confidential. All rights reserved. What’s the Difference Between Stubs, Mocks, and Service Virtualization? © 2017 CA. Confidential. All rights reserved. Service Virtualization Destroys Stubs and Mocks Critical Dev./Test Feature Service Virtualization Stubs and Mocks Reduce dependencies and constraints in application development Automated creation of simulated system Rich test data for comprehensive testing early in SDLC Share virtual services across entire development team—not trapped in a single sandbox Know that your code will scale in production Changes to any dependent systems (mainframe, ERP, middleware, 3rd party) are automatically synced…teams focus on building solutions vs. maintenance Wizard-based UI for use by all team members regardless of coding skill
  • 8. 6 Why © 2017 CA. Confidential. All rights reserved. Service Virtualization: Why It’s Needed “I can’t do anything until I have everything … and I never have everything!” Data Constraints System Constraints Cost Constraints Development Constraints Bottlenecks Everywhere ESB of teams experience delays in development and QA due to unavailable dependencies* Over 80% 79% of teams face prohibitive restrictions, time limits or access fees on needed 3rd party services* *Source: voke Market Snapshot TM Report: ServiceVirtualization  – January 2015 AccesstoTest Environments/ BrittleStubs& Mocks Developers Deadlocked
  • 9. 7 © 2017 CA. Confidential. All rights reserved. 7 Common Service Virtualization Use Cases Training Environments Create complete and comprehensive virtual training environments “Business In a Box” Use SV for Integration constraints 3rd Party APIs Use SV to remove access and cost constraints. Mainframe Constraints Eliminate mainframe constraints for both distributed and mainframe development Negative Scenarios Use SV to enable Negative Scenario Testing Performance Constraints Stress test applications components using virtual services Time Constraints Use SV to “Shift-Left” your SDLC, customers have shown 25%-50% faster © 2017 CA. Confidential. All rights reserved. EMA – DevOps/CD Tooling Survey Of the following application delivery-related practices and capabilities, please indicate the top 3 that are most important to your company's Digital Business? Enterprise Management Associates - Analyst Deck – April 2017 32% 30% 28% 26% 25% 25% 24% 24% 20% 19% 18% DevOps Integrations unifying and/or sharing data in existing mgt. tools across stages of the app lifecycle Continuous Delivery of new code and features into production Integrations capable of unifying and/or sharing data during production Process and/or workflow automation Deployment automation Agile Development Automated Application Performance Management (APM) tools supporting production applications Continuous delivery-related productivity metrics Development-related productivity metrics Structured, predictable Release Management processes
  • 10. 8 © 2017 CA. Confidential. All rights reserved. Distributed Teams •  Remove constraints with virtual services •  Test components out of order •  Capture behavior data and performance characteristics of composite applications •  Avoid manual repetitive development of stubs or mockups •  Mobile, Web, Middleware, Mainframe, 3rd Party Services and API’s Virtual Services Components Set-Up Test Environment Test Data Systems and Services Integration Testing Create test environments that exactly replicate production infrastructure. •  Cut integration time from three days to three hours •  Avoided $300,000 in test hardware and software costs •  Decreased software defects by 25 percent hours AutoTrader STABILITY “CA Service Virtualization gives us a more stable and available environment for Testing” Increase availability of testing platforms up to 90% Enable Agile Testing Sprints KPN Telecommunications Save $2.5 million in infrastructure Cut overall development cycle by 66% NordstromForrester TEI Study November 2015 © 2017 CA. Confidential. All rights reserved. ü  Use the same tests used for functional test ü  Virtual services for performance ü  Engineering ü  Simulate backend load ü  Outlier conditions ü  Mobile experience Establish IT as an Enabler of growth 1 x 500 throughput increase in testing Eliminate capacity constraints for performance testing Reduce delays with high-performance masking and sub-setting, and automated data discovery Nordstrom SPEED “CA Service Virtualization helps us bring better applications to market faster and establish our IT function as an enabler of business growth” •  Reduced performance testing time from 3 months to an average of 4 days •  Cut overall development cycle by 66% Application “X” BillMeLater PayPal TNT Express 3rd Party Service Current Testing Tools Thousands of transactions Test Data Performance Testing Innovate Faster while Delivering a High Quality Experience
  • 11. 9 © 2017 CA. Confidential. All rights reserved. New Innovation Paradigm “Shift-left” the SDLC Without SV WITH SV Dev1 Dev2 Dev3 System Test Integration Performance Test UAT System Dev 1 Dev 2 Dev 1 Dev 3 Dev 2 Dev 3 Integration Performance UAT… Uncertain delivery schedule – defects persist until UAT Typical composite app today waits for whole assembly to begin With Service Virtualization quality effort moved earlier in the lifecycle Reduction in SDLC Faster Delivery Accelerate Delivery Increase Quality Who
  • 12. 10 © 2017 CA. Confidential. All rights reserved. •  Enable Parallel Development •  Eliminate Mocking/ Stubbing •  Build True Release Candidate •  Reproduce Production Defects •  Minimize System Availability Wait Time DEVELOPERS •  Eliminate Wait Time •  Minimize Test Data Setup •  Eliminate Test Data Burn •  Negative Test Coverage •  Provide Stable Test Environment INTEGRATION TESTER •  Reduce Infrastructure Costs •  Eliminate Environment Sharing •  Improved Scalability •  Reduce Transaction Costs PERFORMANCE TESTER Who Benefits from Service Virtualization How
  • 13. 11 © 2017 CA. Confidential. All rights reserved. Service Virtualization Having Everything you need, when you need them. Front End Back End Internet of Things Mobile SaaS/Cloud Partner Ecosystems External Developers Secure Environments Applications ERP/SAP Mainframe 3rd Party/APIs Orchestration Layer Performance Testing §  Provide end-to-end security for apps, mobile, and IoT §  Control access with SSO and identity management §  Protect against threads and OWASP vulnerabilities Integration Testing §  Remove constraints with virtual services §  Avoid manual repetitive development of stubs/mocks §  Simulate web services, Middleware, 3rd Party, APIs, or Mainframe Better Quality §  Test sooner and more often §  Increase test coverage and negative testing capabilities §  Find up to 90% more defects at least one cycle earlier Faster Time to Market §  Always available resources to continue work §  No waiting for backend or 3rd party resources needed §  Speed Software Development Lifecycle by up to 50% © 2017 CA. Confidential. All rights reserved. Service Virtualization: How Does it Work? Evaluate data and protocols Convert into live-like model “Make it easy” for developers Consistent interface across supported protocols CAPTURE PROCESS MODEL Record traffic between existing systems Create from engineering specs Draw from sources such as log files, sample data, packet capture, and CA APIM Gateway Living, breathing, “live” model Sophisticated, contextual behavior Automatic handling for dynamic properties “Any sufficiently advanced technology is indistinguishable from magic.” - Arthur C. Clarke