Continuous Load Testing Inside and Out
- 1. © 2013 SOASTA CONFIDENTIAL - All rights reserved.
Continuous Load Testing Inside and Out
Complete load and
performance testing
from the lab to live
production
Webinar
- 2. © 2013 SOASTA CONFIDENTIAL - All rights reserved.
Load testing is a team sport
In This Webinar
TODAY’S SOASTA PRESENTERS
Connie Quach Mike Ostenberg
VP Product Management Dir. Solutions Engineering
Agenda:
• Performance testing as a continuous process
• Test types across the lifecycle
• CloudTest capabilities for Dev into Ops
Questions:
Submit in chat box during event
- 4. © 2013 SOASTA CONFIDENTIAL - All rights reserved.
Testing In General
Linear approaches include delays between testing
Ut
Unit Testing
Ft
Functional
Testing
Development Testing Operations
Pt
Performance
Testing
Mo
Monitoring
Legacy Approach: Silos and waiting
TIME
- 5. © 2013 SOASTA CONFIDENTIAL - All rights reserved.
Eliminating Delays Compresses Time
Enabling more testing to be done earlier and more often
Ut
Unit Testing
Ft
Functional
Testing
Testing
Pt
Performance
Testing
Mo
Monitoring
Legacy Approach: Silos and waiting
Agile Approach: Automation and Continuous Testing
OperationsDevelopment
Dev Ops
Testing
TIME
- 6. © 2013 SOASTA CONFIDENTIAL - All rights reserved.
Retest
Continuous Delivery presents new opportunities
Test Development Infra setup Repeat?FixTest Analyze
The Legacy Approach
TIME
Load Testing is Not a Singular Event
- 7. © 2013 SOASTA CONFIDENTIAL - All rights reserved.
Eliminate HW costs &
compress time-to-fix
with real time
analytics
/
TIME
The Legacy Approach
Test
Analyze
Fix
Test Dev
Load Testing is Not a Singular Event
Continuous Delivery presents new opportunities
Test Development Infra setup Test Analyze Retest
The SOASTA Approach
Fix Repeat?
- 8. © 2013 SOASTA CONFIDENTIAL - All rights reserved.
Continuous Delivery presents new opportunities
The SOASTA Approach
TIME
The Legacy Approach
Run more tests in less
time.
Start earlier.
Cover more ground.xn
/ Test
Analyze
Fix
Test Dev
Load Testing is Not a Singular Event
Test Development Infra setup Test Analyze Retest Repeat?Fix
- 9. © 2013 SOASTA CONFIDENTIAL - All rights reserved.
Load Testing with Specific Objectives
Tests at different stages deliver higher coverage
Component
scalability
Performance
baseline
Integration testing
End to End
w/ Service
Virtualization
Unit scalability
Database testing
3rd party
services
Live E2E
tests
Stress
testing Soak test
(reliability)
Failover
Capacity
Latency
Performance
Regression
(smoke tests)
Network
Testing (staging) Operations (prod)Development (sandbox)
- 10. © 2013 SOASTA CONFIDENTIAL - All rights reserved.
CloudTest from Lab to Production
Tests at different stages delivers higher coverage
API Testing
(REST/SOAP
& now
WebSockets)
Testing (staging) Operations (prod)Development (sandbox)
Run smoke
tests with
Continuous
Integration
frameworks
Run larger tests
sooner with
Virtual Private
Clouds
Introduce
external load
sources with
the cloud
Test to
beyond peak
expectations
Establish true
user SLA’s
(and monitor
them)
Directly test
your
databases
to scale
Newer capabilities
Test the “hard
to test”
(Java custom
modules)
- 11. © 2013 SOASTA CONFIDENTIAL - All rights reserved.
Mike Ostenberg
(Demonstration)
CloudTest from Dev to Ops
- 12. © 2013 SOASTA CONFIDENTIAL - All rights reserved.
Summary
✓ Load and performance testing spans delivery
✓ When you test more often, coverage increases and risk
decreases
✓ SOASTA CloudTest is built for today and the future
