This document outlines a webinar presentation on performance testing. It discusses how performance testing needs to change to keep up with trends like increased application development, continuous delivery, and more demanding users. Traditional approaches using siloed teams and infrequent testing are outdated. The presentation provides tips on breaking the status quo by increasing test frequency, embracing mobile applications, and integrating performance testing into agile development teams throughout the software lifecycle. Distributed, collaborative performance testing driven by real user data is presented as the new modern approach.

1. April 16, 2015 1© 2015 SOASTA. All rights reserved.
Webinar

2. April 16, 2015 2© 2015 SOASTA. All rights reserved.
Today’s Presenters
Mark Tomlinson
Independent
Performance Coach
F1000 Companies
Microsoft
HP (former LoadRunner PM)
Brad Johnson
Performance Product
“Lifer”
SOASTA
Borland
Mercury Interactive
Compuware

3. April 16, 2015 3© 2015 SOASTA. All rights reserved.

4. April 16, 2015 4© 2015 SOASTA. All rights reserved.
Agenda
Changes are upon us
1. Breaking the Status Quo
2. Apps are Eating the World
3. What about the Center of Excellence?

5. User ExpectationsUnpredictable Demand
Continuous DeliveryMultiple Devices
P
Performance Is Complicated
Speed
Quality

6. April 16, 2015 6© 2015 SOASTA. All rights reserved.
Models are inaccurate

7. April 16, 2015 7© 2015 SOASTA. All rights reserved.
Models are inaccurate
Silos are not agile

8. April 16, 2015 8© 2015 SOASTA. All rights reserved.
Models are inaccurate
Silos are not agile
Production scale tests are
rare

9. April 16, 2015 9© 2015 SOASTA. All rights reserved.
RetestTest Development Infra setup RepeatFix
Tes
t
Analyze
TIME
Breaking the Status Quo
The Legacy Approach

10. April 16, 2015 10© 2015 SOASTA. All rights reserved.
Breaking the Status Quo
Everything has changed…
o Real user data-driven test specifications
o Collaborative teams are displacing specialist teams
o Increased test frequency

11. April 16, 2015 11© 2015 SOASTA. All rights reserved.
Breaking the Status Quo
Everything has changed…
o Real user data-driven test specifications
o Collaborative teams are displacing specialist teams

12. April 16, 2015 12© 2015 SOASTA. All rights reserved.
o Real user data-driven test specifications
o Collaborative teams are displacing specialist teams
o Increased test frequency
Breaking the Status Quo
Everything has changed…

13. April 16, 2015 13© 2015 SOASTA. All rights reserved.
Tips for Breaking the Status Quo
Taking your first steps into a larger world…
o Calculate the ROI of increased feedback on performance
o Calculate the KPI trends on repeated release candidates
o Invade the sprint planning and add performance to the stories
o Replace your test plans with continuous feedback from APM

14. April 16, 2015 14© 2015 SOASTA. All rights reserved.
Apps are Eating the World
So What?
o Mobile is everywhere (obviously)

15. April 16, 2015 15© 2015 SOASTA. All rights reserved.
Apps are Eating the World
So What?
o Mobile is everywhere (obviously)
o Digital commerce & User Experience has changed Dev Cycles
o Competing is different

16. April 16, 2015 16© 2015 SOASTA. All rights reserved.
Apps are Eating the World
So What?
o Mobile is everywhere (obviously)
o Digital commerce & User Experience has changed Dev Cycles
o Competing is different

17. April 16, 2015 17© 2015 SOASTA. All rights reserved.
Tips for the Explosion of Apps
Less is more…
o Investigate performance sooner & faster, in smaller scope
o Trust external dependencies, until proven otherwise
o Know your competitors’ performance - leverage that knowledge
o Calculate your impact on time-to-market or project schedules

18. April 16, 2015 18© 2015 SOASTA. All rights reserved.
What About the Center of Excellence?
Agile meets a Silo

19. April 16, 2015 19© 2015 SOASTA. All rights reserved.
What About the Center of Excellence?
Agile meets a Silo
o Stop being a bottleneck

20. April 16, 2015 20© 2015 SOASTA. All rights reserved.
What About the Center of Excellence?
Agile meets a Silo
o Stop being a bottleneck
o Integrate to the continuous pace
o Add value with complete, integrated performance tests

21. April 16, 2015 21© 2015 SOASTA. All rights reserved.
What About the Center of Excellence?
Agile meets a Silo
o Stop being a bottleneck
o Integrate to the continuous pace
o Add value with complete, integrated performance tests

22. April 16, 2015 22© 2015 SOASTA. All rights reserved.
The Modern Approach
TIME
The Legacy Approach
Run more tests in less time.
Start earlier.
Cover more ground.repeat
/ Test
Analyz
e
Fix
Test Dev
Test Development Infra setup
Tes
t
Analyze Retest RepeatFix
Distributed Performance

23. April 16, 2015 23© 2015 SOASTA. All rights reserved.
Distributed Perforamance
Component
scalability
Performance
baseline
Integration testing
End to End
w/ Service
Virtualization
Unit scalability
Database testing
3rd party
services
Live E2E
tests
Stress
testing Soak test
(reliability)
Failover
Capacity
Latency
Performance
Regression
(smoke tests)
Network
Testing (staging) Operations (prod)Development (sandbox)
Define Tests with Real User Data

24. April 16, 2015 24© 2015 SOASTA. All rights reserved.
Tips for Distributed Excellence
Measure yourself by the impact on others…
o Find project champions - create institutionalized excellence there
o Start an inclusive, collaborative working group - not exclusive silo
o Integrate with open-source tools across the lifecycle - enable them
o Abandon the questionnaire - assign full-time facilitators

25. April 16, 2015 25© 2015 SOASTA. All rights reserved.
• Rapidly collect accurate test specifications
• Collaborate with all teams
• Integrate testing processes
• Try new approaches….

26. April 16, 2015 26© 2015 SOASTA. All rights reserved.
1. Break the Status Quo
2. Embrace the “App” culture of change
3. Reconsider centalized approches in an agile world

27. April 16, 2015 27© 2015 SOASTA. All rights reserved.
o Read up on Performance Engineering
o Try a free product
o Get certified for FREE (SOASTA University)
o Test Now and see!
NEW WHITEPAPER!
www.soasta.com