Visual Studio 2010 Ultimate lets you profile and stress test your application early and throughout its development lifecycle with realistically modeled simulated load. By integrating performance validations early into your applications, you can ensure that your solution copes with real-world demands and behaves in a predictable manner, effectively increasing overall software quality. In this session, we will learn the importance of performance and stress testing, as well as the capabilities of Visual Studio 2010 Ultimate to improve profiling and testing throughout the application lifecycle.

2. Improving Overall Software
Quality Through Profiling and
Performance Testing
Ervin Loh and Lai Ee
ALM Program Manager and ALM Engineer
K365Labs Sdn Bhd

4. Agenda
Load & Performance Testing with Visual Studio
Proven within Microsoft
External Success Stories
The Visual Studio Load & Performance Offering
The Visual Studio Load & Performance
Community

5. Visual Studio: Battle Hardened
Visual Studio is
the de facto load
testing tool
within Microsoft
Scales to massive
loads
Handles the most
complex
scenarios

6. Load Test Internal Success Stories
Team Test Target Description
Office Server Office SharePoint Perf and stress testing of Office Server System
Windows SharePoint
Excel Server
SQL SQL Reporting Services Perf and Stress, benchmarking, sizing
SQL BI
Dynamics AX Dynamics 4.0 Perf and Stress, benchmarking, sizing
MSN/Live Ad Center High volume perf and stress testing
Hot Mail
Virtual Earth Recent 12-hour production test:
Autos
March Madness
Total requests generated 3.63 Billion
Music Average requests/sec 84,248
More…
Groove Open Office Perf and Stress Testing
DevDiv Team Foundation Server Perf and Stress Test TFS
MSIT SAP Load Test SAP via Web Services
MSTV IPTV servers Huge tests to load test IPTV national rollout
MS CRM MS CRM Perf and Stress, benchmarking, sizing
Using Load Tests to validate IPTV pods
Microsoft.com Microsoft.com Perf and Stress Testing
Each services 100,000 customers
Dr Watson Log collection servers Perf andmajor telecoms are customers:
Many Stress Testing
Windows Update Patch download servers Perf andTel Italia, Bell Canada, more…
AT&T, Stress Testing

7. External Success Stories
Services Test Labs
Professional performance and stress testing services
Before: 100% on HP Load Runner and Borland Silk
Performer
After: 100% on VS, with many successful customer
engagements
Prefer VS over Load Runner and Silk Performer
Many others

8. Tailspin Toys

9. Agenda
Load & Performance Testing with Visual Studio
The Visual Studio Load & Performance Offering
Web Test Architecture & Feature Set
Load Test Architecture & Feature Set
The Visual Studio Load & Performance
Community

10. Web Performance Test Feature Set
Deep integration with Visual Studio
Web (HTTP) Tests
Data Collection
Performance Counter Sets capture key measurements
Test results stored in SQL for custom reporting
Performance Analysis
Correlate of server activity with performance measurements
Drill into error logs

11. Web Performance Test Recorder
Visual Studio Launches Internet Explorer
Visual Studio Internet Explorer
Recorder BHO
Browser events
Recorder Listener Record events
Browser Control
Browser Recorder
Merging Recorder Wininet Shim
Record events Wininet Recorder
Record events Wininet
Intercepts wininet calls

12. Web Test Recorder Plugin
Visual Studio Launches Internet Explorer
Internet Explorer
Visual Studio Recorder
BHO
Browser events
Record events
Browser
Browser Control
Merging Recorder
Recorder Wininet
Wininet Shim
Recorder Wininet
Record events
Intercept s wininet calls
Record events
Recorder Listener

13. Key Capabilities in 2010
Declarative branching and looping in a web performance test
Excel based performance reporting
Run UI tests as performance tests
Integration with data collectors
ASP.net profiler
Intellitrace™

14. Web Performance Tests

15. Visual Studio 2010 Load Test
Architecture
Visual Studio
Load agent web server
test controller
database server
Microsoft Test Manager 2010

16. Load/Stress Test Feature Set
Flexible Load Modeling
“Scenarios” for modeling different user groups
Goal-based, step, constant, and custom load
patterns
Model different browsers and networks
Duration-based and iteration based
Efficient Load Generation
“Unit” tests can be run under load

17. Key Capabilities in 2010
Virtual user activity chart
64-bit test execution
Driver level network emulation
Collect the full test result on error
Numerous enhancements to make creating
scripts easier
New extensibility points
… and more

18. Load Tests

19. Agenda
Load & Performance Testing with Visual Studio
The Visual Studio Load & Performance Offering
The Visual Studio Load & Performance
Community
Plugins, Extensibility
Forums, Blogs

20. Extensibility
Load test plugins
Many extensibility points in Web performance
tests
web test plugins
web test request plugins
web test recorder plugins
diagnostic data adapters (DDA) (a.k.a “data
collectors”)

21. Visual Studio Load & Performance
Community
Forums
http://social.msdn.microsoft.com/Forums/en-
US/vstswebtest/threads
Blogs
Blogs.msdn.com/edglas
Blogs.msdn.com/billbar
Blogs.msdn.com/slumley
http://blogs.msdn.com/edglas/pages/content-
index-for-web-tests-and-load-tests.aspx

22. Visual Studio Load & Performance
Community
CodePlex
Quick Reference Guide
WCF Load Test Recorder
SQL Load Test Recorder
Load Test Reports
Web and Load Test Plugins
SharePoint Scripts
continue….

23. How Do I Get It?

24. Questions & Answers

25. Resources
Getting Started with Load and Web Performance Test Walkthroughs
http://msdn.microsoft.com/en-us/library/ee923685.aspx
Web Performance Test Walkthroughs
http://msdn.microsoft.com/en-us/library/aa337591.aspx
Load Test Walkthroughs
http://msdn.microsoft.com/en-us/library/ff406963.aspx
Walkthrough: Using a Test Controller and Test Agents in a Load Test
http://msdn.microsoft.com/en-us/library/ff400223.aspx

26. We value your feedback!
Please remember to complete the
overall conference evaluation form and
return it to the Registration Counter.