Performance testing and optimization are often neglected parts of enterprise application roll out and upgrade initiatives. The challenge for many IT managers is communicating the value of IT performance projects to business stakeholders who would benefit the most. An interactive discussion with Walter Kuketz, CTO of Collaborative Consulting where he shares: - How to align key business drivers with your performance engineering projects - Ways to bridge the IT-business stakeholder communication gap - A new approach to model business transactions and their IT dependencies Host: Frank Days Title: VP of Marketing, Correlsense

1. Show Me the Money: Connecting Performance Engineering to Real Business Results Walter Kuketz Collaborative Consulting Frank Days Correlsense

2. Speakers Featured speaker: Walter Kuketz Senior Vice President and CTO Collaborative Consulting Your host: Frank Days VP, Marketing Correlsense 2

3. Housekeeping Presentation will last around 30 minutes Followed by Q&A Slides will be available tomorrow real-user-monitoring.com Enjoy! 3

4. Agenda Performance engineering challenges Aligning PE to business initiatives Improve IT and business communication New approach to model business transactions

6. Distributed Infrastructure

8. Architecture and Development

10. Third party services

11. SaaS products

14. Training and career paths

15. Constant cost and budget pressure

16. Maintaining a meaningful performance lab (production-like)

17. User populations are exploding

18. Web site performance directly impacts revenue

19. Release schedules, monthly, quarterly

21. Sharing information across the organization Start Here Business goals, SLA’s Productions Operations monitoring Enterprise Architecture SDLC design & build Performance Engineering & testing

22. Connecting PE to business value Indirect expenses Website Conversion rate & fast website response time Hourly cost of a website outage Defer hardware upgrades or purchase New product or technology evaluation for NFR’s & learning investment Design and build to support SLA’s Methodology has PE tasks and activities SDLC Will it work with the new business volumes Scalability, stability, performance Manage risk Manage costs, efficiency Costs per business transaction Costs Improve web site conversion rates Proactively monitor real user experience Website Key part of managing SaaS and cloud No longer your infrastructure Vendors

23. Connecting PE to business value Indirect expenses Website Conversion rate & fast website response time Hourly cost of a website outage Defer hardware upgrades or purchase New product or technology evaluation for NFR’s & learning investment Conversation rate: 10% Average order amount: $55.00 Web site visitors: 5,000/hr Event duration: 24 hrs.

24. Connecting PE to business value Indirect expenses Website Conversion rate & fast website response time Hourly cost of a website outage Defer hardware upgrades or purchase New product or technology evaluation for NFR’s & learning investment Outage cost of $250,000/hour $3 Million per 12 hour day What is the busiest hour during the day? Average revenue per day & peak revenue per day

25. Connecting PE to business value Indirect expenses Website Conversion rate & fast website response time Hourly cost of a website outage Defer hardware upgrades or purchase New product or technology evaluation for NFR’s & learning investment A constant workload, for a given system configuration Design and build more efficient applications for each release cycle Process the same workload with fewer computing resources Defer hardware upgrades, or purchases to another quarter

26. Connecting PE to business value Indirect expenses Website Conversion rate & fast website response time Hourly cost of a website outage Defer hardware upgrades or purchase New product or technology evaluation for NFR’s & learning investment Business is interested in the competitive value of a new product or technology Evaluate for non-functional requirements of performance, scalability, stability Use options based approach on product evaluations Use benchmarks, custom performance tests, etc

27. Budgets – people, environments, tools You must understand how budgeting decisions are made. Shared services IT Project based Business unit Enterprise level

29. Improve web site conversion rates, reduce the risk of being the last to know by proactive real user monitoring

30. Increase number of performance tests with in the testing windowReduce risk Training the team on new technologies and monitoring the market Increase options

31. Agenda Performance Engineering challenges Aligning PE to business initiatives Improve IT and business communication New approach to model business transactions

32. Alignment – talking with the business Why invest in a performance engineering team? Manage risk: stability, scalability (fear of the unknown) Reduce operational costs and production outages Increase efficiency: supporting same workload with fewer Resources & Additional spending Support business objective (growth), drive revenue Visibility: what are PE resources working on?

33. Alignment – talking with the business Know your audiences approach to investments and the significance of External focused applications vs. internal corporate Internal business units Cost focus External business units Revenue focus

35. New client for healthcare claims processing system (from 500,000/Day to 800,000)

36. Retail brokerage is expecting day trading volume to increase by 40%

37. And we need to handle more flash market events

38. Marketing driven events with limitsValue disciplines: Customer intimacy Operational excellence Innovation

40. Can handle that?

41. We have 750,000 customers in the database, and expect half of them to be interested in this.

42. Well, we ran a couple of tests with 1,500 to 2,000 virtual users with almost no think time and the system held, though the Database ran hot.

43. The max response time did increase well past the goal, but the average was still under six seconds.

44. We could only test half the TPS of what we think 375,000 users would do. Due to the environment be smaller than production.Where do you go from here??

46. Can handle that?

47. We have 750,000 customers in the database, and expect half of them to be interested in this.

48. We see risk to the event. We have successfully executed scalability tests for 175,000 users accessing the site, before their experience will be poor.

49. We have developed a few options to help us reduce the risk;

50. Option A – requires $250,000 to implement, did this business factor this into their ROI

51. Option B – requires impacting other applications during the event. Taking their computing resources

53. Transactions matter to the business people Business Service and workflow Application transaction response time Infrastructure Complete user experience Confirm Order Component view of utilization

54. Business transactions How do you make sure your customers have an outstanding experience on your web site? How do you make sure your internal users are having the right experience on their internal systems (workflow)?

59. Identify slow parts of the overall transactionMinimize disruptions

60. To Understand App Performance… … You must know the experience of your real users…not a robot…

61. Transaction Management for Performance Engineering

62. SharePath – The APM Innovator “SharePath rapidly generates detailed multitier models of an application's execution path in an almost entirely automated manner, making the technology very easy to deployand maintain, while capturing data at a high degree of granularity without having an impact on production performance.” Gartner, March 2010

65. Every hop, every transactionSERVER WEB APP SVR PROXY MQ/ESB CORBA LDAP DCOM Web Services The SharePath Product Family

66. Use SharePath RUM for Free http://www.real-user-monitoring.com

67. About Collaborative Consulting Business and technology consulting firm Clients across the United States Consulting services Business enablement Information management Technology enablement Program management 31

69. Experienced, pragmatic, and dedicated team

70. Integrated approach

71. Accelerators