Performance testing and optimization are often neglected parts of enterprise application roll out and upgrade initiatives.
The challenge for many IT managers is communicating the value of IT performance projects to business stakeholders who would benefit the most.
An interactive discussion with Walter Kuketz, CTO of Collaborative Consulting where he shares:
- How to align key business drivers with your performance engineering projects
- Ways to bridge the IT-business stakeholder communication gap
- A new approach to model business transactions and their IT dependencies
Host: Frank Days
Title: VP of Marketing, Correlsense
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
Show Me the Money: Connecting Performance Engineering to Real Business Results
1. Show Me the Money: Connecting Performance Engineering to Real Business Results Walter Kuketz Collaborative Consulting Frank Days Correlsense
2. Speakers Featured speaker: Walter Kuketz Senior Vice President and CTO Collaborative Consulting Your host: Frank Days VP, Marketing Correlsense 2
3. Housekeeping Presentation will last around 30 minutes Followed by Q&A Slides will be available tomorrow real-user-monitoring.com Enjoy! 3
4. Agenda Performance engineering challenges Aligning PE to business initiatives Improve IT and business communication New approach to model business transactions
21. Sharing information across the organization Start Here Business goals, SLA’s Productions Operations monitoring Enterprise Architecture SDLC design & build Performance Engineering & testing
22. Connecting PE to business value Indirect expenses Website Conversion rate & fast website response time Hourly cost of a website outage Defer hardware upgrades or purchase New product or technology evaluation for NFR’s & learning investment Design and build to support SLA’s Methodology has PE tasks and activities SDLC Will it work with the new business volumes Scalability, stability, performance Manage risk Manage costs, efficiency Costs per business transaction Costs Improve web site conversion rates Proactively monitor real user experience Website Key part of managing SaaS and cloud No longer your infrastructure Vendors
23. Connecting PE to business value Indirect expenses Website Conversion rate & fast website response time Hourly cost of a website outage Defer hardware upgrades or purchase New product or technology evaluation for NFR’s & learning investment Conversation rate: 10% Average order amount: $55.00 Web site visitors: 5,000/hr Event duration: 24 hrs.
24. Connecting PE to business value Indirect expenses Website Conversion rate & fast website response time Hourly cost of a website outage Defer hardware upgrades or purchase New product or technology evaluation for NFR’s & learning investment Outage cost of $250,000/hour $3 Million per 12 hour day What is the busiest hour during the day? Average revenue per day & peak revenue per day
25. Connecting PE to business value Indirect expenses Website Conversion rate & fast website response time Hourly cost of a website outage Defer hardware upgrades or purchase New product or technology evaluation for NFR’s & learning investment A constant workload, for a given system configuration Design and build more efficient applications for each release cycle Process the same workload with fewer computing resources Defer hardware upgrades, or purchases to another quarter
26. Connecting PE to business value Indirect expenses Website Conversion rate & fast website response time Hourly cost of a website outage Defer hardware upgrades or purchase New product or technology evaluation for NFR’s & learning investment Business is interested in the competitive value of a new product or technology Evaluate for non-functional requirements of performance, scalability, stability Use options based approach on product evaluations Use benchmarks, custom performance tests, etc
27. Budgets – people, environments, tools You must understand how budgeting decisions are made. Shared services IT Project based Business unit Enterprise level
28.
29. Improve web site conversion rates, reduce the risk of being the last to know by proactive real user monitoring
30. Increase number of performance tests with in the testing windowReduce risk Training the team on new technologies and monitoring the market Increase options
31. Agenda Performance Engineering challenges Aligning PE to business initiatives Improve IT and business communication New approach to model business transactions
32. Alignment – talking with the business Why invest in a performance engineering team? Manage risk: stability, scalability (fear of the unknown) Reduce operational costs and production outages Increase efficiency: supporting same workload with fewer Resources & Additional spending Support business objective (growth), drive revenue Visibility: what are PE resources working on?
33. Alignment – talking with the business Know your audiences approach to investments and the significance of External focused applications vs. internal corporate Internal business units Cost focus External business units Revenue focus
34.
35. New client for healthcare claims processing system (from 500,000/Day to 800,000)
41. We have 750,000 customers in the database, and expect half of them to be interested in this.
42. Well, we ran a couple of tests with 1,500 to 2,000 virtual users with almost no think time and the system held, though the Database ran hot.
43. The max response time did increase well past the goal, but the average was still under six seconds.
44. We could only test half the TPS of what we think 375,000 users would do. Due to the environment be smaller than production.Where do you go from here??
47. We have 750,000 customers in the database, and expect half of them to be interested in this.
48. We see risk to the event. We have successfully executed scalability tests for 175,000 users accessing the site, before their experience will be poor.
50. Option A – requires $250,000 to implement, did this business factor this into their ROI
51. Option B – requires impacting other applications during the event. Taking their computing resources
52.
53. Transactions matter to the business people Business Service and workflow Application transaction response time Infrastructure Complete user experience Confirm Order Component view of utilization
54. Business transactions How do you make sure your customers have an outstanding experience on your web site? How do you make sure your internal users are having the right experience on their internal systems (workflow)?
62. SharePath – The APM Innovator “SharePath rapidly generates detailed multitier models of an application's execution path in an almost entirely automated manner, making the technology very easy to deployand maintain, while capturing data at a high degree of granularity without having an impact on production performance.” Gartner, March 2010
63.
64.
65. Every hop, every transactionSERVER WEB APP SVR PROXY MQ/ESB CORBA LDAP DCOM Web Services The SharePath Product Family
67. About Collaborative Consulting Business and technology consulting firm Clients across the United States Consulting services Business enablement Information management Technology enablement Program management 31
SharePath is a next generation Transaction Management Solution.SharePath Is UniqueTracks transactions across any type of element (not limited to Java/.NET), and models transaction and application behaviorDetects a change of specific component’s impact on end-user experience – One-Click-Problem-IsolationDesigned for Production from scratch. 24x7, No sampling. 100% of transactions are monitored and stored with negligible overhead.Quickly deployed. Get value in hours.Low TCO – No code changes, no “reconfigurations”, resistant to OS and application changes, no need to be familiar with application codeSharePath BenefitsEffectively isolating performance problems, even the most sporadic onesReducing risks of rollouts, identify problems before rolling outSafely migrating to Private Cloud, P2VDelivering IT Reliability:Insuring Your End-Users Are Not Impacted By Changes In Your Ever-Changing Environment
Byrne recommended adding to the key strengths (only verbally) that there is no need for appliances which enables more flexibility.