This presentation was given as part of a Dynatrace Lunch & Learn event. APM (=Application Performance Management) allows us to transform the way we develop, deploy and run software.
Here are some ideas how APM can be (r)evolutionized
DevOps Transformation at Dynatrace and with Dynatrace
(R)evolutionize APM
1. Dynatrace Lunch & Learn
1 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Dynatrace
2. Dynatrace
• 5,700 customers, from Born-In-The-Cloud to Global 2000
• Gartner Market Share leader for two consecutive years
• Used by 17 of the top 20 online retailers - Internet RETAILER, 2014 TOP 500 Guide
• Net Promoter Score of 89, best NPS among all APM vendors
• 600 R&D and 300 technical experts - Largest expertise in APM
2 @Dynatrace
3. (R)Evolutionize APM
- by learning from DevOps Movement
- More on http://blog.dynatrace.com
Hosted by: Andreas Grabner - @grabnerandi
3 @Dynatrace
7. The stuff we did
when we were a Start Up
and we All were
Devs, Testers and Ops
7 @Dynatrace
8. The Idea is to …
Improve Collaboration between Developers and Operators and
• Stop wasting money
• Stop wasting time
• Stop frustrating people
• Start building great systems
•And do it much faster and more frequent!
8 @Dynatrace
9. Who made the transition?
700 Deployments / Year
10+ Deployments / Day
50-60 Deployments / Day
Every 11.6 seconds
9 @Dynatrace
10. Inside the Amazon Numbers!
Deploying every 11.6s
75% fewer outages since 2006
90% fewer outage minutes
~0.001% of deployments cause a problem
Instantaneous automatic rollback
10 @Dynatrace
23. Using Hibernate results in 4k+ SQL Statements to
display 3 items!
Hibernate
Executes 4k+
Statements
Individual
Execution VERY
FAST
But Total SUM
takes 6s
23 @Dynatrace
24. Metrics: # Total SQLs
# SQLs / Web Request
# Same SQLs / Request
Transferred Rows
Dev: “Learn” Frameworks
Test: With realistic Data
Ops: Monitor Usage
24 @Dynatrace
27. Distance Calculation Issues
480km biking
in 1 hour!
Solution: Unit Test in
Live App reports Geo
Calc Problems
Finding: Only
happens on certain
Android versions
27 @Dynatrace
29. Metrics: Crashes, Exceptions, # and
Status of 3rd Party Calls, Payload of
Web Service Calls
Dev: Build for Mobile
Test: Test on Mobile and Diff. Carriers
Ops: Monitor Mobile
29 @Dynatrace
37. The Dynatrace APM Trifecta
Deep Dive
• Deepest visibility
• All transactions
• Discrete transaction tracing
• Code-level details
• Full lifecycle integration
Synthetics
• SaaS Delivery
• World Presence
• Running in minutes
• Worldwide network
• Web & mobile
• Enterprise Apps
Passive
Network
• Real User Monitoring
• Passive
• All Apps
• Tier-by-tier
• Network visibility
Dynatrace
APM
• Development • Test • Production • Business
SaaS Delivery Model
• Internet Synthetic
• Industry Benchmarks
• dynaTrace DTM
• User Experience
• Mobile
On Prem Delivery Model
• DCRUM
• dynaTrace DTM
• Synthetic Enterprise
• Real User Experience
• APM in the Lifecycle
37 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Dynatrace
38. Dynatrace Synthetic
Global Internet Transaction Management Deep Dive
•Deepest visibility
•All transactions
•Discrete transaction tracing
•Code-level details
•Full lifecycle integration
Synthetics
•SaaS-delivered
•Running in minutes
•Worldwide network
•Web & mobile
Passive
•Real Users
•Passive
•All Apps
•Tier-by-tier
•Network visibility
38 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Dynatrace
39. The World’s Most Comprehensive Performance and
Testing Network
Synthetic Agents
Deployed and managed
by Dynatrace
Backbone Last Mile Cloud
High Volume Load
Generation
13 Global locations
Web Performance
Management
100+ locations
Web Performance
Management and
Load Testing
10,000’s+ locations
Mobile
Dozens of countries
connected to real
wireless carriers
Synthetic Private Agents
Deployed by Customer
• SaaS Private Agents
• SaaS Private Peers
• Enterprise Synthetic (OnPrem)
39 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Dynatrace
40. APM Portal - Out of The Box Dashboards
Critical
Transactions
3rd Party
Errors
Global Perspective
40 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Dynatrace
41. Automated Diagnostics and Drilldown to PurePath
Home page is slow
Event
Notification
Problem Identification
Automatic Problem
Analysis
1st Byte Time
41 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Dynatrace
42. Datacenter Monitoring
Passive Application Monitoring
Featuring
• Transaction Trace Analysis
Deep Dive
•Deepest visibility
•All transactions
•Discrete transaction tracing
•Code-level details
•Full lifecycle integration
Synthetics
•SaaS-delivered
•Running in minutes
•Worldwide network
•Web & mobile
Passive
•Real Users
•Passive
•All Apps
•Tier-by-tier
•Network visibility
42 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Dynatrace
43. How Does It Work?
• Fault Domain Isolation: Locate Bottlenecks
• Business Impact: Managing vs. Monitoring
• Prioritization: Affected Users, Affected Transactions
• All Applications: Across entire datacenter
• All Users: By User ID, By Locations, Citrix, VM, WAN, and
LAN
• Always On: Continuous data feed of Performance
43 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Dynatrace
44. Affected Users
Cross-Tier FDI
Centralized View of All Applications
Synthetic Network Health
Overlay Charts
44 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Dynatrace
46. Dynatrace Application
Deep Transaction Monitoring Deep Dive
•Deepest visibility
•All transactions
•Discrete transaction tracing
•Code-level details
•Full lifecycle integration
Synthetics
•SaaS-delivered
•Running in minutes
•Worldwide network
•Web & mobile
Passive
•Real Users
•Passive
•All Apps
•Tier-by-tier
•Network visibility
46 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Dynatrace
47. Test Environment
Production Environment
8x slower
3x more SQL
47 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Dynatrace
48. Test Environment Production Environment
Hibernate,
Hibernate,
Classloading,
XML – The Key
Classloading, XML
– The Key Hotspots
I/O for Web
Requests Hotspots
doesn’t
even show up!
That’s Normal:
Having I/O for Web
Request as main
contributor
48 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Dynatrace
49. Top Contributor
Class.getInterfaces
Called from Hibernates
FieldInterceptionHelper
These calls all originate
form thousands of calls to
find item by code
49 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Dynatrace
50. Every 11.6 seconds
Unit & Integration Tests
Commit Stage
• Compile
• Execute Unit Test
• Code Analysis
• Build installers
Automated
Acceptance
Testing
Performance Tests
Automated
Capacity
Testing
Production
Monitoring
Manual testing
• Key showcases
• Exploratory testing Release
Functional Tests
50 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE #Dynatrace
Every year, Internet Retailer, surveys the top 500 sites and ask them which web performance solution they rely on.
17 out of the top 20 reported that they were using our platform.
In fact, we are the most used APM among the top 500 retail sites in the world.
One of our most important indicator is our NPS. We have been asking customers the following questions on every case closure, each ES engagement/coaching engagement, and our Guardian engagements: “would you recommend us to a peer?”
For our APM portfolio specifically, our NPS is 89, the largest in the industry.
{..next slide..}
http://www.internetretailer.com/top500/online/
For reference only - the top 20 online retailers who said they are using Compuware for Web Performance are :
Amazon.com (#1)
Apple (#2)
Staples (#3)
Sears Holdings (#5)
Liberty Interactive (#6)
Netflix (#7)
Office Depot (#9)
Dell (#10)
CDW (#11)
WW Grainger (#13)
Costco (#14)
Best Buy (#15)
The Home Depot (#16)
Newegg (#17)
Target (#18)
Gap (#19)
Sony Electronics (#20)
Last updated or created: April ‘11
Key themes:
Gomez covers the globe with the most comprehensive testing network
We are where your customers are
Talk track
This is a visual depiction of our global testing network.
You can see where our Backbone and Last Mile testing locations are.
Our Last Mile locations literally span the globe and allow you to test and monitor from any significant location in the world. And it’s growing every day.
You can use these for a combination of monitoring and load testing.
You can’t see the locations for the virtual test bed because it’s virtual – i.e. location independent.
And, as the blue areas indicate, we can monitor your actual end users literally wherever they are on the planet