It’s your big day, the day of the year your company either makes it, or breaks it. Your customers expect your system to work, always. Excuses are unacceptable. To meet this new challenge, your application must use modern tools and techniques. Serverless, containers, and cloud technologies are working with new DevOps processes and risk management concepts in order to build a dynamic, highly scalable, highly available application that meets your customers needs. And central to all of this is the modern analytics necessary to determine how your system is running and what you need to do to keep it running...at scale. Your customers demand modern applications, and modern applications demand modern tools and modern analytics. Are you ready to meet these modern challenges?

1. ©2008–18 New Relic, Inc. All rights reserved
Keeping Modern Applications Performing
Driving Insights to Action within the Enterprise
Lee Atchison
Senior Director Strategic Architecture at New Relic, Inc.
leeatchison@leeatchison

2. ©2008–18 New Relic, Inc. All rights reserved
You Have a Problem…
2

3. ©2008–18 New Relic, Inc. All rights reserved 3
It’s Your Big Day
Busiest Day of the Year
Black
Friday
Product
Launch
Election
Day
The day of the year when
your company either…
… makes it or breaks it

4. ©2008–18 New Relic, Inc. All rights reserved
Will You Survive?
Can you scale?
Can you stay operational?

5. ©2008–18 New Relic, Inc. All rights reserved
You’ve Been Anticipating This…
5
…but are you ready?

6. ©2008–18 New Relic, Inc. All rights reserved
Well, let’s find out
6

7. ©2008–18 New Relic, Inc. All rights reserved

8. ©2008–18 New Relic, Inc. All rights reserved

9. ©2008–18 New Relic, Inc. All rights reserved

10. ©2008–18 New Relic, Inc. All rights reserved
It worked most of
the time.
Why are you
complaining?

11. CustomerCare AppOwners
Executives
Customer
Care
Operations Developers
App
Owners
Marketing
Picture
Your
Apps
Here
Behind every modern app
are modern teams

12. ©2008–18 New Relic, Inc. All rights reserved 12
How is my
business doing?
Business
Success
Am I open
for business?
Application
Performance
How are customers
engaging?
Customer
Experience
Asking Important Questions

13. ©2008–18 New Relic, Inc. All rights reserved 13
First
Deploy
in AWS
India AZ
Java
Security
Vulnerability?
Traffic
Spike from
Celebrity
Tweet!
New Mobile
App!
Flaky Ad
Network?
New Location
Feature
Experiment!
Cloud
Reboot!
Devs
Deploy
Docker
Acquire
New Team!
(They use
Node.js)
Apple
Changes
Terms of
Service
Key
Engineer
on Open
Source Tool
Leaves
6 million new
sensors now
lve!
Bug
Fix!
DNS
Outage?
Try New
CDN in
Europe
Asking Important Questions…
… About Constant Change
How is my
business doing?
Business
Success
Am I open
for business?
Application
Performance
How are customers
engaging?
Customer
Experience
New
Aviation
Service

14. ©2008–18 New Relic, Inc. All rights reserved 14
Keeping Your Modern Application Running
and…well…modern
Managing
Risk
Instrument
All the
Things
Dynamic
Infrastructure
DevOps
Culture

15. ©2008–18 New Relic, Inc. All rights reserved 15
Keeping Your Modern Application Running
Managing
Risk
Instrument
All the
Things
Dynamic
Infrastructure
DevOps
Culture

16. ©2008–18 New Relic, Inc. All rights reserved 16
It’s Not Just Static
Ops
Static Data
Centers

17. ©2008–18 New Relic, Inc. All rights reserved 17
It’s Not Just Static
Ops
Static Data
Centers

18. ©2008–18 New Relic, Inc. All rights reserved 18
It’s Not Just Static
Dev
Dynamic Cloud
World
Ops
Static Data
Centers
Ops

19. ©2008–18 New Relic, Inc. All rights reserved
Dynamic Cloud Enables Better Applications Faster
Dynamic Cloud
Easier Scaling
Faster Change
Faster Response
Higher Availability
and
Greater Application Value
The way you’ve done things in the past
won’t work in the future.

20. ©2008–18 New Relic, Inc. All rights reserved 20
Keeping Your Modern Application Running
Managing
Risk
Instrument
All the
Things
Dynamic
Infrastructure
DevOps
Culture

21. ©2008–18 New Relic, Inc. All rights reserved 21
Keeping Your Modern Application Running
Managing
Risk
Instrument
All the
Things
Dynamic
Infrastructure
DevOps
Culture

22. ©2008–18 New Relic, Inc. All rights reserved
Real life availability story…
…overheard OPs conversation...
©2008–18 New Relic, Inc. All rights reserved

23. ©2008–18 New Relic, Inc. All rights reserved
The Conversation…
“We were wondering how
changing a setting on our
MySQL database might impact
our performance…
©2008–18 New Relic, Inc. All rights reserved

24. ©2008–18 New Relic, Inc. All rights reserved
The Conversation…
“We were wondering how
changing a setting on our
MySQL database might impact
our performance…
… but we were worried
that the change may
cause our production
database to fail…”
©2008–18 New Relic, Inc. All rights reserved

25. ©2008–18 New Relic, Inc. All rights reserved
The “Scary” Overheard Conversation…
“… Since we didn’t want to bring
down production, we decided to
make the change to our backup
(replica) database instead…
Under
Construction
… but we were worried
that the change may
cause our production
database to fail…”
©2008–18 New Relic, Inc. All rights reserved

26. ©2008–18 New Relic, Inc. All rights reserved
The “Scary” Overheard Conversation…
… After all, it wasn’t
being used for anything
at the moment.”
Under
Construction
©2008–18 New Relic, Inc. All rights reserved
“… Since we didn’t want to bring
down production, we decided to
make the change to our backup
(replica) database instead…

27. ©2008–18 New Relic, Inc. All rights reserved
The “Scary” Overheard Conversation…
Under
Construction
X
©2008–18 New Relic, Inc. All rights reserved
Until, of course, the backup was needed…

28. ©2008–18 New Relic, Inc. All rights reserved
The “Scary” Overheard Conversation…
This was a true story
Under
Construction
!!!
!
X
X
©2008–18 New Relic, Inc. All rights reserved
Until, of course, the backup was needed…

29. ©2008–18 New Relic, Inc. All rights reserved
All Systems Have Risk in Them
Risk is a measure of the likelihood
of an undesirable event occurring
Server
will crash
Database will
get corrupted
Returned
answer will
be incorrect
Network
connection
will fail
Newly deployed
piece of
software will fail
There is risk that a …

30. ©2008–18 New Relic, Inc. All rights reserved
Risk
On the surface…
Keeping an application running requires removing risk…
But the reality is…
More and more complicated systems…
…makes this less and less possible.
Removing surprises…
Removing risk is not a viable option.

31. ©2008–18 New Relic, Inc. All rights reserved
Living with Risk
Knowing what
your risk is
Knowing how much
risk is acceptable
Knowing what
you can do to mitigate
the risk
Risk Management
is at the heart of
building highly
available systems

32. ©2008–18 New Relic, Inc. All rights reserved
Living with Risk
Managing what
your risk is
Managing how much
risk is acceptable
Knowing what
you can do to mitigate
the risk
Risk Management
is at the heart of
building highly
available systems
Risk Mitigation
Risk Management
is not about
Removing Risk
it’s about
Understanding & Mitigating
Risk

33. ©2008–18 New Relic, Inc. All rights reserved
Risk Management
Likelihood of a risk occurring
along with
Severity of the impact if the risk if it occurs
If a risk occurs
Risk Management is understanding:
Having a Plan to deal with it…
…have plan before the risk plays out

34. ©2008–18 New Relic, Inc. All rights reserved
Risk Management
Likelihood
Risk Management is understanding:
Plan
Severity
The three cornerstones to Risk Management.

35. ©2008–18 New Relic, Inc. All rights reserved 35
Keeping Your Modern Application Running
Managing
Risk
Instrument
All the
Things
Dynamic
Infrastructure
DevOps
Culture

36. ©2008–18 New Relic, Inc. All rights reserved 36
Keeping Your Modern Application Running
Managing
Risk
Instrument
All the
Things
Dynamic
Infrastructure
DevOps
Culture

37. ©2008–18 New Relic, Inc. All rights reserved 37
DevOps
Is Not…
A
Product Change
Is Not Entirely…
A
Process Change
Is Not…
A
Migration

38. ©2008–18 New Relic, Inc. All rights reserved 38
DevOps
DevOps Is…
A
Cultural
Change

39. ©2008–18 New Relic, Inc. All rights reserved 39
DevOps
Your teams will change:
Develop
Applications
Deploy
Applications
Monitor
Applications
Respond to
Problems
Key to DevOps: Team level ownership

40. ©2008–18 New Relic, Inc. All rights reserved 40
DevOps & Cloud
DevOps Adoption requires Cloud Adoption
Cloud Adoption requires DevOps Adoption
They are both important…for either to succeed

41. ©2008–18 New Relic, Inc. All rights reserved
Toolchain is critical to your success:
• Efficiently designed
• Highly integrated tooling
• Monitored
Solid Toolchain
41

42. ©2008–18 New Relic, Inc. All rights reserved 42
Three DevOps Principles
Toolchain must
be solid
Cloud is
Mandatory
DevOps
Is Cultural
#1 #2 #3

43. ©2008–18 New Relic, Inc. All rights reserved 43
Keeping Your Modern Application Running
Managing
Risk
Instrument
All the
Things
Dynamic
Infrastructure
DevOps
Culture

44. ©2008–18 New Relic, Inc. All rights reserved 44
Keeping Your Modern Application Running
Managing
Risk
Instrument
All the
Things
Dynamic
Infrastructure
DevOps
Culture

45. ©2008–18 New Relic, Inc. All rights reserved 45
Problems Can Come From Anywhere
Anticipate
and
Predict
(analyze trends)
Notice
and
Acknowledge
(alert on problems)
Diagnose
and
Resolve
(determine what’s wrong)
Continuous Monitoring Enables You to…
!!!
MTTD
Mean Time
To Detection
MTTR
Mean Time
To Recovery

46. ©2008–18 New Relic, Inc. All rights reserved
Why Monitoring Matters

47. ©2008–18 New Relic, Inc. All rights reserved
300ms
4.5s
47

48. ©2008–18 New Relic, Inc. All rights reserved48
900ms

49. ©2008–18 New Relic, Inc. All rights reserved49

50. ©2008–18 New Relic, Inc. All rights reserved
The Data from Monitoring Your App
Dwarfs the Data Inside the App

51. ©2008–18 New Relic, Inc. All rights reserved
User Experience
Business Outcome
Servers
Apps
Big Data Problem
©2008–18 New Relic, Inc. All rights reserved

52. ©2008–18 New Relic, Inc. All rights reserved
It’s All About Data
52

53. ©2008–18 New Relic, Inc. All rights reserved
Success in Software Analytics
Application
Performance
Customer
Experience
Business
Outcome

54. ©2008–18 New Relic, Inc. All rights reserved
54
Software Measurement Framework
Software
Business
• Daily Revenue
• Cart Value / Volume
• What do you sell?
Customer
Experience
• Conversion Rates
• Engagement / Interactions
• End-User Performance
Application
Performance
& Infrastructure
• App performance
• Slow Queries
• Burst & Scale
Engineering
Velocity
• Lead Time
• Deploys
• MTTR
Service
Quality
• Uptime
• App Errors
• Successful
Deploys

55. ©2008–18 New Relic, Inc. All rights reserved 55
Keeping Your Modern Application Running
Managing
Risk
Instrument
All the
Things
Dynamic
Infrastructure
DevOps
Culture

56. ©2008–18 New Relic, Inc. All rights reserved 56
Keeping Your Modern Application Running
Managing
Risk
Instrument
All the
Things
Dynamic
Infrastructure
DevOps
Culture

57. Customers demand modern applications
Modern applications modern technologyrequire
Keeping Your Application Modern
Modern monitoringModern infrastructure Modern processes and procedures

58. ©2008–18 New Relic, Inc. All rights reserved
I Hope, I Hope, I Hope
the Site Stays Up

59. ©2008–18 New Relic, Inc. All rights reserved

60. ©2008–18 New Relic, Inc. All rights reserved 60
Modern Applications Require…
Ops
…modernize your enterprise…
…your teams…
…and your processes…
…not just your application

61. Thank You
©2008–18 New Relic, Inc. All rights reserved
Lee Atchison
Senior Director Strategic Architecture at New Relic, Inc.
leeatchison@leeatchison Architecting for Scale
By: Lee Atchison
Published by: O’Reilly Media
http://scalinginthe.cloud

62. ©2008–18 New Relic, Inc. All rights reserved 62
Safe Harbor
This presentation and the information herein (including any information that may be incorporated by reference) is provided for informational
purposes only and should not be construed as an offer, commitment, promise or obligation on behalf of New Relic, Inc. (“New Relic”) to sell
securities or deliver any product, material, code, functionality, or other feature. Any information provided hereby is proprietary to New Relic and
may not be replicated or disclosed without New Relic’s express written permission.
Such information may contain forward-looking statements within the meaning of federal securities laws. Any statement that is not a historical fact or
refers to expectations, projections, future plans, objectives, estimates, goals, or other characterizations of future events is a forward-looking
statement. These forward-looking statements can often be identified as such because the context of the statement will include words such as
“believes,” “anticipates,” “expects” or words of similar import.
Actual results may differ materially from those expressed in these forward-looking statements, which speak only as of the date hereof, and are
subject to change at any time without notice. Existing and prospective investors, customers and other third parties transacting business with New
Relic are cautioned not to place undue reliance on this forward-looking information. The achievement or success of the matters covered by such
forward-looking statements are based on New Relic’s current assumptions, expectations, and beliefs and are subject to substantial risks,
uncertainties, assumptions, and changes in circumstances that may cause the actual results, performance, or achievements to differ materially
from those expressed or implied in any forward-looking statement. Further information on factors that could affect such forward-looking statements
is included in the filings New Relic makes with the SEC from time to time. Copies of these documents may be obtained by visiting New Relic’s
Investor Relations website at ir.newrelic.com or the SEC’s website at www.sec.gov.
New Relic assumes no obligation and does not intend to update these forward-looking statements, except as required by law. New Relic makes no
warranties, expressed or implied, in this presentation or otherwise, with respect to the information provided.