In this living room session, industry leaders from ecommerce, tech, and media discuss war stories from the edge, rehashing the biggest business and technological challenges theyâve faced and how they addressed them.
3. Everyone will make mistakes
Information is imperfect
Failure is rarely a single thing
Complex systems have complex failures
Sometimes there is a single point of failure
There shouldnât be a single button / command / event that requires manual
intervention
Fundamental surprise
Failures happen in ways that cannot be predicted
4.
5. Some things can only be observed in production
Keep fire escapes clear
Keep the cost of failure low
Limited blast radius
http://www.kitchensoap.com/2013/09/30/learning-from-failure-at-etsy/
https://codeascraft.com/speakers/john-allspaw-outages-post-mortems-and-human-error/
https://www.slideshare.net/kellan/continuous-deployment-7300057
10. The dashboard not changing color is related to
S3 issue. See the banner at the top of the
dashboard for updates.
@awscloud
Amazon Web Services
2:17 PM - 28 Feb 2017
@sethvargo