SlideShare ist ein Scribd-Unternehmen logo
1 von 20
Downloaden Sie, um offline zu lesen
Operating Human Systems:
MTBF v. MTTR
Aaron Aldrich (@crayzeigh) — (@elastic)
1
Mean Time Between Failures
Mean Time To Recovery
Aaron Aldrich - @crayzeigh 2
complex systems
Aaron Aldrich - @crayzeigh 3
we design for reliability:
4 stiff boundaries, layers, formalisms
4 defense in depth
4 redundancy
4 interference protection
4 assurance & accountability
Aaron Aldrich - @crayzeigh 4
we want resilience:
4 withstand transients
4 recover swiftly & smoothly from failures
4 prioritize to serve high level goals
4 recognize & respond to abnormal situations
4 adapt to change
Aaron Aldrich - @crayzeigh 5
failure aversion leads to
kludge and tech debt
relational debt is a real
thing
Aaron Aldrich - @crayzeigh 6
unpaid debt leads to
catastrophic failure
Aaron Aldrich - @crayzeigh 7
there is no root cause to failure in
{ complex systems | relationships }
Aaron Aldrich - @crayzeigh 8
blamelessness (just culture) is required
for improvement
Aaron Aldrich - @crayzeigh 9
experience with failure is
necessary
Aaron Aldrich - @crayzeigh 10
if we do not experience
failure, we are not living to
our potential
Aaron Aldrich - @crayzeigh 11
lessons from networking:
TCP > UDP
avoid feelings of not being
heard
Aaron Aldrich - @crayzeigh 12
"What you're saying is 'X',
what I'm hearing is 'Y'."
Aaron Aldrich - @crayzeigh 13
lessons from distributed
systems:
translations are hard
Aaron Aldrich - @crayzeigh 14
assume good intent
Aaron Aldrich - @crayzeigh 15
/zoom
Aaron Aldrich - @crayzeigh 16
tooling:
Non-Violent Communication
Observation, Feeling, Needs, Requests
Aaron Aldrich - @crayzeigh 17
NVC Framework
1. Observation: !== evaluation || judgement
2. Feelings: !== thinking, [SASHET]
3. Needs: connection, well-being, honestly, play, peace,
autonomy, meaning
4. Requests: what we DO want, != demand
Aaron Aldrich - @crayzeigh 18
NVC Framework
1. Observation: !== evaluation || judgement
2. Feelings: !== thinking, [SASHET]
3. Needs: connection, well-being, honestly, play, peace,
autonomy, meaning
4. Requests: what we DO want, != demand
Aaron Aldrich - @crayzeigh 19
2: Richard Cook - "How Complex Systems Fail" (http://bit.ly/2mKO8UL)(pdf)
3-4: Velocity 2012: Richard Cook - "How Complex Systems Fail"
(https://youtu.be/2S0k12uZR14)
9: Philip G Boysen, II, MD, MBA, FACP, FCCP, FCCM - "Just Culture: A Foundation for
Balanced Accountability and Patient Safety" (http://bit.ly/2DgJM1Z)
13: Certified Fresh Events: "Oh No You Didn't: Conflict Management in Today's Tech
Industry" (https://certifiedfreshevents.com/events/conflict-management/)
17: The Center for Non-Violent Communication (https://www.cnvc.org/)
thanks!
Aaron Aldrich - @crayzeigh 20

Weitere ähnliche Inhalte

Mehr von Aaron Aldrich

DevOpsDays DC 2017 - Better Living Through Storytelling
DevOpsDays DC 2017 -  Better Living Through StorytellingDevOpsDays DC 2017 -  Better Living Through Storytelling
DevOpsDays DC 2017 - Better Living Through StorytellingAaron Aldrich
 
DevOpsDays TO - Managing Fires
DevOpsDays TO - Managing FiresDevOpsDays TO - Managing Fires
DevOpsDays TO - Managing FiresAaron Aldrich
 
DevOpsDays SEA - Managing Fires: Leadership through Crisis
DevOpsDays SEA - Managing Fires: Leadership through CrisisDevOpsDays SEA - Managing Fires: Leadership through Crisis
DevOpsDays SEA - Managing Fires: Leadership through CrisisAaron Aldrich
 
Skeptics in the Church of Data Getting Evangelical
Skeptics in the Church of Data Getting EvangelicalSkeptics in the Church of Data Getting Evangelical
Skeptics in the Church of Data Getting EvangelicalAaron Aldrich
 
Better Living Through Storytelling
Better Living Through StorytellingBetter Living Through Storytelling
Better Living Through StorytellingAaron Aldrich
 
DevOpsDays Madison 2016 - Humane Treatment of On-Call Engineers (Ignite)
DevOpsDays Madison 2016 - Humane Treatment of On-Call Engineers (Ignite)DevOpsDays Madison 2016 - Humane Treatment of On-Call Engineers (Ignite)
DevOpsDays Madison 2016 - Humane Treatment of On-Call Engineers (Ignite)Aaron Aldrich
 
DOD-OH - The Humane Treatment of Engineers
DOD-OH - The Humane Treatment of EngineersDOD-OH - The Humane Treatment of Engineers
DOD-OH - The Humane Treatment of EngineersAaron Aldrich
 

Mehr von Aaron Aldrich (8)

DevOpsDays DC 2017 - Better Living Through Storytelling
DevOpsDays DC 2017 -  Better Living Through StorytellingDevOpsDays DC 2017 -  Better Living Through Storytelling
DevOpsDays DC 2017 - Better Living Through Storytelling
 
DevOpsDays TO - Managing Fires
DevOpsDays TO - Managing FiresDevOpsDays TO - Managing Fires
DevOpsDays TO - Managing Fires
 
DevOpsDays SEA - Managing Fires: Leadership through Crisis
DevOpsDays SEA - Managing Fires: Leadership through CrisisDevOpsDays SEA - Managing Fires: Leadership through Crisis
DevOpsDays SEA - Managing Fires: Leadership through Crisis
 
Skeptics in the Church of Data Getting Evangelical
Skeptics in the Church of Data Getting EvangelicalSkeptics in the Church of Data Getting Evangelical
Skeptics in the Church of Data Getting Evangelical
 
Better Living Through Storytelling
Better Living Through StorytellingBetter Living Through Storytelling
Better Living Through Storytelling
 
DevOpsDays Madison 2016 - Humane Treatment of On-Call Engineers (Ignite)
DevOpsDays Madison 2016 - Humane Treatment of On-Call Engineers (Ignite)DevOpsDays Madison 2016 - Humane Treatment of On-Call Engineers (Ignite)
DevOpsDays Madison 2016 - Humane Treatment of On-Call Engineers (Ignite)
 
DOD-OH - The Humane Treatment of Engineers
DOD-OH - The Humane Treatment of EngineersDOD-OH - The Humane Treatment of Engineers
DOD-OH - The Humane Treatment of Engineers
 
Managing fires
Managing firesManaging fires
Managing fires
 

Kürzlich hochgeladen

08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 

Kürzlich hochgeladen (20)

08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 

2018-01 DevOpsDays NYC: Operating Human Systems: MTBF v. MTTR

  • 1. Operating Human Systems: MTBF v. MTTR Aaron Aldrich (@crayzeigh) — (@elastic) 1
  • 2. Mean Time Between Failures Mean Time To Recovery Aaron Aldrich - @crayzeigh 2
  • 4. we design for reliability: 4 stiff boundaries, layers, formalisms 4 defense in depth 4 redundancy 4 interference protection 4 assurance & accountability Aaron Aldrich - @crayzeigh 4
  • 5. we want resilience: 4 withstand transients 4 recover swiftly & smoothly from failures 4 prioritize to serve high level goals 4 recognize & respond to abnormal situations 4 adapt to change Aaron Aldrich - @crayzeigh 5
  • 6. failure aversion leads to kludge and tech debt relational debt is a real thing Aaron Aldrich - @crayzeigh 6
  • 7. unpaid debt leads to catastrophic failure Aaron Aldrich - @crayzeigh 7
  • 8. there is no root cause to failure in { complex systems | relationships } Aaron Aldrich - @crayzeigh 8
  • 9. blamelessness (just culture) is required for improvement Aaron Aldrich - @crayzeigh 9
  • 10. experience with failure is necessary Aaron Aldrich - @crayzeigh 10
  • 11. if we do not experience failure, we are not living to our potential Aaron Aldrich - @crayzeigh 11
  • 12. lessons from networking: TCP > UDP avoid feelings of not being heard Aaron Aldrich - @crayzeigh 12
  • 13. "What you're saying is 'X', what I'm hearing is 'Y'." Aaron Aldrich - @crayzeigh 13
  • 14. lessons from distributed systems: translations are hard Aaron Aldrich - @crayzeigh 14
  • 15. assume good intent Aaron Aldrich - @crayzeigh 15
  • 16. /zoom Aaron Aldrich - @crayzeigh 16
  • 17. tooling: Non-Violent Communication Observation, Feeling, Needs, Requests Aaron Aldrich - @crayzeigh 17
  • 18. NVC Framework 1. Observation: !== evaluation || judgement 2. Feelings: !== thinking, [SASHET] 3. Needs: connection, well-being, honestly, play, peace, autonomy, meaning 4. Requests: what we DO want, != demand Aaron Aldrich - @crayzeigh 18
  • 19. NVC Framework 1. Observation: !== evaluation || judgement 2. Feelings: !== thinking, [SASHET] 3. Needs: connection, well-being, honestly, play, peace, autonomy, meaning 4. Requests: what we DO want, != demand Aaron Aldrich - @crayzeigh 19
  • 20. 2: Richard Cook - "How Complex Systems Fail" (http://bit.ly/2mKO8UL)(pdf) 3-4: Velocity 2012: Richard Cook - "How Complex Systems Fail" (https://youtu.be/2S0k12uZR14) 9: Philip G Boysen, II, MD, MBA, FACP, FCCP, FCCM - "Just Culture: A Foundation for Balanced Accountability and Patient Safety" (http://bit.ly/2DgJM1Z) 13: Certified Fresh Events: "Oh No You Didn't: Conflict Management in Today's Tech Industry" (https://certifiedfreshevents.com/events/conflict-management/) 17: The Center for Non-Violent Communication (https://www.cnvc.org/) thanks! Aaron Aldrich - @crayzeigh 20