21/02/2018 "La La Land of DevOps Tools Integration" por Manuel Pais (@manupaisable) https://www.meetup.com/madrid-devops/events/247459841/ madrid.devops.es

1. La La Land of DevOps Integration
Manuel Pais
@manupaisable | manuelpais.net
Madrid DevOps Feb 2018
21 Feb 2018, Madrid ES

2. Continuous Delivery
(Tooling) (Anti-)Patterns
Manuel Pais
@manupaisable | manuelpais.net
Madrid DevOps Feb 2018
21 Feb 2018, Madrid ES

3. Today
1. DevOps integration: two camps
2. Pattern #1: Best of breed tools
3. Pattern #2: Pipeline = workflow
4. Pattern #3: Own your golden logs

4. About me
Manuel Pais
MS Software Eng
@manupaisable
manuelpais.net
me@manuelpais.net
DevOps and Delivery Consultant
Focused on teams and flow

5. DevOpsTopologies.com

6. releasabilitybook.com
Upcoming book:
Team Guide to
Software Releasability
by Chris O’Dell & Manuel Pais

7. Today
1. DevOps integration: two camps
2. Pattern #1: Best of breed tools
3. Pattern #2: Pipeline = workflow
4. Pattern #3: Own your golden logs

8. “integrating various
tools in software
delivery is very hard”
“a toolchain is a
design pattern
that everybody
can agree on”
https://www.infoq.com/articles/tool-integration-hard-truth
https://www.infoq.com/interviews/interview-damon-edwards-qcon-2014

9. Integrated
DevOps Tool
In the left corner…

10. Integrated
DevOps
Toolchain
In the right corner…

11. Integrated
DevOps
Toolchain
Integrated
DevOps Tool

12. Quick setup
Familiar, consistent UI
Less to worry about
Integrated
DevOps Tool

13. Long term ownership
Best tool for (each) job
Update tools independently
Integrated
DevOps Toolchain

14. tool choices…
are trade-offs

15. the problem is not being
aware of those trade-offs

16. some patterns
become extremely hard
with integrated tools…

17. Today
1. DevOps integration: two camps
2. Pattern #1: Best of breed tools
3. Pattern #2: Pipeline = workflow
4. Pattern #3: Own your golden logs

18. Integrated DevOps Toolchain

19. single-purpose tools
need APIs to survive

20. Integrated DevOps Tool

21. Integrated DevOps Toolchain

22. Integrated DevOps Toolchain

23. Integrated DevOps Toolchain

24. a flexible toolchain
standardizes practices,
not tools

25. Integrated DevOps Tool

26. Integrated DevOps Tool

27. tooling should evolve
when YOU need it

28. Limit blast radius

29. tightly coupled tooling

30. tightly coupled tooling

31. tightly coupled tooling

32. tightly coupled tooling

33. limit blast radius

35. poorly understood concepts

36. poorly understood concepts

37. Today
1. DevOps integration: two camps
2. Pattern #1: Best of breed tools
3. Pattern #2: Pipeline = workflow
4. Pattern #3: Own your golden logs

38. what’s missing?

39. what’s missing?
we tend to care about
technical bits only…

40. Integration
Tests
Functional
Tests
Performance
Tests
Operational
Acceptance
PROD

43. painful bottlenecks
in team interactions

44. bottlenecks = silos
time is lost in queues,
not execution

45. automating hand-offs
requires trust… which in
turn requires time

46. breaking down silos is
HARD!

47. we need to design pipelines
with our users in mind,
just like with our apps

48. Amy, the Product Owner

50. Amy, the Product Owner

51. non-technical stakeholders
are part of delivery too

52. pipeline = (real) workflow
highlight bottlenecks => build bridges
trust requires time => automate gradually
not just technical => include everyone

53. pipeline = (real) workflow
highlight bottlenecks => build bridges
trust requires time => automate gradually
not just technical => include everyone

54. pipeline = (real) workflow
highlight bottlenecks => build bridges
trust requires time => automate gradually
not just technical => include everyone

55. Today
1. DevOps integration: two camps
2. Pattern #1: Best of breed tools
3. Pattern #2: Pipeline = workflow
4. Pattern #3: Own your golden logs

56. 111.222.333.123 HOME -
[01/Feb/1998:01:08:39 -0800] "GET
/bannerad/ad.htm HTTP/1.0" 200 198
"http://www.referrer.com/bannerad/ba_in
tro.htm" "Mozilla/4.01 (Macintosh; I;
PPC)"

57. the problems with logs

58. the problems with logs
too much information
information hiding

59. the problems with logs
information hiding

60. the problems with logs
integrated tools
information hiding

61. the problems with logs
too much information

63. difficult to use log
aggregation to diagnose
pipeline issues with an
integrated DevOps tool

64. https://www.infoq.com/articles/why-test-logging

65. information hiding
should not be the reason
why you can’t diagnose

66. the problem with
error messages

67. generic error messages

68. generic error messages
“VM could not be started”

69. generic error messages
“VM could not be started”
“Deployment failed”

71. without correct error
information you can’t
diagnose/improve

72. time between failures
time to repair
old view of the world

73. time between failures
time to repair
new view of the world

74. time to repair
=
time to diagnose + time to fix

75. time to repair
=
time to diagnose (80) + time to fix (20)

76. log aggregation
own your logs
quickly find correlated events
don’t depend on generic error messages
reduce time to diagnose

77. Today
1. DevOps integration: two camps
2. Pattern #1: Best of breed tools
3. Pattern #2: Pipeline = workflow
4. Pattern #3: Own your golden logs

78. Tomorrow
tooling choices are
trade-off choices

79. Tomorrow
tool chain ownership
supports evolution

80. Tomorrow
visualize real workflow
to break down silos

81. Sources
• Manuel Pais and Matthew Skelton, 2017, ‘Continuous
Delivery Anti-Patterns’, https://dzone.com/articles/continuous-delivery-
anti-patterns
• Betty Zakheim, 2017, ‘How Difficult Can It Be to Inte-
grate Software Development Tools? The Hard Truth’,
https://www.infoq.com/articles/tool-integration-hard-truth
• Damon Edwards, 2014 ‘DevOps is an Enterprise
Concern’,
https://www.infoq.com/interviews/interview-damon-edwards-qcon-2014
• Don G. Reinertsen, 2009, ‘The Principles of Product Development
Flow: Second Generation Lean Product Development’
https://www.youtube.com/watch?v=L6v6W7jkwok

82. thank you
Manuel Pais
@manupaisable
me@manuelpais.net

83. La La Land of DevOps Integration
Manuel Pais
@manupaisable | manuelpais.net
Madrid DevOps Feb 2018
21 Feb 2018, Madrid ES