The document outlines principles of microservices, including modeling services around business domains, having a culture of automation, hiding implementation details, decentralizing systems, isolating failures, deploying independently, making systems highly observable, and other principles. The presentation provides examples and discusses strategic goals and architectural practices for designing fine-grained microservice systems.

1. PRINCIPLES OF
MICROSERVICES
Sam Newman
XP Days Ukraine December 2014
1

2. @samnewman#xpdays

3. @samnewman#xpdays
Accounts
Returns
Invoicing
Shipping
Inventory
Customer
Service

4. @samnewman#xpdays
Accounts
Returns
Invoicing
Shipping
Inventory
Customer
Service
Small Autonomous services
that work together

5. @samnewman#xpdays
4
Show Gilt, Groupon, Netflix, Amazon

6. @samnewman#xpdays
4
Show Gilt, Groupon, Netflix, Amazon

7. @samnewman#xpdays
4
Show Gilt, Groupon, Netflix, Amazon

8. @samnewman#xpdays
Sam Newman
Building
Microservices
DESIGNING FINE-GRAINED SYSTEMS

9. @samnewman#xpdays

10. @samnewman#xpdays http://www.12factor.net/

11. @samnewman#xpdays
Strategic Goals
Architectural
Principles
Design and Delivery
Practices
Enable scalable
business
More customers/transactions
Self-service for customers
Support entry into
new markets
Flexible operational processes
New products and operational
processes
Support innovation
in existing markets
Flexible operational processes
New products and operational
processes
Reduce inertia
Make choices that favour rapid
feedback and change, with reduced
dependencies across teams.
Eliminate accidental
complexity
Aggressively retire and replace
unnecessarily complex processes,
systems, and integrations so that we
can focus on the essential
complexity.
Consistent interfaces
and data flows
Eliminate duplication of data and
create clear systems of record, with
consistent integration interfaces.
No silver bullets
Off the shelf solutions deliver early
value but create inertia and
accidental complexity.
Standard REST/HTTP
Encapsulate legacy
Eliminate integration
databases
Consolidate and
cleanse data
Published integration
model
Small independent
Services
Continuous
deployment
Minimal customisation
of COTS/SAAS

12. @samnewman#xpdays
Small Autonomous services
that work together

13. @samnewman#xpdays
10
Principles Of
Microservices

14. @samnewman#xpdays
10
Principles Of
Microservices
Modelled Around
Business Domain

15. @samnewman#xpdays
10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation

16. @samnewman#xpdays
10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details

17. @samnewman#xpdays
10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Decentralise All
The Things

18. @samnewman#xpdays
10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Decentralise All
The Things
Deploy
Independently

19. @samnewman#xpdays
10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Decentralise All
The Things
Isolate Failure Deploy
Independently

20. @samnewman#xpdays
10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Decentralise All
The Things
Isolate Failure Deploy
Independently
Highly
Observable

21. @samnewman#xpdays
10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Decentralise All
The Things
Isolate Failure Deploy
Independently
Highly
Observable

22. @samnewman#xpdays
Accounts
Returns
Invoicing
Shipping
Inventory
Customer
Service

23. @samnewman#xpdays

24. @samnewman#xpdays
13
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Decentralise All
The Things
Isolate Failure Deploy
Independently
Highly
Observable
✔

25. @samnewman#xpdays
13
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Decentralise All
The Things
Isolate Failure Deploy
Independently
Highly
Observable
✔

26. @samnewman#xpdays

27. @samnewman#xpdays
3 Months
2 Microservices

28. @samnewman#xpdays
3 Months
2 Microservices
12 Months
10 Microservices

29. @samnewman#xpdays
3 Months
2 Microservices
12 Months
10 Microservices
18 Months
60 Microservices

30. @samnewman#xpdays
Infrastructure Automation

31. @samnewman#xpdays
Infrastructure Automation
Automated Testing

32. @samnewman#xpdays
Infrastructure Automation
Continuous Delivery
Automated Testing

33. @samnewman#xpdays
16
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Decentralise All
The Things
Isolate Failure Deploy
Independently
Highly
Observable
✔ ✔

34. @samnewman#xpdays
16
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation
Hide Implementation
Details
Decentralise All
The Things
Isolate Failure Deploy
Independently
Highly
Observable
✔ ✔

35. @samnewman#xpdays
DB

36. @samnewman#xpdays
DB

37. @samnewman#xpdays
DB

38. @samnewman#xpdays
DB

39. @samnewman#xpdays
DB
HIDE YOUR DATABASE

40. @samnewman#xpdays
http://martinfowler.com/bliki/images/boundedContext/sketch.png

41. @samnewman#xpdays
19
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Decentralise All
The Things
Isolate Failure Deploy
Independently
Highly
Observable
✔ ✔ ✔

42. @samnewman#xpdays
19
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Decentralise All
The Things
Isolate Failure Deploy
Independently
Highly
Observable
✔ ✔ ✔

43. @samnewman#xpdays

44. @samnewman#xpdays
What is autonomy?

45. @samnewman#xpdays
What is autonomy?
Giving people as much freedom as possible
to do the job at hand

46. @samnewman#xpdays
What is autonomy?
Giving people as much freedom as possible
to do the job at hand

47. @samnewman#xpdays
SELF-SERVICE
https://www.flickr.com/photos/katsrcool/15184711908/

48. @samnewman#xpdays
http://tech.gilt.com/post/102628539834/making-architecture-work-in-microservice
SHARED GOVERNANCE

49. @samnewman#xpdays
OWNER-OPERATOR
https://www.flickr.com/photos/stevendepolo/5939055612

50. @samnewman#xpdays
INTERNAL OPEN SOURCE

51. @samnewman#xpdays
DUMB-PIPES, SMART ENDPOINTS
Magical Mystery Bus

52. @samnewman#xpdays
Magical Mystery Bus

53. @samnewman#xpdays

54. @samnewman#xpdays
28
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Isolate Failure Deploy
Independently
Highly
Observable
✔ ✔ ✔
Decentralise All
The Things
✔

55. @samnewman#xpdays
28
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Isolate Failure Deploy
Independently
Highly
Observable
✔ ✔ ✔
Decentralise All
The Things
✔

56. @samnewman#xpdays
After the break!

57. @samnewman#xpdays
ONE SERVICE PER-HOST
Host
Service

58. @samnewman#xpdays
ONE SERVICE PER-HOST
Host
Service
Host
Service Service
Service Service
VS

59. @samnewman#xpdays
CONSUMER-DRIVEN CONTRACTS
Expectations
Prod
Shipping Inventory

60. @samnewman#xpdays
https://github.com/realestate-com-au/pact

61. @samnewman#xpdays
CO-EXIST ENDPOINTS
Customer Service
Shipping

62. @samnewman#xpdays
CO-EXIST ENDPOINTS
Customer Service
Shipping
V2V1

63. @samnewman#xpdays
CO-EXIST ENDPOINTS
Customer Service
Shipping
V2V1

64. @samnewman#xpdays
CO-EXIST ENDPOINTS
Customer Service
Shipping
V2

65. @samnewman#xpdays
34
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Isolate Failure
Highly
Observable
✔ ✔ ✔
Decentralise All
The Things
✔
Deploy
Independently✔

66. @samnewman#xpdays
34
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Isolate Failure
Highly
Observable
✔ ✔ ✔
Decentralise All
The Things
✔
Deploy
Independently✔

67. @samnewman#xpdays

68. @samnewman#xpdays
1 in 100

69. @samnewman#xpdays
1 in 100

70. @samnewman#xpdays
4 in 100

71. @samnewman#xpdays
Strangler App

72. @samnewman#xpdays
Strangler App
Legacy App
Legacy AppLegacy App

73. @samnewman#xpdays
Strangler App
Legacy App
Legacy App
Requests
Legacy App

74. @samnewman#xpdays
Strangler App
Legacy App
Legacy App
Requests
Legacy App

75. @samnewman#xpdays
Strangler App
Legacy App
Legacy App
Requests
Legacy App

76. @samnewman#xpdays
Strangler App
Legacy App
Legacy App
Requests
Legacy App
30 - 60 Concurrent Requests

77. @samnewman#xpdays
Strangler App
Legacy App
Legacy App
Requests
Legacy App
30 - 60 Concurrent Requests
> 800 Concurrent Requests

78. @samnewman#xpdays
Strangler App
Legacy App
Legacy App
Requests
Legacy App
30 - 60 Concurrent Requests
> 800 Concurrent Requests

79. @samnewman#xpdays
Strangler App
Legacy App Legacy App Legacy App
Thread Pool

80. @samnewman#xpdays
Strangler App
Legacy App Legacy App Legacy App
Thread Pool
Failing…slowly!

81. @samnewman#xpdays
Strangler App
Legacy App Legacy App Legacy App
Thread Pool
Failing…slowly!

82. @samnewman#xpdays
Strangler App
Legacy App Legacy App Legacy App
Thread Pool
Failing…slowly!
Thread-pool
exhausted

83. @samnewman#xpdays
Strangler App
Legacy App Legacy App Legacy App
Thread Pool
Failing…slowly!
Thread-pool
exhausted
No requests to other
downstream apps

84. @samnewman#xpdays
Strangler App
Legacy App Legacy App Legacy App
Thread Pool
Failing…slowly!
Thread-pool
exhausted
No requests to other
downstream apps

85. @samnewman#xpdays
Strangler App
Legacy App Legacy App Legacy App
Thread Pool
Failing…slowly!
Thread-pool
exhausted
Requests
Building Up
No requests to other
downstream apps

86. @samnewman#xpdays
Strangler App
Legacy App Legacy App Legacy App
Thread Pool

87. @samnewman#xpdays
Strangler App
Legacy App Legacy App Legacy App
Fix Timeouts
Thread Pool

88. @samnewman#xpdays
Strangler App
Legacy App Legacy App Legacy App
Fix Timeouts
Thread Pool

89. @samnewman#xpdays
Strangler App
Legacy App Legacy App Legacy App
Fix Timeouts
Thread Pool Thread PoolThread Pool

90. @samnewman#xpdays
Strangler App
Legacy App Legacy App Legacy App
Fix Timeouts
Thread Pool Thread PoolThread Pool
Bulkhead
Downstream
Connections

91. @samnewman#xpdays
Strangler App
Legacy App Legacy App Legacy App
Fix Timeouts
Thread Pool Thread PoolThread Pool
Bulkhead
Downstream
Connections

92. @samnewman#xpdays
Strangler App
Legacy App Legacy App Legacy App
Fix Timeouts
Thread Pool Thread PoolThread Pool
Bulkhead
Downstream
Connections
Circuit Breakers

93. @samnewman#xpdays
39
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Highly
Observable
✔ ✔ ✔
Decentralise All
The Things
✔
Deploy
Independently✔
Isolate Failure✔

94. @samnewman#xpdays
39
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Highly
Observable
✔ ✔ ✔
Decentralise All
The Things
✔
Deploy
Independently✔
Isolate Failure✔

95. @samnewman#xpdays

96. @samnewman#xpdays
AGGREGATION

97. @samnewman#xpdays
LOGS
AGGREGATION

98. @samnewman#xpdays
LOGS
STATS
AGGREGATION

99. @samnewman#xpdays
CORRELATION IDS

100. @samnewman#xpdays
CORRELATION IDS
ID 8964

101. @samnewman#xpdays
CORRELATION IDS
ID 8964
ID 8964
ID 8964
ID 8964
ID 8964

102. @samnewman#xpdays
Principles Of
Microservices

103. @samnewman#xpdays
Principles Of
Microservices
Modelled Around
Business Domain

104. @samnewman#xpdays
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation

105. @samnewman#xpdays
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details

106. @samnewman#xpdays
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Decentralise All
The Things

107. @samnewman#xpdays
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Decentralise All
The Things
Deploy
Independently

108. @samnewman#xpdays
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Decentralise All
The Things
Isolate Failure Deploy
Independently

109. @samnewman#xpdays
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details
Decentralise All
The Things
Isolate Failure Deploy
Independently
Highly
Observable

110. Sam Newman
@samnewman
THANKS!