Slides from JEEConf 2019 talk about Microservices with Istio Service Mesh

1. Microservices
the phantom menace
istio service mesh
the new hope

2. About me
Sergii Bishyr
Software engineer at Lohika
@BishyrS
seriybg@gmail.com
2

3. Agenda
• Why do we need Service Mesh?
• What is Istio and how to use it
• Demo
• Summary
3

4. Why Microservices?
• It’s a trend
• Make changes less expensive
• Use right tool for the right task
• Scalability
• etc.
4

5. Why Microservices?
• It’s a tend
• Make change less expensive
• Use right tool for the right task
• Scalability
• etc.
5
Complexity it
introduces!

6. Microservices
6

7. Microservices
7

8. Client Library
8

9. Client Library
9
Service
Discovery
Circuit
breaker
Tracing,
Metrics
etc.

10. Client Library
10
Service
Discovery
Circuit
breaker
Tracing,
Metrics
etc.

11. Client Library
11

12. Polyglot architectures
12

13. Client Library
13

14. Sidecar Pattern
14

15. Sidecar Pattern
15

16. Sidecar Pattern
16

17. Service Mesh
17
Control Plane

18. Service Mesh
18
Control Plane
Configs

19. Service Mesh
19
Control Plane
Configs

20. ThoughtWorks Technology Radar
thoughtworks.com/radar/techniques/service-mesh 20

21. Meet Istio
istio.io
21

22. Istio Control Plane
Pilot Mixer Citadel
Configs Telemetry,
Policy checks
TLS certs
22

23. Istio Proxy
23

24. Istio
24
Control Plane
Configs

25. ThoughtWorks Technology Radar
thoughtworks.com/radar/platforms/istio 25

26. Service to Service communication
26

27. Service to Service communication
27

28. Service to Service communication
28

29. Service to Service communication
29

30. Service to Service communication
30

31. Service to Service communication
31

32. Service Discovery
32
Service
Registry

33. Service Discovery
33
Service
Registry

34. Service Discovery
34
Service
Registry

35. Service Discovery
35
Service
Registry

36. Service Discovery
36
Service
Registry

37. Service Discovery
37
Service
Registry

38. Service Discovery
38
Service
Registry

39. Service Discovery
39
Service
Registry

40. Fault Handling
40

41. Fault Handling
41

42. Fault Handling
42
Service A Service B

43. Fault Handling
43
Service A Service B

44. Fault Handling
Timeout
44
Service A Service B

45. Fault Handling
Timeout
Retry
45
Service A Service B

46. Istio Resiliency
46
Service A Service B
Timeout: 1m, Retries: 5

47. Istio Resiliency
47
Service A Service B
Timeout: 1m, Retries: 5
Timeout: 15s, Retries: 3

48. Fault Handling
48
Service A Service B

49. Fault Handling
49
Service A Service B

50. Fault Handling
50
Service A Service B

51. Istio Circuit Breaker
51
Service A Service B

52. Istio Circuit Breaker
52
Service A Service B

53. Istio Circuit Breaker
53
Service A Service B

54. Istio Circuit Breaker
54
Service A Service B
max connections
max pending requests
max requests
consecutive errors

55. Testing
55

56. Testing
56

57. Testing
57

58. Testing
58

59. Testing
59

60. Istio Fault injection
60

61. Istio Fault injection
61

62. Istio Fault injection
62

63. Release testing
63
Service A Service B v1

64. Release testing
64
Service A
Service B v1
Service B v2

65. Blue-Green Deployment
65
Service A
Service B v1
Service B v2
GREEN
BLUE

66. Blue-Green Deployment
66
TESTS
Service A
Service B v1
Service B v2
GREEN
BLUE

67. Blue-Green Deployment
67
Service A
Service B v1
Service B v2
GREEN
BLUE

68. Istio Traffic mirroring
68
Service A
Service B v1
Service B v2
GREEN
BLUE

69. Istio Traffic mirroring
69
Service A
Service B v1
Service B v2
GREEN
BLUE

70. Canary Deployment
70
Service A
Service B v1
Service B v2

71. Canary Deployment
71
Service A
Service B v1
Service B v2

72. Canary Deployment
72
Service A
Service B v1
Service B v2

73. Istio Advanced routing
73
Service A
Service B v1
Service B v2

74. Istio Advanced routing
74
Service A
Service B v1
Service B v2

75. Security
75

76. Encryption
76
HTTPS

77. Encryption
77
HTTPS

78. Encryption
78
HTTPS
Certificate
Authority

79. Encryption
79
HTTPS
Certificate
Authority

80. Encryption
80
HTTPS
Certificate
Authority

81. Istio Mutual TLS
81
Istio Citadel
HTTPS

82. Istio Mutual TLS
82
Istio Citadel
HTTPS

83. Istio Mutual TLS
83
Istio Citadel
HTTPS

84. Istio Mutual TLS
84
Istio Citadel
HTTPS

85. Troubleshooting
85

86. Troubleshooting
86

87. Troubleshooting
87

88. Troubleshooting
88

89. Troubleshooting
89
?
?
?
?
? ? ?
???

90. Distributed Tracing, Log Aggregation,
Monitoring
90

91. Istio Telemetry
Service Service Service
Istio Mixer
Tracing
Metrics
Logging
etc.
91

92. Istio Telemetry
Service Service Service
Istio Mixer
92

93. Istio Key Concepts
93
The Cluster
SERVICE
SERVICE
SERVICEVIRTUAL
SERVICE
DESTINATION
RULE
GATEWAY SERVICE
ENTRY
POLICIES

94. Not so long time ago, in a company
far far away…
(DEMO TIME)
github.com/SeriyBg/starwars-istio 94

95. 95github.com/SeriyBg/starwars-istio
jeeconf.istiodemo.xyz

96. 96
Summary
● Focus on business logic
● Freedom to choose any technology stack
● Observability out of the box
● Solve most of the microservices problems
(but not all of them)
Choose wisely.
You are responsible for your application!

97. Resources
• Official Istio blog
istio.io/blog
• “Istio in Action” by Christian Posta
manning.com/books/istio-in-action
• Christian Posta’s blog
blog.christianposta.com/tags/#istio
• Red Hat Developers blog
developers.redhat.com/topics/service-mesh
97

98. Thank You!
@BishyrS
seriybg@gmail.com
Any questions do you have?
98