Have you ever build your own distributed system? Do you think it is very complicated task? All those CAP theorem, transport protocols and consensus algorithms, right? But I can say definitely - NO. It is not so hard and complicated, even more, it can be easy and fun if you are using good tools and frameworks. My example will be build on Atomix and I will show you how easy and funny it can be.

1. Distributed Systems
Fast, Fun & Useful

2. Me
!2

3. Me
!2
andriyrav@gmail.com
JandriyR
@AndriyRymar

4. Me
!2
andriyrav@gmail.com
JandriyR
@AndriyRymar
Found / Co-found: &

5. Me
!2
andriyrav@gmail.com
JandriyR
@AndriyRymar
Morning@Lohika
Found / Co-found:
Program committee:
&
&

6. Me
!2
andriyrav@gmail.com
JandriyR
@AndriyRymar
Morning@Lohika
Feb 23, Lviv
Found / Co-found:
Program committee:
Organize:
&
&

7. Content
!3

8. Content
!3
What?

9. Content
!3
What?
Why?

10. Content
!3
What?
Why?
How?

12. FUN
https://mbtskoudsalg.com/images/alien-clipart-1.png

13. FUN
FAST
https://mbtskoudsalg.com/images/alien-clipart-1.pnghttps://image.flaticon.com/icons/png/512/263/263385.png

14. FUN
FAST
USEFUL
https://mbtskoudsalg.com/images/alien-clipart-1.pnghttps://ubisafe.org/images/astronaut-transparent-3.pnghttps://image.flaticon.com/icons/png/512/263/263385.png

15. What?

16. What?
!6

17. What?
!6
Features

18. What?
!6
Features
Goals

19. What?
!6
Features
Goals
Challenges

20. Features
!7

21. Features
!7

22. Features
!7

23. Features
!7

24. Features
!7

25. Goals
!8

26. Goals
!8
Transparency

27. Goals
!8
Transparency

28. Goals
!9

29. Goals
!9
Openness

30. Goals
!9
Openness

31. Goals
!9
Openness

32. Goals
!10

33. Goals
!10
Reliability

34. Goals
!10
Reliability

35. Goals
!10
Reliability

36. Goals
!10
Reliability

37. Goals
!10
Reliability

38. Goals
!11

39. Goals
!11
Performance

40. Goals
!11
Performance

41. Goals
!11
Performance

42. Goals
!11
Performance

43. Goals
!12

44. Goals
!12
Scalability

45. Goals
!12
Scalability

46. Goals
!12
Scalability

47. Goals
!12
Scalability

48. Goals
!13

49. Goals
!13
Transparency

50. Goals
!13
Transparency
Openness

51. Goals
!13
Transparency
Openness
Reliability

52. Goals
!13
Transparency
Openness
Reliability
Performance

53. Goals
!13
Transparency
Openness
Reliability
Performance
Scalability

54. Challenges
!14

55. Challenges
!14
Security
http://i.imgur.com/VdzZAqx.png

56. !15

57. Challenges
!16
Security

58. Challenges
!16
Security

59. Challenges
!16
Security

60. Challenges
!17

61. Challenges
!17
Fault tolerance

62. Challenges
!17
Fault tolerance

63. Challenges
!17
Fault tolerance

64. Challenges
!18

65. Challenges
!18
Coordination

66. Challenges
!18
Coordination

67. Challenges
!18
Coordination

68. Challenges
!19

69. Challenges
!19
Security

70. Challenges
!19
Security
Fault tolerance

71. Challenges
!19
Security
Fault tolerance
Coordination

72. What?
!20

73. What?
!20
Features

74. What?
!20
Features
Goals

75. What?
!20
Features
Goals
Challenges

76. Why?

77. Why?
!22

78. Why?
!22
Data Processing

79. Why?
!22
Data Processing Task Execution

80. !23
Data Processing

81. !23
Data Processing
MR
Map Reduce

82. !23
Data Processing
DAG
Distributed Acyclic Graph

83. !24
Distributed Acyclic Graph

84. !24
Distributed Acyclic Graph
Source

85. !24
Distributed Acyclic Graph
Source
Tokenize

86. !24
Distributed Acyclic Graph
Source
Tokenize Accumulate

87. !24
Distributed Acyclic Graph
Source
Tokenize Accumulate Combine

88. !24
Distributed Acyclic Graph
Source
Tokenize Accumulate Combine
Result

89. !24
Distributed Acyclic Graph
Source
Tokenize Accumulate Combine
Result
Word count

90. !24
Distributed Acyclic Graph
Source
Tokenize Accumulate Combine
Text lines
Result
Word count

91. !24
Distributed Acyclic Graph
Source
Tokenize Accumulate Combine
Text lines
Extracted
words
Result
Word count

92. !24
Distributed Acyclic Graph
Source
Tokenize Accumulate Combine
Text lines
Extracted
words
Word 2 count
pairs
Result
Word count

93. !24
Distributed Acyclic Graph
Source
Tokenize Accumulate Combine
Text lines
Extracted
words
Word 2 count
pairs
Result
Word count
Unique pairs

94. !25
Task execution

95. !25
Task execution

96. !25
Task execution
Job coordinator

97. !25
Task execution
Job coordinator

98. !26
Task execution

99. !26
Task execution
Self organized

100. !26
Task execution
Self organized

101. !26
Task execution
Self organized

102. Why?
!27

103. Why?
!27
Scalability

104. Why?
!27
Scalability
Reliability
http://files.channel9.msdn.com/thumbnail/6ea2b003-389b-4e21-abbe-af00822ae852.png

105. Why?
!27
Scalability
Reliability
Speed
http://files.channel9.msdn.com/thumbnail/6ea2b003-389b-4e21-abbe-af00822ae852.png

106. How?

107. !29

108. How?
!30

109. How?
!30
Cluster

110. How?
!30
Cluster
Communication

111. How?
!30
Cluster
Communication
Coordination

112. How?
!30
Cluster
Communication
Coordination
Failure detection

113. How?
!30
Cluster
Communication
Coordination
Failure detection
Consensus

114. Cluster
!31

115. Cluster
!31

116. Cluster
!31

117. Cluster
!31

118. Cluster
!31

119. Cluster
!32
?

120. Cluster
!33

121. Cluster
!33

122. Cluster
!33

123. Cluster
!33

124. Cluster
!33

125. Communication
!34

126. Communication
!34
Data format

127. Communication
!34
Data format

128. Communication
!35

129. Communication
!35
Routing

130. Communication
!35
Routing

131. Communication
!35
Routing

132. Communication
!36

133. Communication
!36
Acknowledgements

134. Communication
!36
Acknowledgements

135. Communication
!36
Acknowledgements

136. Communication
!36
Acknowledgements

137. Communication
!37

138. Communication
!37
Timeouts & retries

139. Communication
!37
Timeouts & retries

140. Communication
!37
Timeouts & retries

141. Communication
!37
Timeouts & retries

142. Communication
!37
Timeouts & retries

143. Communication
!38

144. Communication
!38
Direction

145. Communication
!38
Direction

146. Communication
!38
Direction

147. Communication
!38
Direction

148. Communication
!38
Direction
?

149. Communication
!39

150. Communication
!39
Sequence & Flow

151. Communication
!39
Sequence & Flow

152. Communication
!39
Sequence & Flow

153. Communication
!40

154. Communication
!40
Epidemic algorithms

155. Communication
!40
Epidemic algorithms
Gossip

156. Gossip
!41

157. Gossip
!41

158. Coordination
!42

159. Coordination
!42
Data distribution

160. Coordination
!42
Data distribution
Neighborhood selection

161. Data distribution
!43

162. Data distribution
!43

163. Data distribution
!43
- smthng + smthng

164. Data distribution
!43
Long
- smthng + smthng

165. Data distribution
!44
Long
- smthng + smthng

166. Neighborhood selection
!45

167. Neighborhood selection
!45
Snitch funcitons

168. Neighborhood selection
!45
Snitch funcitons
https://vignette.wikia.nocookie.net/harrypotter/images/b/b9/Golden_Snitch..png/revision/latest?cb=20161120075526

169. Neighborhood selection
!46
Snitch funcitons

170. Neighborhood selection
!47
Snitch funcitons

171. Neighborhood selection
!47
Snitch funcitons

172. Neighborhood selection
!47
Snitch funcitons

173. Neighborhood selection
!47
1000M ly
Snitch funcitons

174. Neighborhood selection
!47
1000M ly
Snitch funcitons

175. Neighborhood selection
!47
1000M ly
450M ly
Snitch funcitons

176. Neighborhood selection
!47
1000M ly
450M ly
Snitch funcitons

177. Failure detection
!48

178. Failure detection
!48
Exact value

179. Failure detection
!48
Exact value
Continuous value

180. Exact failure value
!49

181. Exact failure value
!49

182. Exact failure value
!49

183. Exact failure value
!49

184. Continuous failure value
!50

185. Continuous failure value
!50

186. Continuous failure value
!50

187. Continuous failure value
!50

188. Continuous failure value
!50

189. Continuous failure value
!50

190. Continuous failure value
!50

191. Continuous failure value
!50

192. Continuous failure value
!50

193. Consensus
!51

194. Consensus
!51
https://images.vexels.com/media/users/3/152300/isolated/preview/ae0fc81df564354bb6b22d3b4fca7e85-astronauta-segurando-bandeira-dos-desenhos-animados-by-vexels.png

195. Consensus
!52

196. Consensus
!52
Raft

197. Consensus
!52
Raft
Primary-backup

198. Raft
!53

199. Raft
!53

200. Raft
!53

201. Raft
!53

202. Raft
!53

203. !54
Raft

204. !54
Raft

205. !54
Leder
Raft

206. !54
Leder
Follower
Raft

207. !54
Leder
Follower Candidate
Raft

208. !54
Leder
Follower Candidate
sync/req
Raft

209. !54
Leder
Follower Candidate
sync/req
Raft

210. !54
Leder
Follower Candidate
sync/req
init election
Raft

211. !54
Leder
Follower Candidate
sync/req
init election
start election
Raft

212. !54
Leder
Follower Candidate
sync/req
init election
start election
change to leader
Raft

213. !54
Leder
Follower Candidate
sync/req
init election
start election
change to leader
Raft
change to follower

214. Primary-backup
!55

215. Primary-backup
!55

216. Primary-backup
!55

217. Primary-backup
!55

218. Primary-backup
!55

219. Primary-backup
!56

220. Primary-backup
!56
Client

221. Primary-backup
!56
Client
Primary

222. Primary-backup
!56
Client
Primary
Backup

223. Primary-backup
!56
Client
Primary
Backup
synk synk

224. Primary-backup
!56
Client
Primary
Backup
synk synk
req

225. Primary-backup
!56
Client
Primary
Backup
synk synk
req
upd

226. Primary-backup
!56
Client
Primary
Backup
synk synk
req resp
upd

227. Primary-backup
!56
Client
Primary
Backup
synk synk synk
req resp
upd

228. Primary-backup
!56
Client
Primary
Backup
synk synk synk
req resp
upd

229. Primary-backup
!56
Client
Primary
Backup
synk synk synk
req resp
upd
I’m Primary

230. How?
!57

231. How?
!57
Cluster

232. How?
!57
Cluster
Communication

233. How?
!57
Cluster
Communication
Coordination

234. How?
!57
Cluster
Communication
Coordination
Failure detection

235. How?
!57
Cluster
Communication
Coordination
Failure detection
Consensus

236. DEMO

237. Atomix
!59

238. Atomix
!60

239. Atomix
!61https://vignette.wikia.nocookie.net/starwars/images/6/62/X-70B-Phantom-TOR.png/revision/latest?cb=20161011022806

240. Demo plan
!62

241. Galaxy race
!63

242. Galaxy race
!63

243. !64
Galaxy race

244. !64
Galaxy race

245. !64
Galaxy race

246. !65
Galaxy race

247. !66
Galaxy race

248. !66
Galaxy race

249. !66
Galaxy race

250. !66
Galaxy race
Boolean

251. !66
Galaxy race
Boolean
Start race
Finish race

252. !66
Galaxy race
Boolean Map
Start race
Finish race

253. !66
Galaxy race
Boolean Map
Start race
Finish race
Racer name
Racer sate

254. !66
Galaxy race
Boolean Map
Start race
Finish race
Racer name
Racer sate
0…..n

255. !66
Galaxy race
Boolean Map
Start race
Finish race
Racer name
Racer sate
0…..n
UI

256. !67

257. Hope you like it
!68

258. Summary
!69

259. Summary
!69
What?

260. Summary
!69
What?
Why?

261. Summary
!69
What?
Why?
How?

262. Demo repo
!70
https://github.com/flylight/atomix-space-racing

263. Thanks
!71
Nick Mkrtchyan
https://codepen.io/WebSonick/

264. Resources
!72
• https://images.vexels.com/media/users/3/150026/isolated/preview/580cca5efa65c7c69ba5cad9e954698d-ilustra--o-de-foguete-espacial-
by-vexels.png
• http://www.transparentpng.com/download/space/space-rocket-silver-icon-png-30.png
• https://pixler.com.au/wp-content/uploads/2017/05/rocket.png
• https://dumielauxepices.net/sites/default/files/spaceship-clipart-772365-6555786.png
• https://apprecs.com/android/com.nanoki.warspace/war-space-free-strategy-mmo
• https://mbtskoudsalg.com/explore/spaceship-png-images/
• https://media.indiedb.com/images/games/1/51/50676/sun.png
• http://planetlazer.net/beta/wp-content/uploads/2014/09/fireplanet.png
• https://img00.deviantart.net/16cf/i/2012/137/9/5/space_station_3_by_mysticmorning-d504aab.png
• https://ubisafe.org/images/astronaut-transparent-3.png
• https://vignette.wikia.nocookie.net/starwars/images/c/c4/XWAPLT2-StationStub.png/revision/latest?cb=20160904144954
• https://i.pinimg.com/originals/a1/40/a5/a140a5c1206d3cd334cf1781d0d41d0b.png
• https://cdn150.picsart.com/upscale-252635731007212.png?r1024x1024
• https://cdn.pixabay.com/photo/2017/07/29/04/54/cartoon-2550646_1280.png
• https://wallscover.com/images/showtime-wallpaper-5.jpg
• http://mightynice.com.au/wp-content/uploads/2015/07/Spaceman2.png

265. !73
Thank You! https://i.gifer.com/Bf.gif

266. !73
Thank You! https://i.gifer.com/Bf.gif

267. Questions?
!74
andriyrav@gmail.com
JandriyR
@AndriyRymar
Become a speakerContacts
Morning@Lohika
JavaDay Lviv