Scalaとビッグデータで弱小卓球部を強くします

1. ! Scala x
ScalaMatsuri2018

2. Who are You ?
LIVEDSP
GitHub: https://github.com/x1-
http://x1.inkenkun.com/
2

3. Who are You ?
GitHub: https://github.com/inkenkun
3

5. 5

6. 6

7. 7

8. 8

9. 9

10. 10

11. 11

12. 12

13. 13

14. 14

15. 15

16. 16

17. 17
{"time":"2018-02-12T16:32:50.110
Z","player":" ","speed":
120.3,"x":515.294,"y":
102.540,"z":82.540}

18. 18
fluentd

19. 19

20. 20

21. 21
Apache Pulsar
phaistos-networks/TANK
NATS
Cloud Pub/Sub
Amazon Kinesis
Apache Kafka
Apache Kafka

22. 22

23. 23

24. 24

25. 25
{"time":"2018-02-12T16:32:50.110Z","player
":" ","speed":120.3,"pos":{"x":
515.294,"y":102.540,"z":82.540}}
{"time":"2018-02-12T16:32:50.210Z","player
":" ","speed":119.8,"pos":{"x":
926.442,"y":130.206,"z":148.540}}
{"time":"2018-02-12T16:32:50.310Z","player
":" ","speed":119.3,"pos":{"x":
1215.932,"y":157.120,"z":242.540}}
{"time":"2018-02-12T16:32:50.410Z","player
":" ","speed":118.5,"pos":{"x":
1505.125,"y":182.712,"z":126.540}}
{"time":"2018-02-12T16:32:50.510Z","player
":" ","speed":116.4,"pos":{"x":
1824.087,"y":211.917,"z":11.540}}
{“time":"2018-02-12T16:32:50.610Z","player
":" ","speed":116.4,"pos":{"x":
2105.629,"y":246.344,"z":0.540}}
:

26. 26
{"time":"2018-02-12T16:32:50.110Z","player":" ","speed":
120.3,"pos":{"x":515.294,"y":102.540,"z":82.540}}
{"time":"2018-02-12T16:32:50.210Z","player":" ","speed":
119.8,"pos":{"x":926.442,"y":130.206,"z":148.540}}
{"time":"2018-02-12T16:32:50.310Z","player":" ","speed":
119.3,"pos":{"x":1215.932,"y":157.120,"z":242.540}}
{"time":"2018-02-12T16:32:50.410Z","player":" ","speed":
118.5,"pos":{"x":1505.125,"y":182.712,"z":126.540}}
{"time":"2018-02-12T16:32:50.510Z","player":" ","speed":
116.4,"pos":{"x":1824.087,"y":211.917,"z":11.540}}
{“time":"2018-02-12T16:32:50.610Z","player":" ","speed":
116.4,"pos":{"x":2105.629,"y":246.344,"z":0.540}}
:
time player speed angle …
2018-02-12T16:32:50.110Z 120.3 210.52
2018-02-12T16:32:50.210Z 119.8 212.30
2018-02-12T16:32:50.310Z 119.3 214.11
: : :

27. 27

28. 28

29. OSS
29

30. 30
JVM
Java Scala
※ Java API Scala Java

31. 31
Scala

32. Scala
32
f(x) g(x) h(x)

33. 33
f(x)
f(x)
f(x)
f(x)
f(x)
f(x)
f(x)
f(x)
f(x)
f(x)
f(x)
A B
Scala

34. 34
Scala
(Stream, map, filter, fold, reduce)
Scala Java
Scala

35. 35
e p
p e e
e p
Functional Programming in Scala 14
Scala

36. 36

37. 37
13%
time player speed angle …
2018-02-12T16:32:50.110Z 120.3 210.52
2018-02-12T16:32:50.210Z 119.8 212.30
2018-02-12T16:32:50.310Z 119.3 214.11
: : :
15%
17%
3% 2% 5%
5%
30%
10%

38. 38
time player speed angle …
2018-02-12T16:32:50.110Z 120.3 210.52
2018-02-12T16:32:50.210Z 119.8 212.30
2018-02-12T16:32:50.310Z 119.3 214.11
: : :

39. 39

40. 40
Google Data Studio
Amazon QuickSight
Microsoft Power BI
Tableau
QlikView
DOMO
Pentaho
Superset
Metabase
Apache Zeppelin
JupyterNotebook(Lab)
Vegas
Lightning
Matplotlib
VisPy
HoloViews
Plotly
D3.js
OSS
Python
Scala
JavaScript

41. 41

42. 42

43. 43
DEMO

44. Apache Zeppelin: https://zeppelin.apache.org/
44

45. 45
Thank you for listening!