Real Time Analytic

1. TopDemandNow
By Sandi Wibowo
Witness Fast Moving Market Value

2. {"item": "Chocolate",
"storeid": 2345,
"location": ”SFO",
"time":
1466022986282}
{"item": "Chocolate",
"storeid": 2345, "location":
”SFO", "time":
1466022986282}
1 2 3
REALTIME

3. 1. Milk
2. Chocolate
3. Soda
1. Chips
2. Water
3. Beer
1. Chips
2. Water
3. Chocolate
San Francisco
Palo Alto
Oakland

4. Data Pipeline
Queue
Process
Persist
{"item": "Chocolate",
"storeid": 2345,
"location": ”SFO",
"time":
1466022986282}
Visual

5. map
reduceByKey
Join x=>func(x)
val
foldwhile
forvariable
loop
Functional ProgrammingProcedural Programming
1
10
11
11
14
16
16
16
16
16
16
10
10
10
10
10
0
0
0
2
2
[0,0,0]
[]
[2,2]
Data Min Max
(Data-Min)/interval
map-> map-> reduce->
14-1610-12 12-14
3
5
count
[3,0,2] [3,3,5]
fold
2
Flag
Cumulative distribution

6. About Me
• Phd Physics University Wisconsin Milwaukee
• Enjoy learning Scala and Spark
• Good at coding ice skating