大數據時代的行動支付風險控制

Copyright© 2016 Cheng-Hsun Lin All Rights ReservedChris Lin
X X
(
20160730

(ETL & Data Analysis )
3

(Data Mining & Machine Learning)
...
4

(A.I. & Deep Learning)
.....
5

VS
6

SQL R Python
DMML
HDFS
Hadoop Spark
7

SQL
NoSQL
8

1. -
2. -
3. -
4. -
5. -
X X

2016/7/30
( )
( )
( )
( )
15

...
16
X X

X X
Koban Coin
Koban Coin 2015 2 29
API (APIM)
.......
Koban Coin 2015 2 28
17

Koban Coin
18

/
App
Koban Coin
kobantimes.com
/ Koban Coin -2017 2 29 5:54
# #
19

P6
/
?
20

-
21

-
22

- (Gateway Provider)
23

- /
24

1
26

2
28

3
30

P6
/
p=2
: 2016/7/30
32

300KM / hr
<
33

Case1
Case2
34

P6
/
Streaming / LBS Log
ML /
36

22:00-08:00
18:00-22:00
9:00-18:00
6:00-11:00

(LBS) v.s.
LBS
38

3690336902

36903
LBS
36902

( )
( )
M12345678 36902 30

- Mapper
Input Data
Data
Time UNIX
IMEI EWallet_UID
1 2
3

- Mapper
IMEI EWallet_UID
24
EWallet_UID TimeFlag Key
Location TimeStamp Value
3
Time UNIX
Map output

- Reducer
21
3
TimeStamp
Map input
Key Value
Key Reducer
Key Reducer

- Reducer
54
3
off
Time (17:59:59)
Output

Step1 ( Extract-Transform-Load, ETL )
48

Step1 ( Extract-Transform-Load, ETL )
49

Step2 (Hierarchical Clustering)
50

Step2 (Hierarchical Clustering)
51

Step3 (Hierarchical Agglomerative Clustering)
52

Step3 (Hierarchical Agglomerative Clustering)
53

Step4
54

Step4
55

Step5-1 1( )
56

Step5-2 2( )
57

Step5-3 3( )
58

11
1 1
111
3
3
2
22
2
1 3

LBS
(Intelligent Transportation System , ITS) API
……
60

Yuen Sze Lok,2015, ,http://photoblog.hk/

Map-Reduce
62

- (2014)
65
https://youtu.be/UEBLoDxq0yM

(2016) -
https://www.youtube.com/watch?v=QCmXHGa5dlQ
66

[3] ,2015,”Hadoop ”,DATAGURU
[2]Cloudera,2016,”Developer Training for Apache Spark”
[4] ,2016,”Python ”,DATAGURU
[1]Cloudera,2016,”Cloudera Administrator Training for Apache Hadoop”
[5] ,2016,” ”,DATAGURU

大數據時代的行動支付風險控制

Recommended

Recommended

More Related Content

Recently uploaded

Recently uploaded (20)

Featured

Featured (20)

大數據時代的行動支付風險控制