Hadoop

Valdas Vaivaras sban.com Distributed computing su Hadoop

Problema Nr. 1 ,[object Object],[object Object]

Sprendimas ,[object Object],[object Object],[object Object],Procesas prie duomenų, o ne duomenys prie proceso.

Problema Nr. 2 ,[object Object],[object Object]

Kas yra Hadoop? ,[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop failų sistema (HDFS) Slave Node Slave Node Slave Node Slave Node Slave Node Client HDFS Slave Node Master Node

MapReduce ,[object Object],[object Object],[object Object]

MAP map (in_key, in_value) -> (out_key, intermediate_value) list

Pavyzdys: Explode Mapper ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

REDUCE reduce (out_key, intermediate_value list) -> out_value list

Pavyzdys : Sum Reducer ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hadoop

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Mehr von BarCamp Lithuania

Mehr von BarCamp Lithuania (20)

Hadoop