SlideShare ist ein Scribd-Unternehmen logo
1 von 17
Downloaden Sie, um offline zu lesen
Hadoop
Edit by Cassell Hsu
2013.04.19
Hadoop
Master
Slave
Slave
Slave
Hadoop
• Master
• NameNode
• JobTracker
• SecondaryNameNode
NameNode
• Where is NameNode?
• Master
• HDFS(Hadoop Distributed File System)
• What is NameNode?
• 資料之位置資訊
• 資料之屬性
??
NameNode
• 位置資訊 ?
• 所有資料皆存放在 – DataNode
DataNode
• What is DataNode
• 存放資料
• Where is DataNode
• HDFS
• Slaves (and Master)
UserUser
DataNodeDataNode
NameNodeNameNode
DataNodeDataNode
DataNodeDataNode
128
Mb B
64Mb
A
64Mb
Check hdfs-site.xml
B
64Mb
A
64Mb
Hadoop
DataNodeDataNodeNameNodeNameNode
Master
DataNodeDataNode
DataNodeDataNode
DataNodeDataNode
Slaves
Hadoop
• Master
• NameNode
• JobTracker
• SecondaryNameNode
JobTracker
• What is JobTracker?
• 排程工作
• Where is JobTracker?
• Master
誰來工作?
JobTracker & TaskTracker
JobTracker TaskTracker
Where Master Slaves
What 排程工作 執行工作
Hadoop
DataNodeDataNodeNameNodeNameNode
Master
DataNodeDataNode
Slaves
JobTrackerJobTracker
TaskTrackerTaskTracker
Hadoop
• Master
• NameNode
• JobTracker
• SecondaryNameNode
SecondaryNameNode
• What is SecondaryNameNode?
• NameNode 發生錯誤時補救
• Where is SecondaryNameNode?
• Master
Hadoop
DataNodeDataNodeNameNodeNameNode
Master
DataNodeDataNode
Slaves
JobTrackerJobTracker
TaskTrackerTaskTracker
SecondaryNodeSecondaryNode
MapReduce
User Master
Slave2
Slave1
A
A1
A2
Task
NameNode
Task
Result1
Result2
Reduce
Final ResultHDFS
MapReduce
• 案切割檔
• Hadoop 上區塊切割
• 程式指定

Weitere ähnliche Inhalte

Mehr von Nitish Bhardwaj

Mehr von Nitish Bhardwaj (20)

Do1c
Do1cDo1c
Do1c
 
Doc1x
Doc1xDoc1x
Doc1x
 
Internet of-things-slideshare-140819153732-phpapp01
Internet of-things-slideshare-140819153732-phpapp01Internet of-things-slideshare-140819153732-phpapp01
Internet of-things-slideshare-140819153732-phpapp01
 
Adrianalimabikinibodyworkoutdietplan
AdrianalimabikinibodyworkoutdietplanAdrianalimabikinibodyworkoutdietplan
Adrianalimabikinibodyworkoutdietplan
 
Drivepresent 140702005121-phpapp01
Drivepresent 140702005121-phpapp01Drivepresent 140702005121-phpapp01
Drivepresent 140702005121-phpapp01
 
Drivepresent 140702005121-phpapp01
Drivepresent 140702005121-phpapp01Drivepresent 140702005121-phpapp01
Drivepresent 140702005121-phpapp01
 
Drivepresent 140702005121-phpapp01
Drivepresent 140702005121-phpapp01Drivepresent 140702005121-phpapp01
Drivepresent 140702005121-phpapp01
 
Beautifulplanetearthafrica 140801155400-phpapp01
Beautifulplanetearthafrica 140801155400-phpapp01Beautifulplanetearthafrica 140801155400-phpapp01
Beautifulplanetearthafrica 140801155400-phpapp01
 
Ppt1x present
Ppt1x presentPpt1x present
Ppt1x present
 
Nbhardwa w7n1
Nbhardwa w7n1Nbhardwa w7n1
Nbhardwa w7n1
 
Hadoop 130419075715-phpapp02(1)
Hadoop 130419075715-phpapp02(1)Hadoop 130419075715-phpapp02(1)
Hadoop 130419075715-phpapp02(1)
 
Do1c
Do1cDo1c
Do1c
 
Doc1x
Doc1xDoc1x
Doc1x
 
Interactive upload
Interactive uploadInteractive upload
Interactive upload
 
PPT upload
PPT uploadPPT upload
PPT upload
 
Checkupload1 140213043220-phpapp01 (1)
Checkupload1 140213043220-phpapp01 (1)Checkupload1 140213043220-phpapp01 (1)
Checkupload1 140213043220-phpapp01 (1)
 
Docx document
Docx documentDocx document
Docx document
 
Checkupload1 140213043220-phpapp01
Checkupload1 140213043220-phpapp01Checkupload1 140213043220-phpapp01
Checkupload1 140213043220-phpapp01
 
Hadoop 130419075715-phpapp02(1)
Hadoop 130419075715-phpapp02(1)Hadoop 130419075715-phpapp02(1)
Hadoop 130419075715-phpapp02(1)
 
Doc1x
Doc1xDoc1x
Doc1x
 

Checkupload1 140213043220-phpapp01