2. An Overview of Hadoop
Hadoop is a open-source tool which can be used
effectively in processing huge volumes of data sets. It
works in a distributed computing scenario. Hadoop is
one of the best solution for addressing the issue of big
data.
Newyorksys has the best trainers who provides the best
online training for Hadoop by using the state of the art
training methodologies
3. Agenda
ï What is Hadoop.
ï Why do we need Hadoop.
ï How Hadoop works.
ï HDFS Architecture.
ï What is Map â Reduce.
ï Hadoop Cluster.
ï Hadoop Processes.
ï Topology of a Hadoop Cluster.
ï Distinction of Hadoop Framework .
ï Prerequisites to learn hadoop.
4. What is Hadoop
ï Hadoop is an open Sourse Framework.
ï Developed by Apache Software Foundation.
ï Used for distributed processing of large date sets.
ï It works across clusters of computers using a simple
programming model (Map-Reduce).
5. Why do we need Hadoop
ï Data is growing faster.
ï Need to process multi petabytes of data.
ï The performance of traditional applications is
decreasing.
ï The number of machines in a cluster is not constant.
ï Failure is expected, rather than exceptional.
6. How Hadoop Works
ï The Hadoop core consists of two modules :
ï Hadoop Distributed File System (HDFS) [Storage].
ï Map Reduce [Processing].
Mapper
Reducer
8. What is Map â Reduce
ï Map Reduce plays a key role in hadoop framework.
ï Map Reduce is a Programming model for writing
applications that rapidly process large amount of data.
ï Mapper â is a function that processes input data to
generate intermediate output data.
ï Reducer â Merges all intermediate data from all
mappers and generate final output data.
9. Hadoop Cluster
ï A Hadoop Cluster consist of multiple machines Which
can be classified into 3 types
ï Namenode
ï Secondary Namenode
ï Datanode
10. Hadoop Processes
ï Below are the daemons (Processes) Which runs in a
cluster.
Name node (Runs on a master machine)
Job Tracker (Runs on a master machine)
Data node (Runs on slave machines)
Task Tracker (Runs on slave machines)
12. Distinction
ï Simple â Hadoop allows users to quickly write efficient
parallel code.
ï Reliable â Because Hadoop runs on commodity
hardware, it can face frequent automatically handle
such failures.
ï Scalable â we can increase or decrease the number of
nodes (machine) in hadoop cluster.
13. Prerequisites
ï Linux bases operating system (Mac
OS, Redhat, ubuntu)
ï Java 1.6 or higher version
ï Disk space ( To hold HDFS data and itâs replications )
ï Ram (Recommended 2GB)
ï A cluster of computers.
ï You can even install Hadoop on single machine.
14. Newyorksys.com
ï NewyorkSys is one of the leading top Training and
Consulting Company in US. We have certified trainers.
We will provide Online Training, Fast Track online
training, with job assistance. We are providing
excellent Training in all courses. We also help you in
resume preparation and provide job assistance till you
get job.
For more details Visit : http://www.newyorksys.com
15 Roaring Brook Rd, Chappaqua, NY 10514.
USA: +1-718-313-0499 & 718-305-1757
E:enquiry@newyorksys.us