SlideShare ist ein Scribd-Unternehmen logo
1 von 24
Experiment -3
Installation of Hadoop Single Node Cluster
1
2
3
4
Infrastructure-as-a-service (IaaS)
• With IaaS, you rent IT infrastructure—servers and virtual machines (VMs), storage,
networks, operating systems—from a cloud provider on a pay-as-you-go basis.
Platform as a service (PaaS)
• Platform-as-a-service (PaaS) that supply an on-demand environment for developing,
testing, delivering and managing software applications.
• PaaS is designed to make it easier for developers to quickly create web or mobile apps,
without worrying about setting up or managing the underlying infrastructure of servers,
storage, network and databases needed for development.
5
Software as a service (SaaS)
• Software-as-a-service (SaaS) is a services for delivering software applications
over the Internet, on demand and typically on a subscription basis.
• With SaaS, cloud providers host and manage the software application and
underlying infrastructure and handle any maintenance, like software upgrades.
6
VMware Workstation
• VMware Workstation is a hosted hypervisor that runs on x64
versions of Windows and Linux operating systems.
• It enables users to set up virtual machines on a single physical
machine, and use them simultaneously along with the actual
machine.
7
REQUIREMENTS
• A Laptop or Desktop with 32 or 64 bit with window (Linux
operating system when using VM )
• Minimum of 2 Gb ram
• Minimum of 100 gb hard disk
• Minimum VGA is required
8
Installing of Hadoop Single Node Cluster Configuration.
1. Downloading the software Required
2. Untar the software/extract jdk and hadoop
3. Bashrc configurations
4. Hadoop Configuration File
5. Share public key to localhost
6. Formatting the name node
7. Starting Hadoop Daemons
8. Checking the working hadoop Daemons
9
STEP-1
SOFTWARES REQUIRED
• Hadoop 1.2.0-bin.tar.gz
• Jdk 7u67-linux-i586.tar.gz
Link for JDK
http://www.oracle.com/technetwork/java/javase/downloads/ind
ex.html
Link of Hadoop :
http://mirror.fibergrid.in/apache/hadoop/common/hadoop-1.2.0/
10
STEP-2
Untar the software with commands or
right click to extract hadoop and JDK
• Open the terminal window
• Type the command : cd Desktop
• Type ls command
• tar –zxvf jdk-7u67-linux-i586.tar.gz
• tar –zxvf hadoop-1.2.0-bin.tar.gz
11
Step 3
Bashrc configurations
Open the terminal type the command
sudo gedit ~/.bashrc
export JAVA_HOME=/home/user/Desktop/jdk1.7.0_67
export PATH=$PATH:$JAVA_HOME/bin
export HADOOP_HOME=/home/user/Desktop/hadoop-1.2.0
export PATH=$PATH:$HADOOP_HOME/bin
Open new terminal and check for java version and Hadoop version.
12
Step-4
Hadoop Configuration Files
Go to hadoop folder and click on conf folder , edit
configuaration files
1. Core-site.xml
(Configuration setting for hadoop core, such as I/O setting that are
common to HDFS and Mapreduce)
2.Hdfs-Site.xml
(Configuration setting for HDFS daemons the name node, Secondary
name node and data node and Replication factor as well)
13
3. Mapred-site.xml
(configuration setting for MapReduce daemons: the job tracker and the
task tracker)
4. Hadoop-Env_sh
(Environment variables that are used in the scripts to run Hadoop)
14
• Open the new terminal window
• Go to the hadoop folder
• cd Desktop
• cd Hadoop (Press tab) for path
• cd conf
• Type ls
• All the above mentioned files are listed
15
• Go to terminal and type
sudo gedit core-site.xml
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>
Ip address :127.0.0.0 , 198.1.27.0
Port no: 80,
16
• Go to terminal and type
sudo gedit hdfs-site.xml
<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
<name>dfs.name.dir</name>
<value>/home/user/Desktop/hadoop-1.2.0/name/data</value>
</property>
</configuration>
17
• Go to terminal and type
sudo gedit mapred-site.xml
<configuration>
<property>
<name>mapred.job.tracker</name>
<value>hdfs://localhost:9001</value>
</property>
</configuration>
18
• Go to terminal and type
sudo gedit hadoop-env.sh
export JAVA_HOME=/home/user/Desktop/jdk1.7.0_67
19
STEP-5
SSh Configuration
• sudo apt-get install ssh
• ssh-keygen -t rsa -P ""
Sharing the public key with host
• ssh-copy-id –i ~/.ssh/id_rsa.pub user@ubuntuvm and check
• ssh localhost (It should not ask password)
20
STEP 6
Formatting the Name Node
• $ hadoop namenode –format
• format a new distributed file system
• Process creates an empty file system for creating the storage
directories
21
STEP-7&8
Starting Hadoop Daemons
Open the terminal window and type
$ start-all.sh
and type
$ jps
22
• user@ubuntuvm:~$ start-all.sh
• Warning: $HADOOP_HOME is deprecated.
• starting namenode, logging to /home/user/Downloads/hadoop-
1.2.0/libexec/../logs/hadoop-user-namenode-ubuntuvm.out
• localhost: datanode running as process 2978.
• localhost: secondarynamenode running as process 3123.
• jobtracker running as process 3204.
• localhost: tasktracker running as process 3342.
• user@ubuntuvm:~$ jps
• 4020 Jps
• 3342 TaskTracker
• 3204 JobTracker
• 3123 SecondaryNameNode
• 3606 NameNode
• 2978 DataNode
23
24

Weitere ähnliche Inhalte

Ähnlich wie Exp-3.pptx

Apache HDFS - Lab Assignment
Apache HDFS - Lab AssignmentApache HDFS - Lab Assignment
Apache HDFS - Lab AssignmentFarzad Nozarian
 
Hadoop single node setup
Hadoop single node setupHadoop single node setup
Hadoop single node setupMohammad_Tariq
 
Killer Docker Workflows for Development
Killer Docker Workflows for DevelopmentKiller Docker Workflows for Development
Killer Docker Workflows for DevelopmentChris Tankersley
 
Distro-independent Hadoop cluster management
Distro-independent Hadoop cluster managementDistro-independent Hadoop cluster management
Distro-independent Hadoop cluster managementDataWorks Summit
 
WordPress Development Environments
WordPress Development Environments WordPress Development Environments
WordPress Development Environments Ohad Raz
 
DC HUG Hadoop for Windows
DC HUG Hadoop for WindowsDC HUG Hadoop for Windows
DC HUG Hadoop for WindowsTerry Padgett
 
Big Data in Container; Hadoop Spark in Docker and Mesos
Big Data in Container; Hadoop Spark in Docker and MesosBig Data in Container; Hadoop Spark in Docker and Mesos
Big Data in Container; Hadoop Spark in Docker and MesosHeiko Loewe
 
Introduction to Stacki - World's fastest Linux server provisioning Tool
Introduction to Stacki - World's fastest Linux server provisioning ToolIntroduction to Stacki - World's fastest Linux server provisioning Tool
Introduction to Stacki - World's fastest Linux server provisioning ToolSuresh Paulraj
 
Ceph, Docker, Heroku Slugs, CoreOS and Deis Overview
Ceph, Docker, Heroku Slugs, CoreOS and Deis OverviewCeph, Docker, Heroku Slugs, CoreOS and Deis Overview
Ceph, Docker, Heroku Slugs, CoreOS and Deis OverviewLeo Lorieri
 
The Forefront of the Development for NVDIMM on Linux Kernel
The Forefront of the Development for NVDIMM on Linux KernelThe Forefront of the Development for NVDIMM on Linux Kernel
The Forefront of the Development for NVDIMM on Linux KernelYasunori Goto
 
Big data processing using hadoop poster presentation
Big data processing using hadoop poster presentationBig data processing using hadoop poster presentation
Big data processing using hadoop poster presentationAmrut Patil
 
Introduction to hadoop administration jk
Introduction to hadoop administration   jkIntroduction to hadoop administration   jk
Introduction to hadoop administration jkEdureka!
 
Implementing Hadoop on a single cluster
Implementing Hadoop on a single clusterImplementing Hadoop on a single cluster
Implementing Hadoop on a single clusterSalil Navgire
 
Big Data Step-by-Step: Infrastructure 1/3: Local VM
Big Data Step-by-Step: Infrastructure 1/3: Local VMBig Data Step-by-Step: Infrastructure 1/3: Local VM
Big Data Step-by-Step: Infrastructure 1/3: Local VMJeffrey Breen
 

Ähnlich wie Exp-3.pptx (20)

Apache HDFS - Lab Assignment
Apache HDFS - Lab AssignmentApache HDFS - Lab Assignment
Apache HDFS - Lab Assignment
 
Unit 5
Unit  5Unit  5
Unit 5
 
Hadoop single node setup
Hadoop single node setupHadoop single node setup
Hadoop single node setup
 
Killer Docker Workflows for Development
Killer Docker Workflows for DevelopmentKiller Docker Workflows for Development
Killer Docker Workflows for Development
 
Distro-independent Hadoop cluster management
Distro-independent Hadoop cluster managementDistro-independent Hadoop cluster management
Distro-independent Hadoop cluster management
 
WordPress Development Environments
WordPress Development Environments WordPress Development Environments
WordPress Development Environments
 
DC HUG Hadoop for Windows
DC HUG Hadoop for WindowsDC HUG Hadoop for Windows
DC HUG Hadoop for Windows
 
Run wordcount job (hadoop)
Run wordcount job (hadoop)Run wordcount job (hadoop)
Run wordcount job (hadoop)
 
Hadoop on osx
Hadoop on osxHadoop on osx
Hadoop on osx
 
Big Data in Container; Hadoop Spark in Docker and Mesos
Big Data in Container; Hadoop Spark in Docker and MesosBig Data in Container; Hadoop Spark in Docker and Mesos
Big Data in Container; Hadoop Spark in Docker and Mesos
 
DR_PRESENT 1
DR_PRESENT 1DR_PRESENT 1
DR_PRESENT 1
 
Hadoop and Big Data
Hadoop and Big DataHadoop and Big Data
Hadoop and Big Data
 
Introduction to Stacki - World's fastest Linux server provisioning Tool
Introduction to Stacki - World's fastest Linux server provisioning ToolIntroduction to Stacki - World's fastest Linux server provisioning Tool
Introduction to Stacki - World's fastest Linux server provisioning Tool
 
Ceph, Docker, Heroku Slugs, CoreOS and Deis Overview
Ceph, Docker, Heroku Slugs, CoreOS and Deis OverviewCeph, Docker, Heroku Slugs, CoreOS and Deis Overview
Ceph, Docker, Heroku Slugs, CoreOS and Deis Overview
 
The Forefront of the Development for NVDIMM on Linux Kernel
The Forefront of the Development for NVDIMM on Linux KernelThe Forefront of the Development for NVDIMM on Linux Kernel
The Forefront of the Development for NVDIMM on Linux Kernel
 
Big data processing using hadoop poster presentation
Big data processing using hadoop poster presentationBig data processing using hadoop poster presentation
Big data processing using hadoop poster presentation
 
Introduction to hadoop administration jk
Introduction to hadoop administration   jkIntroduction to hadoop administration   jk
Introduction to hadoop administration jk
 
Implementing Hadoop on a single cluster
Implementing Hadoop on a single clusterImplementing Hadoop on a single cluster
Implementing Hadoop on a single cluster
 
Big Data Step-by-Step: Infrastructure 1/3: Local VM
Big Data Step-by-Step: Infrastructure 1/3: Local VMBig Data Step-by-Step: Infrastructure 1/3: Local VM
Big Data Step-by-Step: Infrastructure 1/3: Local VM
 
Getting started big data
Getting started big dataGetting started big data
Getting started big data
 

Kürzlich hochgeladen

How To Land Your Next PM Dream Job - PMISSC Meeting - April 2024
How To Land Your Next PM Dream Job - PMISSC Meeting - April 2024How To Land Your Next PM Dream Job - PMISSC Meeting - April 2024
How To Land Your Next PM Dream Job - PMISSC Meeting - April 2024Hector Del Castillo, CPM, CPMM
 
Protection of Children in context of IHL and Counter Terrorism
Protection of Children in context of IHL and  Counter TerrorismProtection of Children in context of IHL and  Counter Terrorism
Protection of Children in context of IHL and Counter TerrorismNilendra Kumar
 
Chapter 4 - Promoting Inclusive Culture.ppt
Chapter 4 - Promoting   Inclusive Culture.pptChapter 4 - Promoting   Inclusive Culture.ppt
Chapter 4 - Promoting Inclusive Culture.pptmoytopo
 
401799841-Increasing-Crimes-and-Suicides-Among-Youth.pptx
401799841-Increasing-Crimes-and-Suicides-Among-Youth.pptx401799841-Increasing-Crimes-and-Suicides-Among-Youth.pptx
401799841-Increasing-Crimes-and-Suicides-Among-Youth.pptxwaghmare9860lavin
 
Escort Service Andheri WhatsApp:+91-9833363713
Escort Service Andheri WhatsApp:+91-9833363713Escort Service Andheri WhatsApp:+91-9833363713
Escort Service Andheri WhatsApp:+91-9833363713Riya Pathan
 
Senior IT Professional with Master’s Degree with 21+ years of experience is...
Senior IT Professional with Master’s Degree with 21+ years of experience   is...Senior IT Professional with Master’s Degree with 21+ years of experience   is...
Senior IT Professional with Master’s Degree with 21+ years of experience is...Anas Acharath Parakat
 
Abanoub Ghobrial, Planning Team Leader.pdf
Abanoub Ghobrial, Planning Team Leader.pdfAbanoub Ghobrial, Planning Team Leader.pdf
Abanoub Ghobrial, Planning Team Leader.pdfAbanoubGhobrial1
 
Banged Dubai Call Girls O525547819 Call Girls Dubai
Banged Dubai Call Girls O525547819 Call Girls DubaiBanged Dubai Call Girls O525547819 Call Girls Dubai
Banged Dubai Call Girls O525547819 Call Girls Dubaikojalkojal131
 
Design, Desire and Demand Presentation.pptx
Design, Desire and Demand Presentation.pptxDesign, Desire and Demand Presentation.pptx
Design, Desire and Demand Presentation.pptxaaronbasko1
 
Human Rights are notes and helping material
Human Rights are notes and helping materialHuman Rights are notes and helping material
Human Rights are notes and helping materialnadeemcollege26
 
Nathan_Baughman_Resume_copywriter_and_editor
Nathan_Baughman_Resume_copywriter_and_editorNathan_Baughman_Resume_copywriter_and_editor
Nathan_Baughman_Resume_copywriter_and_editorNathanBaughman3
 
Career-Orientation-for-Grade-9-and-10.pptx
Career-Orientation-for-Grade-9-and-10.pptxCareer-Orientation-for-Grade-9-and-10.pptx
Career-Orientation-for-Grade-9-and-10.pptxGachaFluffy
 
LinkedIn Strategic Guidelines April 2024
LinkedIn Strategic Guidelines April 2024LinkedIn Strategic Guidelines April 2024
LinkedIn Strategic Guidelines April 2024Bruce Bennett
 
Abanoub Ghobrial, Planning Team Leader.pdf
Abanoub Ghobrial, Planning Team Leader.pdfAbanoub Ghobrial, Planning Team Leader.pdf
Abanoub Ghobrial, Planning Team Leader.pdfAbanoubGhobrial1
 
Thomas Calculus 12th Edition Textbook and helping material
Thomas Calculus 12th Edition Textbook and helping materialThomas Calculus 12th Edition Textbook and helping material
Thomas Calculus 12th Edition Textbook and helping materialsafdarhussainbhutta4
 
美国SU学位证,雪城大学毕业证书1:1制作
美国SU学位证,雪城大学毕业证书1:1制作美国SU学位证,雪城大学毕业证书1:1制作
美国SU学位证,雪城大学毕业证书1:1制作ss846v0c
 
LinkedIn for Your Job Search in April 2024
LinkedIn for Your Job Search in April 2024LinkedIn for Your Job Search in April 2024
LinkedIn for Your Job Search in April 2024Bruce Bennett
 
Back on Track: Navigating the Return to Work after Parental Leave
Back on Track: Navigating the Return to Work after Parental LeaveBack on Track: Navigating the Return to Work after Parental Leave
Back on Track: Navigating the Return to Work after Parental LeaveMarharyta Nedzelska
 
Complete Benefits of career counseling in India
Complete Benefits of career counseling in IndiaComplete Benefits of career counseling in India
Complete Benefits of career counseling in IndiaMere Mentor
 
Jumark Morit Diezmo- Career portfolio- BPED 3A
Jumark Morit Diezmo- Career portfolio- BPED 3AJumark Morit Diezmo- Career portfolio- BPED 3A
Jumark Morit Diezmo- Career portfolio- BPED 3Ajumarkdiezmo1
 

Kürzlich hochgeladen (20)

How To Land Your Next PM Dream Job - PMISSC Meeting - April 2024
How To Land Your Next PM Dream Job - PMISSC Meeting - April 2024How To Land Your Next PM Dream Job - PMISSC Meeting - April 2024
How To Land Your Next PM Dream Job - PMISSC Meeting - April 2024
 
Protection of Children in context of IHL and Counter Terrorism
Protection of Children in context of IHL and  Counter TerrorismProtection of Children in context of IHL and  Counter Terrorism
Protection of Children in context of IHL and Counter Terrorism
 
Chapter 4 - Promoting Inclusive Culture.ppt
Chapter 4 - Promoting   Inclusive Culture.pptChapter 4 - Promoting   Inclusive Culture.ppt
Chapter 4 - Promoting Inclusive Culture.ppt
 
401799841-Increasing-Crimes-and-Suicides-Among-Youth.pptx
401799841-Increasing-Crimes-and-Suicides-Among-Youth.pptx401799841-Increasing-Crimes-and-Suicides-Among-Youth.pptx
401799841-Increasing-Crimes-and-Suicides-Among-Youth.pptx
 
Escort Service Andheri WhatsApp:+91-9833363713
Escort Service Andheri WhatsApp:+91-9833363713Escort Service Andheri WhatsApp:+91-9833363713
Escort Service Andheri WhatsApp:+91-9833363713
 
Senior IT Professional with Master’s Degree with 21+ years of experience is...
Senior IT Professional with Master’s Degree with 21+ years of experience   is...Senior IT Professional with Master’s Degree with 21+ years of experience   is...
Senior IT Professional with Master’s Degree with 21+ years of experience is...
 
Abanoub Ghobrial, Planning Team Leader.pdf
Abanoub Ghobrial, Planning Team Leader.pdfAbanoub Ghobrial, Planning Team Leader.pdf
Abanoub Ghobrial, Planning Team Leader.pdf
 
Banged Dubai Call Girls O525547819 Call Girls Dubai
Banged Dubai Call Girls O525547819 Call Girls DubaiBanged Dubai Call Girls O525547819 Call Girls Dubai
Banged Dubai Call Girls O525547819 Call Girls Dubai
 
Design, Desire and Demand Presentation.pptx
Design, Desire and Demand Presentation.pptxDesign, Desire and Demand Presentation.pptx
Design, Desire and Demand Presentation.pptx
 
Human Rights are notes and helping material
Human Rights are notes and helping materialHuman Rights are notes and helping material
Human Rights are notes and helping material
 
Nathan_Baughman_Resume_copywriter_and_editor
Nathan_Baughman_Resume_copywriter_and_editorNathan_Baughman_Resume_copywriter_and_editor
Nathan_Baughman_Resume_copywriter_and_editor
 
Career-Orientation-for-Grade-9-and-10.pptx
Career-Orientation-for-Grade-9-and-10.pptxCareer-Orientation-for-Grade-9-and-10.pptx
Career-Orientation-for-Grade-9-and-10.pptx
 
LinkedIn Strategic Guidelines April 2024
LinkedIn Strategic Guidelines April 2024LinkedIn Strategic Guidelines April 2024
LinkedIn Strategic Guidelines April 2024
 
Abanoub Ghobrial, Planning Team Leader.pdf
Abanoub Ghobrial, Planning Team Leader.pdfAbanoub Ghobrial, Planning Team Leader.pdf
Abanoub Ghobrial, Planning Team Leader.pdf
 
Thomas Calculus 12th Edition Textbook and helping material
Thomas Calculus 12th Edition Textbook and helping materialThomas Calculus 12th Edition Textbook and helping material
Thomas Calculus 12th Edition Textbook and helping material
 
美国SU学位证,雪城大学毕业证书1:1制作
美国SU学位证,雪城大学毕业证书1:1制作美国SU学位证,雪城大学毕业证书1:1制作
美国SU学位证,雪城大学毕业证书1:1制作
 
LinkedIn for Your Job Search in April 2024
LinkedIn for Your Job Search in April 2024LinkedIn for Your Job Search in April 2024
LinkedIn for Your Job Search in April 2024
 
Back on Track: Navigating the Return to Work after Parental Leave
Back on Track: Navigating the Return to Work after Parental LeaveBack on Track: Navigating the Return to Work after Parental Leave
Back on Track: Navigating the Return to Work after Parental Leave
 
Complete Benefits of career counseling in India
Complete Benefits of career counseling in IndiaComplete Benefits of career counseling in India
Complete Benefits of career counseling in India
 
Jumark Morit Diezmo- Career portfolio- BPED 3A
Jumark Morit Diezmo- Career portfolio- BPED 3AJumark Morit Diezmo- Career portfolio- BPED 3A
Jumark Morit Diezmo- Career portfolio- BPED 3A
 

Exp-3.pptx

  • 1. Experiment -3 Installation of Hadoop Single Node Cluster 1
  • 2. 2
  • 3. 3
  • 4. 4
  • 5. Infrastructure-as-a-service (IaaS) • With IaaS, you rent IT infrastructure—servers and virtual machines (VMs), storage, networks, operating systems—from a cloud provider on a pay-as-you-go basis. Platform as a service (PaaS) • Platform-as-a-service (PaaS) that supply an on-demand environment for developing, testing, delivering and managing software applications. • PaaS is designed to make it easier for developers to quickly create web or mobile apps, without worrying about setting up or managing the underlying infrastructure of servers, storage, network and databases needed for development. 5
  • 6. Software as a service (SaaS) • Software-as-a-service (SaaS) is a services for delivering software applications over the Internet, on demand and typically on a subscription basis. • With SaaS, cloud providers host and manage the software application and underlying infrastructure and handle any maintenance, like software upgrades. 6
  • 7. VMware Workstation • VMware Workstation is a hosted hypervisor that runs on x64 versions of Windows and Linux operating systems. • It enables users to set up virtual machines on a single physical machine, and use them simultaneously along with the actual machine. 7
  • 8. REQUIREMENTS • A Laptop or Desktop with 32 or 64 bit with window (Linux operating system when using VM ) • Minimum of 2 Gb ram • Minimum of 100 gb hard disk • Minimum VGA is required 8
  • 9. Installing of Hadoop Single Node Cluster Configuration. 1. Downloading the software Required 2. Untar the software/extract jdk and hadoop 3. Bashrc configurations 4. Hadoop Configuration File 5. Share public key to localhost 6. Formatting the name node 7. Starting Hadoop Daemons 8. Checking the working hadoop Daemons 9
  • 10. STEP-1 SOFTWARES REQUIRED • Hadoop 1.2.0-bin.tar.gz • Jdk 7u67-linux-i586.tar.gz Link for JDK http://www.oracle.com/technetwork/java/javase/downloads/ind ex.html Link of Hadoop : http://mirror.fibergrid.in/apache/hadoop/common/hadoop-1.2.0/ 10
  • 11. STEP-2 Untar the software with commands or right click to extract hadoop and JDK • Open the terminal window • Type the command : cd Desktop • Type ls command • tar –zxvf jdk-7u67-linux-i586.tar.gz • tar –zxvf hadoop-1.2.0-bin.tar.gz 11
  • 12. Step 3 Bashrc configurations Open the terminal type the command sudo gedit ~/.bashrc export JAVA_HOME=/home/user/Desktop/jdk1.7.0_67 export PATH=$PATH:$JAVA_HOME/bin export HADOOP_HOME=/home/user/Desktop/hadoop-1.2.0 export PATH=$PATH:$HADOOP_HOME/bin Open new terminal and check for java version and Hadoop version. 12
  • 13. Step-4 Hadoop Configuration Files Go to hadoop folder and click on conf folder , edit configuaration files 1. Core-site.xml (Configuration setting for hadoop core, such as I/O setting that are common to HDFS and Mapreduce) 2.Hdfs-Site.xml (Configuration setting for HDFS daemons the name node, Secondary name node and data node and Replication factor as well) 13
  • 14. 3. Mapred-site.xml (configuration setting for MapReduce daemons: the job tracker and the task tracker) 4. Hadoop-Env_sh (Environment variables that are used in the scripts to run Hadoop) 14
  • 15. • Open the new terminal window • Go to the hadoop folder • cd Desktop • cd Hadoop (Press tab) for path • cd conf • Type ls • All the above mentioned files are listed 15
  • 16. • Go to terminal and type sudo gedit core-site.xml <configuration> <property> <name>fs.default.name</name> <value>hdfs://localhost:9000</value> </property> </configuration> Ip address :127.0.0.0 , 198.1.27.0 Port no: 80, 16
  • 17. • Go to terminal and type sudo gedit hdfs-site.xml <configuration> <property> <name>dfs.replication</name> <value>1</value> <name>dfs.name.dir</name> <value>/home/user/Desktop/hadoop-1.2.0/name/data</value> </property> </configuration> 17
  • 18. • Go to terminal and type sudo gedit mapred-site.xml <configuration> <property> <name>mapred.job.tracker</name> <value>hdfs://localhost:9001</value> </property> </configuration> 18
  • 19. • Go to terminal and type sudo gedit hadoop-env.sh export JAVA_HOME=/home/user/Desktop/jdk1.7.0_67 19
  • 20. STEP-5 SSh Configuration • sudo apt-get install ssh • ssh-keygen -t rsa -P "" Sharing the public key with host • ssh-copy-id –i ~/.ssh/id_rsa.pub user@ubuntuvm and check • ssh localhost (It should not ask password) 20
  • 21. STEP 6 Formatting the Name Node • $ hadoop namenode –format • format a new distributed file system • Process creates an empty file system for creating the storage directories 21
  • 22. STEP-7&8 Starting Hadoop Daemons Open the terminal window and type $ start-all.sh and type $ jps 22
  • 23. • user@ubuntuvm:~$ start-all.sh • Warning: $HADOOP_HOME is deprecated. • starting namenode, logging to /home/user/Downloads/hadoop- 1.2.0/libexec/../logs/hadoop-user-namenode-ubuntuvm.out • localhost: datanode running as process 2978. • localhost: secondarynamenode running as process 3123. • jobtracker running as process 3204. • localhost: tasktracker running as process 3342. • user@ubuntuvm:~$ jps • 4020 Jps • 3342 TaskTracker • 3204 JobTracker • 3123 SecondaryNameNode • 3606 NameNode • 2978 DataNode 23
  • 24. 24