Hadoop Installation on Windows 10:
Prerequisite: Java 1.7 or more version is mandatory for Hadoop installation on Windows.
Using javac -version, and java command for Java versions and complete installation.
Step 1: Goto apache mirrors for Hadoop tarball then download it.
Step 2: After downloading tarball extract in your path or will create a different file like Hadoop_Installation then processed it.
Step 3: After extracting the Hadoop file put into the Program files path.
Step 5: After that goto, Hadoop bin file path then copy the path like below
C:\Program Files\hadoop-2.8.0\hadoop-2.8.0\bin
Step 6: Open Environment Variable path then create New User Variable :
Variable Name: HADOOP_HOME
Variable Path : C:\Program Files\hadoop-2.8.0\hadoop-2.8.0\bin
Step 7: Check JAVA_HOME is there or not. If Java home is not there then create in the system variable.
Step 8: If JAVA_HOME set in system variable then put into top position using Move Up buttons.
Step 9: After completion of the Environmental variable setup then goto Hadoop file system etc for configuration of all XML files like core – site.xml, yarn – site.xml, etc. Simply check below the path and configure it.
C:\Program Files\hadoop-2.8.0\hadoop-2.8.0\etc\hadoop
Then copy the below XML code into core – site.xml file.
<configuration> <property> <name>fs.defaultFS</name> <value>hdfs://loclahost:8020</value> </property> </configuration>
Step 10: Then go with the hdfs-site .xml file for storage configurations like replication etc.
<configuration> <property> <name>dfs.replication</name> <value>3</value> </property> <property> <name>dfs.namenode.name.dir</name> <value>C:\hadoop-2.8.0\data\namenode</value> </property> <property> <name>dfs.datanode.data.dir</name> <value>C:\hadoop-2.8.0\data\datanode</value> </property> </configuration>
Step 11: Configured the yarn-site.xml file using below XML code.
<configuration> <property> <name>yarn.nodemanager.aux-services</name> <value>mapreduce_shuffle</value> </property> <property> <name>yarn.nodemanager.auxservices.mapreduce.shuffle.class</name> <value>org.apache.hadoop.mapred.ShuffleHandler</value> </property> </configuration>
Step 12: After completion of All XML file configurations then create data and name node files in the Hadoop file.
Step 13: Go to Hadoop path open command then name node format using below command:
hadoop namenode -format
Step 14: Open name node web UI like Http: localhost:50070 for name node information.
Step 15: Finally after the successful installation of the Hadoop single node cluster setup on the Windows machine then use in simply for Hadoop developers and Administrators also.