How to debugging Hadoop daemons are not started in Linux getting start-all.sh, command not found in putty(terminal).
start-all.sh command not found
First to check core-site.xml, hdfs-site.xml and yarn-site.xml and etc in Hadoop folder first.
Goto Hadoop installation directory path : /home/sreekanth/Hadoop/hadoop-2.6.0/etc. This is my Hadoop installation path then go with xml file configurations.
1.Core-site.xml:
<configuration> <property> <name>fs.defaultFS</name> <value>hdfs://localhost:8020</value> </property> <property> <name>hadoop.tmp.dir</name> <value>file:/home/sreekanth/Hadoop/data/tmp</value> </property> </configuration>
2.Hdfs-site.xml:
<configuration> <property> <name>dfs.replication</name> <value>1</value> </property> <property> <name>dfs.namenode.name.dir</name> <value>file:/home/sreekanth/data/dfs/name</value> </property> <property> <name>dfs.datanode.data.dir</name> <value>file:/home/sreekanth/data/dfs/data</value> </property> </configuration>
3.Yarn-site.xml
<configuration> <!-- YARN configuration properties in Sreekanth Linux box --> <property> <name>yarn.resourcemanager.hostname</name> <!-- Your Localhost or any distributions like Clouder/HDP <value>localhost</value> </property> <property> <name>yarn.nodemanager.aux-services</name> <!-- configure yarn nodemanager> <value>mapreduce_shuffle</value> </property> <property> <name>yarn.nodemanager.aux-services.mapreduce_shuffle.class</name> <value>org.apache.hadoop.mapred.ShuffleHandler</value> </property> </configuration>
After configurations successfully completed then go with bashrc file in the home directory.
Here to set the HADOOP_HOME, and HADOOP PATH with a specific installation path carefully like below.
export HADOOP_HOME=/home/sreekanth/Hadoop/hadoop-2.6.0 export PATH=$PATH:$HADOOP_HOME/bin export PATH=$PATH:$HADOOP_HOME/sbin
Above export, PATH used both bin and sbin path for start all daemons.
Summary: While Hadoop installation sbin path mandatory because here all daemons files are available otherwise will get start-all.sh, command not found an error in Linux box.