Skip to content

Instantly share code, notes, and snippets.

@miguno
Created May 30, 2012 13:43
Show Gist options
  • Save miguno/2836415 to your computer and use it in GitHub Desktop.
Save miguno/2836415 to your computer and use it in GitHub Desktop.
P.S. - Master and slave running same version of Linux and Hadoop and SSH is working perfectly,
because I can start the slave from master node
Also Same settings for core-site.xml, hdfs-site.xml and mapred-site.xml on master(hadooopnode1) and
slave (hadoopnode2)
OS - UBuntu 10
Hadoop Version -
oop@hadoopnode1:~/hadoop-0.20.2/conf$ hadoop version
Hadoop 0.20.2
Subversion https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707
Compiled by chrisdo on Fri Feb 19 08:07:34 UTC 2010
-- Master (hadoopnode1)
hadoop@hadoopnode1:~/hadoop-0.20.2/conf$ uname -a
Linux hadoopnode1 2.6.35-32-generic #67-Ubuntu SMP Mon Mar 5 19:35:26 UTC 2012 i686 GNU/Linux
hadoop@hadoopnode1:~/hadoop-0.20.2/conf$ jps
9923 Jps
7555 NameNode
8133 TaskTracker
7897 SecondaryNameNode
7728 DataNode
7971 JobTracker
masters -> hadoopnode1
slaves -> hadoopnode1
hadoopnode2
--Slave (hadoopnode2)
<code>
hadoop@hadoopnode2:~/hadoop-0.20.2/conf$ uname -a
Linux hadoopnode2 2.6.35-32-generic #67-Ubuntu SMP Mon Mar 5 19:35:26 UTC 2012 i686 GNU/Linux
hadoop@hadoopnode2:~/hadoop-0.20.2/conf$ jps
1959 DataNode
2631 Jps
2108 TaskTracker
masters - hadoopnode1
core-site.xml
hadoop@hadoopnode2:~/hadoop-0.20.2/conf$ cat core-site.xml
<!-- Put site-specific property overrides in this file. -->
hadoop.tmp.dir
/var/tmp/hadoop/hadoop-${user.name}
A base for other temp directories
fs.default.name
hdfs://hadoopnode1:8020
The name of the default file system
hadoop@hadoopnode2:~/hadoop-0.20.2/conf$ cat mapred-site.xml
<!-- Put site-specific property overrides in this file. -->
mapred.job.tracker
hadoopnode1:8021
The host and port that the MapReduce job tracker runs at.If "local", then jobs are run in process as a single map
hadoop@hadoopnode2:~/hadoop-0.20.2/conf$ cat hdfs-site.xml
<!-- Put site-specific property overrides in this file. -->
dfs.replication
2
Default block replication
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment