SwathiMystery
/ from tool
Created
February 11, 2013 11:47
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ bin/hadoop --config ~/.whirr/testcluster fs -ls / |
SwathiMystery
/ list files hdfs
Created
February 11, 2013 11:45
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ export HADOOP_CONF_DIR=~/.whirr/testcluster/hadoop-site.xml | |
| $ hadoop fs -ls / |
SwathiMystery
/ start-proxy
Created
February 11, 2013 11:44
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ sh hadoop-proxy.sh |
SwathiMystery
/ files-generated
Created
February 11, 2013 11:43
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ cd ~/.whirr/testcluster |
SwathiMystery
/ launch-whirr
Created
February 11, 2013 11:41
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ cd whirr-0.8.1 | |
| $ bin/whirr launch-cluster --config whirr_cdh.properties |
SwathiMystery
/ cluster user
Created
February 11, 2013 11:40
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| whirr.cluster-user=whirr |
SwathiMystery
/ mrv1 cdh4
Created
February 11, 2013 11:38
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Cluster name goes here | |
| whirr.cluster-name=testcluster | |
| # Change the number of machines in the cluster here | |
| # Using 3 DN and TT and 1JT and NN# Ganglia is configured | |
| whirr.instance-templates=1 hadoop-jobtracker+hadoop-namenode+ganglia-monitor+ganglia-metad,3 hadoop-datanode+hadoop-tasktracker+ganglia-monitor | |
| # Install JAVA | |
| whirr.java.install-function=install_openjdk | |
| whirr.java.install-function=install_oab_java |
SwathiMystery
/ key-gen
Created
February 11, 2013 11:34
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ ssh-keygen -t rsa -P '' -f ~/.ssh/id_rsa_whirr | |
| $ cd whirr-0.8.1 |
SwathiMystery
/ whirr untar
Created
February 11, 2013 11:26
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| $ tar -xzvf whirr-0.8.1.tar.gz | |
| $ cd whirr-0.8.1 |
NewerOlder