Skip to content

Instantly share code, notes, and snippets.

@okaram
Created December 2, 2012 05:13
Show Gist options
  • Save okaram/4187050 to your computer and use it in GitHub Desktop.
Save okaram/4187050 to your computer and use it in GitHub Desktop.
hadoop
hadoop dfs -copyFromLocal texts /user/hduser/texts
hadoop dfs -ls /user/hduser/texts
wget https://raw.github.com/okaram/scripts/master/hadoop/samples/WordCount.java
javac WordCount.java
jar -cvf wc.jar *.class
ec2-run-instances ami-51de5e38 -t t1.micro -k mac-vm -f install-hadoop-1.1.sh
mkdir texts
cp WordCount.java texts/
hadoop jar wc.jar WordCount /user/hduser/texts /user/hduser/out
PATH=$PATH:/usr/local/hadoop/bin
export CLASSPATH=/usr/local/hadoop/hadoop-core-1.1.0.jar:/usr/local/hadoop/lib/commons-cli-1.2.jar
sudo su -c ./install-hadoop-1.1.sh
sudo su - hduser
wget https://raw.github.com/okaram/scripts/master/hadoop/install-hadoop-1.1.sh
chmod a+x install-hadoop-1.1.sh
@stuart-warren
Copy link

Maybe mention your set_path.sh on your blog post
Took me a while to spot the start-all.sh
:)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment