Skip to content

Instantly share code, notes, and snippets.

@josephmisiti
Created September 26, 2012 22:05
Show Gist options
  • Save josephmisiti/3790922 to your computer and use it in GitHub Desktop.
Save josephmisiti/3790922 to your computer and use it in GitHub Desktop.
#!/bin/sh
SCRIPT_DIR=`pwd`
hadoop dfs -rmr /user/rdw/$3
hadoop jar /usr/lib/hadoop-0.20/contrib/streaming/hadoop-streaming-0.20.2-cdh3u5.jar \
-input /user/rdw/$2 \
-output /user/rdw/$3 \
-mapper "$1 mapper" \
-reducer "$1 reducer" \
-file $SCRIPT_DIR/$1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment