Skip to content

Instantly share code, notes, and snippets.

@josephmisiti

josephmisiti/gist:3336977

Created August 13, 2012 04:27
Show Gist options
  • Save josephmisiti/3336977 to your computer and use it in GitHub Desktop.
Save josephmisiti/3336977 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.sh
#!/bin/sh
#
# This script will exceute the word-count example using Hadoop + Python Streaming
#
hadoop jar /usr/local/Cellar/hadoop/1.0.3/libexec/contrib/streaming/hadoop-*streaming*.jar \
-file /path/to/mapper.py \
-mapper /path/to/mapper.py \
-file /path/to/reducer.py \
-reducer /path/to/reducer.py \
-input /user/hduser/books/* \
-output /user/hduser/books-output
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment