Skip to content

Instantly share code, notes, and snippets.

@herry13
Last active January 3, 2016 19:28
Show Gist options
  • Select an option

  • Save herry13/8508392 to your computer and use it in GitHub Desktop.

Select an option

Save herry13/8508392 to your computer and use it in GitHub Desktop.
Hadoop 1.x cluster testing script
#!/bin/bash
#####
#
# A script that runs wordcount mapreduce application on Apache Hadoop 1.x.
# The input file are files in the "<HOME>/conf" directory.
#
#####
./bin/hadoop dfs -mkdir /input
./bin/hadoop dfs -copyFromLocal ./conf/* /input
./bin/hadoop jar hadoop-examples-*.jar wordcount /input /output
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment