Created
September 17, 2012 19:31
-
-
Save theotherzach/3739279 to your computer and use it in GitHub Desktop.
OSX Hbase/ Pig/ JRuby setup
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Note: | |
This is the bare minimum to get hbase, pig, and JRuby talking. Follow the link for further configs. | |
brew doctor | |
brew install hadoop | |
brew install hbase | |
brew install pig | |
in your .zshrc (or .bash_profile if you insist on BASH) | |
export JAVA_HOME="$(/usr/libexec/java_home)" | |
export HBASE_HOME=/usr/local/Cellar/hbase/0.94.0/libexec/ | |
export HBASE_INSTALL=$(echo $HBASE_HOME) | |
export PIG_HOME=/usr/local/Cellar/pig/0.10.0/ | |
export PIG_INSTALL=$(echo $PIG_HOME) | |
export PIG_CLASSPATH="`${HBASE_HOME}/bin/hbase classpath`:$PIG_CLASSPATH" | |
export CLASSPATH=$CLASSPATH:`java -jar $HBASE_HOME/jruby-complete-1.6.7.2.jar -e "puts Dir.glob('$HBASE_HOME/{.,build,lib}/*.jar').join(':')"` | |
cd $HBASE_HOME | |
wget http://central.maven.org/maven2/org/jruby/jruby-complete/1.6.7.2/jruby-complete-1.6.7.2.jar | |
Sources: | |
http://hortonworks.com/blog/pig-as-hadoop-connector-part-two-hbase-jruby-and-sinatra/ | |
https://github.com/rjurney/enron-jruby-sinatra-hbase-pig | |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment