Skip to content

Instantly share code, notes, and snippets.

@t0mmyt
Last active January 2, 2016 20:52
Show Gist options
  • Save t0mmyt/f894f08332d735ca65d7 to your computer and use it in GitHub Desktop.
Save t0mmyt/f894f08332d735ca65d7 to your computer and use it in GitHub Desktop.
Hadoop user profile
dfs()
{
hdfs dfs "$@" 2>&1 | grep -v 'using builtin-java classes where applicable'
}
export JAVA_HOME=/usr/lib/jvm/java-7-openjdk-amd64
export HADOOP_INSTALL=~/hadoop
export HADOOP_HOME=$HADOOP_INSTALL
export PATH=$PATH:$HADOOP_INSTALL/bin:$HADOOP_INSTALL/sbin
export HADOOP_MAPRED_HOME=$HADOOP_INSTALL
export HADOOP_COMMON_HOME=$HADOOP_INSTALL
export HADOOP_HDFS_HOME=$HADOOP_INSTALL
export YARN_HOME=$HADOOP_INSTALL
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_INSTALL/lib/native
export HADOOP_OPTS="-Djava.library.path=$HADOOP_INSTALL/lib/native"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment