hadoop-tmp-noexec

README.md

Fixes for when /tmp is mounted with noexec

Applies to HDP (Hortonworks Data Platform) but likely relevant for other Hadoop distributions.

This is not complete. Adding to it as issues are found.

Prep

1. Create an alternative tmp directory:

sudo mkdir -p /hadoop/tmp
sudo chown root:hadoop /hadoop/tmp
sudo chmod 1770 /hadoop/tmp

Fixes

HBase, YARN-HBase (Timeline Reader), and Ambari Metrics (AMS)

From Ambari, update YARN yarn-hbase-env, AMS ams-hbase-env, and HBase hbase-env with the following:

export HBASE_OPTS="$HBASE_OPTS -Dorg.apache.hbase.thirdparty.io.netty.native.workdir=/hadoop/tmp"

Knox

Update gateway.sh and knoxcli.sh directly in the file system on all Knox hosts:

-Djava.io.tmpdir=/hadoop/tmp -D*jna*.tmpdir=/hadoop/tmp

Ranger Admin authentication