enroot_nvme.md

Switch Enroot to NVME

1. Create a file enroot_nvme.sh:

#!/bin/bash

# Change the /etc/enroot/enroot.conf file to use local nvme storage:
#ENROOT_RUNTIME_PATH        /tmp/enroot/user-$(id -u) -> /opt/dlami/nvme/enroot/user-$(id -u)
#ENROOT_CONFIG_PATH         ${HOME}/enroot
#ENROOT_CACHE_PATH          /opt/enroot
#ENROOT_DATA_PATH           /tmp/enroot/data/user-$(id -u) -> /opt/dlami/nvme/enroot/data/user-$(id -u)

sudo sed -i 's/\/tmp/\/opt\/dlami\/nvme/g' /etc/enroot/enroot.conf

2. Next submit to the number of compute nodes you have:

sbatch -N 8 enroot_nvme.sh

3. Spot check to make sure it worked:

srun head /etc/enroot/enroot.conf

This should show:

#Please refer https://github.com/NVIDIA/enroot/blob/master/doc/configuration.md for details about individual options.
#ENROOT_LIBRARY_PATH        /usr/lib/enroot
#ENROOT_SYSCONF_PATH        /etc/enroot
ENROOT_RUNTIME_PATH        /opt/dlami/nvme/enroot/user-$(id -u)
ENROOT_CONFIG_PATH         ${HOME}/enroot
ENROOT_CACHE_PATH          /opt/enroot
ENROOT_DATA_PATH           /opt/dlami/nvme/enroot/data/user-$(id -u)
#ENROOT_TEMP_PATH           ${TMPDIR:-/opt/dlami/nvme}