scritps for Colfax Cluster

README.md

Usage of Colfax Cluster during Kaggle competition "Inter-MobileODT"

jupyter-notebook on the cluster

From local machine tap

ssh -L 4321:localhost:4321 colfax

Once on the cluster

jupyter-notebook --no-browser --port 4321

Install NVIDIA DIGITS

Install dependencies

On the cluster, open requirements.txt and remove all version conditions (they are a bit obsolete)

pip install --install-option="--prefix=~/digits_dependencies" -r requirements.txt

digits on the cluster

Tasks won't work without qsub submission

Script start_digits.sh

#!/bin/sh

source ~/env.local

export PYTHONPATH=$PYTHONPATH:~/digits_dependencies/lib/python2.7/site-packages/

export CAFFE_ROOT=/opt/caffe-master/

## START DIGITS SERVER at localhost:5000

# Configuration
export DIGITS_JOBS_DIR=~/digits-jobs
export DIGITS_LOGFILE_FILENAME=~/digits-jobs/digits.log
pushd DIGITS

set -e
python2 -m digits $@

popd

Interactive qsub

Script interactive_qsub :

#PBS -l nodes=1:knl7210:ram96gb -N interactive_qsub -d /home/u2459 -V -I