sean-smith/virtualenv.md

Last active February 8, 2024 02:00

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/sean-smith/a9b13471a33f3e6bf1592f3253be1eee.js"></script>
Save sean-smith/a9b13471a33f3e6bf1592f3253be1eee to your computer and use it in GitHub Desktop.

Download ZIP

Raw

virtualenv.md

Activate virtualenvs with python

Install Virtualenvwrapper - this is my favorite way of creating virtualenvs

sudo apt-get install virtualenvwrapper

Install on the compute as well, where 4 is the number of compute nodes:

srun -N 4 sudo apt-get install virtualenvwrapper

Install your python packages in a shared directory, in this case /fsx/ubuntu:

cd /fsx/ubuntu
mkvirtualenv packages 
pip3 install torch

Create a job script

#!/bin/bash
#SBATCH -N 1

workon packages

...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment