Skip to content

Instantly share code, notes, and snippets.

@kiyoon
Last active August 17, 2021 05:15
Show Gist options
  • Save kiyoon/4fb3abd9535253dfdf0673af21cf3061 to your computer and use it in GitHub Desktop.
Save kiyoon/4fb3abd9535253dfdf0673af21cf3061 to your computer and use it in GitHub Desktop.
Slurm cheatsheet

Node summary

qstat -F gpus,gputype,mem_total -q gpu

Interactive session

qlogin -pe gpu-titanx 1

The laura_group group spaces on both DataStore and Eddie have now been created.

  1. The quota for the DataStore space is 1GB (donated from your personal allocation). You may have already received an email with instructions on how to access it from your own machines, but here is the DataStore documentation in case you need it:

https://www.wiki.ed.ac.uk/display/ResearchServices/DataStore

From Eddie, you can access the DataStore space through the staging nodes (access using -q staging) at the following path:

/exports/csce/datastore/inf/groups/laura_group

More information on data staging on Eddie can be seen here: https://www.wiki.ed.ac.uk/display/ResearchServices/Data+Staging

Anybody else who would like to donate to the DataStore space can do so through Storage Manager: https://registration.ecdf.ed.ac.uk/storage/ ('Allocate to shared space')

  1. The quota for the Eddie space is 200GB and the path to access it from all Eddie nodes is /exports/csce/eddie/inf/groups/laura_group

Further quota can be added at a cost - see https://www.wiki.ed.ac.uk/display/ResearchServices/Charges for prices.

Currently you are the storage admin of both the Eddie and DataStore spaces and the only member of the group.

The storage admin can authorise any changes to the group, including changes in quota, membership, ownership of data and deletion of data.

The storage admin can make quota changes on either the Eddie or DataStore group space using the Storage Manager: https://registration.ecdf.ed.ac.uk/storage/ ('Request Quota Change')* *Note that any quota changes made by the storage admin using the 'Request Quota Change' button are charged. For free quota donations on DataStore, users should use the function mentioned above ('Allocate to shared space'). This function is not available for Eddie spaces.

The storage admin can authorise any additions to/removals from the group by getting in touch with the IS Helpline (https://www.ed.ac.uk/information-services/help-consultancy/contact-helpline).

There is also the option of self-management of the group membership using the Group Manager Wizard: http://www.servicedelivery.is.ed.ac.uk/groupmanager/

If you would like to nominate anybody else to be the storage admin, make any additions to the group or request access to the Group Manager Wizard just now, please let me know by replying to this email.

Please note that when you need the space to be closed down, you need to make sure all the data are deleted and get in touch with us via the IS Helpline to request closure.

Please confirm whether you are happy for me to close this call or let me know if you need anything further.

view partition list

sinfo

Run interactive session

srun --partition=General_Usage --nodes=1 --ntasks-per-node=1 --time=01:00:00 --mem=14000 --cpus-per-task=4 -w <node_name> --gres=gpu:<num_gpus> --exclude=<node_name>[11-12] --pty bash -i
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment