CISL system wide dask configuration

dask.yaml

distributed:
  scheduler:
    bandwidth: 1000000000     # GB MB/s estimated worker-worker bandwidth
  worker:
    memory:
      target: 0.90  # Avoid spilling to disk
      spill: False  # Avoid spilling to disk
      pause: 0.80  # fraction at which we pause worker threads
      terminate: 0.95  # fraction at which we terminate the worker
  comm:
    compression: null

jobqueue:
  pbs:
    name: dask-worker

    # Dask worker options
    cores: 1                    # Total number of cores per job
    memory: '3 GB'              # Total amount of memory per job
    processes: 1                # Number of Python processes per job

    interface: ib0              # Network interface to use like eth0 or ib0

    # PBS resource manager options
    queue: share
    walltime: '00:30:00'
    resource-spec: select=1

  slurm:
    name: dask-worker
    # Dask worker options
    cores: 1                    # Total number of cores per job
    memory: '25 GB'             # Total amount of memory per job
    processes: 1                # Number of Python processes per job

    interface: ib0              # Network interface to use like eth0 or ib0

    # SLURM resource manager options
    walltime: '00:30:00'
    job-extra: {-C skylake}

To CISL staff: the environment variable DASK_ROOT_CONFIG needs to point to the directory that this file ends up in.