GPUs on Magnolia

Magnolia has 6 GPU nodes with 2 NVIDIA L40S GPUs each. The GPU nodes are in the gpuq “partition” or queue. Jobs requiring a GPU should submit requests to this queue and request the appropriate number of GPUs using the Slurm –gpus option, or one of its variations.

The CUDA toolkit is available via the cuda12.6/toolkit module.

The following command starts an interactive job on a GPU node, requesting one GPU and half of the node’s CPUs and memory:
srun -p gpuq --gpus 1 -c 16 --mem 250g --time 1:00:00 --pty bash