Hi, Sean. I followed your instructions and added ConstrainDevices=yes to the /etc/slurm/cgroup.conf file on the server node, and then restarted the relevant services on both the server and the client. However, I still can't enforce the restriction in the Python program.
It seems like the restriction applies to the physical GPU hardware, but it doesn't take effect for CUDA.