Good afternoon all,
after having run a Slurm cluster for a long time with exclusive node usage
(the DEFAULT partition set to Shared=EXCLUSIVE, for historical reasons),
I have now received a request to provide individual CPU cores as well,
so "shared mode" would be it.
I set up a new partition with OverSubscribe=NO, changed the DEFAULT stanza
to OverSubscribe=EXCLUSIVE, and things seemed to work (after I changed
SelectTypeParameters to CR_Core_Memory from CR_Core - apparently nobody
ever hit a memory limit before...).
But -
now there are jobs that don't run anymore. After staring at them for hours,
I found that they would request CPUs=32 (they always did, I suspect).
Our compute nodes are 2s/16c/2t, "slurmd -C" on them reports
CPUs=64 Boards=1 SocketsPerBoard=2 CoresPerSocket=16 ThreadsPerCore=2
Moving those jobs (that claim "never to be runnable") to the new partition
now appears to work, and they claim enough memory not to share their node
with other jobs, but I'd like to keep them in their original partition.
Where's my mistake? Am I trying to mix things that can't be mixed?
Thanks, S
--
Steffen Grunewald, Cluster Administrator
Max Planck Institute for Gravitational Physics (Albert Einstein Institute)
Am Mühlenberg 1 * D-14476 Potsdam-Golm * Germany
~~~
Fon: +49-331-567 7274
Mail: steffen.grunewald(at)aei.mpg.de
~~~
