[slurm-users] Default SelectTypeParameters option

[Thomas Green]

Hi,

I have noticed our site relies on the default value SelectTypeParameters (e.g. not specified in slurm.conf) which should be same as:

SelectTypeParameters=CR_Core_Memory

I have noticed some strange behaviour where the compute nodes do not seem to use memory cgroup e.g. in the log without the above specified in slurm.conf and assuming default value I see:

[2023-11-10T10:47:52.087] [7307368.batch] debug:  task/cgroup: init: core enforcement enabled
[2023-11-10T10:47:52.088] [7307368.batch] debug:  task/cgroup: init: device enforcement enabled

And with the above option in slurm.conf I see:

[2023-11-10T11:00:28.059] [7307370.extern] debug:  task/cgroup: init: core enforcement enabled
[2023-11-10T11:00:28.059] [7307370.extern] debug:  task/cgroup: task_cgroup_memory_init: task/cgroup/memory: TotCfgRealMem:191000M allowed:100%(enforced), swap:0%(enforced), max:100%(191000M) max+swap:100%(382000M) min:30M kmem:100%(191000M permissive) min:30M
[2023-11-10T11:00:28.059] [7307370.extern] debug:  task/cgroup: init: memory enforcement enabled
[2023-11-10T11:00:28.060] [7307370.extern] debug:  task/cgroup: init: device enforcement enabled

This relates to

https://github.com/SchedMD/slurm/blob/master/src/plugins/task/cgroup/task_cgroup.c

Specifically

https://github.com/SchedMD/slurm/blob/d59bf870f660bed022f08aff073c9ae65119c37c/src/plugins/task/cgroup/task_cgroup.c#L78C2-L78C2

Whilst I can only see the default possibly set on slurmctld but not on slurmd:

https://github.com/SchedMD/slurm/blob/d59bf870f660bed022f08aff073c9ae65119c37c/src/plugins/select/cons_tres/select_cons_tres.c#L288

Should the documentation be updated to require use of SelectTypeParameters or the code has better handling of defaulting this parameter?

Specifying the option seemed to fix odd behaviour but wanted to report the observation and whether I have misunderstood how this parameter is defaulted and whether other options also may need special care with defaults.

Tom

--
Thomas Green                         Senior Programmer
ARCCA, Redwood Building, King Edward VII Avenue, Cardiff, CF10 3NB
Tel: +44 (0)29 208 79269             Fax: +44 (0)29 208 70734
Email: greent10 at cardiff.ac.uk<mailto:greent10 at cardiff.ac.uk>        Web: http://www.cardiff.ac.uk/arcca

Thomas Green                         Uwch Raglennydd
ARCCA, Adeilad Redwood, King Edward VII Avenue, Caerdydd, CF10 3NB
Ffôn: +44 (0)29 208 79269            Ffacs: +44 (0)29 208 70734
E-bost: greent10 at caerdydd.ac.uk<mailto:greent10 at caerdydd.ac.uk>      Gwefan: http://www.caerdydd.ac.uk/arcca


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20231120/e75ebd9d/attachment.htm>