[slurm-users] CPUSpecList confusion

[Paul Raines]

I have tried it both ways with the same result.  The assigned CPUs
will be both in and out of the range given to CpuSpecList

I tried setting using commas instead of ranges so used

CpuSpecList=0,1,2,3,4,5,6,7,8,9,10,11,12,13

But still does not work

$ srun -p basic -N 1 --ntasks-per-node=1 --mem=25G \
--time=10:00:00 --cpus-per-task=8 --pty /bin/bash
$ grep -i ^cpu /proc/self/status
Cpus_allowed:   00000780,00000780
Cpus_allowed_list:      7-10,39-42


-- Paul Raines (http://help.nmr.mgh.harvard.edu)



On Mon, 12 Dec 2022 10:21am, Sean Maxwell wrote:

> Hi Paul,
>
> Nodename=foobar \
>>    CPUs=64 Boards=1 SocketsPerBoard=2 CoresPerSocket=16 ThreadsPerCore=2 \
>>    RealMemory=256312 MemSpecLimit=32768 CpuSpecList=14-63 \
>>    TmpDisk=6000000 Gres=gpu:nvidia_rtx_a6000:1
>>
>> The slurm.conf also has:
>>
>> ProctrackType=proctrack/cgroup
>> TaskPlugin=task/affinity,task/cgroup
>> TaskPluginParam=Cores,*SlurmdOf**fSpec*,Verbose
>>
>
> Doesn't setting SlurmdOffSpec tell Slurmd that is should NOT use the CPUs
> in the spec list? (
> https://slurm.schedmd.com/slurm.conf.html#OPT_SlurmdOffSpec)
> In this case, I believe it uses what is left, which is the 0-13. We are
> just starting to work on this ourselves, and were looking at this setting.
>
> Best,
>
> -Sean
>
The information in this e-mail is intended only for the person to whom it is addressed.  If you believe this e-mail was sent to you in error and the e-mail contains patient information, please contact the Mass General Brigham Compliance HelpLine at https://www.massgeneralbrigham.org/complianceline <https://www.massgeneralbrigham.org/complianceline> .
Please note that this e-mail is not secure (encrypted).  If you do not wish to continue communication over unencrypted e-mail, please notify the sender of this message immediately.  Continuing to send or respond to e-mail after receiving this message means you understand and accept this risk and wish to continue to communicate over unencrypted e-mail.