<div dir="ltr">Hi Paul,<br><div dir="ltr"><br></div><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
Nodename=foobar \<br>
   CPUs=64 Boards=1 SocketsPerBoard=2 CoresPerSocket=16 ThreadsPerCore=2 \<br>
   RealMemory=256312 MemSpecLimit=32768 CpuSpecList=14-63 \<br>
   TmpDisk=6000000 Gres=gpu:nvidia_rtx_a6000:1<br>
<br>
The slurm.conf also has:<br>
<br>
ProctrackType=proctrack/cgroup<br>
TaskPlugin=task/affinity,task/cgroup<br>
TaskPluginParam=Cores,<b>SlurmdOf</b><b>fSpec</b>,Verbose<br></blockquote><div><br></div>Doesn't setting SlurmdOffSpec tell Slurmd that is should NOT use the CPUs in the spec list? (<a href="https://slurm.schedmd.com/slurm.conf.html#OPT_SlurmdOffSpec">https://slurm.schedmd.com/slurm.conf.html#OPT_SlurmdOffSpec</a>)</div><div class="gmail_quote">In this case, I believe it uses what is left, which is the 0-13. We are just starting to work on this ourselves, and were looking at this setting.</div><div class="gmail_quote"><br></div><div class="gmail_quote">Best,<br></div><div class="gmail_quote"><br></div><div class="gmail_quote">-Sean<br></div></div>