<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
Hi Sidiney,<br>
<br>
not tested, but shouldn't<br>
<br>
SelectTypeParameters = CR_CPU_MEMORY<br>
<br>
do the trick?<br>
<br>
<br>
Best<br>
Marcus<br>
<br>
<div class="moz-cite-prefix">On 12/07/2018 12:12 PM, Sidiney
Crescencio wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAG4wxsRqwbHnCzamxiTnR7-gsJyU==YQ6jWEH94K3vJeRMrd+g@mail.gmail.com">
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<div dir="ltr">
<div dir="ltr">
<div>Hello All,</div>
<div><br>
</div>
<div>I'm facing some issues to use the HT on my compute nodes,
I'm running slurm 17.02.7</div>
<div><br>
</div>
<div>SelectTypeParameters = CR_CORE_MEMORY</div>
<div><br>
</div>
<div>cgroup.conf</div>
<div><br>
</div>
<div>CgroupAutomount=yes</div>
<div>CgroupReleaseAgentDir="/etc/slurm/cgroup"</div>
<div><br>
</div>
<div># cpuset subsystem</div>
<div>ConstrainCores=yes</div>
<div>TaskAffinity=no</div>
<div><br>
</div>
<div># memory subsystem</div>
<div>ConstrainRAMSpace=yes</div>
<div>ConstrainSwapSpace=yes</div>
<div><br>
</div>
<div># device subsystem</div>
<div>ConstrainDevices=yes</div>
<div><br>
</div>
<div>If I try to allocate the 80 CPUs it will not work, I
couldn't find why this doesn't work. Do you guys have any
ideas or could cause this issue? I've been playing with
several different parameters on the node definition, also
using --threads-per-core, etc.. but still I should be able
to allocate the 80 cpus.</div>
<div><br>
</div>
<div>Thanks in advance.</div>
<div><br>
</div>
<div>srun --reservation=test_ht -p defq -n 80 sleep 100</div>
<div>srun: error: Unable to allocate resources: Requested node
configuration is not available</div>
<div><br>
</div>
<div>--------------</div>
<div><br>
</div>
<div>[root@csk007 ~]# slurmd -C</div>
<div>NodeName=csk007 CPUs=80 Boards=1 SocketsPerBoard=2
CoresPerSocket=20 ThreadsPerCore=2 RealMemory=385630
TmpDisk=217043</div>
<div>UpTime=84-00:36:44</div>
<div>[root@csk007 ~]# scontrol show node csk007</div>
<div>NodeName=csk007 Arch=x86_64 CoresPerSocket=20</div>
<div> CPUAlloc=0 CPUErr=0 CPUTot=80 CPULoad=4.03</div>
<div> AvailableFeatures=(null)</div>
<div> ActiveFeatures=(null)</div>
<div> Gres=(null)</div>
<div> NodeAddr=csk007 NodeHostName=csk007 Version=17.02</div>
<div> OS=Linux RealMemory=380000 AllocMem=0 FreeMem=338487
Sockets=2 Boards=1</div>
<div> State=RESERVED ThreadsPerCore=2 TmpDisk=0 Weight=1
Owner=N/A MCS_label=N/A</div>
<div> Partitions=defq</div>
<div> BootTime=2018-09-14T12:31:05
SlurmdStartTime=2018-11-29T15:25:03</div>
<div> CfgTRES=cpu=80,mem=380000M</div>
<div> AllocTRES=</div>
<div> CapWatts=n/a</div>
<div> CurrentWatts=0 LowestJoules=0 ConsumedJoules=0</div>
<div> ExtSensorsJoules=n/s ExtSensorsWatts=0
ExtSensorsTemp=n/s</div>
<div><br>
</div>
<div>-----------------------</div>
<div><br>
</div>
-- <br>
<div dir="ltr" class="gmail_signature">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">Best Regards, <br>
<div>Sidiney</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
<br>
<pre class="moz-signature" cols="72">--
Marcus Wagner, Dipl.-Inf.
IT Center
Abteilung: Systeme und Betrieb
RWTH Aachen University
Seffenter Weg 23
52074 Aachen
Tel: +49 241 80-24383
Fax: +49 241 80-624383
<a class="moz-txt-link-abbreviated" href="mailto:wagner@itc.rwth-aachen.de">wagner@itc.rwth-aachen.de</a>
<a class="moz-txt-link-abbreviated" href="http://www.itc.rwth-aachen.de">www.itc.rwth-aachen.de</a>
</pre>
</body>
</html>