<div dir="ltr"><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Hi Rodrigo,</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">good spot. At least, scontrol show job is now saying that each job only requires one "CPU", so it seems all the cores are treated the same way now.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Though I still have the problem of not using more than half the cores. So I suppose it might be due to the way I submit (batchtools in this case) the jobs.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">I'm still investigating even if NumCPUs=1 now as it should be. Thanks.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">David</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Oct 8, 2020 at 4:40 PM Rodrigo Santibáñez <<a href="mailto:rsantibanez.uchile@gmail.com">rsantibanez.uchile@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">Hi David,<div dir="auto"><br></div><div dir="auto">I had the same problem time ago when configuring my first server.</div><div dir="auto"><br></div><div dir="auto">Could you try SelectTypeParameters=CR_CPU instead of SelectTypeParameters=CR_Core?</div><div dir="auto"><br></div><div dir="auto">Best regards,</div><div dir="auto">Rodrigo.</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Oct 8, 2020, 02:16 David Bellot <<a href="mailto:david.bellot@lifetrading.com.au" rel="noreferrer" target="_blank">david.bellot@lifetrading.com.au</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Hi,</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">my Slurm cluster has a dozen machines configured as follows:</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">NodeName=foobar01 CPUs=80 Boards=1 SocketsPerBoard=2 CoresPerSocket=20 ThreadsPerCore=2 RealMemory=257243 State=UNKNOWN<br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">and scheduling is:</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"># SCHEDULING<br>SchedulerType=sched/backfill<br>SelectType=select/cons_tres<br>SelectTypeParameters=CR_Core<br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">My problem is that only half of the logical cores are used when I run a computation.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Let me explain: I use R and the package 'batchtools' to create jobs. All the jobs are created under the hood with sbatch. If I log in to all the machines in my cluster and do a 'htop', I can see that only half of the logical cores are used. Other methods to measure the load of each machine confirmed this "visual" clue.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">My jobs ask Slurm for only one cpu per task. I tried to enforce that with the -c 1 but it didn't make any difference.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Then I realized there was something strange: </div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">when I do scontrol show job <jobid>, I can spot the following output:</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">   NumNodes=1 NumCPUs=2 NumTasks=0 CPUs/Task=1 ReqB:S:C:T=0:0:*:*<br>   TRES=cpu=2,node=1,billing=2<br>   Socks/Node=* NtasksPerN:B:S:C=0:0:*:2 CoreSpec=*<br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">that is each job uses NumCPUs=2 instead of 1. Also, I'm not sure why TRES=cpu=2</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Any idea on how to solve this problem and have 100% of the logical cores allocated?</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Best regards,</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">David</div><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"></div></div></div></div></div></div></div></div>
</blockquote></div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div><table border="0" cellpadding="0" cellspacing="0" style="line-height:0px;padding:0px;border-spacing:0px;margin:0px;border-collapse:collapse"><tbody><tr><td width="90"><table border="0" cellpadding="0" cellspacing="0" style="font-family:Arial,Helvetica,sans-serif;line-height:0px;padding:0px;border-spacing:0px;margin:0px;border-collapse:collapse"><tbody><tr><td style="border-collapse:collapse;line-height:0px"><a rel="nofollow" href="https://www.lifetrading.com.au/" style="color:rgb(17,85,204);font-size:0px;line-height:0px" target="_blank"><img height="90" width="90" alt="" border="0" src="https://cdn.share-and-review.com/a4dbb7fe-109f-4836-b28a-19f584decda8/-/resize/180x180/img.png" style="max-width: 100%;"></a></td></tr></tbody></table></td><td width="7" style="border-collapse:collapse;padding-right:7px;width:7px"></td><td width="3" style="border-collapse:collapse;background-color:rgb(62,194,207);width:3px"></td><td width="9" style="border-collapse:collapse;padding-right:9px;width:9px"></td><td><table border="0" cellpadding="0" cellspacing="0" style="font-family:Arial,Helvetica,sans-serif;line-height:0px;padding:0px;border-spacing:0px;margin:0px;border-collapse:collapse"><tbody><tr><td><table border="0" cellpadding="0" cellspacing="0" style="font-family:Arial,Helvetica,sans-serif;line-height:0px;padding:0px;border-spacing:0px;margin:0px;border-collapse:collapse"><tbody><tr><td><table border="0" cellpadding="0" cellspacing="0" style="font-family:Arial,Helvetica,sans-serif;line-height:0px;padding:0px;border-spacing:0px;margin:0px;border-collapse:collapse"><tbody><tr><td style="font-family:Arial,Helvetica,sans-serif;border-collapse:collapse;font-size:18px;line-height:20px;font-weight:bold"><span style="line-height:20px;color:rgb(62,194,207)">David Bellot</span></td></tr><tr><td style="border-collapse:collapse;padding-bottom:1px;height:1px"></td></tr></tbody></table></td><td style="border-collapse:collapse;padding-right:4px;width:4px"></td><td style="border-collapse:collapse;background-color:rgb(89,89,89);width:1px"></td><td style="border-collapse:collapse;padding-right:4px;width:4px"></td><td><table border="0" cellpadding="0" cellspacing="0" style="font-family:Arial,Helvetica,sans-serif;line-height:0px;padding:0px;border-spacing:0px;margin:0px;border-collapse:collapse"><tbody><tr><td style="font-family:Arial,Helvetica,sans-serif;border-collapse:collapse;font-size:15px;font-style:italic;line-height:17px"><span style="line-height:17px;color:rgb(89,89,89)">Head of Quantitative Research</span></td></tr></tbody></table></td></tr></tbody></table></td></tr><tr><td><table border="0" cellpadding="0" cellspacing="0" style="font-family:Arial,Helvetica,sans-serif;line-height:0px;padding:0px;border-spacing:0px;margin:0px;border-collapse:collapse"><tbody><tr><td><table border="0" cellpadding="0" cellspacing="0" style="font-family:Arial,Helvetica,sans-serif;line-height:0px;padding:0px;border-spacing:0px;margin:0px;border-collapse:collapse"><tbody><tr><td style="font-family:Arial,Helvetica,sans-serif;border-collapse:collapse;font-size:11px;line-height:13px"><span style="line-height:13px;color:rgb(0,0,1)"> </span></td></tr></tbody></table></td></tr></tbody></table></td></tr><tr><td><table border="0" cellpadding="0" cellspacing="0" style="font-family:Arial,Helvetica,sans-serif;line-height:0px;padding:0px;border-spacing:0px;margin:0px;border-collapse:collapse"><tbody><tr><td><table border="0" cellpadding="0" cellspacing="0" style="font-family:Arial,Helvetica,sans-serif;line-height:0px;padding:0px;border-spacing:0px;margin:0px;border-collapse:collapse"><tbody><tr><td style="font-family:Arial,Helvetica,sans-serif;border-collapse:collapse;font-size:12px;line-height:14px"><span style="line-height:14px;font-weight:bold;color:rgb(62,194,207)">A.</span> <span style="line-height:14px;color:rgb(143,143,143)">Suite B, Level 3A, 43-45 East Esplanade, Manly, NSW 2095</span></td></tr><tr><td style="border-collapse:collapse;padding-bottom:1px;height:1px"></td></tr><tr><td style="font-family:Arial,Helvetica,sans-serif;border-collapse:collapse;font-size:12px;line-height:14px"><span style="line-height:14px;font-weight:bold;color:rgb(62,194,207)">E.</span> <span style="line-height:14px;color:rgb(143,143,143)"><a href="mailto:david.bellot@lifetrading.com.au" style="color:rgb(17,85,204)" target="_blank">david.bellot@lifetrading.com.au</a></span></td></tr><tr><td style="border-collapse:collapse;padding-bottom:1px;height:1px"></td></tr></tbody></table></td></tr></tbody></table></td></tr><tr><td><table border="0" cellpadding="0" cellspacing="0" style="font-family:Arial,Helvetica,sans-serif;line-height:0px;padding:0px;border-spacing:0px;margin:0px;border-collapse:collapse"><tbody><tr><td><table border="0" cellpadding="0" cellspacing="0" style="font-family:Arial,Helvetica,sans-serif;line-height:0px;padding:0px;border-spacing:0px;margin:0px;border-collapse:collapse"><tbody><tr><td style="font-family:Arial,Helvetica,sans-serif;border-collapse:collapse;font-size:12px;line-height:14px"><span style="line-height:14px;font-weight:bold;color:rgb(62,194,207)">P.</span> <span style="line-height:14px;color:rgb(143,143,143)">(+61) 0405 263012</span></td></tr></tbody></table></td></tr></tbody></table></td></tr></tbody></table></td></tr></tbody></table></div></div></div></div></div></div></div></div>