<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="FR-CA" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US">Hello,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">I have Slurm 17.11 installed on a 64 cores server. My 9 partitions are set with OverSubscribe=NO. I would expect that when all 64 cores are assigned to jobs, Slurm would just put new jobs in PENDING state. But it starts
running new jobs so that more than 64 cores are assigned. Looking at the slurmctld log, we can see that cores 21, 22 and 24 to 38 are used in more than one partition right now:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">[2018-04-16T15:00:00.439] node:katak cpus:64 c:8 s:8 t:1 mem:968986 a_mem:231488 state:11<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">[20</span>18-04-16T15:00:00.439] part:ibismini rows:1 prio:10
<o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US">[2018-04-16T15:00:00.439] row0: num_jobs 6: bitmap: 4,6-12,16-33,48-55<o:p></o:p></span></p>
<p class="MsoNormal">[2018-04-16T15:00:00.439] part:ibisinter rows:1 prio:10 <o:p>
</o:p></p>
<p class="MsoNormal"><span lang="EN-US">[2018-04-16T15:00:00.439] row0: num_jobs 1: bitmap: 24-41<o:p></o:p></span></p>
<p class="MsoNormal">[2018-04-16T15:00:00.439] part:ibismax rows:1 prio:10 <o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US">[2018-04-16T15:00:00.439] row0: num_jobs 3: bitmap: 21-22,24-38,42-47,56-63<o:p></o:p></span></p>
<p class="MsoNormal">[2018-04-16T15:00:00.439] part:rclevesq rows:1 prio:10 <o:p>
</o:p></p>
<p class="MsoNormal">[2018-04-16T15:00:00.439] part:ibis1 rows:1 prio:10 <o:p></o:p></p>
<p class="MsoNormal">[2018-04-16T15:00:00.439] part:ibis2 rows:1 prio:10 <o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US">[2018-04-16T15:00:00.439] row0: num_jobs 1: bitmap: 32-37<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">So some jobs are now sharing the same cores but I don’t understand why since OverSubscribe is set to no.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Thanks for your help!<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:FR-CA">---<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:FR-CA">Stéphane Larose<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:FR-CA">Analyste de l'informatique<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:FR-CA">Institut de Biologie Intégrative et des Systèmes (IBIS)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:FR-CA">Pavillon Charles-Eugène-Marchand<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:FR-CA">Université Laval<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>