<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body lang="EN-GB" link="#0563C1" vlink="#954F72" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">Hi all,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I have what feels like a bug, but I’m keen to validate my configuration first. We are running a configuration where we are tagging hosts with features so that we can specifically request them using job constraints. The configuration
looks like:<br>
<br>
<o:p></o:p></p>
<p class="MsoNormal"># COMPUTE NODES<o:p></o:p></p>
<p class="MsoNormal">NodeName=hosts-[1-4] RealMemory=500000 Sockets=2 CoresPerSocket=64 ThreadsPerCore=2 State=UNKNOWN features=rack17<o:p></o:p></p>
<p class="MsoNormal">NodeName=hosts-[5-8] RealMemory=500000 Sockets=2 CoresPerSocket=64 ThreadsPerCore=2 State=UNKNOWN features=rack18<o:p></o:p></p>
<p class="MsoNormal">NodeName=hosts-[9-12] RealMemory=500000 Sockets=2 CoresPerSocket=64 ThreadsPerCore=2 State=UNKNOWN features=rack19<o:p></o:p></p>
<p class="MsoNormal">NodeName=hosts-[13-16] RealMemory=500000 Sockets=2 CoresPerSocket=64 ThreadsPerCore=2 State=UNKNOWN features=racklr20<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">We’re looking for a particular job setup where we get 4 nodes from one rack, then four nodes from any other rack. We use the constraints:<br>
<br>
--constraint="[(rack17|rack18|rack19|rack20)*4&(rack17|rack18|rack19|rack20)*4]<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Most of the time the above works, but sometimes we’ve ended up with a job landing on 4 nodes from one rack, 3 nodes from another and one from a third rack, which should break our constraints. We took the constraints configuration from
here: <a href="https://slurm.schedmd.com/srun.html#OPT_Brackets">https://slurm.schedmd.com/srun.html#OPT_Brackets</a>
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Can anyone see what the issue might be? <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal"><span style="mso-fareast-language:EN-GB">-- <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:#292C31;mso-fareast-language:EN-GB">Regards,</span><span style="color:black;mso-fareast-language:EN-GB"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:#292C31;mso-fareast-language:EN-GB">Nathan Harper<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<br>
<br>
<font size="1">** We have updated our privacy policy, which contains important information about how we collect and process your personal data. To read the policy, please click
<a href="http://www.graphcore.ai/privacy">here</a> **<br>
<br>
This email and its attachments are intended solely for the addressed recipients and may contain confidential or legally privileged information.<br>
If you are not the intended recipient you must not copy, distribute or disseminate this email in any way; to do so may be unlawful.<br>
<br>
Any personal data/special category personal data herein are processed in accordance with UK data protection legislation.<br>
All associated feasible security measures are in place. Further details are available from the Privacy Notice on the website and/or from the Company.<br>
<br>
Graphcore Limited (registered in England and Wales with registration number 10185006) is registered at 107 Cheapside, London, UK, EC2V 6DN.<br>
This message was scanned for viruses upon transmission. However Graphcore accepts no liability for any such transmission.<br>
<font></font></font>
</body>
</html>