<html>
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>The intention there is to pack jobs on the smallest node that can
handle the job.</p>
<p>This way jobs that only need 1 cpu don't take it from a 64-core
node unless it has to, leaving that one available for that 64-core
job.</p>
<p><br>
</p>
<p>It really boils down to what you want to happen, which will vary
with each installation.</p>
<p><br>
</p>
<p>Brian Andrus<br>
</p>
<p><br>
</p>
<div class="moz-cite-prefix">On 9/5/2019 8:48 AM, Douglas Duckworth
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:BN6PR06MB3409D4F66866AC73A313973DFFBB0@BN6PR06MB3409.namprd06.prod.outlook.com">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
Hello</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
We added some newer Epyc nodes, with NVMe scratch, to our
cluster and so want jobs to run on these over others. So we
added "Weight=100"
<i><b>to the older nodes</b></i> and left the new ones blank.
So indeed, ceteris paribus, srun reveals that the faster nodes
will accept jobs over older ones.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
We have the desired outcome though I am a bit confused by two
statements in the <a
href="https://slurm.schedmd.com/slurm.conf.html"
title="https://slurm.schedmd.com/slurm.conf.html"
moz-do-not-send="true">
manpage</a> that seem to be contradictory:</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
"All things being equal, jobs will be allocated the nodes with
the lowest weight which satisfies their requirements."</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
"...larger weights should be assigned to nodes with more
processors, memory, disk space, higher processor speed, etc."</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
100 is larger than 1 and we do see jobs preferring the new nodes
which have the default weight of 1. Yet we're also told to
assign larger weights to faster nodes?</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
Thanks!</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
Doug</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id="Signature">
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt;
color:#000000; font-family:Calibri,Helvetica,sans-serif">
<p style="margin-top: 0px; margin-bottom: 0px;margin-top:0;
margin-bottom:0"><span id="ms-rterangepaste-start"></span><span
style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">-- </span><br
style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">
<span style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">Thanks,</span><br
style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">
<br style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">
<span style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">Douglas Duckworth, MSc, LFCS</span><br
style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">
<span style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">HPC System Administrator</span><br
style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">
<span style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px"><a
href="https://scu.med.cornell.edu/" class="OWAAutoLink"
moz-do-not-send="true">Scientific Computing Unit</a></span><br
style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">
<span style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">Weill Cornell Medicine"</span><br
style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">
<span style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">E: <a class="moz-txt-link-abbreviated" href="mailto:doug@med.cornell.edu">doug@med.cornell.edu</a></span><br
style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">
<span style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">O: 212-746-6305</span><br
style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">
<span style="color:rgb(33,33,33);
font-family:wf_segoe-ui_normal,"Segoe
UI","Segoe
WP",Tahoma,Arial,sans-serif,serif,EmojiFont;
font-size:14.6667px">F: 212-746-8690</span><span
id="ms-rterangepaste-end"></span><br>
</p>
</div>
</div>
</blockquote>
</body>
</html>