<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-GB" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Hi Purvesh,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Something might be possible but it's a bit of a kludge. To do this cgroups and ConstrainCores needs to be configured.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Say you have a node called tux that has 16 cores and 512GB, and you want to split it into two logical nodes of 8 cores and 256GB.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">In slurm.conf add the NodeNames as you want them (in this case tux01 and tux02) but point the NodeAddr to the hostname or IP of the actual host. Divide up the resources as you wish. Note, the CPUSpecList
is used to reserve cores for system use but we can use it to mask the cores we would like to access on the other logical node. Also note, the documentation does say that the use of the Port option "is not generally recommended except for development or testing
purposes".<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:#0070C0;mso-fareast-language:EN-US">NodeName=tux01 NodeAddr=tux Port=6001 CPUs=16 SocketsPerBoard=2 CoresPerSocket=8 ThreadsPerCore=1 RealMemory=262144 CPUSpecList=0-7<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:#0070C0;mso-fareast-language:EN-US">NodeName=tux02 NodeAddr=tux Port=6002 CPUs=16 SocketsPerBoard=2 CoresPerSocket=8 ThreadsPerCore=1 RealMemory=262144 CPUSpecList=8-15<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Then add the nodes to the partitions.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:#0070C0;mso-fareast-language:EN-US">PartitionName=ppart Nodes=tux01 ...<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New";color:#0070C0;mso-fareast-language:EN-US">PartitionName=cpart Nodes=tux02 ...<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">You'll then need to run two slurmd services per node and use the '-N' option to run the daemon with the given hostname, for example '</span><span style="font-family:"Courier New";color:#0070C0;mso-fareast-language:EN-US">slurmd
-N tux01</span><span style="mso-fareast-language:EN-US">'.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Like I say, it's a bit of a kludge.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">thanks,<br>
Sam<o:p></o:p></span></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="749" style="width:561.6pt;margin-left:5.4pt;border-collapse:collapse">
<tbody>
<tr style="height:16.95pt">
<td width="749" valign="top" style="width:561.6pt;padding:0cm 0cm 0cm 0cm;height:16.95pt">
<p class="MsoNormal"><span style="font-size:10.0pt;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US">From:</span></b><span lang="EN-US"> slurm-users <slurm-users-bounces@lists.schedmd.com>
<b>On Behalf Of </b>Purvesh Parmar<br>
<b>Sent:</b> Thursday, July 6, 2023 1:21 PM<br>
<b>To:</b> Slurm User Community List <slurm-users@lists.schedmd.com><br>
<b>Subject:</b> Re: [slurm-users] Distribute a single node resources across multiple partitons<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<div>
<p class="MsoNormal">Hi,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Do I need separate slurmctld and slurmd to run for this? I am struggling for this. Any pointers.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">--<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Purvesh<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Mon, 26 Jun 2023 at 12:15, Purvesh Parmar <<a href="mailto:purveshp0507@gmail.com">purveshp0507@gmail.com</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<p class="MsoNormal">Hi,<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I have slurm 20.11 in a cluster of 4 nodes, with each node having 16 cpus. I want to create two partitions (ppart and cpart) and want that 8 cores from each of the 4 nodes should be part of part of ppart and remaining 8 cores should be
part of cpart, this means, I want to distribute each node's resources across multiple partitions exclusively. How to go about this? <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">--<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Purvesh<o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</body>
</html>