<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>II know I'm a few weeks late with this response. I actually
looked into this 4-6 weeks ago. According to the Slurm
documenntation, an individual job step counts as a job when
evaluating job limits. Pay attention to the note in the
documenation below. From
<a class="moz-txt-link-freetext" href="https://slurm.schedmd.com/slurm.conf.html">https://slurm.schedmd.com/slurm.conf.html</a>: <br>
</p>
<p>
<blockquote type="cite">
<dl compact="compact">
<dt><b>MaxJobCount</b></dt>
<dd>
The maximum number of jobs Slurm can have in its active
database
at one time. Set the values of <b>MaxJobCount</b> and <b>MinJobAge</b>
to ensure the slurmctld daemon does not exhaust its memory
or other
resources. Once this limit is reached, requests to submit
additional
jobs will fail. The default value is 10000 jobs.
NOTE: Each task of a job array counts as one job even though
they will not
occupy separate job records until modified or initiated.</dd>
</dl>
</blockquote>
<br>
</p>
<p><br>
</p>
<pre class="moz-signature" cols="72">Prentice </pre>
<div class="moz-cite-prefix">On 6/3/21 11:12 AM, Shaohao Chen wrote:<br>
</div>
<blockquote type="cite"
cite="mid:C7BC5F1F-822B-4D95-9C18-035E0BC4D500@mit.edu">
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<meta name="Generator" content="Microsoft Word 15 (filtered
medium)">
<style>@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Calibri",sans-serif;}span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}.MsoChpDefault
{mso-style-type:export-only;
font-size:12.0pt;
font-family:"Calibri",sans-serif;}div.WordSection1
{page:WordSection1;}</style>
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;color:black">Hi,</span><span
style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:black"> </span><span
style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:black">We
use Slurm on our cluster and set a max number of all jobs.
But we would want to implement this: N concurrent individual
jobs and M concurrent jobs in all job arrays (e.g. m job
arrays with n jobs in each and M=n*m), and M is much larger
than N. I have read the Slurm documentation, but cannot find
a way to separate the individual jobs and jobs in arrays.
Does anyone know how to do that?</span><span
style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:black"> </span><span
style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:black">Thank
you.</span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:black"> </span><span
style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;color:black">Shaohao</span><span
style="color:black"><o:p></o:p></span></p>
</div>
</blockquote>
</body>
</html>