<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<tt>You can also limit the number of jobs per user the backfill
scheduler is considering. All SchedulerParameters are worth a
read if you haven't yet. <br>
<br>
<br>
from the slurm.conf man page...<br>
<br>
bf_max_job_user=#<br>
The maximum number of jobs per user to
attempt starting with the backfill scheduler for ALL partitions.
One can set this limit to prevent users from flooding the backfill
queue with jobs that cannot start and that prevent jobs from other
users to start. This is similar to the MAXIJOB limit in Maui.
The default value is 0, which means no limit. This option applies
only to SchedulerType=sched/backfill. Also see the
bf_max_job_part, bf_max_job_test and bf_max_job_user_part=#
options. Set bf_max_job_test to a value much higher than
bf_max_job_user.<br>
<br>
bf_max_job_user_part=#<br>
The maximum number of jobs per user per
partition to attempt starting with the backfill scheduler for any
single partition. The default value is 0, which means no limit.
This option applies only to SchedulerType=sched/backfill. Also
see the bf_max_job_part, bf_max_job_test and bf_max_job_user=#
options.<br>
<br>
</tt><br>
<div class="moz-cite-prefix">On 3/18/20 1:21 PM, Sean Maxwell wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAKzOuDyoQbXQPxAFRQx5dKhtFkv+e1A-+Xg_cns_uiHTzz=a0A@mail.gmail.com">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<div dir="ltr">Hi Mike,<br>
<br>
I think you want to set MaxSubmitJobs on the users account
association. The parameter is described in the sacctmgr
documentation as being the maximum number of jobs a user can
have in state running or pending.<br>
<br>
<a href="https://slurm.schedmd.com/sacctmgr.html"
moz-do-not-send="true">https://slurm.schedmd.com/sacctmgr.html</a><br>
<br>
Thanks,<br>
<br>
-Sean</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Wed, Mar 18, 2020 at 1:12
PM Hanby, Mike <<a href="mailto:mhanby@uab.edu"
moz-do-not-send="true">mhanby@uab.edu</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="EN-US">
<div class="gmail-m_-8266384588791523889WordSection1">
<p class="MsoNormal"><span style="font-size:11pt">Howdy,</span></p>
<p class="MsoNormal"><span style="font-size:11pt"> </span></p>
<p class="MsoNormal"><span style="font-size:11pt">We are
running Slurm 18.08. We have a user who has, twice,
submitted over 15 thousand jobs to the cluster (the
queue normally has a couple thousand jobs at any given
time).</span></p>
<p class="MsoNormal"><span style="font-size:11pt"> </span></p>
<p class="MsoNormal"><span style="font-size:11pt">This
results in Slurm being unresponsive to user requests /
job submits. I suspect the scheduler is getting bogged
down doing backfill processing.</span></p>
<p class="MsoNormal"><span style="font-size:11pt"> </span></p>
<p class="MsoNormal"><span style="font-size:11pt">Is there
any way to limit the maximum number of jobs a single
user can have in the queue at any given time?</span></p>
<p class="MsoNormal"><span style="font-size:11pt"> </span></p>
<p class="MsoNormal"><span
style="font-size:10pt;font-family:"Courier
New";color:black">---------------- </span><span
style="color:black"></span></p>
<p class="MsoNormal"><span
style="font-size:10pt;font-family:"Courier
New";color:black">Mike Hanby</span><span
style="color:black"></span></p>
<p class="MsoNormal"><span
style="font-size:10pt;font-family:"Courier
New";color:black">mhanby @ <a
href="http://uab.edu" target="_blank"
moz-do-not-send="true">uab.edu</a></span><span
style="color:black"></span></p>
<p class="MsoNormal"><span
style="font-size:10pt;font-family:"Courier
New";color:black">Systems Analyst III -
Enterprise</span><span style="color:black"></span></p>
<p class="MsoNormal"><span
style="font-size:10pt;font-family:"Courier
New";color:black">IT Research Computing Services</span><span
style="color:black"></span></p>
<p class="MsoNormal"><span
style="font-size:10pt;font-family:"Courier
New";color:black">The University of Alabama at
Birmingham</span></p>
</div>
</div>
</blockquote>
</div>
</blockquote>
<br>
</body>
</html>