<html>
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
</head>
<body>
<p>My rule of thumb is that the MaxJobs for the entire cluster is
twice the number of cores you have available. That way you have
enough jobs running to fill all the cores and enough jobs pending
to refill them.</p>
<p><br>
</p>
<p>As for per user MaxJobs, it just depends on what you think the
maximum number any user can run with out causing damage to
themselves, the underlying filesystems, and interfering with other
users. Practical experience has lead to us setting that limit to
be 10,000 on our cluster, but I imagine it will vary from location
to location.</p>
<p><br>
</p>
<p>-Paul Edmon-</p>
<p><br>
</p>
<div class="moz-cite-prefix">On 8/6/2020 10:31 PM, Hoyle, Alan P
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:MN2PR03MB48139E3D1F66471E6427A5B2F0490@MN2PR03MB4813.namprd03.prod.outlook.com">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255,
255, 255);">
<span style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt;">I can't find any advice online about how to
tune things like MaxJobs on a per-cluster or per-user basis. </span><br>
</div>
<div>
<div dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica,
sans-serif; font-size: 12pt; color: rgb(0, 0, 0);
background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica,
sans-serif; font-size: 12pt; color: rgb(0, 0, 0);
background-color: rgb(255, 255, 255);">
As far as I can tell, it seems that the default install
cluster MaxJobs seems to be 10,000 and MaxSubmit as the
same. Those seem pretty low to me: are there resources
that get consumed if maxSubmit is much higher or can we
raise this without much worry? </div>
<div style="font-family: Calibri, Arial, Helvetica,
sans-serif; font-size: 12pt; color: rgb(0, 0, 0);
background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica,
sans-serif; font-size: 12pt; color: rgb(0, 0, 0);
background-color: rgb(255, 255, 255);">
Is there advice anywhere about tuning these? When I google,
all I can find are the generic "here's how to change this"
and various universities' documentation of "here are the
limits we have set." <br>
</div>
<div style="font-family: Calibri, Arial, Helvetica,
sans-serif; font-size: 12pt; color: rgb(0, 0, 0);
background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica,
sans-serif; font-size: 12pt; color: rgb(0, 0, 0);
background-color: rgb(255, 255, 255);">
-alan</div>
<div>
<div style="font-family: Calibri, Arial, Helvetica,
sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id="x_Signature">
<div>
<div id="x_divtagdefaultwrapper" dir="ltr"
style="font-size: 12pt; font-family: Calibri,
Helvetica, sans-serif; color: rgb(0, 0, 0);">
<p style="margin-top: 0px; margin-bottom:
0px;margin-top:0px; margin-bottom:0px; margin-top:0;
margin-bottom:0">
</p>
<div>--</div>
<div>Alan Hoyle - <a class="moz-txt-link-abbreviated" href="mailto:alanh@unc.edu">alanh@unc.edu</a></div>
<div>Bioinformatics Scientist</div>
<div>UNC Lineberger - Bioinformatics Core</div>
<div><a class="moz-txt-link-freetext" href="https://lbc.unc.edu/">https://lbc.unc.edu/</a></div>
<br>
<p style="margin-top: 0px; margin-bottom:
0px;margin-top:0px; margin-bottom:0px">
</p>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</body>
</html>