<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<span style="font-family: Calibri, Helvetica, sans-serif;">Re-reading your question, I don't think reservations are applicable to your problem.</span><br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<span style="font-family: Calibri, Helvetica, sans-serif;">Reservations are used to isolate resources for an amount of time for a group of users -- not the job scheduling policies tied to the resources. You can allocate a number of dedicated resources for
a long duration, say 10 nodes for 60 days, but the partition/assoc/QOS/etc limits will still apply to these resources -- your 24hr runtime limit would still apply.
</span><br>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<div><br>
</div>
<div><span style="font-family: Calibri, Helvetica, sans-serif;">I think of reservations as a lightweight, virtual partition.</span><br>
</div>
<div><br>
</div>
<div><span style="font-family: Calibri, Helvetica, sans-serif;">Our max runtime is 14 days (via QOS). This is a major difference between our systems. We use reservations to allocate resources from our shared pool for very long durations, but we haven't needed
to adjust the max job runtime because it's been sufficient. This confused my answer. Sorry!</span></div>
<div><br>
</div>
<div><span style="font-family: Calibri, Helvetica, sans-serif;">Best,</span></div>
<div><br>
</div>
<div><span style="font-family: Calibri, Helvetica, sans-serif;">Sebastian</span><br>
</div>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div id="Signature">
<div>
<div></div>
<div></div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size: 12pt; color: rgb(0, 0, 0); font-family: Calibri, Arial, Helvetica, sans-serif;">
<div style="font-family:Tahoma; font-size:13px">
<div style="font-family:Tahoma; font-size:13px">
<div class="BodyFragment"><font size="2"><span style="font-size:10pt">
<div class="PlainText">
<div id="emailSignature" style="display:block">--</div>
<div id="emailSignature" style="display:block"><br>
<table style="box-sizing: border-box; border-collapse: collapse; border-spacing: 0px; background-color: rgb(255, 255, 255); max-width: 100%; text-align: start; font-family: Helvetica, Arial, san-serif; width: 480px;">
<tbody style="box-sizing:border-box">
<tr style="box-sizing:border-box">
<td style="box-sizing:border-box; vertical-align:top" width="75"><a href="http://www.unr.edu/" style="box-sizing: border-box; background: transparent none repeat scroll 0% 0%; color: rgb(46, 108, 162); text-decoration: underline;"><img alt="University of Nevada, Reno" style="box-sizing:border-box; vertical-align:middle" width="75" src="https://www.unr.edu/assets/images/blockn-100x100.png"></a></td>
<td style="box-sizing:border-box" width="20"> </td>
<td style="box-sizing:border-box; vertical-align:top" width="385">
<table style="box-sizing:border-box; border-collapse:collapse; max-width:100%; width:385px; text-align:left">
<tbody style="box-sizing:border-box">
<tr style="box-sizing:border-box">
<td style="box-sizing:border-box; vertical-align:top"><span style="box-sizing:border-box"><span style="box-sizing: border-box; color: rgb(0, 51, 102);"><strong style="box-sizing:border-box; font-weight:bold"><span style="box-sizing:border-box">Sebastian Smith<br style="box-sizing:border-box">
</span></strong></span><span style="box-sizing:border-box"><span style="box-sizing:border-box">High-Performance Computing Engineer<br style="box-sizing:border-box">
</span><span style="box-sizing:border-box">Office of Information Technology<br style="box-sizing:border-box">
</span><span style="box-sizing:border-box">1664 North Virginia Street<br style="box-sizing:border-box">
</span><span style="box-sizing:border-box">MS 0291<br style="box-sizing:border-box">
</span><span style="box-sizing:border-box"></span><span style="box-sizing:border-box"></span><br style="box-sizing:border-box">
<strong style="box-sizing:border-box; font-weight:bold">work-phone:<span> </span></strong><span style="box-sizing:border-box"><a href="tel:7756825050" style="box-sizing: border-box; background: transparent none repeat scroll 0% 0%; text-decoration: underline;">775-682-5050</a><br style="box-sizing:border-box">
</span><strong style="box-sizing:border-box; font-weight:bold"></strong><span style="box-sizing:border-box"></span><strong style="box-sizing:border-box; font-weight:bold">email:<span> </span></strong><span style="box-sizing:border-box"><a href="mailto:stsmith@unr.edu" style="box-sizing: border-box; background: transparent none repeat scroll 0% 0%; text-decoration: underline;">stsmith@unr.edu</a><br style="box-sizing:border-box">
</span><strong style="box-sizing:border-box; font-weight:bold">website:<span> </span></strong><span style="box-sizing:border-box"><a href="http://rc.unr.edu/" style="box-sizing: border-box; background: transparent none repeat scroll 0% 0%; text-decoration: underline;">http://rc.unr.edu</a><br style="box-sizing:border-box">
</span></span><br style="box-sizing:border-box">
</span></td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</span></font></div>
</div>
</div>
</div>
</div>
</div>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> slurm-users <slurm-users-bounces@lists.schedmd.com> on behalf of Matthew BETTINGER <matthew.bettinger@external.total.com><br>
<b>Sent:</b> Wednesday, July 8, 2020 10:53 AM<br>
<b>To:</b> Slurm User Community List <slurm-users@lists.schedmd.com><br>
<b>Subject:</b> Re: [slurm-users] Allow certain users to run over partition limit</font>
<div> </div>
</div>
<div class="BodyFragment"><font size="2"><span style="font-size:11pt;">
<div class="PlainText">Ok I see the resource hierarchy limits :<br>
<br>
Partition QOS limit<br>
Job QOS limit<br>
User association<br>
Account association(s), ascending the hierarchy<br>
Root/Cluster association<br>
Partition limit<br>
None<br>
<br>
Where in this list does the reservations fall under? Do reservations override all of these if they are set to exceed resources imposed by the partition configuration? Thanks!<br>
<br>
On 7/7/20, 6:02 PM, "slurm-users on behalf of Sebastian T Smith" <slurm-users-bounces@lists.schedmd.com on behalf of stsmith@unr.edu> wrote:<br>
<br>
Hi,<br>
<br>
We use Job QOS and Resource Reservations for this purpose. QOS is a good option for a "permanent" change to a user's resource limits. We use reservations similar to how you're currently using partitions to "temporarily" provide a resource boost without
the complexities of re-partitioning or mucking with associations.<br>
<br>
<br>
Precedence in resource limits: <a href="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fslurm.schedmd.com%2Fresource_limits&data=01%7C01%7Cstsmith%40unr.edu%7Cd78b383953814945112908d823680dff%7C523b4bfc0ebd4c03b2b96f6a17fd31d8%7C1&sdata=2zkNSAHfRPnral7FbGtC9Q68YyYzhSaaLMONOCFAv1E%3D&reserved=0">
https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fslurm.schedmd.com%2Fresource_limits&data=01%7C01%7Cstsmith%40unr.edu%7Cd78b383953814945112908d823680dff%7C523b4bfc0ebd4c03b2b96f6a17fd31d8%7C1&sdata=2zkNSAHfRPnral7FbGtC9Q68YyYzhSaaLMONOCFAv1E%3D&reserved=0</a>.<br>
<br>
________________________________________<br>
From: slurm-users <slurm-users-bounces@lists.schedmd.com> on behalf of Matthew BETTINGER <matthew.bettinger@external.total.com><br>
Sent: Tuesday, July 7, 2020 9:40 AM<br>
To: slurm-users@lists.schedmd.com <slurm-users@lists.schedmd.com><br>
Subject: [slurm-users] Allow certain users to run over partition limit <br>
<br>
Hello,<br>
<br>
We have a slurm system with partitions set for max runtime of 24hours. What would be the proper way to allow a certain set of users to run jobs on the current partitions beyond the partition limits? In the past we would isolate some nodes based on their
job requirements , make a new partition and a reservation with the users and have to push out the new configuration. This is pretty unwieldy but works but doing it this way the nodes are basically wasted unless they are not being used by these special users
and unavailable for others. <br>
<br>
Is there some way we can allow some users sometimes to run over partition run time more easily than manually modifying slurm.conf. Possibly with qos?<br>
<br>
Thanks.<br>
<br>
<br>
</div>
</span></font></div>
</body>
</html>