<html><body><div style="font-family: trebuchet ms,sans-serif; font-size: 11pt; color: #000000"><div>Hi Miguel,<br><br>As far as I understood <!--StartFragment--><span class="" style="background-color: #ffff00;" data-mce-style="background-color: #ffff00;">GrpTRESMins=cpu=N(4227) <!--StartFragment--></span><!--EndFragment--> seems not to be the limit of the QOS unlike its name but the RawUsage of the QOS in mn instead of second as accounted in RawUsage.<br>When I set QOS RawUsage to 0 GrpTRESMins=cpu is also set to 0. <br>Each time a job as completed using this QOS <!--StartFragment-->RawUsage <!--EndFragment--> and <!--StartFragment-->GrpTRESMins=cpu<!--EndFragment--> are increased by the usage of this job (in mn or s).<br data-mce-bogus="1"></div><div><br data-mce-bogus="1"></div><div>So I need to first try setting the limit on one QOS as you told me, then set the same limit on all QOS and see how it handles all those limits with one account.<br><br data-mce-bogus="1"></div><div>I think this should be the last test to understand the complete behavior of GrpTRESMins.<br><br>I'll inform you on the result, but in a while because of holidays.<br><br></div><div>Thanks a lot for all your help.<br><br><br><br></div><div data-marker="__SIG_PRE__"><div>Best,</div><div><span style="color: #3333ff;"><span style="color: #000000;">Gérard</span><br></span><br><br></div></div><div><br></div><hr id="zwchr" data-marker="__DIVIDER__"><div data-marker="__HEADERS__"><blockquote style="border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;"><b>De: </b>"Miguel Oliveira" <miguel.oliveira@uc.pt><br><b>À: </b>"Gérard Gil" <gerard.gil@cines.fr><br><b>Cc: </b>"Slurm-users" <slurm-users@lists.schedmd.com><br><b>Envoyé: </b>Jeudi 30 Juin 2022 21:33:46<br><b>Objet: </b>Re: [slurm-users] GrpTRESMins and GrpTRESRaw usage<br></blockquote></div><div data-marker="__QUOTED_TEXT__"><blockquote style="border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt;">Hi Gérard,<div class=""><br class=""></div><div class="">Let see if I understood this right. You have a user on the account dci and you have put GrpTRESMins limit on this (cpu=4100).</div><div class="">From the output it looks like that is associated to the QoS toto.</div><div class="">However the limit put on the association and not on the QoS:</div><div class=""><br class=""></div><div class=""><blockquote class=""><div class=""><div id="zimbraEditorContainer" class="2" style="font-family: "trebuchet ms", sans-serif; font-size: 11pt;"><div class=""><span class="" style="background-color: rgb(255, 255, 0);">GrpTRESMins=cpu=N(4227)</span></div></div></div></blockquote><br class=""></div><div class="">You need to remove the limit from the association and put it on the QoS.</div><div class=""><br class=""></div><div class="">Hope that helps,</div><div class=""><br class=""></div><div class="">MAO</div><div class=""><br class=""></div><div class=""><div><br class=""><blockquote class=""><div class="">On 30 Jun 2022, at 19:12, <a href="mailto:gerard.gil@cines.fr" class="" target="_blank">gerard.gil@cines.fr</a> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class=""><div id="zimbraEditorContainer" style="font-family: "trebuchet ms", sans-serif; font-size: 11pt;" class="2"><div class="">Hi Miguel,<br class=""><br class="">I finally found the time to test the QOS NoDecay configuration vs GrpTRESMins account limit.<br class=""><br class="">Here is my benchmark :<br class=""></div><div class=""><br class=""></div><div class=""><hr class=""><br class="">1) <span style="text-decoration: underline;" class="">Initialize the benchmark configuration</span><br class=""> - reset all RawUsage (on QOS and account)<br class=""> - set a limit on Account GrpTRESMins<br class=""> - run several jobs with a controlled ellaps cpu time on a QOS.</div><div class=""> - reset account RawUsage <br class=""></div><div class=""> - set a limit on Account GrpTRESMins under the QOS RawUsage </div><div class=""><br class=""></div><div class="">Here is the inital state before running the benchmark</div><div class=""><br class=""></div><div class=""><strong class="">toto@login1:</strong>~/TEST$ sshare -A dci -u " " -o account,user,GrpTRESRaw%80,GrpTRESMins,rawusage<br class=""> Account User GrpTRESRaw GrpTRESMins RawUsage <br class="">-------------------- ---------- ----------------------------------------------------- ------------------------------ ----------- <br class="">dci <span style="background-color: rgb(255, 255, 0);" class=""><strong class=""> cpu=0</strong></span>,mem=0,energy=0,node=0,billing=0,fs/disk=0,vmem=0,pages=0 <span style="background-color: rgb(255, 255, 0);" class=""><strong class="">cpu=4100</strong></span> 0 </div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">Account <span style="background-color: rgb(255, 255, 0);" class=""><strong class=""> RawUsage = 0</strong> </span><br class=""></div><div class=""> GrpTRESMins <span style="background-color: rgb(255, 255, 0);" class=""><strong class="">cpu=4100</strong></span> </div><div class=""><span style="background-color: rgb(255, 255, 0);" class=""><strong class=""><br class=""></strong></span></div><div class=""><br class=""></div><div class=""><br class=""><strong class="">toto@login1</strong>:~/TEST$ scontrol -o show assoc_mgr | grep "^QOS" | grep support<br class="">QOS=support(8) <span style="background-color: rgb(255, 255, 0);" class="">UsageRaw=253632</span>.000000 GrpJobs=N(0) GrpJobsAccrue=N(0) GrpSubmitJobs=N(0) GrpWall=N(132.10) GrpTRES=cpu=N(0),mem=N(0),energy=N(0),node=2106(0),billing=N(0),fs/disk=N(0),vmem=N(0),pages=N(0) <span style="background-color: rgb(255, 255, 0);" class="">GrpTRESMins=cpu=N(4227)</span>,mem=N(7926000),energy=N(0),node=N(132),billing=N(4227),fs/disk=N(0),vmem=N(0),pages=N(0) GrpTRESRunMins=cpu=N(0),mem=N(0),energy=N(0),node=N(0),billing=N(0),fs/disk=N(0),vmem=N(0),pages=N(0) MaxWallPJ=1440 MaxTRESPJ=node=700 MaxTRESPN= MaxTRESMinsPJ= MinPrioThresh= MinTRESPJ= PreemptMode=OFF Priority=10 Account Limits= dci={MaxJobsPA=N(0) MaxJobsAccruePA=N(0) MaxSubmitJobsPA=N(0) MaxTRESPA=cpu=N(0),mem=N(0),energy=N(0),node=N(0),billing=N(0),fs/disk=N(0),vmem=N(0),pages=N(0)} User Limits= 1145={MaxJobsPU=N(0) MaxJobsAccruePU=N(0) MaxSubmitJobsPU=N(0) MaxTRESPU=cpu=N(0),mem=N(0),energy=N(0),node=2106(0),billing=N(0),fs/disk=N(0),vmem=N(0),pages=N(0)}</div><div class=""><br class=""></div><div class=""> <div class="">QOS support RawUsage <strong class="">= 253632 s </strong>or <strong class=""><span style="background-color: rgb(255, 255, 0);" class="">4227</span> mn</strong></div><div class=""><br class=""></div><div class=""><strong class=""><br class=""><span style="background-color: rgb(255, 255, 0);" class="">QOS support RawUsage > GrpTRESMins </span></strong><span style="background-color: rgb(255, 255, 0);" class=""> SLURM should prevent to start a job for this account if it works as expected.</span><strong class=""><br class=""></strong></div> </div><div class=""><br class=""></div><div class=""><br class=""><br class="">2) <span style="text-decoration: underline;" class="">Run the benchmark to control limit GrpTRESMins efficiency over QOS rawusage</span> <br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><div class="">toto@login1:~/TEST$ sbatch TRESMIN.slurm <br class="">Submitted batch job 3687</div><div class=""><br class=""></div><div class=""><br class="">toto@login1:~/TEST$ squeue<br class=""> JOBIDADMIN_COMMMIN_MEMOR SUBMIT_TIME PRIORITY PARTITION QOS USER STATE TIME_LIMIT TIME NODES REASON START_TIME<br class=""> 3687 BDW28 60000M 2022-06-30T19:36:42 1100000 bdw28 support toto <strong class=""><span style="background-color: rgb(255, 255, 0);" class="">RUNNING </span> </strong>5:00 0:02 1 None 2022-06-30T19:36:42 </div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">The job is running unless GrpTRESMins is under <strong class=""><span style="background-color: rgb(255, 255, 0);" class="">QOS support RawUsage</span></strong> .<br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">Is there anything wrong with my control process that invalidates the result ?<br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">Thanks<br class=""></div><div class=""><br class=""></div><div class=""><span style="color: #3333ff;" class=""><span style="" class="">Gérard </span><br class=""><br class=""></span><a href="http://www.cines.fr/" target="_blank" class=""></a><br class=""></div></div><div class=""><br class=""></div><hr id="zwchr" class=""><div class=""><blockquote style="border-left-width: 2px; border-left-style: solid; border-left-color: rgb(16, 16, 255); margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;" class=""><b class="">De: </b>"gerard gil" <<a href="mailto:gerard.gil@cines.fr" class="" target="_blank">gerard.gil@cines.fr</a>><br class=""><b class="">À: </b>"Slurm-users" <<a href="mailto:slurm-users@lists.schedmd.com" class="" target="_blank">slurm-users@lists.schedmd.com</a>><br class=""><b class="">Envoyé: </b>Mercredi 29 Juin 2022 19:13:56<br class=""><b class="">Objet: </b>Re: [slurm-users] GrpTRESMins and GrpTRESRaw usage<br class=""></blockquote></div><div class=""><blockquote style="border-left-width: 2px; border-left-style: solid; border-left-color: rgb(16, 16, 255); margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;" class=""><div style="font-family: "trebuchet ms", sans-serif; font-size: 11pt;" class=""><div class="">Hi Miguel,<br class=""></div><br class=""><div class=""> <div class="">>If I understood you correctly your goal was to limit the number of minutes each project can run. By associating each project to a slurm account with a nodecay QoS then you will have achieved your goal.</div><div class=""><br class=""></div><div class="">Here is what I what to do :<br class=""></div><div class=""><br class=""></div><div class="">"All jobs submitted to an account regardless the QOS they use have to be constrained to a number of minutes set by the limit associated with that account (and not to QOS)." <br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">>Try a project with a very small limit and you will see that it won’t run</div><div class=""><br class=""></div><div class="">I already tested GrpTRESmins limit and confirms it works as expected.<br class=""></div><div class="">Then I saw the decay effect on GrpTRESRaw (what I thought first as the right metric to look at) and try to find out a way to fix it.<br class=""><br class=""></div><div class=""> It's really very import for me to trust it, so I need a deterministic test to prove it. </div><div class=""><br class=""></div><div class="">I'm testing this GrpTRESMins limit with NoDecay set on QOS resetting all RawUsage (Account and QOS) to be sure it works as I expect. <br class=""></div><div class="">I print the account GrpTRESRaw (in mn) at the end of my tests job to set a new limits with GrpTRESMins and see how it behaves.<br class=""></div><div class=""><br class=""></div><div class=""> I'll get inform on the results. I hope it works. <br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div> </div><div class=""><div class=""><span style="color: #3333ff;" class=""><span style="" class=""> > You don’t have to add anything. </span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class="">>Each QoS will accumulate its respective usage, i.e, the usage of all users on that account. Users can even be on different accounts (projects) and charge the respective project with the parameter --account on </span></span><span style="color: #3333ff;" class=""><span style="" class="">sbatch. </span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class=""></span></span><br class=""></div><div class="">If SLURM does it for to manage limit I would also like to obtain the current RawUsage for an account. </div><div class=""><strong class="">Do you know how to get it ?</strong><span style="color: #3333ff;" class=""><span style="" class=""><br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class=""></span></span><br class=""></div><div class=""><span style="color: #3333ff;" class=""><span style="" class=""><br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class=""><br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="color: #3333ff;" class=""><span style="" class=""> </span></span></span><div class="">>The GrpTRESMins is always changed on the QoS with a command like:</div><div class="">><br class=""></div><div class="">>sacctmgr update qos where qos=... set GrpTRESMin=cpu=….</div><span style="color: #3333ff;" class=""><span style="" class=""> </span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class=""><br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class="">That's right if you want to set a limit to a QOS. </span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class="">But I dont know/think the same limit value will also apply to all other QOS, and if I apply the same limit to all QOS.</span></span></div><div class=""><strong class=""><span style="color: #3333ff;" class=""><span style="" class="">Is my account limit the sum of all the QOS limit ?<br class=""></span></span></strong></div><div class=""><span style="color: #3333ff;" class=""><span style="" class=""><br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class=""><br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class="">Actualy I'm setting the limit to the Account using command:<br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class=""><br class=""></span></span></div><div class=""> <code class="">sacctmgr modify account myaccount set grptresmins=cpu=60000 qos=...</code> </div><div class=""><span style="color: #3333ff;" class=""><span style="" class=""><br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class="">With this setting I saw the limit is set to the account and not to the QOS. <br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class=""><em class=""><strong class="">sacctmgr show QOS</strong></em> command shows an empty field for GrpTRESMins on all QOS<br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class=""><br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class=""><br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class="">Thanks again form your help.<br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class="">I hope I'm close to get the answer to my issue.<br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class=""><br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class="">Best,<br class=""></span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class="">Gérard </span><br class=""></span><a href="http://www.cines.fr/" target="_blank" rel="noopener" class=""></a><br class=""></div></div><br class=""><hr id="zwchr" class=""><div class=""><blockquote style="border-left-width: 2px; border-left-style: solid; border-left-color: rgb(16, 16, 255); margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;" class=""><b class="">De: </b>"Miguel Oliveira" <<a href="mailto:miguel.oliveira@uc.pt" class="" target="_blank">miguel.oliveira@uc.pt</a>><br class=""><b class="">À: </b>"Slurm-users" <<a href="mailto:slurm-users@lists.schedmd.com" class="" target="_blank">slurm-users@lists.schedmd.com</a>><br class=""><b class="">Envoyé: </b>Mercredi 29 Juin 2022 01:28:58<br class=""><b class="">Objet: </b>Re: [slurm-users] GrpTRESMins and GrpTRESRaw usage<br class=""></blockquote></div><div class=""><blockquote style="border-left-width: 2px; border-left-style: solid; border-left-color: rgb(16, 16, 255); margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;" class="">Hi Gérard,<div class=""><br class=""></div><div class="">If I understood you correctly your goal was to limit the number of minutes each project can run. By associating each project to a slurm account with a nodecay QoS then you will have achieved your goal.</div><div class="">Try a project with a very small limit and you will see that it won’t run.</div><div class=""><br class=""></div><div class="">You don’t have to add anything. Each QoS will accumulate its respective usage, i.e, the usage of all users on that account. Users can even be on different accounts (projects) and charge the respective project with the parameter --account on sbatch.</div><div class="">The GrpTRESMins is always changed on the QoS with a command like:</div><div class=""><br class=""></div><div class="">sacctmgr update qos where qos=... set GrpTRESMin=cpu=….</div><div class=""><br class=""></div><div class="">Hope that makes sense!</div><div class=""><br class=""></div><div class="">Best,</div><div class=""><br class=""></div><div class="">MAO</div><div class=""><div class=""><br class=""><blockquote class=""><div class="">On 28 Jun 2022, at 18:30, <a href="mailto:gerard.gil@cines.fr" class="" target="_blank">gerard.gil@cines.fr</a> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class=""><div style="font-family: "trebuchet ms", sans-serif; font-size: 11pt;" class=""><div class="">Hi Miguel,<br class=""><br class="">OK, I did'nt know this command.<br class=""><br class="">I'm not sure to understand how it works regarding to my goal.<br class=""></div><div class="">I use the following command inspired by the command you gave me and I obtain a UsageRaw for each QOS. <br class=""></div><div class=""><br class=""></div><div class=""><span style="caret-color: rgb(0, 0, 0);" class="">scontrol -o show assoc_mgr</span> -accounts=myaccount Users=" "<br class=""></div><div class=""><div class=""><br class=""></div><div class=""><br class=""></div><div class="">Do I have to sumup all QOS RawUsage to obtain the RawUsage of myaccount with NoDecay ?</div><div class="">If I set GrpTRESMins for an Account and not for a QOS, does SLURM handle to sumpup these QOS RawUsage to control if the GrpTRESMins account limit is reach ?<br class=""></div><div class=""><br class=""></div><div class="">Thanks again for your precious help.<br class=""></div><div class=""><br class=""></div><div class=""><span style="color: #3333ff;" class=""><span style="" class="">Gérard </span><br class=""></span><a href="http://www.cines.fr/" target="_blank" class=""></a><br class=""></div></div><div class=""><br class=""></div><hr id="zwchr" class=""><div class=""><blockquote style="border-left-width: 2px; border-left-style: solid; border-left-color: rgb(16, 16, 255); margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;" class=""><b class="">De: </b>"Miguel Oliveira" <<a href="mailto:miguel.oliveira@uc.pt" class="" target="_blank">miguel.oliveira@uc.pt</a>><br class=""><b class="">À: </b>"Slurm-users" <<a href="mailto:slurm-users@lists.schedmd.com" class="" target="_blank">slurm-users@lists.schedmd.com</a>><br class=""><b class="">Envoyé: </b>Mardi 28 Juin 2022 17:23:18<br class=""><b class="">Objet: </b>Re: [slurm-users] GrpTRESMins and GrpTRESRaw usage<br class=""></blockquote></div><div class=""><blockquote style="border-left-width: 2px; border-left-style: solid; border-left-color: rgb(16, 16, 255); margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;" class="">Hi Gérard,<div class=""><br class=""></div><div class="">The way you are checking is against the association and as such it ought to be decreasing in order to be used by fair share appropriately.</div><div class="">The counter used that does not decrease is on the QoS, not the association. You can check that with:</div><div class=""><br class=""></div><div class=""><span style="caret-color: rgb(0, 0, 0);" class="">scontrol -o show assoc_mgr | grep "^QOS='+account+’</span><font class=""><span style="caret-color: rgb(0, 0, 0);" class="">”</span></font></div><div class=""><font class=""><span style="caret-color: rgb(0, 0, 0);" class=""><br class=""></span></font></div><div class=""><font class="">That ought to give you two numbers. The first is the limit, or N for not limit, and the second in parenthesis the usage.</font></div><div class=""><font class=""><br class=""></font></div><div class=""><font class="">Hope that helps.</font></div><div class=""><font class=""><br class=""></font></div><div class=""><font class="">Best,</font></div><div class=""><font class=""><br class=""></font></div><div class=""><font class="">Miguel Afonso Oliveira<br class=""></font><div class=""><br class=""><blockquote class=""><div class="">On 28 Jun 2022, at 08:58, <a href="mailto:gerard.gil@cines.fr" class="" target="_blank">gerard.gil@cines.fr</a> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class=""><div style="font-family: "trebuchet ms", sans-serif; font-size: 11pt;" class=""><div class="">Hi Miguel,<br class=""><br class=""><br class="">I modified my test configuration to evaluate the effect of NoDecay.<br class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""><br class="">I modified all QOS adding <strong class="">NoDecay</strong> Flag.<br class=""><br class=""><br class="">toto@login1:~/TEST$ sacctmgr show QOS<br class=""> Name Priority GraceTime Preempt PreemptExemptTime PreemptMode Flags UsageThres UsageFactor GrpTRES GrpTRESMins GrpTRESRunMin GrpJobs GrpSubmit GrpWall MaxTRES MaxTRESPerNode MaxTRESMins MaxWall MaxTRESPU MaxJobsPU MaxSubmitPU MaxTRESPA MaxJobsPA MaxSubmitPA MinTRES <br class="">---------- ---------- ---------- ---------- ------------------- ----------- ---------------------------------------- ---------- ----------- ------------- ------------- ------------- ------- --------- ----------- ------------- -------------- ------------- ----------- ------------- --------- ----------- ------------- --------- ----------- ------------- <br class=""> normal 0 00:00:00 cluster NoDecay 1.000000 <br class="">interactif 10 00:00:00 cluster NoDecay 1.000000 node=50 node=22 1-00:00:00 node=50 <br class=""> petit 4 00:00:00 cluster NoDecay 1.000000 node=1500 node=22 1-00:00:00 node=300 <br class=""> gros 6 00:00:00 cluster NoDecay 1.000000 node=2106 node=700 1-00:00:00 node=700 <br class=""> court 8 00:00:00 cluster NoDecay 1.000000 node=1100 node=100 02:00:00 node=300 <br class=""> long 4 00:00:00 cluster NoDecay 1.000000 node=500 node=200 5-00:00:00 node=200 <br class=""> special 10 00:00:00 cluster NoDecay 1.000000 node=2106 node=2106 5-00:00:00 node=2106 <br class=""> support 10 00:00:00 cluster NoDecay 1.000000 node=2106 node=700 1-00:00:00 node=2106 <br class=""> visu 10 00:00:00 cluster NoDecay 1.000000 node=4 node=700 06:00:00 node=4 <br class=""><br class=""><br class=""><br class="">I submitted a bunch of jobs to control the NoDecay efficiency and I noticed <strong class="">RawUsage</strong> as well as <strong class="">GrpTRESRaw</strong> <strong class="">cpu</strong> is still decreasing.<br class=""><br class=""><br class="">toto@login1:~/TEST$ sshare -A dci -u " " -o account,user,GrpTRESRaw%80,<strong class="">GrpTRESMins</strong>,RawUsage<br class=""> Account User <strong class="">GrpTRESRaw GrpTRESMins RawUsage</strong><br class="">-------------------- ---------- ----------------------------------------------------- ------------------------------ -----------<br class="">dci <strong class="">cpu=6932</strong>,mem=12998963,energy=0,node=216,billing=6932,fs/disk=0,vmem=0,pages=0 cpu=17150 <strong class="">415966</strong><br class="">toto@login1:~/TEST$ sshare -A dci -u " " -o account,user,GrpTRESRaw%80,<strong class="">GrpTRESMins</strong>,<strong class="">RawUsage</strong><br class=""> Account User <strong class="">GrpTRESRaw GrpTRESMins RawUsage</strong><br class="">-------------------- ---------- ----------------------------------------------------- ------------------------------ -----------<br class="">dci <strong class="">cpu=6931</strong>,mem=12995835,energy=0,node=216,billing=6931,fs/disk=0,vmem=0,pages=0 cpu=17150 <strong class="">415866</strong><br class="">toto@login1:~/TEST$ sshare -A dci -u " " -o account,user,GrpTRESRaw%80,GrpTRESMins,RawUsage<br class=""> Account User <strong class="">GrpTRESRaw GrpTRESMins RawUsage</strong> <br class="">-------------------- ---------- ----------------------------------------------------- ------------------------------ ----------- <br class="">dci <strong class="">cpu=6929</strong>,mem=12992708,energy=0,node=216,billing=6929,fs/disk=0,vmem=0,pages=0 cpu=17150 <strong class="">415766</strong> <br class=""><br class=""><br class="">Something I forgot to do ?<br class=""><br class=""><br class="">Best,<br class="">Gérard<br class=""><br class=""></div><div class=""><div class=""><span style="color: #3333ff;" class=""><span style="" class="">Cordialement,</span></span></div><div class=""><span style="color: #3333ff;" class=""><span style="" class="">Gérard Gil</span><br class=""><br class="">Département Calcul Intensif</span><br class="">Centre Informatique National de l'Enseignement Superieur<br class="">950, rue de Saint Priest<br class="">34097 Montpellier CEDEX 5<br class="">FRANCE<br class=""><br class="">tel : (334) 67 14 14 14<br class="">fax : (334) 67 52 37 63<br class="">web : <a href="http://www.cines.fr/" target="_blank" class="">http://www.cines.fr</a><br class=""></div></div><div class=""><br class=""></div><hr id="zwchr" class=""><div class=""><blockquote style="border-left-width: 2px; border-left-style: solid; border-left-color: rgb(16, 16, 255); margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;" class=""><b class="">De: </b>"Gérard Gil" <<a href="mailto:gerard.gil@cines.fr" class="" target="_blank">gerard.gil@cines.fr</a>><br class=""><b class="">À: </b>"Slurm-users" <<a href="mailto:slurm-users@lists.schedmd.com" class="" target="_blank">slurm-users@lists.schedmd.com</a>><br class=""><b class="">Cc: </b>"slurm-users" <<a href="mailto:slurm-users@schedmd.com" class="" target="_blank">slurm-users@schedmd.com</a>><br class=""><b class="">Envoyé: </b>Vendredi 24 Juin 2022 14:52:12<br class=""><b class="">Objet: </b>Re: [slurm-users] GrpTRESMins and GrpTRESRaw usage<br class=""></blockquote></div><div class=""><blockquote style="border-left-width: 2px; border-left-style: solid; border-left-color: rgb(16, 16, 255); margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;" class=""> Hi Miguel,<br class=""> <br class=""> Good !!<br class=""> <br class=""> I'll try this options on all existing QOS and see if everything works as<br class=""> expected.<br class=""> I'll inform you on the results.<br class=""> <br class=""> <br class=""> Thanks a lot<br class=""> <br class=""> Best,<br class=""> Gérard<br class=""> <br class=""> <br class=""> ----- Mail original -----<br class=""><blockquote style="border-left-width: 2px; border-left-style: solid; border-left-color: rgb(16, 16, 255); margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;" class=""> De: "Miguel Oliveira" <<a href="mailto:miguel.oliveira@uc.pt" class="" target="_blank">miguel.oliveira@uc.pt</a>><br class=""> À: "Slurm-users" <<a href="mailto:slurm-users@lists.schedmd.com" class="" target="_blank">slurm-users@lists.schedmd.com</a>><br class=""> Cc: "slurm-users" <<a href="mailto:slurm-users@schedmd.com" class="" target="_blank">slurm-users@schedmd.com</a>><br class=""> Envoyé: Vendredi 24 Juin 2022 14:07:16<br class=""> Objet: Re: [slurm-users] GrpTRESMins and GrpTRESRaw usage</blockquote><br class=""> <br class=""><blockquote style="border-left-width: 2px; border-left-style: solid; border-left-color: rgb(16, 16, 255); margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;" class=""> Hi Gérard,<br class=""> <br class=""> I believe so. All our accounts correspond to one project and all have an<br class=""> associated QoS with NoDecay and DenyOnLimit. This is enough to restrict usage<br class=""> on each individual project.<br class=""> You only need these flags on the QoS. The association will carry on as usual and<br class=""> fairshare will not be impacted.<br class=""> <br class=""> Hope that helps,<br class=""> <br class=""> Miguel Oliveira<br class=""> <br class=""><blockquote style="border-left-width: 2px; border-left-style: solid; border-left-color: rgb(16, 16, 255); margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;" class=""> On 24 Jun 2022, at 12:56, <a href="mailto:gerard.gil@cines.fr" class="" target="_blank">gerard.gil@cines.fr</a> wrote:<br class=""> <br class=""> Hi Miguel,<br class=""> <br class=""><blockquote style="border-left-width: 2px; border-left-style: solid; border-left-color: rgb(16, 16, 255); margin-left: 5px; padding-left: 5px; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica, Arial, sans-serif; font-size: 12pt;" class=""> Why not? You can have multiple QoSs and you have other techniques to change<br class=""> priorities according to your policies.</blockquote><br class=""> <br class=""> Is this answer my question ?<br class=""> <br class=""> "If all configured QOS use NoDecay, we can take advantage of the FairShare<br class=""> priority with Decay and all jobs GrpTRESRaw with NoDecay ?"<br class=""> <br class=""> Thanks<br class=""> <br class=""> Best,</blockquote></blockquote><br class=""> > > Gérard<br class=""><br class=""></blockquote></div></div></div></div></blockquote></div><br class=""></div><br class=""></blockquote></div></div></div></div></blockquote></div><br class=""></div></blockquote></div></div><br class=""></blockquote></div></div></div></div></blockquote></div><br class=""></div><br></blockquote></div></div></body></html>