<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-GB" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">I’m trying to use QoS limits to dynamically change the number of CPUs a user is allowed to use on our cluster. As far as I can see I’m setting the appropriate GrpTRES=cpu value and I can read that back, but then jobs are being stopped
before the user has reached that limit.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In squeue I see loads of lines like:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">166599 normal nf-BISMARK_(288) auser PD 0:00 1 (QOSMaxCpuPerUserLimit)<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">..but if I run:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">squeue -t running -p normal --format="%.12u %.2t %C "<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Then the total for that user is 288 cores, but in the QoS configuration they should be allowed more. If I run:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">sacctmgr show user WithAssoc format=user%12,GrpTRES<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">..then I get:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"> auser cpu=512<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">What am I missing? Why is ‘auser’ not being allowed to use all 512 of their allowed CPUs before the QOS limit is kicking in?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks for any help you can offer.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Simon.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal" style="text-autospace:none"><o:p></o:p><o:p></o:p><span style="font-size:8.0pt;
font-family:"Arial","sans-serif";color:#1F497D">The Babraham Institute, Babraham Research Campus, Cambridge CB22 3AT
</span><i><span style="font-size:
8.0pt;font-family:"Arial","sans-serif";color:#365F91;mso-themecolor:accent1;
mso-themeshade:191">Registered Charity No. 1053902.</span></i><span style="font-size:8.0pt;font-family:"Arial","sans-serif";color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:8.0pt;
font-family:"Arial","sans-serif";color:#1F497D">The information transmitted in this email is directed only to the addressee. If you received this in error, please contact the sender
and delete this email from your system. The contents of this e-mail are the views of the sender and do not necessarily represent the views of the Babraham Institute.
</span><span style="font-size:8.0pt;
font-family:"Arial","sans-serif";color:#365F91;mso-themecolor:accent1;
mso-themeshade:191">Full conditions at:
</span><a href="http://www.babraham.ac.uk/terms"><span style="font-size:8.0pt;font-family:"Arial","sans-serif";
color:#365F91;mso-themecolor:accent1;mso-themeshade:191">www.babraham.ac.uk</span></a><span style="font-size:8.0pt;font-family:"Arial","sans-serif";color:#365F91;
mso-themecolor:accent1;mso-themeshade:191"><o:p></o:p></span></p>
</body>
</html>