<div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div class="gmail_default" style="font-family:monospace">sprio --long shows:</div><div class="gmail_default"><div class="gmail_default" style="font-family:monospace"><br></div><div class="gmail_default"><font face="monospace">JOBID PARTITION     USER   PRIORITY        AGE  FAIRSHARE    JOBSIZE  PARTITION      QOS       NICE   TRES</font><br></div><div class="gmail_default" style="font-family:monospace">...</div><div class="gmail_default" style="font-family:monospace"><br></div><div class="gmail_default" style="font-family:monospace">2203317 largenode    alice    1000010         10          0          0          0   1000000          0 2203318 largenode    alice    1000010         10          0          0          0   1000000          0</div><div class="gmail_default" style="font-family:monospace">2203319 largenode    alice    1000010         10          0          0          0   1000000          0</div><div class="gmail_default" style="font-family:monospace">2203320 largenode    alice    1000010         10          0          0          0   1000000          0</div><div class="gmail_default" style="font-family:monospace">2203321 largenode    alice    1000010         10          0          0          0   1000000          0</div><div class="gmail_default" style="font-family:monospace">2221670 largenode       me    3000000          0          0          0          0   1000000   -2000000</div><div class="gmail_default" style="font-family:monospace">root@beagle-ctld:~#</div><div class="gmail_default" style="font-family:monospace"><br></div><div class="gmail_default" style="font-family:monospace">`squeue --start` all show:</div><div class="gmail_default" style="font-family:monospace"><br></div><div class="gmail_default" style="font-family:monospace">2221670 largenode sleeper.       me PD                 N/A      1 (null)               (AssocGrpCpuLimit)<br></div><div class="gmail_default" style="font-family:monospace"><br></div><div class="gmail_default" style="font-family:monospace"><br></div><div class="gmail_default" style="font-family:monospace"><div class="gmail_default">JobId=2221670 JobName=sleeper.sh</div><div class="gmail_default">   UserId=me(12345) GroupId=g_me(12345) MCS_label=N/A</div><div class="gmail_default">   Priority=3000000 Nice=-2000000 Account=account QOS=normal</div><div class="gmail_default">   JobState=PENDING Reason=AssocGrpCpuLimit Dependency=(null)</div><div class="gmail_default">   Requeue=0 Restarts=0 BatchFlag=1 Reboot=0 ExitCode=0:0</div><div class="gmail_default">   RunTime=00:00:00 TimeLimit=3-00:00:00 TimeMin=N/A</div><div class="gmail_default">   SubmitTime=2019-02-28T06:11:17 EligibleTime=2019-02-28T06:11:17</div><div class="gmail_default">   AccrueTime=2019-02-28T06:11:17</div><div class="gmail_default">   StartTime=Unknown EndTime=Unknown Deadline=N/A</div><div class="gmail_default">   PreemptTime=None SuspendTime=None SecsPreSuspend=0</div><div class="gmail_default">   LastSchedEval=2019-02-28T06:32:27</div><div class="gmail_default">   Partition=largenode AllocNode:Sid=fitzroy:13714</div><div class="gmail_default">   ReqNodeList=(null) ExcNodeList=(null)</div><div class="gmail_default">   NodeList=(null)</div><div class="gmail_default">   NumNodes=1 NumCPUs=16 NumTasks=1 CPUs/Task=16 ReqB:S:C:T=0:0:*:*</div><div class="gmail_default">   TRES=cpu=16,node=1,billing=16</div><div class="gmail_default">   Socks/Node=* NtasksPerN:B:S:C=0:0:*:* CoreSpec=*</div><div class="gmail_default">   MinCPUsNode=16 MinMemoryNode=0 MinTmpDiskNode=0</div><div class="gmail_default">   Features=(null) DelayBoot=00:00:00</div><div class="gmail_default">   OverSubscribe=OK Contiguous=0 Licenses=(null) Network=(null)</div><div class="gmail_default">   Command=./sleeper.sh</div><div class="gmail_default">   WorkDir=/home/me/tutorial/run</div><div class="gmail_default">   StdErr=/home/me/tutorial/run/slurm-2221670.out</div><div class="gmail_default">   StdIn=/dev/null</div><div class="gmail_default">   StdOut=/home/me/tutorial/run/slurm-2221670.out</div><div class="gmail_default">   Power=</div><div class="gmail_default"><br></div><div class="gmail_default">I think you are correct about that, though I'm not sure how to debug those reservations.</div><div class="gmail_default"><br></div><div class="gmail_default">Thanks</div><div class="gmail_default"><br></div><div class="gmail_default">M</div></div></div></div><input name="virtru-metadata" type="hidden" value="{"email-policy":{"state":"closed","expirationUnit":"days","disableCopyPaste":false,"disablePrint":false,"disableForwarding":false,"enableNoauth":false,"expires":false,"isManaged":false},"attachments":{},"compose-id":"10","compose-window":{"secure":false}}"></div></div></div></div><br><div class="gmail_quote" style=""><div dir="ltr" class="gmail_attr">On Wed, Feb 27, 2019 at 10:22 PM Chris Samuel <<a href="mailto:chris@csamuel.org" target="_blank">chris@csamuel.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">On Wednesday, 27 February 2019 1:08:56 PM PST Michael Gutteridge wrote:<br>
<br>
> Yes, we do have time limits set on partitions- 7 days maximum, 3 days<br>
> default.  In this case, the larger job is requesting 3 days of walltime,<br>
> the smaller jobs are requesting 7.<br>
<br>
It sounds like no forward reservation is being created for the larger job, <br>
what do these say?<br>
<br>
sprio -l<br>
<br>
squeue --start<br>
<br>
scontrol show job ${LARGE_JOBID}<br>
<br>
All the best,<br>
Chris<br>
-- <br>
  Chris Samuel  :  <a href="http://www.csamuel.org/" rel="noreferrer" target="_blank">http://www.csamuel.org/</a>  :  Berkeley, CA, USA<br>
<br>
<br>
<br>
<br>
</blockquote></div>
</div>