<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Hi Michael,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Yes, without the singleton it works as expected:</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<span>$ sbatch --hold fakejob.sh<br>
</span>
<div>Submitted batch job 26636869<br>
</div>
<div>$ sbatch --hold fakejob.sh<br>
</div>
<div>Submitted batch job 26636870<br>
</div>
<div>$ sbatch --hold fakejob.sh<br>
</div>
<div>Submitted batch job 26636871<br>
</div>
<div>$ scontrol update jobid=26636870 Dependency=after:26636871<br>
</div>
<div>$ scontrol update jobid=26636871 Dependency=after:26636869<br>
</div>
<div>$ scontrol release 26636869 26636870 26636871<br>
</div>
<span></span><span>$ squeue -u jarno<br>
</span>
<div> JOBID USER ACCOUNT NAME ST TIME_LEFT NODES CPUS GRES MIN_MEM NODELIST (REASON)
<br>
</div>
<div> 26636869 jarno def-jarno_cp fakejob R 1:35 1 1 (null) 250M cdr650 (None)
<br>
</div>
<div> 26636871 jarno def-jarno_cp fakejob R 1:39 1 1 (null) 250M cdr652 (None)
<br>
</div>
<div> 26636870 jarno def-jarno_cp fakejob R 1:42 1 1 (null) 250M cdr667 (None)
<br>
</div>
<span></span></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Thanks,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Jarno<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id="Signature">
<div></div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Helvetica,sans-serif">
<p style="margin-top:0px; margin-bottom:0px; margin-top:0; margin-bottom:0"><span id="ms-rterangepaste-start"></span></p>
<div>Jarno van der Kolk, PhD Phys.<br>
Analyste principal en informatique scientifique | Senior Scientific Computing Specialist<br>
Solutions TI | IT Solutions<br>
Université d<span style="color:#000000">’</span>Ottawa | University of Ottawa</div>
<span id="ms-rterangepaste-end"></span><br>
<p style="margin-top:0px; margin-bottom:0px"></p>
</div>
<div>
<div id="appendonsend"></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> slurm-users <slurm-users-bounces@lists.schedmd.com> on behalf of Michael Di Domenico <mdidomenico4@gmail.com><br>
<b>Sent:</b> August 28, 2019 10:26 AM<br>
<b>To:</b> Slurm User Community List <slurm-users@lists.schedmd.com><br>
<b>Subject:</b> Re: [slurm-users] Dependencies with singleton and after</font>
<div> </div>
</div>
<div class="BodyFragment"><font size="2"><span style="font-size:11pt">
<div class="PlainText">Attention : courriel externe | external email<br>
<br>
just curious. if you leave out the singleton, do you get the behavior<br>
as expected?<br>
<br>
On Tue, Aug 27, 2019 at 9:42 AM Jarno van der Kolk <jvanderk@uottawa.ca> wrote:<br>
><br>
> Hi all,<br>
><br>
> I'm still puzzled by the expected behaviour of the following:<br>
> $ sbatch --hold fakejob.sh<br>
> Submitted batch job 25909273<br>
> $ sbatch --hold fakejob.sh<br>
> Submitted batch job 25909274<br>
> $ sbatch --hold fakejob.sh<br>
> Submitted batch job 25909275<br>
> $ scontrol update jobid=25909273 Dependency=singleton<br>
> $ scontrol update jobid=25909274 Dependency=singleton,after:25909275<br>
> $ scontrol update jobid=25909275 Dependency=singleton,after:25909273<br>
> $ scontrol release 25909273 25909274 25909275<br>
><br>
> I expected these to be executed as 25909273, 25909275, 25909274. However, it seems that singletons are executed in order of submission so that this leads to a circular dependency. That is, 25909274 depends on 25909275 due to "after", and 25909275 depends
on 25909274 due to "singleton" plus order of submission.<br>
><br>
> From the man page for sbatch, that wasn't really clear to me:<br>
> singleton<br>
> This job can begin execution after any previously launched jobs sharing the same<br>
> job name and user have terminated.<br>
><br>
> I'm somewhat interested in creating a patch for this, but before I can look into this, I'll need to know what the expected behaviour is.<br>
> If "launched" means submitted to the queue and preserving order, then I should focus on the circular dependency detection.<br>
> If "launched" means entered the running state without preserving order, then I should focus on the dependency resolving.<br>
><br>
> Any thoughts on this?<br>
><br>
> Thanks,<br>
> Jarno<br>
><br>
> Jarno van der Kolk, PhD Phys.<br>
> Analyste principal en informatique scientifique | Senior Scientific Computing Specialist<br>
> Solutions TI | IT Solutions<br>
> Université d’Ottawa | University of Ottawa<br>
><br>
<br>
</div>
</span></font></div>
</div>
</div>
</body>
</html>