<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">We have a situation where Slurm is cancelling jobs due to the error “job dependency can’t be satisfied”. However, all of the job dependencies are completing successfully. Sacct shows that they are successful and scontrol shows they
all have exit codes of 0. <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Subsequently, once we have determined that the dependencies were successful we requeued the cancelled job. Again it was cancelled:<o:p></o:p></p>
<p class="MsoNormal">JobState=CANCELLED Reason=Dependency Dependency=afterok:7438267_*<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">This seems to be a random event because we have submitted jobs of this type often and only some of them get cancelled. Shortly after this happened today I tried to recreate the problem by submitting a job array and then submitting a second
job that was dependent on the job array. The dependent job was successful.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Has anyone seen this behavior before or can anyone shed light on this?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">We are using Slurm 18.08.4.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks in advance!<o:p></o:p></p>
<p class="MsoNormal">-Roger<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="color:black"><img width="111" height="25" id="Picture_x0020_1" src="cid:image001.png@01D58E71.37877310" alt="cid:image001.png@01D22319.C7D5D540"></span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#595959">Roger Moye<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#595959">HPC Engineer<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#595959">713.425.6236 Office<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#595959">713.898.0021 Mobile<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#595959"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#595959">QUANT</span><span style="font-size:10.0pt;color:#FF3300">LAB</span><span style="font-size:10.0pt;color:black">
</span><span style="font-size:10.0pt;color:#595959">Financial, LLC</span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#595959">3 Greenway Plaza</span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#595959">Suite 200</span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#595959">Houston, Texas 77046</span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#595959"><a href="https://www.quantlab.com/"><span style="color:blue">www.quantlab.com</span></a></span><u><span style="color:blue"><o:p></o:p></span></u></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p><font style="font-family: Verdana; font-size: 11px;"><span style="font-family: Verdana;"> </span>-----------------------------------------------------------------------------------</font></p><font style="font-family: Verdana; font-size: 11px;">
</font><p><font style="font-family: Verdana; font-size: 11px;">The information in this communication and any attachment is confidential and intended solely for the attention and use of the named addressee(s). All information and opinions expressed herein are subject to change without notice. This communication is not to be construed as an offer to sell or the solicitation of an offer to buy any security. Any such offer or solicitation can only be made by means of the delivery of a confidential private offering memorandum (which should be carefully reviewed for a complete description of investment strategies and risks). Any reliance one may place on the accuracy or validity of this information is at their own risk. Past performance is not necessarily indicative of the future results of an investment. All figures are estimated and unaudited unless otherwise noted. If you are not the intended recipient, or a person responsible for delivering this to the intended recipient, you are not authorized to and must not disclose, copy, distribute, or retain this message or any part of it. In this case, please notify the sender immediately at 713-333-5440</font></p></body>
</html>