<div dir="auto">My opinion is no, at least not forced. </div><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jul 6, 2023 at 1:40 PM Amjad Syed <<a href="mailto:amjadcsu@gmail.com">amjadcsu@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;padding-left:1ex;border-left-color:rgb(204,204,204)"><div dir="auto">Agreed the point of greater responsibility but even rm -r ( without f) gives a warning. In this case should slurm have that option ( forced) especially if it can immediately kill a running job? <div dir="auto"><br></div><div dir="auto"><br><div dir="auto"><br></div><div dir="auto"><br></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, 6 Jul 2023, 18:16 Jason Simms, <<a href="mailto:jsimms1@swarthmore.edu" target="_blank">jsimms1@swarthmore.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;padding-left:1ex;border-left-color:rgb(204,204,204)"><div dir="auto">An unfortunate example of the “with great power comes great responsibility” maxim. Linux will gleefully let you rm -fr your entire system, drop production databases, etc., provided you have the right privileges. Ask me how I know…</div><div dir="auto"><br></div><div dir="auto">Still, I get the point. Would it be possible to somehow ask for confirmation if you are setting a max time that is less than the current walltime? Perhaps. Could you script that yourself? Yes, I’m certain of it. Those kind of built-in safeguards aren’t super common, however. </div><div dir="auto"><br></div><div dir="auto">Jason</div><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jul 6, 2023 at 12:55 PM Amjad Syed <<a href="mailto:amjadcsu@gmail.com" rel="noreferrer" target="_blank">amjadcsu@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;padding-left:1ex;border-left-color:rgb(204,204,204)"><div dir="ltr">Yes, the initial End Time was 7-00:00:00 but it allowed the typo (16:00:00) which caused the jobs to be killed without warning</div><div dir="ltr"><div><br></div><div>Amjad</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jul 6, 2023 at 5:27 PM Bernstein, Noam CIV USN NRL (6393) Washington DC (USA) <<a href="mailto:noam.bernstein@nrl.navy.mil" rel="noreferrer" target="_blank">noam.bernstein@nrl.navy.mil</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;padding-left:1ex;border-left-color:rgb(204,204,204)">
<div>
Is the issue that the error in the time made it shorter than the time the job had already run, so it killed it immediately?<br>
<div><br>
<blockquote type="cite">
<div>On Jul 6, 2023, at 12:04 PM, Jason Simms <<a href="mailto:jsimms1@swarthmore.edu" rel="noreferrer" target="_blank">jsimms1@swarthmore.edu</a>> wrote:</div>
<br>
<div>
<div dir="ltr">No, not a bug, I would say. When the time limit is reached, that's it, job dies. I wouldn't be aware of a way to manage that. Once the time limit is reached, it wouldn't be a hard limit if you then had to notify the user and then...
what? How long would you give them to extend the time? Wouldn't be much of a limit if a job can be extended, plus that would throw off the scheduler/estimator. I'd chalk it up to an unfortunate typo.
<div><br>
</div>
<div>Jason</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Thu, Jul 6, 2023 at 11:54 AM Amjad Syed <<a href="mailto:amjadcsu@gmail.com" rel="noreferrer" target="_blank">amjadcsu@gmail.com</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;padding-left:1ex;border-left-color:rgb(204,204,204)">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">Hello
<div><br>
</div>
<div>We were trying to increase the time limit of a slurm running job</div>
<div><br>
</div>
<div>scontrol update job=<jobid> TimeLimit=16-00:00:00</div>
<div><br>
</div>
<div>But we accidentally got it to 16 hours</div>
<div><br>
</div>
<div>
<div>scontrol update job=<jobid> TimeLimit=16:00:00</div>
</div>
<div><br>
</div>
<div>This actually timeout and killed the running job and did not give any notification</div>
<div><br>
</div>
<div>Is this a bug, should not the user be warned that this job will be killled ?</div>
<div><br>
</div>
<div>Amjad</div>
<div><br>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br clear="all">
<div><br>
</div>
<span class="gmail_signature_prefix">-- </span><br>
<div dir="ltr" class="gmail_signature">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div style="font-family:Helvetica;font-size:14px;margin:0px"><span style="font-family:Helvetica;color:rgb(130,36,51)"><font face="Century Gothic" style="font-family:"Century Gothic";color:rgb(130,36,51)"><b style="font-family:"Century Gothic"">Jason L. Simms, Ph.D., M.P.H.</b></font></span></div>
<font face="Century Gothic" style="font-family:"Century Gothic";color:rgb(0,0,0)">Manager of Research Computing</font><br>
</div>
<div dir="ltr">
<div style="font-family:Helvetica;font-size:14px;margin:0px"><font face="Century Gothic" style="font-family:"Century Gothic";color:rgb(0,0,0)"><span style="font-family:"Century Gothic";color:gray">Swarthmore College<br>
Information Technology Services</span></font></div>
<div style="font-family:Helvetica;font-size:14px;margin:0px"><font face="Century Gothic" style="font-family:"Century Gothic";color:rgb(0,0,0)"><span style="font-family:"Century Gothic";color:gray">(610) 328-8102<br>
</span></font></div>
<div style="font-family:Helvetica;font-size:14px;margin:0px"><font face="Century Gothic" style="font-family:"Century Gothic";color:rgb(0,0,0)">Schedule a meeting: </font><span style="font-family:Arial,Helvetica,sans-serif;font-size:small;color:rgb(32,33,36)"><a href="https://calendly.com/jlsimms" style="font-family:Arial,Helvetica,sans-serif" rel="noreferrer" target="_blank">https://calendly.com/jlsimms</a></span><br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
<div>
<p><u></u><u></u>
</p><table>
<tbody>
<tr>
<td>
<div style="border-width:2px 0px 0px 2px;border-style:solid;border-color:navy white white navy">
</div>
</td>
<td>
<div style="border-width:2px 0px 0px;border-style:solid;border-color:navy white white">
</div>
</td>
<td>
<div style="border-width:2px 2px 0px 0px;border-style:solid;border-color:navy navy white white">
</div>
</td>
</tr>
<tr>
<td>
<div style="border-width:0px 0px 0px 2px;border-style:solid;border-color:white white white navy">
</div>
</td>
<td style="text-align:center"><b>U.S. NAVAL </b></td>
<td>
<div style="border-width:0px 2px 0px 0px;border-style:solid;border-color:white navy white white">
</div>
</td>
</tr>
<tr>
<td>
<div style="border-width:0px 0px 2px 2px;border-style:solid;border-color:white white navy navy">
</div>
</td>
<td style="text-align:center"><b>RESEARCH </b></td>
<td>
<div style="border-width:0px 2px 2px 0px;border-style:solid;border-color:white navy navy white">
</div>
</td>
</tr>
<tr>
<td></td>
<td style="font-size:86%">LABORATORY </td>
<td></td>
</tr>
</tbody>
</table>
<table>
<tbody>
<tr>
<td>Noam Bernstein, Ph.D.</td>
</tr>
<tr>
<td>Center for Materials Physics and Technology</td>
</tr>
<tr>
<td>U.S. Naval Research Laboratory</td>
</tr>
<tr>
<td>T +1 202 404 8628 F +1 202 404 7546</td>
</tr>
<tr>
<td><a href="https://www.nrl.navy.mil" rel="noreferrer" target="_blank">https://www.nrl.navy.mil</a></td>
</tr>
</tbody>
</table>
<p></p>
</div>
<br>
</div>
</blockquote></div>
</blockquote></div></div><span class="gmail_signature_prefix">-- </span><br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div style="font-family:Helvetica;font-size:14px;margin:0px;color:rgb(0,0,0)"><span style="font-family:Helvetica;color:rgb(130,36,51)"><font face="Century Gothic" style="font-family:"Century Gothic";color:rgb(130,36,51)"><b style="font-family:"Century Gothic"">Jason L. Simms, Ph.D., M.P.H.</b></font></span></div><font face="Century Gothic" style="font-family:"Century Gothic";color:rgb(0,0,0)">Manager of Research Computing</font><br></div><div dir="ltr"><div style="font-family:Helvetica;font-size:14px;margin:0px;color:rgb(0,0,0)"><font face="Century Gothic" style="font-family:"Century Gothic";color:rgb(0,0,0)"><span style="font-family:"Century Gothic";color:gray">Swarthmore College<br>Information Technology Services</span></font></div><div style="font-family:Helvetica;font-size:14px;margin:0px;color:rgb(0,0,0)"><font face="Century Gothic" style="font-family:"Century Gothic";color:rgb(0,0,0)"><span style="font-family:"Century Gothic";color:gray">(610) 328-8102<br></span></font></div><div style="font-family:Helvetica;font-size:14px;margin:0px;color:rgb(0,0,0)"><font face="Century Gothic" style="font-family:"Century Gothic";color:rgb(0,0,0)">Schedule a meeting: </font><span style="font-family:Arial,Helvetica,sans-serif;font-size:small;color:rgb(32,33,36)"><a href="https://calendly.com/jlsimms" rel="noreferrer" target="_blank" style="font-family:Arial,Helvetica,sans-serif">https://calendly.com/jlsimms</a></span><br></div></div></div></div></div></div>
</blockquote></div>
</blockquote></div></div><span class="gmail_signature_prefix">-- </span><br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:14px;margin:0px"><span style="color:rgb(130,36,51)"><font face="Century Gothic"><b>Jason L. Simms, Ph.D., M.P.H.</b></font></span></div><font face="Century Gothic">Manager of Research Computing</font><br></div><div dir="ltr"><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:14px;margin:0px"><font face="Century Gothic"><span style="color:gray">Swarthmore College<br>Information Technology Services</span></font></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:14px;margin:0px"><font face="Century Gothic"><span style="color:gray">(610) 328-8102<br></span></font></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:14px;margin:0px"><font face="Century Gothic">Schedule a meeting: </font><span style="font-family:Arial,Helvetica,sans-serif;font-size:small;color:rgb(32,33,36)"><a href="https://calendly.com/jlsimms" target="_blank">https://calendly.com/jlsimms</a></span><br></div></div></div></div></div></div>