<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
Have you checked the logs for slurmd and slurmctld? I seem to recall that the "invalid" state for a node meant that there was some discrepancy between what the node says or thinks it has (slurmd -C) and what the slurm.conf says it has. While there is that
discrepancy and the node is invalid, you can't just tell it to resume.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
<br>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> slurm-users <slurm-users-bounces@lists.schedmd.com> on behalf of Sushil Mishra <sushilbioinfo@gmail.com><br>
<b>Sent:</b> Tuesday, October 11, 2022 10:08 AM<br>
<b>To:</b> Slurm User Community List <slurm-users@lists.schedmd.com><br>
<b>Subject:</b> [slurm-users] slurm_update error: Invalid node state specified</font>
<div> </div>
</div>
<div>
<table border="0" cellspacing="0" cellpadding="0" width="100%" align="left" style="border:0; display:table; width:100%; table-layout:fixed; border-collapse:seperate; float:none">
<tbody>
<tr>
<td valign="middle" width="1px" bgcolor="#A6A6A6" cellpadding="7px 2px 7px 2px" style="padding:7px 2px 7px 2px; background-color:#A6A6A6">
</td>
<td valign="middle" width="100%" bgcolor="#EAEAEA" cellpadding="7px 5px 7px 15px" color="#212121" style="width:100%; background-color:#EAEAEA; padding:7px 5px 7px 15px; font-family:wf_segoe-ui_normal,Segoe UI,Segoe WP,Tahoma,Arial,sans-serif; font-size:12px; font-weight:normal; color:#212121; text-align:left; word-wrap:break-word">
<div>You don't often get email from sushilbioinfo@gmail.com. <a href="https://aka.ms/LearnAboutSenderIdentification">
Learn why this is important</a></div>
</td>
<td valign="middle" align="left" width="75px" bgcolor="#EAEAEA" cellpadding="7px 5px 7px 5px" color="#212121" style="width:75px; background-color:#EAEAEA; padding:7px 5px 7px 5px; font-family:wf_segoe-ui_normal,Segoe UI,Segoe WP,Tahoma,Arial,sans-serif; font-size:12px; font-weight:normal; color:#212121; text-align:left; word-wrap:break-word">
</td>
</tr>
</tbody>
</table>
<div>
<div dir="ltr">
<div>Dear all,</div>
<div><br>
</div>
<div>I am stuck with scontrol not recognizing the state keywords. I wonder if someone can point me to the possible cause of the error. I restarted slurmd a few times, and it didn't help. </div>
<div><br>
</div>
<div>[sushil@fucose ~]$ sinfo <br>
PARTITION AVAIL TIMELIMIT NODES STATE NODELIST<br>
</div>
<div>LocalQ* up infinite 1 inval fucose<br>
</div>
<div><br>
</div>
[sushil@fucose ~]$ sinfo -R<br>
REASON USER TIMESTAMP NODELIST<br>
cg sushil 2022-10-10T18:11:27 fucose<br>
<br>
<div>[sushil@fucose ~]$ sudo scontrol update NodeName=fucose state=RESUME<br>
[sudo] password for sushil: <br>
slurm_update error: Invalid node state specified<br>
<br>
<div>[sushil@fucose ~]$ squeue <br>
JOBID PARTITION NAME USER ST TIME NODES NODELIST(REASON)<br>
<br>
<div>Best,<br>
</div>
<div>Sushil</div>
<div> </div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>