We just upgraded Slurm to 25.05.3, and I would like to highlight a new functionality of the "sinfo -t <state>" command in 25.05:
The state can be prefixed with '~' which will invert the result of match.
We find this "NOT-state" selection useful together with Slurm power saving [1] where any idle nodes may be powered off to save electrical power or cloud costs.
For example, the ClusterShell [2] clush command can now skip connections to the powered down nodes like in this example:
$ clush -bw@slurmstate:~POWERED_DOWN uname -r
You can even configure ClusterShell so that "clush -a" includes all nodes which are *not* powered down. The details are described in the Wiki page [3].
Best regards, Ole
[1] https://slurm.schedmd.com/power_save.html [2] https://clustershell.readthedocs.io/en/latest/intro.html [3] https://wiki.fysik.dtu.dk/Niflheim_system/Slurm_operations/#skipping-powered...