Hi all,
We hit a snag when updating our clusters from Slurm 23.02 to 24.05. After updating the slurmdbd, our multi cluster setup was broken until everything was updated to 24.05. We had not anticipated this.
SchedMD says that fixing it would be a very complex operation.
Hence, this warning to everybody on planning to update: make sure to quickly updating everything once you've updated the slurmdbd daemon.
Reference: https://support.schedmd.com/show_bug.cgi?id=20931
Ward