On 3/6/25 18:10, Paul Musset via slurm-users wrote:
If they are on two different machines, doing as described on the slurm documentation is not a problem. I just updated an ubuntu installation a few days ago following the doc and they can both can run without the other running
If they are on the same machine, my guess would be that you have to first stop slurmdb then slurmctld, update them both, first start slurmdb and them slurmctld. Just be sure to disable them both in systemd, to avoid that they restart in the wrong order. (it happened to me with apt). I am not experienced on one machine configs, so someone else might be able to confirm or correct me.
We also run slurmdbd and slurmctld on separate servers so that upgrading Slurm will be safer and in order to optimize the system performance. The slurmctld doesn't require slurmdbd to be available immediately, since slurmctld caches its data for a long time (hours?) until slurmdbd becomes available again.
When doing *minor Slurm updates* (like 24.05.4 to 24.05.5), the daemons will start immediately from Systemd, and we always do such RPM updates without experiencing any issues (we run the RPM-based RockyLinux).
Since you have slurmdbd and slurmctld on the same machine, I think these daemons don't depend (strongly) on each other and can be upgraded at the same time, as long as you are only making *minor version updates*. If you want to play it safe, you can disable automatic startup of slurmdbd by Systemd (systemctl disable slurmdbd; systemctl stop slurmdbd). When your Slurm packages have been upgraded and slurmctld is running normally, you can enable and start the slurmdbd with Systemd. The slurmctld will connect to slurmdbd successfully at this stage.
For *major release upgrades* the important thing when upgrading slurmdbd is do *disable* automatic startup from Systemd. After upgrading slurmdbd with a *major release* you must start it manually because database conversion can take a long time (minutes to hours). Details are discussed in this Wiki page: https://wiki.fysik.dtu.dk/Niflheim_system/Slurm_installation/#upgrade-slurmd...
IHTH, Ole
On 06/03/2025 17.04, Matthias Leopold via slurm-users wrote:
Hi,
I'm building Slurm Debian packages from SchedMD sources using this tutorial https://www.schedmd.com/slurm/installation-tutorial/. Now I tried upgrading (minor release upgrade within 24.05) using these packages. https://slurm.schedmd.com/upgrades.html tells me to upgrade (a) slurmdbd (b) slurmctld (c) slurmd separately in this order, stopping each service for the upgrade. How can I follow this when the Debian packages have a dependency between slurmdbd + slurmctld that upgrades both packages at the same time?