Hello,

I suppose the actual error is:

slurmctld: fatal: Can not recover last_conf_lite, incompatible version, (9472 not between 9728 and 10240), start with '-i' to ignore this. Warning: using -i will lose the data that can't be recovered.

did you upgrade from Slurm 21.08 (9472) to your actual version 23.11 (10240) ? See here for numbers reference: https://github.com/SchedMD/slurm/blob/40058e4df5fa243f4c340db9622ed559ce771778/src/common/slurm_protocol_common.h#L63

You have to stay in a 2 releases window for the upgrades to work.

Best regards,
Lorenzo

On 25/06/24 16:30, stth via slurm-users wrote:

Hello,

slurmctld.log and journalctl -u slurmctld --no-pager give the same info as I have already provided. 

“ Referenced but unset environment variable evaluates to an empty string:
SLURMCTLD_OPTIONS* " has to do with the files on /etc/default (slurmdbd/slurmctld/slurmd), where there is a line: SLURMDBD_OPTIONS="".

But it does not have anything to do with the fact that the deamon is not active

On Tue, Jun 25, 2024 at 3:49 PM daijiangkuicgo--- via slurm-users <slurm-users@lists.schedmd.com> wrote:

What's your “ Referenced but unset environment variable evaluates to an empty string:
SLURMCTLD_OPTIONS* ”？ Meanwhile, you can check slurmctld.log and journalctl -u slurmctld --no-pager.

--
slurm-users mailing list -- slurm-users@lists.schedmd.com
To unsubscribe send an email to slurm-users-leave@lists.schedmd.com