[slurm-users] protocol_version 8960 not supported
msh at roe.ac.uk
Tue Nov 29 12:41:50 UTC 2022
Never mind, I found the problem. The rebuilt nodes were still listed in my other cluster config (running Slurm 19), and hence it was sending them status check messages which they couldn't respond to. Tidied up the config and the messages have disappeared.
From: slurm-users <slurm-users-bounces at lists.schedmd.com> On Behalf Of Mark Holliman
Sent: 29 November 2022 11:53
To: Slurm User Community List <slurm-users at lists.schedmd.com>
Subject: [slurm-users] protocol_version 8960 not supported
I've just finished building and installing Slurm 22.05.6 from source on a head node and a couple workers. I installed the same RPMs on all the nodes, and the slurmdbd, slurmctld, and slurmd daemons have all come online and appear healthy (test jobs can be submitted to partitions and successfully run on the nodes). But I'm seeing these errors at regular intervals in the slurm logs:
[2022-11-29T11:29:49.683] error: unpack_header: protocol_version 8960 not supported
[2022-11-29T11:29:49.683] error: unpacking header
[2022-11-29T11:29:49.683] error: destroy_forward: no init
[2022-11-29T11:29:49.684] error: slurm_receive_msg_and_forward: [[sdc-uk]:53026] failed: Message receive failure
[2022-11-29T11:29:49.694] error: service_connection: slurm_receive_msg: Message receive failure
My slurm.conf is based on my previous (still existing) cluster config, and I've already encountered one or two issues with plugins not working. I can't find anything online listing the Slurm protocol_version numbers to check what is causing this error, though I'm assuming it's plugin related (slurmdbd maybe?). Turning up the debugging on the slurm logs doesn't help at finding the issue. Does anyone here know what protocol_verson 8960 relates to?
Relevant slurm.conf lines are:
# Job cleanup
# LOGGING AND ACCOUNTING
Senior Data Systems Specialist
Wide Field Astronomy Unit
Institute for Astronomy
University of Edinburgh
The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the slurm-users