<div dir="auto">The oversight is perhaps understandable, since for most software, a given version XX.YY would be major version XX, minor version YY. But with Slurm it’s major version XX.YY and minor is XX.YY.zz </div><div dir="auto"><br></div><div dir="auto"><br></div><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Sep 8, 2022 at 2:43 PM Ole Holm Nielsen <<a href="mailto:Ole.H.Nielsen@fysik.dtu.dk">Ole.H.Nielsen@fysik.dtu.dk</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;padding-left:1ex;border-left-color:rgb(204,204,204)">Paul is right!  You may upgrade 18.08 to 20.02, but not 20.11!<br>
<br>
Some details on upgrading Slurm is in this Wiki page:<br>
<a href="https://wiki.fysik.dtu.dk/niflheim/Slurm_installation#upgrading-slurm" rel="noreferrer" target="_blank">https://wiki.fysik.dtu.dk/niflheim/Slurm_installation#upgrading-slurm</a><br>
<br>
/Ole<br>
<br>
On 08-09-2022 18:26, Paul Edmon wrote:<br>
> But not any 20.  There are 20 versions, 20.02 and 20.11, and there was a <br>
> previous 19.05.  So two versions for 18.08 would be 20.02 not 20.11<br>
> <br>
> <br>
> -Paul Edmon-<br>
> <br>
> <br>
> On 9/8/22 12:14 PM, Wadud Miah wrote:<br>
>> The previous version was 18 and now I am trying to upgrade to 20, so I <br>
>> am well within 2 major versions.<br>
>><br>
>> Regards,<br>
>> ------------------------------------------------------------------------<br>
>> *From:* slurm-users <<a href="mailto:slurm-users-bounces@lists.schedmd.com" target="_blank">slurm-users-bounces@lists.schedmd.com</a>> on behalf <br>
>> of Paul Edmon <<a href="mailto:pedmon@cfa.harvard.edu" target="_blank">pedmon@cfa.harvard.edu</a>><br>
>> *Sent:* Thursday, September 8, 2022 4:44:36 PM<br>
>> *To:* <a href="mailto:slurm-users@lists.schedmd.com" target="_blank">slurm-users@lists.schedmd.com</a> <<a href="mailto:slurm-users@lists.schedmd.com" target="_blank">slurm-users@lists.schedmd.com</a>><br>
>> *Subject:* Re: [slurm-users] Upgrading SLURM from 18 to 20.11.9<br>
>> *CAUTION:* This e-mail originated outside the University of Southampton.<br>
>><br>
>> Typically slurm only supports upgrading between 2 major versions <br>
>> ahead.  If you are on 18.08 you likely can only go to 20.02. Then <br>
>> after you upgrade to 20.02 you can go to 20.11 or 21.08.<br>
>><br>
>><br>
>> -Paul Edmon-<br>
>><br>
>><br>
>> On 9/8/22 11:38 AM, Wadud Miah wrote:<br>
>>> hi Mick,<br>
>>><br>
>>> I have checked that all the compute nodes and controllers all have <br>
>>> the same version of SLURM (20.11.9). I am indeed trying to upgrade <br>
>>> SlurmDB first, and am getting the errors in the slurmdbd.log:<br>
>>><br>
>>> [2022-09-08T15:45:11.115] slurmdbd version 20.11.9 started<br>
>>> [2022-09-08T15:45:23.001] error: unpack_header: protocol_version 8448 <br>
>>> not supported<br>
>>> [2022-09-08T15:33:57.001] unpacking header<br>
>>> [2022-09-08T15:33:57.001] error: destroy_forward: no init<br>
>>> [2022-09-08T15:33:57.001] error: slurm_unpack_received_msg: Message <br>
>>> receive failure<br>
>>> [2022-09-08T15:33:57.011] error: CONN:11 Failed to unpack <br>
>>> SLURM_PERSIST_INIT message<br>
>>><br>
>>> Regards,<br>
>>> Wadud.<br>
>>><br>
>>> ------------------------------------------------------------------------<br>
>>> *From:* slurm-users <<a href="mailto:slurm-users-bounces@lists.schedmd.com" target="_blank">slurm-users-bounces@lists.schedmd.com</a>> <br>
>>> <mailto:<a href="mailto:slurm-users-bounces@lists.schedmd.com" target="_blank">slurm-users-bounces@lists.schedmd.com</a>> on behalf of Timony, <br>
>>> Mick <<a href="mailto:Michael_Timony@hms.harvard.edu" target="_blank">Michael_Timony@hms.harvard.edu</a>> <br>
>>> <mailto:<a href="mailto:Michael_Timony@hms.harvard.edu" target="_blank">Michael_Timony@hms.harvard.edu</a>><br>
>>> *Sent:* 08 September 2022 16:24<br>
>>> *To:* Slurm User Community List <<a href="mailto:slurm-users@lists.schedmd.com" target="_blank">slurm-users@lists.schedmd.com</a>> <br>
>>> <mailto:<a href="mailto:slurm-users@lists.schedmd.com" target="_blank">slurm-users@lists.schedmd.com</a>><br>
>>> *Subject:* Re: [slurm-users] Upgrading SLURM from 18 to 20.11.9<br>
>>> *CAUTION:* This e-mail originated outside the University of Southampton.<br>
>>> This thread on the forums may help:<br>
>>><br>
>>> <a href="https://groups.google.com/g/slurm-users/c/YB55Ru9rvD4" rel="noreferrer" target="_blank">https://groups.google.com/g/slurm-users/c/YB55Ru9rvD4</a> <br>
>>> <<a href="https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fg%2Fslurm-users%2Fc%2FYB55Ru9rvD4&data=05%7C01%7Cw.miah%40soton.ac.uk%7Cfd25248a7e6a4fa729d308da91b20c1a%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637982491141437024%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=THo3JUObIzF6EWcIlQ1OsJwUwxEAGUFeMdLuvlEKhzA%3D&reserved=0" rel="noreferrer" target="_blank">https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fg%2Fslurm-users%2Fc%2FYB55Ru9rvD4&data=05%7C01%7Cw.miah%40soton.ac.uk%7Cfd25248a7e6a4fa729d308da91b20c1a%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637982491141437024%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=THo3JUObIzF6EWcIlQ1OsJwUwxEAGUFeMdLuvlEKhzA%3D&reserved=0</a>><br>
>>><br>
>>><br>
>>> It looks like you have something on your network with an older <br>
>>> version of slurm installed. I'd check the Slurm version installed on <br>
>>> your compute nodes and controllers.<br>
>>><br>
>>> The recommended approach to upgrading is to upgrade the SlurmDB <br>
>>> first, then the controllers, then the compute nodes. More info here:<br>
>>><br>
>>> <a href="https://slurm.schedmd.com/quickstart_admin.html#upgrade" rel="noreferrer" target="_blank">https://slurm.schedmd.com/quickstart_admin.html#upgrade</a> <br>
>>> <<a href="https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fslurm.schedmd.com%2Fquickstart_admin.html%23upgrade&data=05%7C01%7Cw.miah%40soton.ac.uk%7Cfd25248a7e6a4fa729d308da91b20c1a%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637982491141437024%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Evu1PdyvAeinb0W11Ia6NxUgOvfaITmJiVau8nak%2Fac%3D&reserved=0" rel="noreferrer" target="_blank">https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fslurm.schedmd.com%2Fquickstart_admin.html%23upgrade&data=05%7C01%7Cw.miah%40soton.ac.uk%7Cfd25248a7e6a4fa729d308da91b20c1a%7C4a5378f929f44d3ebe89669d03ada9d8%7C0%7C0%7C637982491141437024%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Evu1PdyvAeinb0W11Ia6NxUgOvfaITmJiVau8nak%2Fac%3D&reserved=0</a>><br>
>>><br>
>>> Regards<br>
>>> -- <br>
>>> Mick Timony<br>
>>> Senior DevOps Engineer<br>
>>> Harvard Medical School<br>
>>> --<br>
>>><br>
>>> ------------------------------------------------------------------------<br>
>>> *From:* slurm-users <<a href="mailto:slurm-users-bounces@lists.schedmd.com" target="_blank">slurm-users-bounces@lists.schedmd.com</a>> <br>
>>> <mailto:<a href="mailto:slurm-users-bounces@lists.schedmd.com" target="_blank">slurm-users-bounces@lists.schedmd.com</a>> on behalf of Wadud <br>
>>> Miah <<a href="mailto:W.Miah@soton.ac.uk" target="_blank">W.Miah@soton.ac.uk</a>> <mailto:<a href="mailto:W.Miah@soton.ac.uk" target="_blank">W.Miah@soton.ac.uk</a>><br>
>>> *Sent:* Thursday, September 8, 2022 10:47 AM<br>
>>> *To:* <a href="mailto:slurm-users@lists.schedmd.com" target="_blank">slurm-users@lists.schedmd.com</a> <br>
>>> <mailto:<a href="mailto:slurm-users@lists.schedmd.com" target="_blank">slurm-users@lists.schedmd.com</a>> <br>
>>> <<a href="mailto:slurm-users@lists.schedmd.com" target="_blank">slurm-users@lists.schedmd.com</a>> <mailto:<a href="mailto:slurm-users@lists.schedmd.com" target="_blank">slurm-users@lists.schedmd.com</a>><br>
>>> *Subject:* [slurm-users] Upgrading SLURM from 18 to 20.11.9<br>
>>> Hi,<br>
>>><br>
>>> I am attempting to upgrade from SLURM 18 to 20.11.9 and when I <br>
>>> attempt to start slurmdbd (version 20.11.9), I get the following <br>
>>> error messages in /var/log/slurm/slurmdbd.log:<br>
>>><br>
>>> [2022-09-08T15:45:11.115] slurmdbd version 20.11.9 started<br>
>>> [2022-09-08T15:45:23.001] error: unpack_header: protocol_version 8448 <br>
>>> not supported<br>
>>> [2022-09-08T15:33:57.001] unpacking header<br>
>>> [2022-09-08T15:33:57.001] error: destroy_forward: no init<br>
>>> [2022-09-08T15:33:57.001] error: slurm_unpack_received_msg: Message <br>
>>> receive failure<br>
>>> [2022-09-08T15:33:57.011] error: CONN:11 Failed to unpack <br>
>>> SLURM_PERSIST_INIT message<br>
>>><br>
>>> Any help will be greatly appreciated.<br>
>>><br>
>>> Regards,<br>
>>><br>
>>> ----------<br>
>>> Wadud Miah<br>
>>> Research Computing Support<br>
>>> University of Southampton<br>
<br>
<br>
</blockquote></div></div>-- <br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:14px;margin:0px"><span style="color:rgb(130,36,51)"><font face="Century Gothic"><b>Jason L. Simms, Ph.D., M.P.H.</b></font></span></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:14px;margin:0px"><font face="Century Gothic"><span>Manager of Research and High-Performance Computing</span></font></div><div style="color:rgb(0,0,0);font-family:Helvetica;font-size:14px;margin:0px"><font face="Century Gothic"><span>XSEDE Campus Champion<br></span><span style="color:gray">Lafayette College<br>Information Technology Services<br>710 Sullivan Rd | Easton, PA 18042<br>Office: 112 Skillman Library<br>p: (610) 330-5632</span></font></div></div></div></div></div></div></div></div></div>