<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=iso-8859-1"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.E-postmall18
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1695230455;
mso-list-type:hybrid;
mso-list-template-ids:1872426252 -1550431944 134807555 134807557 134807553 134807555 134807557 134807553 134807555 134807557;}
@list l0:level1
{mso-level-start-at:0;
mso-level-number-format:bullet;
mso-level-text:-;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-font-family:Calibri;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Courier New";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Symbol;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Courier New";}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Symbol;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Courier New";}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Wingdings;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-GB link="#0563C1" vlink="#954F72"><div class=WordSection1><p class=MsoNormal>Hello,<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>I have a client slurmd problem, that I cannot really figure out how to solve. I would be grateful for any suggestions on how to move forward.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>The master computer on a small local calculational cluster is getting quite old, and therefore I am currently in the process of exchanging it. I also use one calculational node for the basic master-client set-up of all programs, including slurm. Some basic data: CentOS 7.7, slurm 20.02.4.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Setting up the systemctld on the master node is (seemingly) straightforward. Getting slurmd to work on the client appears more complicated. I get the following error message (journalctl –xe) when starting slurmd on the client:<o:p></o:p></p><p class=MsoNormal>Aug 24 11:01:34 cpu3.calc.cluster slurmd[9002]: error: _fetch_child: failed to fetch remote configs<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>No useful error messages are obtained from ‘systemctl –l status slurmd.service’ on the client, slurmd.log on the client, nor slurmctld.log on the master.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>In this context, the following should be noted:<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo1'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>root and test user exist on the master and client; same uid and gid on both machines<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo1'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>ping works in both directions (master <-> client)<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo1'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>passphrase-free ssh login work in both directions for both root and for a test user<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo1'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>munged is running and with the same key on both machines<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo1'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>the same slurm.conf is read from the master and from the client<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo1'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>named (bind) has been set up on the master, and nslookup and dig work properly on the client<o:p></o:p></p><p class=MsoListParagraph style='text-indent:-18.0pt;mso-list:l0 level1 lfo1'><![if !supportLists]><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span><![endif]>the ‘forward’ zone file of named on the master (DNS) contains the recommended SRV record directing slurmctld requests to port 6817 on the master (syntax seems ok, i.e. no error messages)<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>I have also tried to start slurmd in a config-less mode (slurm.conf edited on the master) with the suggested environment variable set (slurmd on the client). Then, slurmd starts without error messages, but slurmctld on the master cannot communicate with slurmd on the client.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Has anyone encountered a similar problem --- and how did you solve it? Or, do you have any suggestions where to start looking?<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Many thanks for input, and best regards,<o:p></o:p></p><p class=MsoNormal>Lars<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><span style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'>//////////////////////////////~~~_/)~~~\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\</span><span style='mso-fareast-language:EN-GB'><o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'> Lars Kloo, Prof.</span><span style='mso-fareast-language:EN-GB'><o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'> </span><span style='mso-fareast-language:EN-GB'><o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'> Tillämpad fysikalisk kemi Applied Physical Chemistry</span><span style='mso-fareast-language:EN-GB'><o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'> Institutionen för kemi Dept. of Chemistry</span><span style='mso-fareast-language:EN-GB'><o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'> Kungliga Tekniska högskolan Royal Inst. of Technology (KTH)</span><span style='mso-fareast-language:EN-GB'><o:p></o:p></span></p><p class=MsoNormal><span style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'> </span><span lang=EN-US style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'>100 44 STOCKHOLM SE-100 44 Stockholm</span><span lang=EN-US style='mso-fareast-language:EN-GB'><o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'> SWEDEN</span><span lang=EN-US style='mso-fareast-language:EN-GB'><o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'> </span><span lang=EN-US style='mso-fareast-language:EN-GB'><o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'> Tel: 08-790 9343 Tel: +46-8-790 9343</span><span lang=EN-US style='mso-fareast-language:EN-GB'><o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'> Fax: 08-790 9349 Fax: +46-8-790 9349</span><span lang=EN-US style='mso-fareast-language:EN-GB'><o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'> E-post: </span><a href="mailto:lakloo@kth.se"><span lang=EN-US style='font-family:"Courier New";color:purple;mso-fareast-language:EN-GB'>lakloo@kth.se</span></a><span lang=EN-US style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'> E-mail: </span><a href="mailto:lakloo@kth.se"><span lang=EN-US style='font-family:"Courier New";color:purple;mso-fareast-language:EN-GB'>lakloo@kth.se</span></a><span lang=EN-US style='mso-fareast-language:EN-GB'><o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'> </span><span lang=EN-US style='mso-fareast-language:EN-GB'><o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'> WWW: </span><a href="http://www.kth.se/che/divisions/tfk"><span lang=EN-US style='font-family:"Courier New";color:purple;mso-fareast-language:EN-GB'>http://www.kth.se/che/divisions/tfk</span></a><span lang=EN-US style='mso-fareast-language:EN-GB'><o:p></o:p></span></p><p class=MsoNormal><span lang=EN-US style='font-family:"Courier New";color:#1F497D;mso-fareast-language:EN-GB'>\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\~~~_/)~~~//////////////////////////////</span><span lang=EN-US style='mso-fareast-language:EN-GB'><o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p></div></body></html>