<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle18
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">Trying to setup accounting using the MySQL backend and I am getting errors from the slurmctld and slurm tools when trying to interact with the accounting database. Tried starting in debug as well, but could not see anything else that could
point to what could be causing this issue. I have followed all steps listed at:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><a href="https://slurm.schedmd.com/accounting.html">https://slurm.schedmd.com/accounting.html</a><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">The DBD daemon starts up without error as can be seen from the logs:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Slurmdbd.log:<o:p></o:p></p>
<p class="MsoNormal">[2019-01-17T10:18:40.365] chdir to /var/tmp<o:p></o:p></p>
<p class="MsoNormal">[2019-01-17T10:18:40.367] slurmdbd version 18.08.4 started<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Though in the slurmctld.log file I am seeing the following:<o:p></o:p></p>
<p class="MsoNormal">[2019-01-17T10:19:40.024] error: Persistent Conn: read: No error<o:p></o:p></p>
<p class="MsoNormal">[2019-01-17T10:19:40.024] error: Persistent Conn: only read 117 of 2613 bytes<o:p></o:p></p>
<p class="MsoNormal">[2019-01-17T10:19:40.025] error: Persistent Conn: read: No error<o:p></o:p></p>
<p class="MsoNormal">[2019-01-17T10:19:40.025] error: Persistent Conn: only read 117 of 2613 bytes<o:p></o:p></p>
<p class="MsoNormal">[2019-01-17T10:19:40.025] error: Persistent Conn: read: No error<o:p></o:p></p>
<p class="MsoNormal">[2019-01-17T10:19:40.025] error: Persistent Conn: only read 119 of 1375731712 bytes<o:p></o:p></p>
<p class="MsoNormal">[2019-01-17T10:19:40.025] error: Persistent Conn: read: No error<o:p></o:p></p>
<p class="MsoNormal">[2019-01-17T10:19:40.025] error: Persistent Conn: only read 117 of 2613 bytes<o:p></o:p></p>
<p class="MsoNormal">[2019-01-17T10:19:40.025] error: slurm_persist_conn_open: Failed to unpack persistent connection init resp message from 127.0.0.1:3306<o:p></o:p></p>
<p class="MsoNormal">[2019-01-17T10:19:40.025] error: slurmdbd: Sending PersistInit msg: No error<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I do restart all services in the order of munge, dbd, slurmctld after config changes.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">The relevant configs are as follows:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">slurmdbd.conf:<o:p></o:p></p>
<p class="MsoNormal">AuthType=auth/munge<o:p></o:p></p>
<p class="MsoNormal">DbdAddr=127.0.0.1<o:p></o:p></p>
<p class="MsoNormal">DbdHost=localhost<o:p></o:p></p>
<p class="MsoNormal">DbdPort=7031<o:p></o:p></p>
<p class="MsoNormal">SlurmUser=slurm<o:p></o:p></p>
<p class="MsoNormal">LogFile=/var/log/slurmdbd.log<o:p></o:p></p>
<p class="MsoNormal">PidFile=/var/run/slurmdbd.pid<o:p></o:p></p>
<p class="MsoNormal">StorageType=accounting_storage/mysql<o:p></o:p></p>
<p class="MsoNormal">StorageHost=localhost<o:p></o:p></p>
<p class="MsoNormal">StoragePort=3306<o:p></o:p></p>
<p class="MsoNormal">StoragePass=xxxxxxxxxxxxxxxxxxxxxxxxxxxxx<o:p></o:p></p>
<p class="MsoNormal">StorageUser=slurm<o:p></o:p></p>
<p class="MsoNormal">StorageLoc=slurm_acct_db<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">slurm.conf:<o:p></o:p></p>
<p class="MsoNormal">AccountingStorageType=accounting_storage/slurmdbd<o:p></o:p></p>
<p class="MsoNormal">AccountingStorageHost=127.0.0.1<o:p></o:p></p>
<p class="MsoNormal">AccountingStoragePort=3306<o:p></o:p></p>
<p class="MsoNormal">AccountingStorageUser=slurm<o:p></o:p></p>
<p class="MsoNormal">AccountingStorageEnforce=limits<o:p></o:p></p>
<p class="MsoNormal">AccountingStoreJobComment=YES<o:p></o:p></p>
<p class="MsoNormal">AcctGatherNodeFreq=30<o:p></o:p></p>
<p class="MsoNormal">ClusterName=ares<o:p></o:p></p>
<p class="MsoNormal">JobAcctGatherFrequency=30<o:p></o:p></p>
<p class="MsoNormal">JobAcctGatherType=jobacct_gather/linux<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">We are running Slurm 18.04 on CentOS 7 with MariaDB as the backend.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">-SS-<o:p></o:p></p>
</div>
</body>
</html>