<div dir="ltr"><div>1. After systemctl restart slurmdbd , what does journalctl -xe say?</div><div>2. Your email is very hard to read. This is bc posted in html, with terminal colours and etc. Could you send the next email in plain text pls?</div><div><br></div><div>Cheers</div><div>L.<br></div></div><br><div class="gmail_quote"><div dir="ltr">On Fri, 12 Oct 2018 at 08:02, Aravindh Sampathkumar <<a href="mailto:aravindh@fastmail.com">aravindh@fastmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><u></u>





<div><div style="font-size:16px">Hello.<br></div>
<div style="font-size:16px"><br></div>
<div style="font-size:16px">I'm trying to setup a SLURM cluster in a virtual environment before actually deploying it for serious work. I hit a snag where Slurmdbd fails soon after starting because of trouble connecting to MariaDB.<br></div>
<div style="font-size:16px"><br></div>
<div style="font-size:16px">SlurmDBD service status:<br></div>
<p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[root@slmaster ~]# systemctl status slurmdbd</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span class="m_-8276723749873139023colour" style="color:rgb(252,93,78)"><b>●</b></span><span style="font-variant-ligatures:no-common-ligatures"> slurmdbd.service - Slurm DBD accounting daemon</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><span class="m_-8276723749873139023Apple-converted-space">   </span>Loaded: loaded (/etc/systemd/system/slurmdbd.service; enabled; vendor preset: disabled)</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><span class="m_-8276723749873139023Apple-converted-space">   </span>Active: </span><span class="m_-8276723749873139023colour" style="color:rgb(252,93,78)"><b>failed</b></span><span style="font-variant-ligatures:no-common-ligatures"> (Result: timeout) since Thu 2018-10-11 20:34:42 UTC; 14min ago</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><span class="m_-8276723749873139023Apple-converted-space">  </span>Process: 1406 ExecStart=/usr/sbin/slurmdbd $SLURMDBD_OPTIONS (code=exited, status=0/SUCCESS)</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal;min-height:16px"><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">Oct 11 20:33:11 slmaster systemd[1]: Starting Slurm DBD accounting daemon...</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">Oct 11 20:33:11 slmaster systemd[1]: PID file /var/run/slurmdbd.pid not readable (yet?) after start.</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(231,236,237)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)">Oct 11 20:34:42 slmaster systemd[1]: </span><span style="font-variant-ligatures:no-common-ligatures"><b>slurmdbd.service start operation timed out. Terminating.</b></span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(252,93,78)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)">Oct 11 20:34:42 slmaster systemd[1]: </span><span style="font-variant-ligatures:no-common-ligatures"><b>Failed to start Slurm DBD accounting daemon.</b></span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(231,236,237)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)">Oct 11 20:34:42 slmaster systemd[1]: </span><span style="font-variant-ligatures:no-common-ligatures"><b>Unit slurmdbd.service entered failed state.</b></span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">Oct 11 20:34:42 slmaster systemd[1]: </span><span class="m_-8276723749873139023colour" style="color:rgb(231,236,237)"><b>slurmdbd.service failed.</b></span></span></span></span></span><br></p><div style="font-size:16px"><br></div>
<div style="font-size:16px">MariaDB running just fine:<br></div>
<p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[root@slmaster ~]# systemctl status mariadb</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span class="m_-8276723749873139023colour" style="color:rgb(89,213,108)"><b>●</b></span><span style="font-variant-ligatures:no-common-ligatures"> mariadb.service - MariaDB database server</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><span class="m_-8276723749873139023Apple-converted-space">   </span>Loaded: loaded (/usr/lib/systemd/system/mariadb.service; enabled; vendor preset: disabled)</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><span class="m_-8276723749873139023Apple-converted-space">   </span>Active: </span><span class="m_-8276723749873139023colour" style="color:rgb(89,213,108)"><b>active (running)</b></span><span style="font-variant-ligatures:no-common-ligatures"> since Thu 2018-10-11 20:33:11 UTC; 18min ago</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><span class="m_-8276723749873139023Apple-converted-space">  </span>Process: 991 ExecStartPost=/usr/libexec/mariadb-wait-ready $MAINPID (code=exited, status=0/SUCCESS)</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><span class="m_-8276723749873139023Apple-converted-space">  </span>Process: 943 ExecStartPre=/usr/libexec/mariadb-prepare-db-dir %n (code=exited, status=0/SUCCESS)</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><span class="m_-8276723749873139023Apple-converted-space"> </span>Main PID: 989 (mysqld_safe)</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><span class="m_-8276723749873139023Apple-converted-space">   </span>CGroup: /<a href="http://system.slice/mariadb.service" target="_blank">system.slice/mariadb.service</a></span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><span class="m_-8276723749873139023Apple-converted-space">           </span>├─ 989 /bin/sh /usr/bin/mysqld_safe --basedir=/usr</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><span class="m_-8276723749873139023Apple-converted-space">           </span>└─1265 /usr/libexec/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --log-error=/var/log/mariadb/maria...</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal;min-height:16px"><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">Oct 11 20:33:07 slmaster systemd[1]: Starting MariaDB database server...</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">Oct 11 20:33:07 slmaster mariadb-prepare-db-dir[943]: Database MariaDB is probably initialized in /var/lib/mysql already, nothing is done.</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">Oct 11 20:33:08 slmaster mysqld_safe[989]: 181011 20:33:08 mysqld_safe Logging to '/var/log/mariadb/mariadb.log'.</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">Oct 11 20:33:09 slmaster mysqld_safe[989]: 181011 20:33:09 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">Oct 11 20:33:11 slmaster systemd[1]: Started MariaDB database server.</span></span></span></span></span><br></p><div style="font-size:16px"><br></div>
<div style="font-size:16px">Logfile from Slurmdbd:<br></div>
<div style="font-size:16px"><br></div>
<p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.648] debug:<span class="m_-8276723749873139023Apple-converted-space">  </span>Log file re-opened</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.720] debug:<span class="m_-8276723749873139023Apple-converted-space">  </span>Munge authentication plugin loaded</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.749] debug2: mysql_connect() called for db slurm_acct_db</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.785] debug2: innodb_buffer_pool_size: 629145600</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.785] debug2: innodb_log_file_size: 67108864</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.786] debug2: innodb_lock_wait_timeout: 900</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.956] Accounting storage MYSQL plugin loaded</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: ArchiveDir<span class="m_-8276723749873139023Apple-converted-space">        </span>= /tmp</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: ArchiveScript <span class="m_-8276723749873139023Apple-converted-space">    </span>= (null)</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: AuthInfo<span class="m_-8276723749873139023Apple-converted-space">          </span>= (null)</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: AuthType<span class="m_-8276723749873139023Apple-converted-space">          </span>= auth/munge</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: CommitDelay <span class="m_-8276723749873139023Apple-converted-space">      </span>= 0</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: DbdAddr <span class="m_-8276723749873139023Apple-converted-space">          </span>= slmaster</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: DbdBackupHost <span class="m_-8276723749873139023Apple-converted-space">    </span>= (null)</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: DbdHost <span class="m_-8276723749873139023Apple-converted-space">          </span>= slmaster</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: DbdPort <span class="m_-8276723749873139023Apple-converted-space">          </span>= 6819</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: DebugFlags<span class="m_-8276723749873139023Apple-converted-space">        </span>= (null)</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: DebugLevel<span class="m_-8276723749873139023Apple-converted-space">        </span>= 6</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: DebugLevelSyslog<span class="m_-8276723749873139023Apple-converted-space">  </span>= 10</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: DefaultQOS<span class="m_-8276723749873139023Apple-converted-space">        </span>= (null)</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: LogFile <span class="m_-8276723749873139023Apple-converted-space">          </span>= /var/log/slurm/slurmdbd.log</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: MessageTimeout<span class="m_-8276723749873139023Apple-converted-space">    </span>= 10</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: Parameters<span class="m_-8276723749873139023Apple-converted-space">        </span>= (null)</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: PidFile <span class="m_-8276723749873139023Apple-converted-space">          </span>= /var/spool/slurm/slurmdbd.pid</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: PluginDir <span class="m_-8276723749873139023Apple-converted-space">        </span>= /usr/lib64/slurm</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: PrivateData <span class="m_-8276723749873139023Apple-converted-space">      </span>= none</span></span></span></span></span><br></p><div style="font-size:16px"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: PurgeEventAfter <span class="m_-8276723749873139023Apple-converted-space">  </span>= NONE</span></span></span></span></span><br></div>
<p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: PurgeJobAfter <span class="m_-8276723749873139023Apple-converted-space">    </span>= NONE</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: PurgeResvAfter<span class="m_-8276723749873139023Apple-converted-space">    </span>= NONE</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: PurgeStepAfter<span class="m_-8276723749873139023Apple-converted-space">    </span>= NONE</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: PurgeSuspendAfter = NONE</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: PurgeTXNAfter = NONE</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: PurgeUsageAfter = NONE</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: SlurmUser <span class="m_-8276723749873139023Apple-converted-space">        </span>= slurm(982)</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: StorageBackupHost = (null)</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: StorageHost <span class="m_-8276723749873139023Apple-converted-space">      </span>= localhost</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: StorageLoc<span class="m_-8276723749873139023Apple-converted-space">        </span>= slurm_acct_db</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: StoragePort <span class="m_-8276723749873139023Apple-converted-space">      </span>= 3306</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: StorageType <span class="m_-8276723749873139023Apple-converted-space">      </span>= accounting_storage/mysql</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: StorageUser <span class="m_-8276723749873139023Apple-converted-space">      </span>= slurm</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: TCPTimeout<span class="m_-8276723749873139023Apple-converted-space">        </span>= 2</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: TrackWCKey<span class="m_-8276723749873139023Apple-converted-space">        </span>= 0</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: TrackSlurmctldDown= 0</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.958] debug2: acct_storage_p_get_connection: request new connection 1</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.974] slurmdbd version 18.08.1 started</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.986] debug2: running rollup at Thu Oct 11 20:33:11 2018</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:33:11.986] debug2: Everything rolled up</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:34:42.968] Terminate signal (SIGINT or SIGTERM) received</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[2018-10-11T20:34:42.969] debug:<span class="m_-8276723749873139023Apple-converted-space">  </span>rpc_mgr shutting down</span></span></span></span></span><br></p><div style="font-size:16px"><br></div>
<div style="font-size:16px">sacctmgr says:<br></div>
<p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[root@slmaster ~]# sacctmgr -vvvv</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">sacctmgr: Accounting storage SLURMDBD plugin loaded</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">sacctmgr: debug2: slurm_connect failed: Connection refused</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">sacctmgr: debug2: Error connecting slurm stream socket at <a href="http://127.0.0.1:6819" target="_blank">127.0.0.1:6819</a>: Connection refused</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">sacctmgr: error: slurm_persist_conn_open_without_init: failed to open persistent connection to slmaster:6819: Connection refused</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">sacctmgr: error: slurmdbd: Sending PersistInit msg: Connection refused</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">sacctmgr: error: Problem talking to the database: Connection refused</span></span></span></span></span><br></p><div style="font-size:16px"><br></div>
<div style="font-size:16px">I am able to connect to MariaDB locally using the above settings...<br></div>
<div style="font-size:16px"><br></div>
<p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[root@slmaster ~]# mysql -u slurm -h localhost -P 3306 -p</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">Enter password:<span class="m_-8276723749873139023Apple-converted-space"> </span></span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(231,236,237)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><b>Welcome to the MariaDB monitor.<span class="m_-8276723749873139023Apple-converted-space">  </span>Commands end with ; or \g.</b></span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(231,236,237)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><b>Your MariaDB connection id is 7</b></span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(231,236,237)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><b>Server version: 5.5.60-MariaDB MariaDB Server</b></span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal;min-height:16px"><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(231,236,237)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><b>Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.</b></span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal;min-height:16px"><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(231,236,237)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"><b>Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.</b></span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal;min-height:16px"><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">MariaDB [(none)]><span class="m_-8276723749873139023Apple-converted-space"> </span></span></span></span></span></span><br></p><div style="font-size:16px"><br></div>
<div style="font-size:16px">Config files are all attached. slurm.conf, slurmdbd.conf<br></div>
<div style="font-size:16px"><br></div>
<div style="font-size:16px">Mariadb configuration was not changed..<br></div>
<p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[mysqld]</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">datadir=/var/lib/mysql</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">socket=/var/lib/mysql/mysql.sock</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"># Disabling symbolic-links is recommended to prevent assorted security risks</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">symbolic-links=0</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"># Settings user and group are ignored when systemd is used.</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"># If you need to run mysqld under a different user or group,</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"># customize your systemd unit file for mariadb according to the</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"># instructions in <a href="http://fedoraproject.org/wiki/Systemd" target="_blank">http://fedoraproject.org/wiki/Systemd</a></span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal;min-height:16px"><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">[mysqld_safe]</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">log-error=/var/log/mariadb/mariadb.log</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">pid-file=/var/run/mariadb/mariadb.pid</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal;min-height:16px"><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">#</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures"># include all files from the config directory</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">#</span></span></span></span></span><br></p><p style="margin:0px;font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;line-height:normal"><span class="m_-8276723749873139023highlight" style="background-color:rgb(33,47,63)"><span class="m_-8276723749873139023colour" style="color:rgb(44,197,94)"><span class="m_-8276723749873139023font" style="font-family:Menlo"><span class="m_-8276723749873139023size" style="font-size:14px"><span style="font-variant-ligatures:no-common-ligatures">!includedir /etc/my.cnf.d</span></span></span></span></span><br></p><div style="font-size:16px"><br></div>
<div style="font-size:16px">Appreciate any help troubleshooting the "Connection refused" error.. <br></div>
<div style="font-size:16px"><br></div>
<div style="font-size:16px">Thanks,</div>
<div id="m_-8276723749873139023sig56753105"><div class="m_-8276723749873139023signature">--<br></div>
<div class="m_-8276723749873139023signature">  Aravindh Sampathkumar<br></div>
<div class="m_-8276723749873139023signature">  <a href="mailto:aravindh@fastmail.com" target="_blank">aravindh@fastmail.com</a><br></div>
<div class="m_-8276723749873139023signature"><br></div>
</div>
<div style="font-size:16px"><br></div>
</div>

</blockquote></div><br clear="all"><br>-- <br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div>------<br></div><div>'...postwork futures are dismissed with the claim that "it is not in our nature to be idle", thereby demonstrating at once an essentialist view of labor and an impoverished imagination of the possibilities of nonwork.'</div><div><br></div><div>Kathi Weeks, <a href="https://www.dukeupress.edu/The-Problem-with-Work/" target="_blank"><i>The Problem with Work: Feminism, Marxism, Antiwork Politics and Postwork Imaginaries</i></a><br></div></div></div></div></div></div></div></div></div></div></div></div></div>