<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p>You will need to also reinstall/restart slurmdbd with the updated
      binary.</p>
    <p>Look in the slurmdbd logs to see what is happening there. I
      suspect it had errors updating/creating the database and tables.
      If you have no data in it yet, you can just DROP the database and
      restart slurmdbd.</p>
    <p>Brian Andrus<br>
    </p>
    <div class="moz-cite-prefix">On 12/3/2021 6:42 AM, Giuseppe G. A.
      Celano wrote:<br>
    </div>
    <blockquote type="cite"
cite="mid:CANypsJTOWT5dW-MJWZXZjOGEYjcyFCPMdEwUHK3QLjA2aBWY9g@mail.gmail.com">
      <meta http-equiv="content-type" content="text/html; charset=UTF-8">
      <div dir="ltr">
        <div dir="ltr">
          <div class="gmail_default"
            style="font-family:verdana,sans-serif">Thanks for the
            answer, Brian. I now added 
            --with-mysql_config=/etc/mysql/my.cnf, but the problem is
            still there and now also slurmctld does not work, with the
            error:</div>
          <div class="gmail_default"
            style="font-family:verdana,sans-serif"><br>
          </div>
          <div class="gmail_default"
            style="font-family:verdana,sans-serif">[2021-12-03T15:36:41.018]
            accounting_storage/slurmdbd:
            clusteracct_storage_p_register_ctld: Registering slurmctld
            at port 6817 with slurmdbd<br>
            [2021-12-03T15:36:41.019] error: _conn_readable: persistent
            connection for fd 9 experienced error[104]: Connection reset
            by peer<br>
            [2021-12-03T15:36:41.019] error: _slurm_persist_recv_msg:
            only read 150 of 2613 bytes<br>
            [2021-12-03T15:36:41.019] error: Sending PersistInit msg: No
            error<br>
            [2021-12-03T15:36:41.020] error: _conn_readable: persistent
            connection for fd 9 experienced error[104]: Connection reset
            by peer<br>
            [2021-12-03T15:36:41.020] error: _slurm_persist_recv_msg:
            only read 150 of 2613 bytes<br>
            [2021-12-03T15:36:41.020] error: Sending PersistInit msg: No
            error<br>
            [2021-12-03T15:36:41.020] error: _conn_readable: persistent
            connection for fd 9 experienced error[104]: Connection reset
            by peer<br>
            [2021-12-03T15:36:41.020] error: _slurm_persist_recv_msg:
            only read 150 of 2613 bytes<br>
            [2021-12-03T15:36:41.020] error: Sending PersistInit msg: No
            error<br>
            [2021-12-03T15:36:41.020] error: DBD_GET_TRES failure: No
            error<br>
            [2021-12-03T15:36:41.021] error: _conn_readable: persistent
            connection for fd 9 experienced error[104]: Connection reset
            by peer<br>
            [2021-12-03T15:36:41.021] error: _slurm_persist_recv_msg:
            only read 0 of 2613 bytes<br>
            [2021-12-03T15:36:41.021] error: Sending PersistInit msg: No
            error<br>
            [2021-12-03T15:36:41.021] error: DBD_GET_QOS failure: No
            error<br>
            [2021-12-03T15:36:41.021] error: _conn_readable: persistent
            connection for fd 9 experienced error[104]: Connection reset
            by peer<br>
            [2021-12-03T15:36:41.021] error: _slurm_persist_recv_msg:
            only read 150 of 2613 bytes<br>
            [2021-12-03T15:36:41.021] error: Sending PersistInit msg: No
            error<br>
            [2021-12-03T15:36:41.021] error: DBD_GET_USERS failure: No
            error<br>
            [2021-12-03T15:36:41.022] error: _conn_readable: persistent
            connection for fd 9 experienced error[104]: Connection reset
            by peer<br>
            [2021-12-03T15:36:41.022] error: _slurm_persist_recv_msg:
            only read 0 of 2613 bytes<br>
            [2021-12-03T15:36:41.022] error: Sending PersistInit msg: No
            error<br>
            [2021-12-03T15:36:41.022] error: DBD_GET_ASSOCS failure: No
            error<br>
            [2021-12-03T15:36:41.022] error: _conn_readable: persistent
            connection for fd 9 experienced error[104]: Connection reset
            by peer<br>
            [2021-12-03T15:36:41.022] error: _slurm_persist_recv_msg:
            only read 0 of 2613 bytes<br>
            [2021-12-03T15:36:41.022] error: Sending PersistInit msg: No
            error<br>
            [2021-12-03T15:36:41.022] error: DBD_GET_RES failure: No
            error<br>
            [2021-12-03T15:36:41.022] fatal: You are running with a
            database but for some reason we have no TRES from it.  This
            should only happen if the database is down and you don't
            have any state files.</div>
          <div class="gmail_default"
            style="font-family:verdana,sans-serif"><br>
          </div>
          <br>
        </div>
        <br>
        <div class="gmail_quote">
          <div dir="ltr" class="gmail_attr">On Thu, Dec 2, 2021 at 10:36
            PM Brian Andrus <<a href="mailto:toomuchit@gmail.com"
              moz-do-not-send="true" class="moz-txt-link-freetext">toomuchit@gmail.com</a>>
            wrote:<br>
          </div>
          <blockquote class="gmail_quote" style="margin:0px 0px 0px
            0.8ex;border-left:1px solid
            rgb(204,204,204);padding-left:1ex">
            <div>
              <p><br>
              </p>
              <p>Your slurm needs built with the support. If you have
                mysql-devel installed it should pick it up, otherwise
                you can specify the location with --with-mysql when you
                configure/build slurm</p>
              <p>Brian Andrus<br>
              </p>
              <div>On 12/2/2021 12:40 PM, Giuseppe G. A. Celano wrote:<br>
              </div>
              <blockquote type="cite">
                <div dir="ltr">
                  <div>
                    <div><span style="font-family:verdana,sans-serif">Hi
                        everyone,<br>
                      </span></div>
                    <div><span style="font-family:verdana,sans-serif"><br>
                      </span></div>
                    <div><span style="font-family:verdana,sans-serif">I
                        am having trouble getting <i>slurmdbd</i> to
                        work. This is the error I get:</span></div>
                    <div><span style="font-family:verdana,sans-serif"><br>
                      </span></div>
                    <div><span style="font-family:verdana,sans-serif"><i>error:
                          Couldn't find the specified plugin name for
                          accounting_storage/mysql looking at all files<br>
                          error: cannot find accounting_storage plugin
                          for accounting_storage/mysql<br>
                          error: cannot create accounting_storage
                          context for accounting_storage/mysql<br>
                          fatal: Unable to initialize
                          accounting_storage/mysql accounting storage
                          plugin</i></span></div>
                    <div><span style="font-family:verdana,sans-serif"><br>
                      </span></div>
                    <div><span style="font-family:verdana,sans-serif">I
                        have installed <i>mysql</i> (<i>apt install
                          mysql</i>) on Ubuntu 20.04.03 and followed the
                        instructions on the slurm <a
                          href="https://slurm.schedmd.com/accounting.html"
                          target="_blank" moz-do-not-send="true">website</a>;
                        <i>mysql</i> is running (<i>port 3306</i>) and
                        these are the relevant parts in my <i>.conf</i>
                        files: <br>
                      </span></div>
                    <div><span style="font-family:verdana,sans-serif"><br>
                      </span></div>
                    <div><span style="font-family:verdana,sans-serif"><i>slurm.conf</i><br>
                      </span></div>
                    <div><span style="font-family:verdana,sans-serif"><br>
                      </span></div>
                    <div><span style="font-family:verdana,sans-serif">#
                        LOGGING AND ACCOUNTING<br>
                        AccountingStorageHost=</span><span
                        style="font-family:verdana,sans-serif">localhost<br>
                        AccountingStoragePort=3306<br>
                        AccountingStorageType=</span><span
                        style="font-family:verdana,sans-serif">accounting_storage/slurmdbd<br>
                        AccountingStorageUser=slurm<br>
                        JobCompType=jobcomp/none<br>
                        JobAcctGatherFrequency=30<br>
                        JobAcctGatherType=jobacct_</span><span
                        style="font-family:verdana,sans-serif">gather/linux<br>
                        SlurmctldDebug=info<br>
                        SlurmctldLogFile=/var/log/</span><span
                        style="font-family:verdana,sans-serif">slurmctld.log<br>
                        SlurmdDebug=info<br>
                        SlurmdLogFile=/var/log/slurmd.</span><span
                        style="font-family:verdana,sans-serif">log</span></div>
                    <div><span style="font-family:verdana,sans-serif"><br>
                      </span></div>
                    <div><span style="font-family:verdana,sans-serif"><i>slurmdbd.conf</i><br>
                      </span></div>
                    <div><span style="font-family:verdana,sans-serif"><br>
                      </span></div>
                    <div><span style="font-family:verdana,sans-serif">AuthType=auth/munge<br>
                        DbdAddr=localhost<br>
                        DbdHost=localhost<br>
                        DbdPort=3306<br>
                        LogFile=/var/log/slurmdbd.log<br>
                        PidFile=/var/run/slurmdbd.pid<br>
                        PluginDir=/usr/lib/slurm<br>
                        SlurmUser=slurm<br>
                        StoragePass=password<br>
                        StorageType=accounting_</span><span
                        style="font-family:verdana,sans-serif">storage/mysql<br>
                        StorageUser=slurm <br>
                        StorageLoc=slurm_acct_db</span></div>
                    <div><span style="font-family:verdana,sans-serif"><br>
                      </span></div>
                    <div><span style="font-family:verdana,sans-serif">I
                        changed the port to 3306 because otherwise <i>slurmdbd
                        </i>could not communicate with <i>mysql</i>. If
                        I run <i>sacct</i>, for example, I get:</span></div>
                    <div><span style="font-family:verdana,sans-serif"><br>
                      </span></div>
                    <div><span style="font-family:verdana,sans-serif"><i>sacct:
                          error: _slurm_persist_recv_msg: read of fd 3
                          failed: No error<br>
                          sacct: error: _slurm_persist_recv_msg: only
                          read 126 of 2616 bytes<br>
                          sacct: error: slurm_persist_conn_open: No
                          response to persist_init<br>
                          sacct: error: Sending PersistInit msg: No
                          error<br>
                          JobID           JobName  Partition    Account
                           AllocCPUS      State ExitCode <br>
                          ------------ ---------- ---------- ----------
                          ---------- ---------- -------- <br>
                          sacct: error: _slurm_persist_recv_msg: read of
                          fd 3 failed: No error<br>
                          sacct: error: _slurm_persist_recv_msg: only
                          read 126 of 2616 bytes<br>
                          sacct: error: Sending PersistInit msg: No
                          error<br>
                          sacct: error: DBD_GET_JOBS_COND failure:
                          Unspecified error</i></span></div>
                    <div><span style="font-family:verdana,sans-serif"><i><br>
                        </i></span></div>
                    <div><span style="font-family:verdana,sans-serif">Does
                        anyone have a suggestion to solve this problem?
                        Thank you very much.</span></div>
                    <div><span style="font-family:verdana,sans-serif"><br>
                      </span></div>
                    <div><span style="font-family:verdana,sans-serif">Best,</span></div>
                    <div><span style="font-family:verdana,sans-serif">Giuseppe</span></div>
                  </div>
                </div>
              </blockquote>
            </div>
          </blockquote>
        </div>
      </div>
    </blockquote>
  </body>
</html>