[slurm-users] [EXTERNAL] SlurmDBD losing connection to the backend MariaDB

[Richard Chang]

Hello Greg,

I have a two node set up. node1 is primary slurmctld + backup slurmdbd 
and node2 is primary slurmdbd + backup slurmctld and mysql database host.

  My concern is if node 2 goes down, then the backup slurmdbd will take 
over, then what will happen ?

I have read that slurmctld can cache data, but what about slurmdbd? Not 
sure.

I have intentionally used the slurmdbd + mariadb in the second node 
because I didn't want to overload the primary slurmctld.

I hope you all are getting the picture of how my set up is.

Thanks,

RC


On 11/1/2022 10:40 AM, Greg Wickham wrote:
>
> Hi Richard,
>
> Slurmctld caches the updates until slurmdbd comes back online.
>
> You can see how many records are pending for the database by using the 
> “sdiag” command and looking for “DBD Agent queue size”.
>
> If this number grows significantly it means that slurmdbd isn’t available.
>
> -Greg
>
> On 01/11/2022, 07:23, "slurm-users" 
> <slurm-users-bounces at lists.schedmd.com> wrote:
>
> Hi,
>
> Just for my info, I would like to know what happens when SlurmDBD loses
> connection to the backend Database, for ex, MariaDB.
>
> Does it cache the accounting info and keep them till the DB comes back
> up ?, or does it panic and shut down ?
>
> Thank you,
>
> RC.
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20221101/4f23a363/attachment.htm>