<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div class="elementToProof">
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0">
This ticket with SchedMD implies it's a munged issue:<br>
<br>
</div>
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0">
<a href="https://bugs.schedmd.com/show_bug.cgi?id=1293" id="LPlnk979866">https://bugs.schedmd.com/show_bug.cgi?id=1293</a><br>
</div>
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0">
<br>
</div>
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0">
Is the munge daemon running on all systems? If it is, are all servers running a network time daemon such chronyd or ntpd and the time is in sync on all hosts?</div>
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0">
<br>
</div>
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0">
Regards</div>
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0">
--Mick</div>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> slurm-users <slurm-users-bounces@lists.schedmd.com> on behalf of Craig Stark <cestark@ad.uci.edu><br>
<b>Sent:</b> Monday, January 8, 2024 1:51 PM<br>
<b>To:</b> slurm-users@lists.schedmd.com <slurm-users@lists.schedmd.com><br>
<b>Subject:</b> Re: [slurm-users] DBD_SEND_MULT_MSG - invalid uid error</font>
<div> </div>
</div>
<style type="text/css" style="display:none">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div dir="ltr">
<div id="x_appendonsend"></div>
<div class="x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">3rd</span><span style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)"> time
trying to get this to come through to the list - hopefully this time works.</span><br>
</div>
<div dir="ltr">
<div class="x_x_elementToProof">
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span><br>
</span></div>
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span><span class="x_x_x_elementToProof" style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)"><span class="x_x_ContentPasted1" style="font-size:12pt; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; margin:0px; color:rgb(0,0,0)">I've
been running<span class="x_x_ContentPasted1"> </span><span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">SLURM</span><span class="x_x_ContentPasted1"> </span>for several
years now, but in setting it up on a new cluster, I'm hitting a recurring issue. I'm using a MariaDB and configured it just as I had in my several-year-ago setup and in the docs. There's a "<span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">slurm</span>"
user (59999) on the OS (Rocky 9), that's on all the nodes, and I've added the<span class="x_x_ContentPasted1"> </span><span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">slurm</span>@localhost
as instructed (grant all on<span class="x_x_ContentPasted1"> </span><span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">slurm</span>_acct_db.* TO '<span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">slurm</span>'@'localhost'
identified by 'PASSWORD'). But, I keep getting things like this:</span></span>
<div class="x_x_x_elementToProof" style="font-size:12pt; margin:0px; background-color:rgb(255,255,255)">
<br class="x_x_ContentPasted1">
</div>
<div class="x_x_x_elementToProof x_x_ContentPasted1" style="font-size:12pt; margin:0px; background-color:rgb(255,255,255)">
```</div>
<div class="x_x_x_elementToProof" style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span class="x_x_ContentPasted1" style="font-size:12pt; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; margin:0px; color:rgb(0,0,0)">Dec 22 14:22:07 kirby<span class="x_x_ContentPasted1"> </span><span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">slurm</span>dbd[14518]:<span class="x_x_ContentPasted1"> </span><span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">slurm</span>dbd:
error: DBD_SEND_MULT_MSG message from invalid uid 59999</span></div>
<div style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span class="x_x_ContentPasted1" style="font-size:12pt; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; margin:0px; color:rgb(0,0,0)">Dec 22 14:22:07 kirby<span class="x_x_ContentPasted1"> </span><span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">slurm</span>dbd[14518]:<span class="x_x_ContentPasted1"> </span><span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">slurm</span>dbd:
error: Processing last message from connection 7(192.168.1.2) uid(59999)</span></div>
<div class="x_x_x_elementToProof" style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span class="x_x_ContentPasted1" style="font-size:12pt; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; margin:0px; color:rgb(0,0,0)">Dec 22 14:22:07 kirby<span class="x_x_ContentPasted1"> </span><span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">slurm</span>dbd[14518]:<span class="x_x_ContentPasted1"> </span><span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">slurm</span>dbd:
error: CONN:7 DBD_REGISTER_CTLD message from invalid uid 59999</span></div>
<div style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span class="x_x_ContentPasted1" style="font-size:12pt; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; margin:0px; color:rgb(0,0,0)">Dec 22 14:22:07 kirby<span class="x_x_ContentPasted1"> </span><span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">slurm</span>dbd[14518]:<span class="x_x_ContentPasted1"> </span><span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">slurm</span>dbd:
error: CONN:7 Security violation, DBD_REGISTER_CTLD</span></div>
<div class="x_x_x_elementToProof" style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span class="x_x_ContentPasted1" style="font-size:12pt; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; margin:0px; color:rgb(0,0,0)">Dec 22 14:22:07 kirby<span class="x_x_ContentPasted1"> </span><span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">slurm</span>dbd[14518]:<span class="x_x_ContentPasted1"> </span><span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">slurm</span>dbd:
error: Processing last message from connection 7(192.168.1.2) uid(59999)</span></div>
<div class="x_x_x_elementToProof x_x_ContentPasted1" style="font-size:12pt; margin:0px; background-color:rgb(255,255,255)">
```</div>
<div class="x_x_x_elementToProof" style="font-size:12pt; margin:0px; background-color:rgb(255,255,255)">
<br class="x_x_ContentPasted1">
</div>
<div class="x_x_x_elementToProof x_x_ContentPasted1" style="font-size:12pt; margin:0px; background-color:rgb(255,255,255)">
I'm a total SQL noob, but can at least verify that the user is in there:</div>
<div class="x_x_x_elementToProof" style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span class="x_x_ContentPasted1" style="font-size:12pt; font-family:"Aptos Mono",Aptos_EmbeddedFont,Aptos_MSFontService,monospace; margin:0px; color:rgb(0,0,0)">MariaDB [(none)]> SELECT User, Host, Password FROM mysql.user;</span></div>
<div style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span class="x_x_ContentPasted1" style="font-size:12pt; font-family:"Aptos Mono",Aptos_EmbeddedFont,Aptos_MSFontService,monospace; margin:0px; color:rgb(0,0,0)">+-------------+-----------+-------------------------------------------+</span></div>
<div style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span class="x_x_ContentPasted1" style="font-size:12pt; font-family:"Aptos Mono",Aptos_EmbeddedFont,Aptos_MSFontService,monospace; margin:0px; color:rgb(0,0,0)">| User | Host | Password |</span></div>
<div style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span class="x_x_ContentPasted1" style="font-size:12pt; font-family:"Aptos Mono",Aptos_EmbeddedFont,Aptos_MSFontService,monospace; margin:0px; color:rgb(0,0,0)">+-------------+-----------+-------------------------------------------+</span></div>
<div style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span class="x_x_ContentPasted1" style="font-size:12pt; font-family:"Aptos Mono",Aptos_EmbeddedFont,Aptos_MSFontService,monospace; margin:0px; color:rgb(0,0,0)">| mariadb.sys | localhost | |</span></div>
<div style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span class="x_x_ContentPasted1" style="font-size:12pt; font-family:"Aptos Mono",Aptos_EmbeddedFont,Aptos_MSFontService,monospace; margin:0px; color:rgb(0,0,0)">| root | localhost | invalid |</span></div>
<div style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span class="x_x_ContentPasted1" style="font-size:12pt; font-family:"Aptos Mono",Aptos_EmbeddedFont,Aptos_MSFontService,monospace; margin:0px; color:rgb(0,0,0)">| mysql | localhost | invalid |</span></div>
<div style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span class="x_x_ContentPasted1" style="font-size:12pt; font-family:"Aptos Mono",Aptos_EmbeddedFont,Aptos_MSFontService,monospace; margin:0px; color:rgb(0,0,0)">|<span class="x_x_ContentPasted1"> </span><span data-markjs="true" class="x_x_markd61dhdyle x_x_ContentPasted1" data-ogac="" data-ogab="" data-ogsc="" data-ogsb="" style="margin:0px">slurm</span><span class="x_x_ContentPasted1"> </span>
| localhost | *D6665ECF4F3CB12BCA836117F7727B6D0B78D644 |</span></div>
<div style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span class="x_x_ContentPasted1" style="font-size:12pt; font-family:"Aptos Mono",Aptos_EmbeddedFont,Aptos_MSFontService,monospace; margin:0px; color:rgb(0,0,0)">+-------------+-----------+-------------------------------------------+</span></div>
<div class="x_x_x_elementToProof" style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span class="x_x_ContentPasted1" style="font-size:12pt; font-family:"Aptos Mono",Aptos_EmbeddedFont,Aptos_MSFontService,monospace; margin:0px; color:rgb(0,0,0)">4 rows in set (0.002 sec)</span></div>
<div class="x_x_x_elementToProof" style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)">
<span style="font-size:12pt; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; margin:0px; color:rgb(0,0,0)"><br class="x_x_ContentPasted1">
</span></div>
<span class="x_x_x_elementToProof" style="font-size:15px; margin:0px; color:rgb(36,36,36); background-color:rgb(255,255,255)"><span class="x_x_ContentPasted1" style="font-size:12pt; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; margin:0px; color:rgb(0,0,0)">Any
thoughts as to where I might look to fix this?</span></span><br class="x_x_Apple-interchange-newline x_x_ContentPasted1">
<br>
</span></div>
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span>Craig</span></div>
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span><br>
</span></div>
</div>
</div>
</div>
</body>
</html>