<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
That's great advice. Thank you Ole.</div>
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
<br>
</div>
<div style="font-family: Arial, Helvetica, sans-serif; font-size: 10pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
--Mick</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> slurm-users <slurm-users-bounces@lists.schedmd.com> on behalf of Ole Holm Nielsen <Ole.H.Nielsen@fysik.dtu.dk><br>
<b>Sent:</b> Friday, July 15, 2022 2:04 AM<br>
<b>To:</b> slurm-users@lists.schedmd.com <slurm-users@lists.schedmd.com><br>
<b>Subject:</b> Re: [slurm-users] SlurmDB Archive settings?</font>
<div> </div>
</div>
<div class="BodyFragment"><font size="2"><span style="font-size:11pt;">
<div class="PlainText">On 7/14/22 18:49, Timony, Mick wrote:<br>
> Which database server and version do you run, MySQL or MariaDB? What's<br>
> your Slurm version?<br>
> <br>
> mariadb 5.5.68 and a patched version of slurm 21.08.7<br>
<br>
We run the same MariaDB on CentOS 7.9, and Slurm 21.08.8-2.<br>
<br>
> Did you already make appropriate database purges to reduce the size? I<br>
> have some notes in my Wiki page<br>
> <a href="https://wiki.fysik.dtu.dk/niflheim/Slurm_database#setting-database-purge-parameters">
https://wiki.fysik.dtu.dk/niflheim/Slurm_database#setting-database-purge-parameters</a><br>
> <<a href="https://wiki.fysik.dtu.dk/niflheim/Slurm_database#setting-database-purge-parameters">https://wiki.fysik.dtu.dk/niflheim/Slurm_database#setting-database-purge-parameters</a>><br>
> <br>
> No, we have not made any changes yet as am concerned that it will cause <br>
> performance issues.<br>
<br>
IMHO, database purging is an important way to *improve* the performance! <br>
Reducing the database size is beneficial, also for making the daily <br>
database dump faster. As I wrote in the above Wiki page, you should <br>
introduce purging very gently and decrease the purging intervals in small <br>
steps over a number of weeks:<br>
<br>
> A monthly purge operation can be a huge amount of work for a database depending on its size, and you certainly want to cut down the amount of work required during the purges. If you did not use purges before, it is probably a good idea to try out a series
of daily purges starting with:<br>
> <br>
> PurgeEventAfter=2000days<br>
> PurgeJobAfter=2000days<br>
> PurgeResvAfter=2000days<br>
> PurgeStepAfter=2000days<br>
> PurgeSuspendAfter=2000days<br>
> <br>
> If this works well over a few days, decrease the purge interval 2000days little by little and try again (1800, 1500, etc) until you after many iterations come down to the desired final purge intervals.<br>
<br>
Please note that it's acceptable for the slurmdbd to be slow, or even down <br>
for many hours. The slurmctld will cache all data (up to a certain limit) <br>
while the slurmdbd is not responding.<br>
<br>
/Ole<br>
<br>
<br>
</div>
</span></font></div>
</body>
</html>