G'Day all,
I have 3 years worth of job records in the slurm DB and we do not have any need to actually track anything at this stage, I would like to keep 12months worth of jobs so I need to purge 2 years worth at some point..
Is there a command to issue via scontrol to kick off a SlurmPurge using the values in the slurmdbd.conf file (currently these are 1000days, so I can see a few dozen records disappear before I shorten it to 365days in incremental steps).
Sid
Hi Sid,
On 8/22/24 02:04, Sid Young via slurm-users wrote:
I have 3 years worth of job records in the slurm DB and we do not have any need to actually track anything at this stage, I would like to keep 12months worth of jobs so I need to purge 2 years worth at some point..
Is there a command to issue via scontrol to kick off a SlurmPurge using the values in the slurmdbd.conf file (currently these are 1000days, so I can see a few dozen records disappear before I shorten it to 365days in incremental steps).
You need to set database purge parameters in slurmdbd.conf, but do it in increments first as explained in this Wiki page: https://wiki.fysik.dtu.dk/Niflheim_system/Slurm_database/#setting-database-p...
IHTH, Ole
Yep, done that today, I will check in the morning if any records disappeared overnight and then reduce again. Was hoping that I could trigger it and monitor the output.
Sid
On Thu, 22 Aug 2024, 18:11 Ole Holm Nielsen via slurm-users, < slurm-users@lists.schedmd.com> wrote:
Hi Sid,
On 8/22/24 02:04, Sid Young via slurm-users wrote:
I have 3 years worth of job records in the slurm DB and we do not have
any
need to actually track anything at this stage, I would like to keep 12months worth of jobs so I need to purge 2 years worth at some point..
Is there a command to issue via scontrol to kick off a SlurmPurge using the values in the slurmdbd.conf file (currently these are 1000days, so I can see a few dozen records disappear before I shorten it to 365days in incremental steps).
You need to set database purge parameters in slurmdbd.conf, but do it in increments first as explained in this Wiki page:
https://wiki.fysik.dtu.dk/Niflheim_system/Slurm_database/#setting-database-p...
IHTH, Ole
-- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-leave@lists.schedmd.com
Hi Sid,
The slurmdbd triggers purges as explained in the Wiki page:
The purge operation is done at the start of each time interval (see bug_4295), which means on the 1st day of the month in this example. Monthly, daily or even hourly purge operations would occur when using different time units for the same interval:
PurgeStepAfter=2months PurgeStepAfter=60days PurgeStepAfter=1440hours
So you have to wait for 1 day if you have set 1000days before seeing log lines in slurmdbd.log.
/Ole
On 8/22/24 11:09, Sid Young wrote:
Yep, done that today, I will check in the morning if any records disappeared overnight and then reduce again. Was hoping that I could trigger it and monitor the output.
Sid
On Thu, 22 Aug 2024, 18:11 Ole Holm Nielsen via slurm-users, <slurm-users@lists.schedmd.com mailto:slurm-users@lists.schedmd.com> wrote:
Hi Sid, On 8/22/24 02:04, Sid Young via slurm-users wrote: > I have 3 years worth of job records in the slurm DB and we do not have any > need to actually track anything at this stage, I would like to keep > 12months worth of jobs so I need to purge 2 years worth at some point.. > > Is there a command to issue via scontrol to kick off a SlurmPurge using > the values in the slurmdbd.conf file (currently these are 1000days, so I > can see a few dozen records disappear before I shorten it to 365days in > incremental steps). You need to set database purge parameters in slurmdbd.conf, but do it in increments first as explained in this Wiki page: https://wiki.fysik.dtu.dk/Niflheim_system/Slurm_database/#setting-database-purge-parameters <https://wiki.fysik.dtu.dk/Niflheim_system/Slurm_database/#setting-database-purge-parameters>
Ahh .. ok that explains it a bit better, thx so tomorrow morning it should drop my initial test jobs when I started this cluster 3 years ago. :)
Sid
On Thu, 22 Aug 2024, 19:24 Ole Holm Nielsen, Ole.H.Nielsen@fysik.dtu.dk wrote:
Hi Sid,
The slurmdbd triggers purges as explained in the Wiki page:
The purge operation is done at the start of each time interval (see bug_4295), which means on the 1st day of the month in this example. Monthly, daily or even hourly purge operations would occur when using different time units for the same interval:
PurgeStepAfter=2months PurgeStepAfter=60days PurgeStepAfter=1440hours
So you have to wait for 1 day if you have set 1000days before seeing log lines in slurmdbd.log.
/Ole
On 8/22/24 11:09, Sid Young wrote:
Yep, done that today, I will check in the morning if any records disappeared overnight and then reduce again. Was hoping that I could trigger it and monitor the output.
Sid
On Thu, 22 Aug 2024, 18:11 Ole Holm Nielsen via slurm-users, <slurm-users@lists.schedmd.com mailto:slurm-users@lists.schedmd.com>
wrote:
Hi Sid, On 8/22/24 02:04, Sid Young via slurm-users wrote: > I have 3 years worth of job records in the slurm DB and we do not have any > need to actually track anything at this stage, I would like tokeep
> 12months worth of jobs so I need to purge 2 years worth at somepoint..
> > Is there a command to issue via scontrol to kick off a SlurmPurge using > the values in the slurmdbd.conf file (currently these are1000days,
so I > can see a few dozen records disappear before I shorten it to 365days in > incremental steps). You need to set database purge parameters in slurmdbd.conf, but doit in
increments first as explained in this Wiki page:https://wiki.fysik.dtu.dk/Niflheim_system/Slurm_database/#setting-database-p... < https://wiki.fysik.dtu.dk/Niflheim_system/Slurm_database/#setting-database-p...
-
Ole Holm Nielsen -
Sid Young