[slurm-users] Rate-limiting sbatch and srun

Ole Holm Nielsen Ole.H.Nielsen at fysik.dtu.dk
Tue Jul 19 06:15:51 UTC 2022


On 7/19/22 00:45, gphipps wrote:
> Hi
> 
> Everyone so often one of our users accidentally writes a “fork-bomb” that 
> submits thousands of sbatch and srun requests per second. It is a giant 
> DDOS attack on our scheduler. Is there a way of rate limiting these 
> requests before they reach the daemon? I could imagine writing a shim in 
> front of sbatch/srun, but I was hoping there was an official way to do this

Perhaps setting MaxSubmitJobs and MaxJobs on associations and QOSes would 
do the trick?

You may also want to increase the default MaxJobCount in slurm.conf.

See my Wiki page for the details: 
https://wiki.fysik.dtu.dk/niflheim/Slurm_configuration#maxjobcount-limit

/Ole



More information about the slurm-users mailing list