[slurm-users] Rate-limiting sbatch and srun

[Ole Holm Nielsen]

On 7/19/22 00:45, gphipps wrote:
> Hi
> 
> Everyone so often one of our users accidentally writes a “fork-bomb” that 
> submits thousands of sbatch and srun requests per second. It is a giant 
> DDOS attack on our scheduler. Is there a way of rate limiting these 
> requests before they reach the daemon? I could imagine writing a shim in 
> front of sbatch/srun, but I was hoping there was an official way to do this

Perhaps setting MaxSubmitJobs and MaxJobs on associations and QOSes would 
do the trick?

You may also want to increase the default MaxJobCount in slurm.conf.

See my Wiki page for the details: 
https://wiki.fysik.dtu.dk/niflheim/Slurm_configuration#maxjobcount-limit

/Ole