[slurm-users] [External] Different max number of jobs in individual and array jobs

[Prentice Bisbal]

II know I'm a few weeks late with this response. I actually looked into 
this 4-6 weeks ago. According to the Slurm documenntation, an individual 
job step counts as a job when evaluating job limits. Pay attention to 
the note in the documenation below. From 
https://slurm.schedmd.com/slurm.conf.html:

> *MaxJobCount*
>     The maximum number of jobs Slurm can have in its active database
>     at one time. Set the values of *MaxJobCount* and *MinJobAge* to
>     ensure the slurmctld daemon does not exhaust its memory or other
>     resources. Once this limit is reached, requests to submit
>     additional jobs will fail. The default value is 10000 jobs. NOTE:
>     Each task of a job array counts as one job even though they will
>     not occupy separate job records until modified or initiated.
>


Prentice

On 6/3/21 11:12 AM, Shaohao Chen wrote:
>
> Hi,
>
> We use Slurm on our cluster and set a max number of all jobs. But we 
> would want to implement this: N concurrent individual jobs and M 
> concurrent jobs in all job arrays (e.g. m job arrays with n jobs in 
> each and M=n*m), and M is much larger than N. I have read the Slurm 
> documentation, but cannot find a way to separate the individual jobs 
> and jobs in arrays. Does anyone know how to do that?
>
> Thank you.
>
> Shaohao
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20210617/5afe459b/attachment.htm>