[slurm-users] [External] Different max number of jobs in individual and array jobs

[Prentice Bisbal]

... to complete my thought, I don't think what you want to do is 
possible. If M is the number of job steps, and N is total jobs, M cannot 
be greater than N.

Prentice

On 6/17/21 3:24 PM, Prentice Bisbal wrote:
>
> II know I'm a few weeks late with this response. I actually looked 
> into this 4-6 weeks ago. According to the Slurm documenntation, an 
> individual job step counts as a job when evaluating job limits. Pay 
> attention to the note in the documenation below. From 
> https://slurm.schedmd.com/slurm.conf.html:
>
>> *MaxJobCount*
>>     The maximum number of jobs Slurm can have in its active database
>>     at one time. Set the values of *MaxJobCount* and *MinJobAge* to
>>     ensure the slurmctld daemon does not exhaust its memory or other
>>     resources. Once this limit is reached, requests to submit
>>     additional jobs will fail. The default value is 10000 jobs. NOTE:
>>     Each task of a job array counts as one job even though they will
>>     not occupy separate job records until modified or initiated.
>>
>
>
> Prentice
> On 6/3/21 11:12 AM, Shaohao Chen wrote:
>>
>> Hi,
>>
>> We use Slurm on our cluster and set a max number of all jobs. But we 
>> would want to implement this: N concurrent individual jobs and M 
>> concurrent jobs in all job arrays (e.g. m job arrays with n jobs in 
>> each and M=n*m), and M is much larger than N. I have read the Slurm 
>> documentation, but cannot find a way to separate the individual jobs 
>> and jobs in arrays. Does anyone know how to do that?
>>
>> Thank you.
>>
>> Shaohao
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20210617/ea7d0118/attachment.htm>