[slurm-users] Different max number of jobs in individual and array jobs
Sebastian T Smith
stsmith at unr.edu
Mon Jun 7 17:00:23 UTC 2021
This doesn't solve your problem but might be an option:
In similar cases, we instruct our users to create `n` Jobs of `m` Steps. Some experimentation may be required to determine the number of Steps to maximize Job run time without hitting your limits. Our max limit is 14 days, so this pattern has been easy for users to implement.
[University of Nevada, Reno]<http://www.unr.edu/>
High-Performance Computing Engineer
Office of Information Technology
1664 North Virginia Street
email: stsmith at unr.edu<mailto:stsmith at unr.edu>
From: slurm-users <slurm-users-bounces at lists.schedmd.com> on behalf of Brian Andrus <toomuchit at gmail.com>
Sent: Thursday, June 3, 2021 10:16 AM
To: slurm-users at lists.schedmd.com <slurm-users at lists.schedmd.com>
Subject: Re: [slurm-users] Different max number of jobs in individual and array jobs
Array jobs are individual jobs that have been grouped. Underneath, they each have their own jobid besides the grouped array jobid.
Not sure there is an easy way to pull what you are looking to do.
On 6/3/2021 8:12 AM, Shaohao Chen wrote:
We use Slurm on our cluster and set a max number of all jobs. But we would want to implement this: N concurrent individual jobs and M concurrent jobs in all job arrays (e.g. m job arrays with n jobs in each and M=n*m), and M is much larger than N. I have read the Slurm documentation, but cannot find a way to separate the individual jobs and jobs in arrays. Does anyone know how to do that?
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the slurm-users