[slurm-users] Use all cores when submitting to heterogeneous nodes

Brian Andrus toomuchit at gmail.com
Tue Mar 22 15:17:59 UTC 2022

You are putting the cart before the horse here. While you can get access 
to all the node using --exclusive, when you request cores, you will not 
know if you have more. For example you request 80 cores and land on a 40 
and a 48 with exclusive access. You would need to do some sort of 
discovery to know what is available versus what you asked for. When 
using exclusive, it becomes more like "I want at least X cores" and you 
get "Ok, here are X cores or more"

Within your script, you could check for total cores. something like 
'srun lscpu' and parse the output.

Brian Andrus

On 3/22/2022 7:29 AM, Richard Ems wrote:
> Hi all,
> I am looking for an option to use all cores when submitting to 
> heterogeneous nodes.
> In this case I have 2 partitions:
> part1:  #N1 nodes, each node has 40 cores
> part2:  #N2 nodes, each node has 48 cores
> I want to submit to both partitions, requesting a number of nodes and 
> then set
> --ntasks=40*#nodes
>  or
> --ntasks=48*#nodes
> depending on which partition gets selected by Slurm.
> Can this be done?
> An option similar to --ntasks=USE_ALL_CORES would be great.
> Many thanks,
> Richard
> -- 
> Richard Ems     /     aiduit     / r.ems at aiduit.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20220322/e0121c18/attachment.htm>

More information about the slurm-users mailing list