[slurm-users] Use all cores when submitting to heterogeneous nodes

[Brian Andrus]

You are putting the cart before the horse here. While you can get access 
to all the node using --exclusive, when you request cores, you will not 
know if you have more. For example you request 80 cores and land on a 40 
and a 48 with exclusive access. You would need to do some sort of 
discovery to know what is available versus what you asked for. When 
using exclusive, it becomes more like "I want at least X cores" and you 
get "Ok, here are X cores or more"

Within your script, you could check for total cores. something like 
'srun lscpu' and parse the output.

Brian Andrus


On 3/22/2022 7:29 AM, Richard Ems wrote:
> Hi all,
>
> I am looking for an option to use all cores when submitting to 
> heterogeneous nodes.
> In this case I have 2 partitions:
> part1:  #N1 nodes, each node has 40 cores
> part2:  #N2 nodes, each node has 48 cores
>
> I want to submit to both partitions, requesting a number of nodes and 
> then set
> --ntasks=40*#nodes
>  or
> --ntasks=48*#nodes
> depending on which partition gets selected by Slurm.
> Can this be done?
>
> An option similar to --ntasks=USE_ALL_CORES would be great.
>
> Many thanks,
> Richard
>
> -- 
> Richard Ems     /     aiduit     / r.ems at aiduit.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20220322/e0121c18/attachment.htm>