Hi Loris,

I have different kind of GPU's in same node , and I beleive feature applies to particular node , and cant be applied to only a few GPU's connected to a single node.

On Mon, 18 Dec 2023, 12:14 Loris Bennett, loris.bennett@fu-berlin.de wrote:

Hi Minu,

Minulakshmi S minulakshmi.s@gmail.com writes:

...

I'm submitting jobs to a cluster via SLURM scheduler, and let's say I

have access to 8 GPUs in my cluster in same node. They are GPUs of type A,B,C,D,E,F,G,H. I

...

would like to submit a job that requests the use of GPUs of type A or B

or C but NOT of type D/E/F/G/H. So I need some type of OR logic with the --gres flag.

...

Eg : When I request GPU of type A , I can do sbatch –gres=gpu:TypeA:1,

I need to input a subset of GPU’s and let slurm schedule job utilizing one of the GPU

...

from this allowed list.

Regards Minu

Assuming the GPUs within a node are all of the same type, could you define a feature for each GPU type, assign the features to the appropriate nodes, and then run the job with

--contraint=gpu_TypeA --gres=gpu:1

?

This is obviously rather clunky and it would be much nicer if multiple GPUs types passed to '--gres' were ORed.

Cheers,

Loris

-- Dr. Loris Bennett (Herr/Mr) ZEDAT, Freie Universität Berlin