Hi Loris, I have different kind of GPU's in same node , and I beleive feature applies to particular node , and cant be applied to only a few GPU's connected to a single node. On Mon, 18 Dec 2023, 12:14 Loris Bennett, <loris.bennett@fu-berlin.de> wrote:

Hi Minu,

Minulakshmi S <minulakshmi.s@gmail.com> writes:

...

I'm submitting jobs to a cluster via SLURM scheduler, and let's say I have access to 8 GPUs in my cluster in same node. They are GPUs of type A,B,C,D,E,F,G,H. I would like to submit a job that requests the use of GPUs of type A or B or C but NOT of type D/E/F/G/H. So I need some type of OR logic with the --gres flag.

Eg : When I request GPU of type A , I can do sbatch –gres=gpu:TypeA:1, I need to input a subset of GPU’s and let slurm schedule job utilizing one of the GPU from this allowed list.

Regards Minu

Assuming the GPUs within a node are all of the same type, could you define a feature for each GPU type, assign the features to the appropriate nodes, and then run the job with

--contraint=gpu_TypeA --gres=gpu:1

?

This is obviously rather clunky and it would be much nicer if multiple GPUs types passed to '--gres' were ORed.

Cheers,

Loris

-- Dr. Loris Bennett (Herr/Mr) ZEDAT, Freie Universität Berlin