[slurm-users] Keep CPU Jobs Off GPU Nodes

[Wagner, Marcus]

Hi Frank,

use Features on the nodes, every cpu node gets e.g. "cpu", every gpu 
node e.g. "gpu".

If a job asks for no gpus, set an additional constraint "cpu" for the job.


Best
Marcus

Am 29.03.2023 um 01:24 schrieb Frank Pari:
> Well, I wanted to avoid using lua.  But, it looks like that's going to 
> be the easiest way to do this without having to create a separate 
> partition for the GPUs.  Basically, check for at least one gpu in the 
> job submission and if none exclude all GPU nodes for the job.
>
> image.png
>
> Now I'm wondering how to auto-gen the list of nodes with GPUs, so I 
> don't have to remember to update job_submit.lua everytime we get new 
> GPU nodes.
>
> -F
>
> On Tue, Mar 28, 2023 at 4:06 PM Frank Pari <parif at bc.edu> wrote:
>
>     Hi all,
>
>     First, thank you all for participating in this list. I've learned
>     so much by just following in other's threads.  =)
>
>     I'm looking at creating a scavenger partition with idle resources
>     from CPU and GPU nodes and I'd like to keep this to one
>     partition.  But, I don't want CPU only jobs using up resources on
>     the GPU nodes.
>
>     I've seen suggestions for job/lua scripts.  But, I'm wondering if
>     there's any other way to ensure a job has requested at least 1 gpu
>     for the scheduler to assign that job to a GPU node.
>
>     Thanks in advance!
>
>     -Frank
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20230329/4f84d089/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 41602 bytes
Desc: not available
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20230329/4f84d089/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 5326 bytes
Desc: S/MIME Cryptographic Signature
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20230329/4f84d089/attachment-0001.bin>