[slurm-users] Limit number of CPU in a partition
Nicolò Parmiggiani
nicolo.parmiggiani at gmail.com
Tue Jan 2 10:28:49 MST 2018
I have only one server and two data analysis pipelines, one for standard
jobs and other one for high priority job that can be triggered sometimes.
My first solution was to split the CPU of the server in two partition, one
for each pipeline.
A more complex (but i suppose better) solution could be to use one
partition and manage the priority of the two pipeline and when i get jobs
from high priority pipeline those jobs must start immediately, temporarily
blocking standard jobs.
What solution do you recommend? And how can I implement it?
Thank You.
2018-01-02 13:33 GMT+01:00 Ole Holm Nielsen <Ole.H.Nielsen at fysik.dtu.dk>:
> On 01/02/2018 12:59 PM, Nicolò Parmiggiani wrote:
>
>> My problem is that i have for instance 100 CPU, and i want to create two
>> partition each with 50 CPU maximum usage. In this way i can submit job to
>> both partitions independently.
>>
>
> I wonder what you really want to achieve? Why do you want to divide your
> 100 CPUs (nodes or CPU cores?) into 2 partitions? The queue will be much
> more flexible if identical nodes constitute 1 partition.
>
> If you really insist on splitting up your nodes into 2 partitions, you can
> configure that in slurm.conf, for example with 100 nodes named a001..a100:
>
> PartitionName=partition1 Nodes=a[001-050]
> PartitionName=partition2 Nodes=a[051-100]
>
> If you wish, you can look at my Slurm Wiki pages for inspiration:
> https://wiki.fysik.dtu.dk/niflheim/SLURM
> https://wiki.fysik.dtu.dk/niflheim/Slurm_configuration
>
> 2018-01-02 11:29 GMT+01:00 Nicolò Parmiggiani <
>> nicolo.parmiggiani at gmail.com <mailto:nicolo.parmiggiani at gmail.com>>:
>>
>> Hi,
>>
>> how can i limit the number of CPU that a partition can use?
>>
>> For instance when a partition reach its maximum CPUs number you can
>> submit new job but they are put in queue.
>>
>
> /Ole
>
> --
> You received this message because you are subscribed to a topic in the
> Google Groups "slurm-users" group.
> To unsubscribe from this topic, visit https://groups.google.com/d/to
> pic/slurm-users/lLpRTC1rvKA/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to
> slurm-users+unsubscribe at googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20180102/704ea54f/attachment-0001.html>
More information about the slurm-users
mailing list