[slurm-users] Creating priority quotas

[Brian Novogradac]

This is great!!1 thank you!


________________________________
From: slurm-users <slurm-users-bounces at lists.schedmd.com> on behalf of Manuel Rodríguez Pascual <manuel.rodriguez.pascual at gmail.com>
Sent: Thursday, January 25, 2018 11:29 AM
To: Slurm User Community List
Subject: Re: [slurm-users] Creating priority quotas

In case any of you is interested, my team integrated DMTCP checkpoint library with Slurm, thus allowing this preemption to be done without loosing any computation (and some other fancy stuff).  An important use case for us is, in fact, these VIP queues :)

Here is a link to the documentation, including tests, configuration and howtos: https://github.com/ciemat-tic/codec/wiki/Slurm-DMTCP
[https://avatars0.githubusercontent.com/u/8639317?s=400&v=4]<https://github.com/ciemat-tic/codec/wiki/Slurm-DMTCP>

Slurm DMTCP · ciemat-tic/codec Wiki · GitHub<https://github.com/ciemat-tic/codec/wiki/Slurm-DMTCP>
github.com
Intro. This document presents a complete description on the integration of Slurm and DMTCP. It includes installation, configuration and testing.



cheers,

Manuel


2018-01-25 17:18 GMT+01:00 Brian Novogradac <Brian.Novogradac at utoronto.ca<mailto:Brian.Novogradac at utoronto.ca>>:

Thank you for your input!


Would any of you have an example on how you setup the conf file for the queue using the QOS method?  I'm reading the QOS docs as I type.


Brian

________________________________
From: slurm-users <slurm-users-bounces at lists.schedmd.com<mailto:slurm-users-bounces at lists.schedmd.com>> on behalf of Loris Bennett <loris.bennett at fu-berlin.de<mailto:loris.bennett at fu-berlin.de>>
Sent: Thursday, January 25, 2018 11:09 AM
To: Slurm User Community List
Subject: Re: [slurm-users] Creating priority quotas

Hi Brian,

QOS is probably the right way to go.  You can set up a QOS 'vip', which
can preempt other QOS.  We don't preempt, but use multifactor priority
with various QOS with different priority values.  In that case, VIP jobs
won't start immediately, but just get pushed to the front of the queue.
On the other hand, no CPU-time is lost due to low-status jobs being
terminated early due to preemption (although if the low-status jobs are
able to do some form of checkpointing that will be less of an issue).
Depending on how pushy your VIPs are, they might go for a preemptionless
solution, too.

Cheers,

Loris

John Hearns <hearnsj at googlemail.com<mailto:hearnsj at googlemail.com>> writes:

> Brian, not my area of expertise. Do you want 'premption' - ie the VIP user runs something and other jobs are pre-empted?
> https://slurm.schedmd.com/preempt.html
Slurm Workload Manager<https://slurm.schedmd.com/preempt.html>
slurm.schedmd.com<http://slurm.schedmd.com>
Preemption. Slurm supports job preemption, the act of stopping one or more "low-priority" jobs to let a "high-priority" job run. Job preemption is implemented as a ...



>
> On 25 January 2018 at 16:27, Brian Novogradac <Brian.Novogradac at utoronto.ca<mailto:Brian.Novogradac at utoronto.ca>> wrote:
>
>  I'm new to Slurm, and looking for some assistance.
>
>  I need to create various queues. The one i am having issues with is a "VIP" queue
>
>  I want to create a queue for a specific node that overides all jobs on that node when a "VIP" uses the queue.
>
>  We are using SSSD for our authentication system to the login node.
>
>  I'm looking at the QOS docs and am stumped.
>
>  Any help or direction much appreciated.
>
>  Brian Novogradac
>
>
--
Dr. Loris Bennett (Mr.)
ZEDAT, Freie Universität Berlin         Email loris.bennett at fu-berlin.de<mailto:loris.bennett at fu-berlin.de>


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20180125/a119eac1/attachment-0001.html>