[slurm-users] non-historical scheduling

Tina Friedrich tina.friedrich at it.ox.ac.uk
Tue Apr 12 14:22:48 UTC 2022


Hi Chagai,

there isn't, no. As far as I can tell, SLURM only knows share-tree, it 
doesn't have functional share like SGE/UGE.

(I'm pretty sure what Chagai wants to happen is this:

There's a share policy on the cluster that only ever operates in the 
moment (i.e. per scheduling run). No history, no nothing.

The cluster has 12 slots.

If there are only jobs from group A in the queue, they all get run.

If there are only jobs from group B in the queue, they all get run.

If there are jobs from both group A and group B in the queue, at all 
times, regardless of prior use, make it so that A and B use the same 
number of slots.)

Tina

On 12/04/2022 14:52, Chagai Nota wrote:
> Wow thanks for your detailed answer.
> I'm coming from SGE, and I thought that there will be simple way to make it behave like SGE.
> As you said hard limits will be waste of resources so it's not good option.
> 
> 
> -----Original Message-----
> From: slurm-users <slurm-users-bounces at lists.schedmd.com> On Behalf Of Paul Edmon
> Sent: Tuesday, April 12, 2022 4:31 PM
> To: slurm-users at lists.schedmd.com
> Subject: Re: [slurm-users] non-historical scheduling
> 
> CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe.
> 
> So you want a purely fractional usage of the cluster.  That's hard to do via fairshare or with out fairshare as the scheduler will usually fill up all the nodes with the top priority job.  If you don't have fairshare running or any historical data it will revert to FIFO.  So which ever user got in first will go first, no matter how many jobs there are.
> Fairshare can accomplish what you want above but it takes time for it to settle into a steady state due to behavior above.  If you chart the usage over time with fairshare you will see it even out, but at any given immediate time you will have one user dominating over another one.
> 
> You could probably achieve a pure fractional usage model by utilizing hard limits for each user in terms of number of cores. The problem is that you will leave parts of the cluster open and idle.  If that is fine then I recommend setting hard limits for each user.
> 
> -Paul Edmon-
> 
> On 4/12/2022 8:55 AM, Chagai Nota wrote:
>> Hi Loris
>>
>> Thanks for your answer.
>> I tired to configure it and I didn't get desired results.
>> This is my configuration:
>> PriorityType=priority/multifactor
>> PriorityDecayHalfLife=0
>> PriorityUsageResetPeriod=DAILY
>> PriorityFavorSmall=yes
>> PriorityWeightFairshare=100000
>> PriorityWeightAge=0
>> PriorityWeightPartition=0
>> PriorityWeightJobSize=100000
>> PriorityMaxAge=1-0
>> PriorityCalcPeriod=1
>>
>> The desired result its that when 2 users A and B send jobs they will have equal number of jobs to each of them.
>> Lets say all grid have 12 slots so user A and B each one of them will
>> get 6, but when happen that user A get 12 and after sometime user B
>> get 12
>>
>>
>>
>> -----Original Message-----
>> From: slurm-users <slurm-users-bounces at lists.schedmd.com> On Behalf Of
>> Loris Bennett
>> Sent: Tuesday, April 12, 2022 12:06 PM
>> To: Slurm User Community List <slurm-users at lists.schedmd.com>
>> Subject: Re: [slurm-users] non-historical scheduling
>>
>> CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe.
>>
>> Hi Chagai,
>>
>> Chagai Nota <https://urldefense.proofpoint.com/v2/url?u=http-3A__chagai.nota-40altair-2Dsemi.com&d=DwIFaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=jm7M7VuAC03WZiP8QPjQXbsP_SRYyhc66dx6T2rYKGk&m=mC6-yDte_BkF_egdAiZhLfKbIi-zhwylR5b6AOgnfEo&s=aOWXcTJqFuopg_IznzSJXY_GKgxYv-0FAFrZrQBDpyA&e=> writes:
>>
>>> Hi
>>>
>>>
>>>
>>> I would like to ask if there is any option that slurm scheduler will consider only running jobs and not historical data.
>>>
>>> We don't care about how many jobs users was running in the past but only the current usage.
>> Look at
>>
>>
>> https://urldefense.proofpoint.com/v2/url?u=https-3A__slurm.schedmd.com
>> _priority-5Fmultifactor.html&d=DwIFaQ&c=euGZstcaTDllvimEN8b7jXrwqOf-v5
>> A_CdpgnVfiiMM&r=jm7M7VuAC03WZiP8QPjQXbsP_SRYyhc66dx6T2rYKGk&m=mC6-yDte
>> _BkF_egdAiZhLfKbIi-zhwylR5b6AOgnfEo&s=ez1DlsO7KAqb6GyBvfk6PoSMDxjckA26
>> SrtvBRwOPtc&e=
>>
>> You probably need to set
>>
>>     PriorityDecayHalfLife=0
>>
>> and then, say,
>>
>>     PriorityUsageResetPeriod=DAILY
>>
>> Cheers,
>>
>> Loris
>>
>>> Thanks
>>>
>>> Chagai Nota
>>>
>>> ---------------------------------------------------------------------
>>> -
>>> ---------------------------------------------------------------------
>>> -
>>> ---------------------------------------------------------------------
>>> -
>>> ------------------------
>>>
>>> Important Notice: This email message and any attachments thereto are
>>> confidential and/or privileged and/or subject to privacy laws and are
>>> intended only for use by the addressee(s) named above. If you are not the intended addressee, you are hereby kindly notified that any dissemination, distribution, copying or use of this email and any attachments thereto is strictly prohibited. If you have received this email in error, kindly delete it from your computer system and notify us at the telephone number or email address appearing above. The writer asserts in respect of this message and attachments all rights for confidentiality, privilege or privacy to the fullest extent permitted by law.
>>>
>> --
>> Dr. Loris Bennett (Herr/Mr)
>> ZEDAT, Freie Universität Berlin         Email loris.bennett at fu-berlin.de
>>
>>
>>
>> ----------
>>
>> This email has been scanned for spam and viruses by Proofpoint Essentials. Visit the following link to report this email as spam:
>> https://urldefense.proofpoint.com/v2/url?u=https-3A__eur02.safelinks.p
>> rotection.outlook.com_-3Furl-3Dhttps-253A-252F-252Feu1.proofpointessen
>> tials.com-252Findex01.php-253Fmod-5Fid-253D11-2526mod-5Foption-253Dlog
>> item-2526mail-5Fid-253D1649754490-2DsOxgKUMnXxFb-2526r-5Faddress-253Dc
>> hagai.nota-252540altair-2Dsemi.com-2526report-253D1-26amp-3Bdata-3D04-
>> 257C01-257C-257Cd5bb86cab5754f0b297008da1c63f87f-257Cd97b0f906803449a9
>> 23b749ca7eedb2b-257C0-257C0-257C637853512947856000-257CUnknown-257CTWF
>> pbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6M
>> n0-253D-257C3000-26amp-3Bsdata-3DI-252FKmvMAweaHTndtIydlYiBJqyylKa58Jl
>> SOYCXSzJnI-253D-26amp-3Breserved-3D0&d=DwIDaQ&c=euGZstcaTDllvimEN8b7jX
>> rwqOf-v5A_CdpgnVfiiMM&r=jm7M7VuAC03WZiP8QPjQXbsP_SRYyhc66dx6T2rYKGk&m=
>> YdiNqiQVEipLlNaWLx4jrE3yjyqxpl8R9ZjqpFSLrlE&s=t69ftM8kYj0Z9v55mJ6qc382
>> 8am44URzJytiPMrrsH4&e=
>>
>> ________________________________
>>
>> Important Notice: This email message and any attachments thereto are confidential and/or privileged and/or subject to privacy laws and are intended only for use by the addressee(s) named above. If you are not the intended addressee, you are hereby kindly notified that any dissemination, distribution, copying or use of this email and any attachments thereto is strictly prohibited. If you have received this email in error, kindly delete it from your computer system and notify us at the telephone number or email address appearing above. The writer asserts in respect of this message and attachments all rights for confidentiality, privilege or privacy to the fullest extent permitted by law.
>>
> 
> 
> 
> ----------
> 
> This email has been scanned for spam and viruses by Proofpoint Essentials. Visit the following link to report this email as spam:
> https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Feu1.proofpointessentials.com%2Findex01.php%3Fmod_id%3D11%26mod_option%3Dlogitem%26mail_id%3D1649770346-k9C-drGQbaj1%26r_address%3Dchagai.nota%2540altair-semi.com%26report%3D1&data=04%7C01%7C%7C7b5fea1f24154e6b948908da1c88e394%7Cd97b0f906803449a923b749ca7eedb2b%7C0%7C0%7C637853671506866135%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=ojjMUODNoPgCKJB79FD9iApqMULP1KQspmI60HNMbbc%3D&reserved=0
> 
> ________________________________
> 
> Important Notice: This email message and any attachments thereto are confidential and/or privileged and/or subject to privacy laws and are intended only for use by the addressee(s) named above. If you are not the intended addressee, you are hereby kindly notified that any dissemination, distribution, copying or use of this email and any attachments thereto is strictly prohibited. If you have received this email in error, kindly delete it from your computer system and notify us at the telephone number or email address appearing above. The writer asserts in respect of this message and attachments all rights for confidentiality, privilege or privacy to the fullest extent permitted by law.
> 

-- 
Tina Friedrich, Advanced Research Computing Snr HPC Systems Administrator

Research Computing and Support Services
IT Services, University of Oxford
http://www.arc.ox.ac.uk http://www.it.ox.ac.uk



More information about the slurm-users mailing list