<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Hi,<div class=""><br class=""></div><div class="">Right, I understand this, what I’m describing is:</div><div class=""><br class=""></div><div class="">If a job is submitted to multiple partitions, -p part1, part2... </div><div class="">When the required resources in a partition (where the job can run) become available, I’d expect the job to be dispatched to the partition with the correct association(qos and limits), but it’s not the case.</div><div class="">Jobs start running on partition with QOS(apparently higher priority), although there is no association entry for this combination(partition/QOS)</div><div class=""><br class=""></div><div class="">Similar case:</div><div class=""><a href="https://bugs.schedmd.com/show_bug.cgi?id=1032" class="">https://bugs.schedmd.com/show_bug.cgi?id=1032</a></div><div class=""><br class=""></div><div class="">All the best,</div><div class="">Nizar</div><div class=""><br class=""></div><div class=""><div class=""><div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div><br class=""></div></div></div><div><blockquote type="cite" class=""><div class="">On 25 Jan 2021, at 15:46, Durai Arasan <<a href="mailto:arasan.durai@gmail.com" class="">arasan.durai@gmail.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">Hi,<div class=""><br class=""></div><div class="">Jobs submitted with sbatch cannot run on multiple partitions. The job will be submitted to the partition where it can start first. (from sbatch reference)</div><div class=""><br class=""></div><div class="">Best,</div><div class="">Durai</div></div><br class=""><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sat, Jan 23, 2021 at 6:50 AM Nizar Abed <<a href="mailto:nizar@huji.ac.il" class="">nizar@huji.ac.il</a>> wrote:<br class=""></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="overflow-wrap: break-word;" class="">Hi list,<br class=""><br class="">I’m trying to enforce limits based on associations, but behavior is not as expected.<br class=""><br class="">In slurm.conf:<div class="">AccountingStorageEnforce=associations,limit,qos</div><div class=""><br class=""></div><div class="">Two partitions:</div><div class="">part1.q</div><div class="">part2.q</div><div class=""><br class=""></div><div class="">One user:</div><div class="">user1</div><div class=""><br class=""></div><div class="">One QOS:</div><div class="">qos1</div><span class="">MaxJobsPU is not set</span><div class=""><span class=""><br class=""></span><span class=""><br class=""></span><div class="">I’d like to have an association for user 1 for each partition, with same qos</div><div class=""><br class=""></div><div class=""><div class=""><div class=""><div style="margin:0px;font-stretch:normal;font-size:7px;line-height:normal;font-family:Monaco;color:rgb(12,255,0);background-color:rgba(255,255,255,0.68)" class=""><span style="font-variant-ligatures:no-common-ligatures" class=""> User Def Acct Admin Cluster Account Partition Share Priority MaxJobs MaxNodes MaxCPUs MaxSubmit MaxWall MaxCPUMins QOS Def QOS </span></div><div style="margin:0px;font-stretch:normal;font-size:7px;line-height:normal;font-family:Monaco;color:rgb(12,255,0);background-color:rgba(255,255,255,0.68)" class=""><span style="font-variant-ligatures:no-common-ligatures" class="">---------- ---------- --------- ---------- ---------- ---------- --------- ---------- ------- -------- -------- --------- ----------- ----------- -------------------- --------- </span></div><div style="margin:0px;font-stretch:normal;font-size:7px;line-height:normal;font-family:Monaco;color:rgb(12,255,0);background-color:rgba(255,255,255,0.68)" class=""><span style="font-variant-ligatures:no-common-ligatures" class=""> user1 account1 None cl1 account1 part1.q 1 3 qos1 </span></div><span class=""><div style="margin:0px;font-stretch:normal;font-size:7px;line-height:normal;font-family:Monaco;color:rgb(12,255,0);background-color:rgba(255,255,255,0.68)" class=""><span style="font-variant-ligatures:no-common-ligatures" class=""> user1 account1 None cl1 account1 part2.q 1 4 qos1 </span></div></span></div></div><span class=""><div style="margin:0px;font-stretch:normal;font-size:7px;line-height:normal;font-family:Monaco;color:rgb(12,255,0);background-color:rgba(255,255,255,0.68)" class=""><span style="font-variant-ligatures:no-common-ligatures" class=""><br class=""></span></div><div style="margin:0px;font-stretch:normal;font-size:7px;line-height:normal;font-family:Monaco;color:rgb(12,255,0);background-color:rgba(255,255,255,0.68)" class=""><span style="font-variant-ligatures:no-common-ligatures" class=""><br class=""></span></div><div style="margin:0px;font-stretch:normal;font-size:7px;line-height:normal;font-family:Monaco;color:rgb(12,255,0);background-color:rgba(255,255,255,0.68)" class=""><span style="font-variant-ligatures:no-common-ligatures" class=""><br class=""></span></div><div style="margin:0px;font-stretch:normal;font-size:7px;line-height:normal;font-family:Monaco;color:rgb(12,255,0);background-color:rgba(255,255,255,0.68)" class=""><span style="font-variant-ligatures:no-common-ligatures" class=""><br class=""></span></div></span></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">User1 submit 6 jobs to part2.q:</div><div class="">4 start running</div><div class="">2 in pending(AssocMaxJobsLimit)</div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">User1 submit 6 jobs to part1.q:</div><div class=""><div style="" class="">3 start running</div><div style="" class="">3 in pending(AssocMaxJobsLimit)</div></div><div class=""><br class=""></div><div class="">This ok and expected behavior.</div><div class=""><br class=""></div><div class="">But when user1 submits 12 jobs like:</div><div class=""><br class=""></div><div class="">sbatch -p part1.q,part2.q slurm-job.sh </div><div class=""><br class=""></div><div class="">Only 3 jobs running on part1.q: association of part1.q</div><div class="">Other 9 jobs on <span style="" class="">AssocMaxJobsLimit</span></div><div class=""><span style="" class=""><br class=""></span></div><div class=""><font class=""><span class="">Why 4 jobs doesn’t start on part2.q?</span></font></div><div class=""><br class=""></div><div class=""><font class=""><span class="">Worst case(listing part2.q before part1.q):</span></font></div><div class=""><span style="" class="">sbatch -p part2.q,part1.q </span><span style="" class="">slurm-job.sh </span></div><div class=""><span style="" class="">4(!) jobs running on part1.q</span></div><div class=""><span style="" class=""><br class=""></span></div><div class=""><span style="" class=""><br class=""></span></div><div class=""><span style="" class="">Is it possible to allow user to submit to multiple partitions, and slurm picks up correct association for each partition?</span></div><div class=""><font class="">What I’m missing here?</font></div><div class=""><font class=""><br class=""></font></div><div class=""><font class=""><br class=""></font></div><div class=""><span style="" class="">Thanks,</span></div><div class=""><span style="" class="">Nizar</span></div><div class=""><span style="" class=""><br class=""></span></div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><br class=""></div></div></div></blockquote></div>
</div></blockquote></div><br class=""></div></body></html>