<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Hi list,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
We are migrating from SGE to Slurm.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
I'm having hard-time to make process pinning work.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Whatever --cpu-bind is set to, I can not get the placement I want.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
It works as expected for cores, threads, boards and sockets, but as soon as I pass a map_cpu or mask_cpu it goes on its own.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Nodes are 1 board, 2 sockets, 4 cores/socket, 1 thread per core.<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Tests were made with Slurm 20.11.0.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
I've built 20.11.1 this morning.<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Am I missing something ?</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
$ srun --exclusive --cpu-bind=v,cores -N 1-1 -n 2 testmpi.sh
<div>cpu-bind=MASK - mania-8, task 0 0 [3126]: mask 0x1 set</div>
cpu-bind=MASK - mania-8, task 1 1 [3127]: mask 0x4 set<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
$ srun --exclusive --cpu-bind=v,threads -N 1-1 -n 2 testmpi.sh
<div>cpu-bind=MASK - mania-8, task 0 0 [3261]: mask 0x1 set</div>
cpu-bind=MASK - mania-8, task 1 1 [3262]: mask 0x4 set<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
$ srun --exclusive --cpu-bind=v,boards -N 1-1 -n 4 testmpi.sh
<div>cpu-bind=MASK - mania-8, task 0 0 [3515]: mask 0x1 set</div>
<div>cpu-bind=MASK - mania-8, task 1 1 [3516]: mask 0x4 set</div>
<div>cpu-bind=MASK - mania-8, task 3 3 [3518]: mask 0x40 set</div>
cpu-bind=MASK - mania-8, task 2 2 [3517]: mask 0x10 set<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
$ srun --exclusive --cpu-bind=v,sockets -N 1-1 -n 4 testmpi.sh
<div>cpu-bind=MASK - mania-8, task 0 0 [3646]: mask 0x55 set</div>
<div>cpu-bind=MASK - mania-8, task 1 1 [3647]: mask 0x55 set</div>
<div>cpu-bind=MASK - mania-8, task 2 2 [3648]: mask 0x55 set</div>
<div>cpu-bind=MASK - mania-8, task 3 3 [3649]: mask 0x55 set</div>
<br>
$ srun --exclusive --cpu-bind=v,mask_cpu:0xa -N 1-1 -n 2 testmpi.sh
<div>cpu-bind=MASK - mania-8, task 0 0 [2816]: mask 0x5 set</div>
<div>cpu-bind=MASK - mania-8, task 1 1 [2819]: mask 0x5 set</div>
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
$ srun --exclusive --cpu-bind=v,mask_cpu:0x0 -N 1-1 -n 4 testmpi.sh
<div>cpu-bind=MASK - mania-8, task 0 0 [3800]: mask 0x55 set</div>
<div>cpu-bind=MASK - mania-8, task 1 1 [3801]: mask 0x55 set</div>
<div>cpu-bind=MASK - mania-8, task 3 3 [3803]: mask 0x55 set</div>
<div>cpu-bind=MASK - mania-8, task 2 2 [3802]: mask 0x55 set</div>
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
$ srun --exclusive --cpu-bind=v,none -N 1-1 -n 4 testmpi.sh
<div>cpu-bind=MASK - mania-8, task 0 0 [5053]: mask 0x55 set</div>
<div>cpu-bind=MASK - mania-8, task 1 1 [5054]: mask 0x55 set</div>
<div>cpu-bind=MASK - mania-8, task 2 2 [5056]: mask 0x55 set</div>
<div>cpu-bind=MASK - mania-8, task 3 3 [5057]: mask 0x55 set</div>
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
$ srun --exclusive --cpu-bind=v,none,mask_cpu:0x33,0x33,0x33,0x33 -N 1-1 -n 4 testmpi.sh
<div>cpu-bind=MASK - mania-8, task 0 0 [5191]: mask 0x55 set</div>
<div>cpu-bind=MASK - mania-8, task 1 1 [5192]: mask 0x55 set</div>
<div>cpu-bind=MASK - mania-8, task 2 2 [5193]: mask 0x55 set</div>
<div>cpu-bind=MASK - mania-8, task 3 3 [5194]: mask 0x55 set</div>
<br>
</div>
<div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Thanks,</div>
<div id="Signature">
<div>
<div></div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Helvetica,sans-serif">
<p style="margin-top:0px; margin-bottom:0px; margin-top:0; margin-bottom:0">-- <br>
</p>
<p style="margin-top:0px; margin-bottom:0px; margin-top:0; margin-bottom:0">Ionel<br>
</p>
</div>
</div>
</div>
</div>
-- <br>
Beicip-Franlab SA - 232 av. Napoleon Bonaparte - BP 2132-92502 Rueil-Malmaison Cedex<br>
Capital: EUR 6 000 000 - TVA FR 54 679 804 047 - RCS Nanterre 679 804 047<br>
This message and any attachments (the message) are confidential and intended solely for the addressees.<br>
Any unauthorised use, dissemination or reproduction is strictly prohibited.<br>
The sender does not accept liability for any errors or omissions in the contents of this message arising as a result of e-mail transmission.
</body>
</html>