[slurm-users] allocate last MPI-rank to an exclusive node?

Jing Gong gongjing at kth.se
Tue Feb 19 10:13:43 UTC 2019

Hi Hendryk,

Thanks for information.

The  'plane' distribution works fine with me as well.

Regards, Jing Gong
From: slurm-users <slurm-users-bounces at lists.schedmd.com> on behalf of Hendryk Bockelmann <bockelmann at dkrz.de>
Sent: Tuesday, February 19, 2019 10:48
To: slurm-users at lists.schedmd.com
Subject: Re: [slurm-users] allocate last MPI-rank to an exclusive node?


we had the same issue and solved it by using the 'plane' distribution in
combination with MPMD style srun, e.g. in your example

#SBATCH -N 3  # 3 nodes with 10 cores each
#SBATCH -n 21 # 21 MPI-tasks in sum
#SBATCH --cpus-per-task=1 # if you do not want hyperthreading

cat > mpmd.conf << EOF
0-19 ./slave_app
20 ./master_app

srun--distribution=plane=10 --multi-prog mpmd.conf

More examples are given here:

Best regards,

More information about the slurm-users mailing list