[slurm-users] allocate last MPI-rank to an exclusive node?

[Jing Gong]

Hi Hendryk,

Thanks for information.

The  'plane' distribution works fine with me as well.

Regards, Jing Gong
________________________________________
From: slurm-users <slurm-users-bounces at lists.schedmd.com> on behalf of Hendryk Bockelmann <bockelmann at dkrz.de>
Sent: Tuesday, February 19, 2019 10:48
To: slurm-users at lists.schedmd.com
Subject: Re: [slurm-users] allocate last MPI-rank to an exclusive node?

Hi,

we had the same issue and solved it by using the 'plane' distribution in
combination with MPMD style srun, e.g. in your example


#SBATCH -N 3  # 3 nodes with 10 cores each
#SBATCH -n 21 # 21 MPI-tasks in sum
#SBATCH --cpus-per-task=1 # if you do not want hyperthreading

cat > mpmd.conf << EOF
0-19 ./slave_app
20 ./master_app
EOF

srun--distribution=plane=10 --multi-prog mpmd.conf


More examples are given here:
https://slurm.schedmd.com/dist_plane.html

Best regards,
Hendryk