[slurm-users] pmix issue

[Andy Riebs]

Are you sure that /share/local/pmix-3.2.1 exists on the compute nodes?

On 12/4/2020 2:54 PM, Yuengling, Philip J. wrote:
>
> Hi everyone,
>
> I’ve been having difficulty getting the --mpi=pmix_v3 option to work 
> for me.  I can get --mpi=pmi2 to work ok, but I really want to 
> understand what I’m doing wrong here.  Everything seems to build ok.
>
> $ srun --mpi=list
>
> srun: MPI types are...
>
> srun: pmix
>
> srun: pmix_v3
>
> srun: cray_shasta
>
> srun: none
>
> srun: pmi2
>
> $ srun --mpi=pmix_v3 -N5 date
>
> srun: error: task 1 launch failed: Invalid MPI plugin name
>
> srun: error: task 2 launch failed: Invalid MPI plugin name
>
> srun: error: task 3 launch failed: Invalid MPI plugin name
>
> srun: error: task 4 launch failed: Invalid MPI plugin name
>
> srun: error: task 0 launch failed: Invalid MPI plugin name
>
> $ srun --mpi=pmi2 -N5 date
>
> Fri Dec  4 13:52:39 EST 2020
>
> Fri Dec  4 13:52:39 EST 2020
>
> Fri Dec  4 13:52:39 EST 2020
>
> Fri Dec  4 13:52:39 EST 2020
>
> Fri Dec  4 13:52:39 EST 2020
>
> openpmix:
>
> CC=/opt/rh/devtoolset-10/root/usr/bin/gcc ./configure 
> --prefix=/share/local/pmix-3.2.1 --with-hwloc=/share/local/hwloc-2.4.0
>
> Slurm 20.11.0:
>
> rpmbuild --define "_with_pmix --with-pmix=/fs/local/pmix-3.2.1" -ta 
> slurm-20.11.0.tar.bz2
>
> From config.log:
>
> ./configure --build=x86_64-redhat-linux-gnu 
> --host=x86_64-redhat-linux-gnu --program-prefix= 
> --disable-dependency-tracking --prefix=/usr --exec-prefix=/usr 
> --bindir=/usr/bin --sbindir=/usr/sbin --sysconfdir=/etc/slurm 
> --datadir=/usr/share --includedir=/usr/include --libdir=/usr/lib64 
> --libexecdir=/usr/libexec --localstatedir=/var 
> --sharedstatedir=/var/lib --mandir=/usr/share/man 
> --infodir=/usr/share/info --with-pmix=/fs/local/pmix-3.2.1 
> --disable-slurmrestd
>
> Open MP 4.0.5:
>
> ./configure  '--prefix=/share/openmpi-4.0.5' '--with-cuda' 
> '--with-pmix=/share/local/pmix-3.2.1' '--with-pmi=/usr' '--with-slurm' 
> '--without-ucx' '--without-verbs'
>
> -- 
>
> Philip J. Yuengling
>
> Johns Hopkins University
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20201204/1c8bbca3/attachment.htm>