[slurm-users] slurm does not pass mca params toopenmpi?

[Michael Di Domenico]

did you copy the mca parameters file to all the compute nodes as well?

On Thu, Jul 19, 2018 at 11:37 AM, Roger Mason <rmason at mun.ca> wrote:
> Hell Gilles,
>
> gilles at rist.or.jp writes:
>
>> is the home directory mounted at the same place regardless this is a
>> frontend or a compute node ?
>
> One host serves as both a frontend and compute node and is used to pixie
> boot the other compute nodes.  On the frontend machine (192.168.0.100) I
> have:
>
> mount:
> /dev/ada1p2 on / (ufs, NFS exported, local, journaled soft-updates)
> devfs on /dev (devfs, local, multilabel)
> /dev/gpt/gpthome on /usr/home/rmason (ufs, NFS exported, local, soft-updates)
> fdescfs on /dev/fd (fdescfs)
> procfs on /proc (procfs, local)
> and there is a symlink from /home to /usr/home.
>
> On the compute nodes I have:
>
> mount:
> 192.168.0.100:/b/tftpboot/FreeBSD/install/ on / (nfs, read-only)
> devfs on /dev (devfs, local, multilabel)
> /dev/md0 on /etc (ufs, local)
> /dev/md1 on /var (ufs, local)
> procfs on /proc (procfs, local)
> /dev/ada0p2 on /var/mnt/local (ufs, local, journaled soft-updates)
> 192.168.0.100:/usr/home/rmason on /var/mnt/rmason (nfs)
> /dev/md2 on /tmp (ufs, local)
>
> On the compute nodes the home directory is symlinked as follows:
> node003 rmason ls -lh /usr/home
> total 0
> lrwxr-xr-x  1 root  wheel    16B May 25 19:38 rmason -> /var/mnt/rmason/
> node003 rmason ls -lh /home
> lrwxr-xr-x  1 root  wheel     8B May 18 17:37 /home -> usr/home
> node003 rmason ls -lh /home/rmason
> lrwxr-xr-x  1 root  wheel    16B May 25 19:38 /home/rmason -> /var/mnt/rmason/
>
>> I noted you --export=ALL, so there is a risk you export $HOME that is
>> not reachable on the compute nodes.
>
> Removing that from the batch script does not make a difference.
>
> Thanks,
> Roger
>