[slurm-users] slurm does not pass mca params toopenmpi?

[Roger Mason]

Hell Gilles,

gilles at rist.or.jp writes:

> is the home directory mounted at the same place regardless this is a
> frontend or a compute node ?

One host serves as both a frontend and compute node and is used to pixie
boot the other compute nodes.  On the frontend machine (192.168.0.100) I
have:

mount:
/dev/ada1p2 on / (ufs, NFS exported, local, journaled soft-updates)
devfs on /dev (devfs, local, multilabel)
/dev/gpt/gpthome on /usr/home/rmason (ufs, NFS exported, local, soft-updates)
fdescfs on /dev/fd (fdescfs)
procfs on /proc (procfs, local)
and there is a symlink from /home to /usr/home.

On the compute nodes I have:

mount:
192.168.0.100:/b/tftpboot/FreeBSD/install/ on / (nfs, read-only)
devfs on /dev (devfs, local, multilabel)
/dev/md0 on /etc (ufs, local)
/dev/md1 on /var (ufs, local)
procfs on /proc (procfs, local)
/dev/ada0p2 on /var/mnt/local (ufs, local, journaled soft-updates)
192.168.0.100:/usr/home/rmason on /var/mnt/rmason (nfs)
/dev/md2 on /tmp (ufs, local)

On the compute nodes the home directory is symlinked as follows:
node003 rmason ls -lh /usr/home
total 0
lrwxr-xr-x  1 root  wheel    16B May 25 19:38 rmason -> /var/mnt/rmason/
node003 rmason ls -lh /home
lrwxr-xr-x  1 root  wheel     8B May 18 17:37 /home -> usr/home
node003 rmason ls -lh /home/rmason
lrwxr-xr-x  1 root  wheel    16B May 25 19:38 /home/rmason -> /var/mnt/rmason/

> I noted you --export=ALL, so there is a risk you export $HOME that is
> not reachable on the compute nodes.

Removing that from the batch script does not make a difference.

Thanks,
Roger