[slurm-users] Python and R installation in a SLURM cluster
datakid at gmail.com
Thu May 10 17:23:08 MDT 2018
On 11 May 2018 at 01:35, Eric F. Alemany <ealemany at stanford.edu> wrote:
> Hi All,
> I know this might sounds as a very basic question: where in the cluster
> should I install Python and R?
> Execute nodes ?
> And is there a particular directory (path) I need to install Python and R.
> SLURM on Ubuntu 18.04
> 1 headnode
> 4 execute nodes
> NFS shared drive among all nodes.
To echo the others: we have a /binaries nfs share that utilises the
standard Environment Modules software so that researchers can manipulate
their $PATH on the fly with module load/module unload. That share is
mounted on all the nodes.
For Python, I use virtualenv's but instead of activating, the path is
changed by the Module file. Personally, I find conda doesn't work very well
in a shared environment. It's fine on a personal level/
For R, we have resorted to only installing the main point release because
we have >700 libraries installed within R and I don't want to reinstall
them every time. We do also have packrat installed so researchers can
install their own libraries locally as well.
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the slurm-users