[slurm-users] Slurm and shared file systems

[Riebs, Andy]

David,

I've been using Slurm for nearly 20 years, and while I can imagine some clever work-arounds, like staging your job in /var/tmp on all of the nodes before trying to run it, it's hard to imagine a cluster serving a useful purpose without a shared user file system, whether or not Slurm is involved.

Having said that, I hope that someone comes up with a real use case to help me see something that I don't currently see!

Andy

From: slurm-users [mailto:slurm-users-bounces at lists.schedmd.com] On Behalf Of David Baker
Sent: Friday, June 19, 2020 8:05 AM
To: Slurm User Community List <slurm-users at lists.schedmd.com>
Subject: [slurm-users] Slurm and shared file systems

Hello,

We are currently helping a research group to set up their own Slurm cluster. They have asked a very interesting question about Slurm and file systems. That is, they are posing the question -- do you need a shared user file store on a Slurm cluster?

So, in the extreme case where this is no shared file store for users can slurm operate properly over a cluster? I have seen commands like sbcast to move a file from the submission node to a compute node, however that command can only transfer one file at a time. Furthermore what would happen to the standard output files? I'm going to guess that there must be a shared file system, however it would be good if someone could please confirm this.

Best regards,
David


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20200619/9a844104/attachment.htm>