[slurm-users] Kinda Off-Topic: data management for Slurm clusters

[Mark Hahn]

>applications) and are presently consuming the data via NFS mounts (both
>groups have 10G ethernet interconnects between the Slurm nodes and the NFS
>servers.) They are both now complaining of "too-long loading times" for the

how about just using cachefs (backed by a local filesystem on ssd)?

https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/7/html/storage_administration_guide/ch-fscache

if files are being re-read, this would be effective, fast, and convenient,
and wouldn't require any staging or hooks into Slurm.

regards, mark hahn
-- 
operator may differ from spokesperson.	            hahn at mcmaster.ca