Transfer from GPFS via slurm
Hi, We were told by our hardware provider that large datasets copied from NFS location to GPFS could be conducted via slurm to monitor the transfer. I am not sure of this works as I could not find much online. Otherwise apart from globus and rsync, what would you suggest as a tool/command to copy files from on a cluster between NFS and GPFS? Best, *Fritz Ratnasamy*Data Scientist Information Technology
I think they are basically talking about using Slurm as a way to schedule time on a data transfer node, or at least that’s what I’ve seen previously. You will still need a software package like rsync or one of its relatives/parallel derivatives, but Slurm would be a way to schedule the time and bandwidth fairly. Sent from my iPhone On Jun 6, 2025, at 00:31, Ratnasamy, Fritz via slurm-users <slurm-users@lists.schedmd.com> wrote: Hi, We were told by our hardware provider that large datasets copied from NFS location to GPFS could be conducted via slurm to monitor the transfer. I am not sure of this works as I could not find much online. Otherwise apart from globus and rsync, what would you suggest as a tool/command to copy files from on a cluster between NFS and GPFS? Best, Fritz Ratnasamy Data Scientist Information Technology -- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-leave@lists.schedmd.com
participants (2)
-
Ratnasamy, Fritz -
Ryan Novosielski