Hi,
We were told by our hardware provider that large datasets copied from NFS location to GPFS could be conducted via slurm to monitor the transfer. I am not sure of this works as I could not find much online. Otherwise apart from globus and rsync, what would you suggest as a tool/command to copy files from on a cluster between NFS and GPFS? Best,
*Fritz Ratnasamy*Data Scientist Information Technology
I think they are basically talking about using Slurm as a way to schedule time on a data transfer node, or at least that’s what I’ve seen previously. You will still need a software package like rsync or one of its relatives/parallel derivatives, but Slurm would be a way to schedule the time and bandwidth fairly.
Sent from my iPhone
On Jun 6, 2025, at 00:31, Ratnasamy, Fritz via slurm-users slurm-users@lists.schedmd.com wrote:
Hi,
We were told by our hardware provider that large datasets copied from NFS location to GPFS could be conducted via slurm to monitor the transfer. I am not sure of this works as I could not find much online. Otherwise apart from globus and rsync, what would you suggest as a tool/command to copy files from on a cluster between NFS and GPFS? Best, Fritz Ratnasamy Data Scientist Information Technology
-- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-leave@lists.schedmd.com
-
Ratnasamy, Fritz -
Ryan Novosielski