[slurm-users] Staging data on the nodes one will be processing on via sbatch

Will Dennis wdennis at nec-labs.com
Sat Apr 3 20:33:16 UTC 2021


If you've got other fast storage in limited supply that can be used for data that can be staged, then by all means use it, but consider whether you want batch cpu cores tied up with the wall time of transferring the data. This could easily be done on a time-shared frontend login node from which the users could then submit (via script) jobs after the data was staged. Most of the transfer wallclock is in network wait, so don't waste dedicated cores for it.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20210403/e5c7391f/attachment.htm>


More information about the slurm-users mailing list