[slurm-users] srun jobfarming hassle question

Ward Poelmans ward.poelmans at vub.be
Wed Jan 18 14:35:57 UTC 2023


On 18/01/2023 15:22, Ohlerich, Martin wrote:
> But Magnus (Thanks for the Link!) is right. This is still far away from a feature rich job- or task-farming concept, where at least some overview of the passed/failed/missing task statistics is available etc.

GNU parallel has log output and options to retry failed jobs.

If you want really fancy stuff, maybe look at dask combined with slurm plugins? It has dashboards for jupyter I believe.

Ward
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 4741 bytes
Desc: S/MIME Cryptographic Signature
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20230118/51702d9a/attachment.bin>


More information about the slurm-users mailing list