[slurm-users] How to run a job at the end of a set of jobs
M.T.West at exeter.ac.uk
Tue May 10 00:27:42 UTC 2022
I would recommend using one of the many workflow management systems (WMS) that can define job dependencies programmatically rather than fuss with base Slurm commands. Some examples I have used or have been recommended to me:
Each of these runs in production on a number of major projects and has active support from developers. Making a pipeline DAG makes managing jobs and rerunning tests so much nicer. No reason to write from scratch what already exists.
From: slurm-users <slurm-users-bounces at lists.schedmd.com> on behalf of David Henkemeyer <david.henkemeyer at gmail.com>
Sent: Monday, May 9, 2022, 22:59
To: Slurm User Community List <slurm-users at lists.schedmd.com>
Subject: [slurm-users] How to run a job at the end of a set of jobs
CAUTION: This email originated from outside of the organisation. Do not click links or open attachments unless you recognise the sender and know the content is safe.
Prologue is a feature whereby I can run something after a single job. Is there a best practice for running a job after a set of jobs?
We submit a bunch of jobs to a bunch of nodes, and after all the jobs are done, we would like to submit a "utility job" on each node, but it has to be the last job. What would be the various ways to achieve this?
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the slurm-users