[slurm-users] Managing Multiple Dependencies

Jason Simms simmsj at lafayette.edu
Tue Mar 2 19:16:34 UTC 2021


Hello all,

I am relatively new to the nuances of handling complex dependencies in
Slurm, so I'm hoping the hive mind can help. I have a user wanting to
accomplish the following:

   - submit one job
   - submit multiple jobs that are dependent on the output from the first
   job (so they just need to launch once the first job has completed)
   - submit one final job dependent on all the previous jobs completing

Is there a way to do this cleanly? So it's a three stage process. I have
ideas in my head of writing Slurm JobIDs to a file, reading them out, and
managing dependencies that way, but perhaps there is a more efficient way
(or perhaps not!).

Warmest regards,
Jason

-- 
*Jason L. Simms, Ph.D., M.P.H.*
Manager of Research and High-Performance Computing
XSEDE Campus Champion
Lafayette College
Information Technology Services
710 Sullivan Rd | Easton, PA 18042
Office: 112 Skillman Library
p: (610) 330-5632
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20210302/4c1f383c/attachment.htm>


More information about the slurm-users mailing list