[slurm-users] Slurm Jobscript Archiver

[Christopher Benjamin Coffey]

Hi All,

We created a slurm job script archiver which you may find handy. We initially attempted to do this through slurm with a slurmctld prolog but it really bogged the scheduler down. This new solution is a custom c++ program that uses inotify to watch for job scripts and environment files to show up out in /var/spool/slurm/hash.* on the head node. When they do, the program copies the jobscript and environment out to a local archive directory. The program is multithreaded and has a dedicated thread watching each hash directory. The program is super-fast and lightweight and has no side effects on the scheduler. The program by default will apply ACLs to the archived job scripts so that only the owner of the jobscript can read the files. Feel free to try it out and let us know how it works for you!

https://github.com/nauhpc/job_archive

Best,
Chris

—
Christopher Coffey
High-Performance Computing
Northern Arizona University
928-523-1167