[slurm-users] How can jobs request a minimum available (free) TmpFS disk space?

[Chris Samuel]

On Monday, 2 September 2019 11:02:57 AM PDT Ole Holm Nielsen wrote:

> We have some users requesting that a certain minimum size of the
> *Available* (i.e., free) TmpFS disk space should be present on nodes
> before a job should be considered by the scheduler for a set of nodes.

At Swinburne I did this by defining a GRES called "tmp" for nodes and then 
translated any --tmp request into a GRES request in the submit filter.

The prolog for the job would then create a directory for the job in the nodes 
local NVME XFS /tmp filesystem, set a project quota on that directory to the 
amount requested (so it couldn't be exceeded) and then used the private tmp 
spank plugin to map that into what the job saw as /tmp, /var/tmp and /dev/shm.

The epilog then cleaned up after the job.

Worked nicely!

All the best,
Chris
-- 
  Chris Samuel  :  http://www.csamuel.org/  :  Berkeley, CA, USA