[slurm-users] Managing Local Scratch/TmpDisk

[Fulcomer, Samuel]

If you use cgroups, tmpfs /tmp and /dev/shm usage is counted against the
requested memory for the job.

On Tue, Mar 31, 2020 at 4:51 PM Ellestad, Erik <Erik.Ellestad at ucsf.edu>
wrote:

> How are folks managing allocation of local TmpDisk for jobs?
>
> We see how you define the location of TmpFs in slurm.conf.
>
> And then how the amount per host is defined via TmpDisk.
>
> Then the request for srun/sbatch via --tmp=X
>
> However, it appears SLURM only checks the defined TmpDisk amount when
> allocating tmp, not the actual space available on disk.
>
> That is to say, for example, if during the course of its run, a job uses
> more of the TmpDisk space than it requests initially, SLURM doesn't check
> the actual disk space available for other jobs.
>
> The only notification that you will get is when your jobs run out of space
> or the defined TmpFs is full.
>
> Thanks!
>
> Erik
>
> ---
> Erik Ellestad
> Wynton Cluster SysAdmin
> UCSF
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20200331/39cb9b28/attachment-0001.htm>