[slurm-users] Usage of Burst Buffers (generic)

Johan Hofmans Johan.Hofmans at glpg.com
Wed Jun 2 15:28:21 UTC 2021


Dear

We would like to start using the generic burst buffer plugin.
For this I read the burst buffer guide<https://slurm.schedmd.com/burst_buffer.html>, however I've not been able to replicate the listed examples.

In slurm.conf, the generic burst buffer was enabled via:
                BurstBufferType=burst_buffer/generic
DebugFlags=BurstBuffer
In the same directory, "burst_buffer_generic.conf", was created with:
                StageInTimeout=300
AllowUsers=centos
JobSizeLimit=200GB # Applies to each job
UserSizeLimit=500GB # Applies to each user
StartStageIn=/home/centos/stageIn.sh
(No reference is made to this file in any of the other configuration files of slurm)

When running for example:
srun --bb="capacity=1G access=striped type=scratch" ls
Or following script, executed via sbatch

        #!/bin/bash
        #BB create_persistent name=alpha capacity=32GB access=striped type=scratch
        #DW jobdw type=scratch capacity=1GB access_mode=striped
        #DW stage_in  type=file source=/home/centos/data.in  destination=$DW_JOB_STRIPED/data
        #DW stage_out type=file destination=/home/centos/data.out source=$DW_JOB_STRIPED/data
        ls
The command all executes without any errors (even when the source files are not available).
But When checking the burst buffer state via:

scontrol show burst
The output is empty.

Is there something I'm missing?
Or misconfiguring?

Thanks in advance!

Kind regards,
Johan Hofmans

--
This e-mail and its attachment(s) (if any) may contain confidential and/or proprietary information and is intended for its addressee(s) only. Any unauthorized use of the information contained herein (including, but not limited to, alteration, reproduction, communication, distribution or any other form of dissemination) is strictly prohibited. If you are not the intended addressee, please notify the originator promptly and delete this e-mail and its attachment(s) (if any) subsequently. 

Neither Galapagos nor any of its affiliates shall be liable for direct, special, indirect or consequential damages arising from alteration of the contents of this message (by a third party) or as a result of a virus being passed on.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20210602/f4e2e6d2/attachment.htm>


More information about the slurm-users mailing list