[slurm-users] Is there any public scientific-workflow example that can be run through Slurm?

Loris Bennett loris.bennett at fu-berlin.de
Mon Aug 21 05:41:09 UTC 2023


"Bernstein, Noam CIV USN NRL (6393) Washington DC (USA)"

<noam.bernstein at nrl.navy.mil> writes:

> I'm the lead developer of another workflow system, wfl (github.com/libAtoms/workflow), which works with slurm using an abstraction layer we also
> developed, ExPyRe (github.com/libAtoms/Expyre), but in writing a recent paper about it we looked at other systems, and ones that we know of that use
> queuing systems include: 
>
>  ASR atomic simulation recipes (which uses MyQueue)
>  Atomate/Fireworks
>  PyIron/Pysqua
>  AiiDA
>  icolos (https://github.com/MolecularAI/Icolos)
>  qmpy (part of OQMD)
>
> Note that I'm not promising that they currently support slurm, but it's a list to start your research from.
>
> Noam
>

On our system we have a number of people, mainly from the life sciences,
who use Nextflow

  https://www.nextflow.io/

It is slightly problematic from our point of view, as it does not yet
support job arrays.  However, there is development activity going on to
address this:

  https://github.com/nextflow-io/nextflow/issues/1477

Cheers,

Loris

-- 
Dr. Loris Bennett (Herr/Mr)
ZEDAT, Freie Universität Berlin



More information about the slurm-users mailing list