[slurm-users] requesting resources and afterwards launch an array of calculations

[Carlos Fenoy]

Hi Alfredo,

You can have a look at using https://github.com/eth-cscs/GREASY . It was
developed before array-jobs were supported in slurm and it will do exactly
what you want.

Regards,
Carlos

On Wed, Dec 19, 2018 at 3:33 PM Alfredo Quevedo <maquevedo.unc at gmail.com>
wrote:

> thank you Michael for the feedback, my scenario is the following: I want
> to run a job array of (lets say) 30 jobs. So I setted the slurm input as
> follows:
>
> #SBATCH --array=1-104%30
> #SBATCH --ntasks=1
>
> however only 4 jobs within the array are launched at a time due to the
> allowed max number of jobs as setted in the slurm configuration (4). As
> a workaround to the issued, the sysadmin suggested me to request the
> resources, and afterwards distribute the resources asigned into a
> multiple set of single CPU task. I believe that with the solution you
> mentioned only 30 (out of the 104) jobs will be finished?
>
> thanks
>
> Alfredo
>
>
> El 19/12/2018 a las 11:15, Renfro, Michael escribió:
> > Literal job arrays are built into Slurm:
> https://slurm.schedmd.com/job_array.html
> >
> > Alternatively, if you wanted to allocate a set of CPUs for a parallel
> task, and then run a set of single-CPU tasks in the same job, something
> like:
> >
> >    #!/bin/bash
> >    #SBATCH --ntasks=30
> >    srun --ntasks=${SLURM_NTASKS} hostname
> >
> > is one way of doing it. If that’s not what you’re looking for, some
> other details would be needed.
> >
>
>

-- 
--
Carles Fenoy
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20181219/507fb5a7/attachment-0001.html>