[slurm-users] introduce short delay starting multiple parallel jobs with srun

[Yakupov, Renat /DZNE]

Hi John,

I am processing high-resolution MRI data. The processing pipeline itself is in Matlab.
I will suggest updating Slurm, but seeing how far behind we are, it seems to me Slurm is really not a priority for them...

Best,
Renat.
________________________________________
From: slurm-users [slurm-users-bounces at lists.schedmd.com] On Behalf Of John Hearns [hearnsj at gmail.com]
Sent: Friday, November 10, 2017 10:11 AM
To: Slurm User Community List
Subject: Re: [slurm-users] introduce short delay starting multiple parallel jobs with srun

Renat,
  I understand better here.  It does look like job arrays are what you need.
Maybe you could ask for the Slurm version on your HPC to be updated.  I gues that may be difficult.

I am also guessing that you are doing some sort of Big Data task, maybe in Python?










On 10 November 2017 at 10:03, Yakupov, Renat /DZNE <Renat.Yakupov at dzne.de<mailto:Renat.Yakupov at dzne.de>> wrote:
slurm 2.5.0! seeing today's announcement about a double digit version release, that is... ancient!

Best,
Renat.
________________________________________
From: slurm-users [slurm-users-bounces at lists.schedmd.com<mailto:slurm-users-bounces at lists.schedmd.com>] On Behalf Of Loris Bennett [loris.bennett at fu-berlin.de<mailto:loris.bennett at fu-berlin.de>]
Sent: Friday, November 10, 2017 10:00 AM
To: Slurm User Community List
Subject: Re: [slurm-users] introduce short delay starting multiple parallel     jobs with srun

"Yakupov, Renat /DZNE" <Renat.Yakupov at dzne.de<mailto:Renat.Yakupov at dzne.de>> writes:

> How can I find that out? Dont see anything like that in slurm.conf...

squeue --version

> Best,
> Renat.
> ________________________________________
> From: slurm-users [slurm-users-bounces at lists.schedmd.com<mailto:slurm-users-bounces at lists.schedmd.com>] On Behalf Of Gennaro Oliva [oliva.g at na.icar.cnr.it<mailto:oliva.g at na.icar.cnr.it>]
> Sent: Thursday, November 09, 2017 3:55 PM
> To: Slurm User Community List
> Subject: Re: [slurm-users] introduce short delay starting multiple parallel jobs with srun
>
> Hi Renat,
>
> On Thu, Nov 09, 2017 at 03:46:23PM +0100, Yakupov, Renat /DZNE wrote:
>> I tried that. It doesnt even queue the job with an error:
>> sbatch: unrecognized option '--array=1-24'
>> sbatch: error: Try help for more information.
>
> what version of slurm are you using?
> Regards
> --
> Gennaro Oliva

--
Dr. Loris Bennett (Mr.)
ZEDAT, Freie Universität Berlin         Email loris.bennett at fu-berlin.de<mailto:loris.bennett at fu-berlin.de>