[slurm-users] MPI Spawn with IntelMPI and multiple nodes
craig.warren at northumbria.ac.uk
Tue Apr 30 15:56:45 UTC 2019
I am trying (unsuccessfully) to use MPI Spawn with IntelMPI and Slurm over multiple nodes. A single node works OK using mpiexec.hydra:
mpiexec.hydra -n 1 python ./script_here.py
My MPI is a task farm essentially based on - https://github.com/jbornschein/mpi4py-examples/blob/master/10-task-pull-spawn.py. The full code is at - https://github.com/gprMax/gprMax/blob/master/gprMax/gprMax.py#L323
I have also tried using srun but it does not spawn the correct number of tasks.
Any advice on routes to solve the problem would be most welcome!
My full submit script:
module --force purge
module use /usr/local/software/jureca/OtherStages
module load Stages/2018b
module load Intel IntelMPI
source activate gprMax
mpiexec.hydra -n 1 python -m gprMax user_models/cylinder_Bscan_2D.in -n 47 -mpi 48
Dr Craig Warren CEng MIMechE MIET FHEA
Senior Lecturer, Department of Mechanical & Construction Engineering
T: +44 (0)191 227 3633
E: craig.warren at northumbria.ac.uk<mailto:craig.warren at northumbria.ac.uk>
Twitter: @DrCraigWarren<http://www.twitter.com/DrCraigWarren>, @enginerdsUK<http://www.twitter.com/enginerdsUK>
Room 117, Wynne Jones Building, Northumbria University, Newcastle upon Tyne, NE1 8ST, United Kingdom
This message is intended solely for the addressee and may contain confidential and/or legally privileged information. Any use, disclosure or reproduction without the sender's explicit consent is unauthorised and may be unlawful. If you have received this message in error, please notify Northumbria University immediately and permanently delete it. Any views or opinions expressed in this message are solely those of the author and do not necessarily represent those of the University. Northumbria University email is provided by Microsoft Office365 and is hosted within the EEA, although some information may be replicated globally for backup purposes. The University cannot guarantee that this message or any attachment is virus free or has not been intercepted and/or amended.
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the slurm-users