[slurm-users] [ext] Submitting jobs from machines outside the cluster

[Hagdorn, Magnus Karl Moritz]

Hi Steve,
we are running a jupyterhub that uses our cluster as a backend. You
need to be able to submit jobs from the hub node, ie you need to
configure slurm and have the slurm binaries. You don't need to run
slurmd. We are using the batchspawner to launch the jobs on the
cluster. 
Regards
magnus


On Sat, 2023-08-26 at 23:17 -0700, Steven Swanson wrote:
> Can I submit jobs with a computer/docker container that is not part
> of the slurm cluster?
> 
> I'm trying to set up slurm as the backend for a system with Jupyter
> Notebook-based front end.  
> 
> The jupyter notebooks are running in containers managed by Jupyter
> Hub, which is a mostly turnkey system for providing docker containers
> that users can access via jupyter.
> 
> I would like the jupyter containers to be able to submit jobs to
> slurm, but making them part of the cluster doesn't seem to make sense
> because:
> 
> 1.  They are dynamically created and don't have known hostnames.
> 2.  They aren't supposed to run jobs.
> 
> Is there a way to do this?  I tried just running slurmd in the
> jupyter containers, but it complained about not being able to figure
> out its name (I think because the container's hostname is not listed
> in slurm.conf).
> 
> My fall back solution is to use ssh to connect to the slurm head node
> and run jobs there, but that seems kludgy.
> 
> -steve

-- 
Magnus Hagdorn
Charité – Universitätsmedizin Berlin
Geschäftsbereich IT | Scientific Computing
 
Campus Charité Virchow Klinikum
Forum 4 | Ebene 02 | Raum 2.020
Augustenburger Platz 1
13353 Berlin
 
magnus.hagdorn at charite.de
https://www.charite.de
HPC Helpdesk: sc-hpc-helpdesk at charite.de
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20230828/fc2767a5/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 5449 bytes
Desc: not available
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20230828/fc2767a5/attachment.bin>