[slurm-users] Submitting jobs from machines outside the cluster

mohammed shambakey shambakey1 at gmail.com
Sun Aug 27 07:35:15 UTC 2023


Hi

May be slurm rest api be useful (https://slurm.schedmd.com/rest.html)? But
I think you will need to generate a token to be able to communicate with
the cluster.

Regards

On Sun, Aug 27, 2023, 8:20 AM Steven Swanson <sjswanson at ucsd.edu> wrote:

> Can I submit jobs with a computer/docker container that is not part of the
> slurm cluster?
>
> I'm trying to set up slurm as the backend for a system with Jupyter
> Notebook-based front end.
>
> The jupyter notebooks are running in containers managed by Jupyter Hub,
> which is a mostly turnkey system for providing docker containers that users
> can access via jupyter.
>
> I would like the jupyter containers to be able to submit jobs to slurm,
> but making them part of the cluster doesn't seem to make sense because:
>
> 1.  They are dynamically created and don't have known hostnames.
> 2.  They aren't supposed to run jobs.
>
> Is there a way to do this?  I tried just running slurmd in the jupyter
> containers, but it complained about not being able to figure out its name
> (I think because the container's hostname is not listed in slurm.conf).
>
> My fall back solution is to use ssh to connect to the slurm head node and
> run jobs there, but that seems kludgy.
>
> -steve
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20230827/6f1bb327/attachment.htm>


More information about the slurm-users mailing list