[slurm-users] REST-based CLI tools out there somewhere?
cseraphine at DRWHoldings.com
Fri Nov 10 18:35:35 UTC 2023
> what are the security concerns?
The cluster is shared between some business units that do not want to share data, so if we install the munge key on a machine that users have administrative or physical access to it could become compromised. This could allow them to run jobs on the cluster as another user and retrieve data from shared filesystems.
Jupyterhub is heavily used, but suffers from the same problem- it needs to be running on a submit node. And, as you mentioned, an interactive solution has drawbacks with many types of workloads.
On 11/10/23, 1:31 AM, "slurm-users on behalf of Hagdorn, Magnus Karl Moritz" <slurm-users-bounces at lists.schedmd.com <mailto:slurm-users-bounces at lists.schedmd.com> on behalf of magnus.hagdorn at charite.de <mailto:magnus.hagdorn at charite.de>> wrote:
what are the security concerns? Being able to control jobs is one
thing. Your users still need to setup the jobs which presumably
involves moving data. We have provided some launchers written in python
for specific use cases (that don't involve moving data). We also have a
jupyterhub that launches notebooks on the cluster. This works quite
well, but you do end up with interactive jobs which are most likely
less efficient than batch jobs. Again, this really depends on your use
On Thu, 2023-11-09 at 23:14 +0000, Chip Seraphine wrote:
> Our users submit their jobs from shared submit hosts, and have
> expressed an understandable preference for being able to submit
> directly from their own workstations. The obvious solution
> (installing the slurm client on their workstations, or providing a
> container that does something similar) are not available to us
> because of security concerns. This leaves REST as the best
> option. We’re hoping to provide a REST-based toolset that users
> familiar with the command line tools can make immediate use of (so,
> provides basic, stripped-down functionality of srun, squeue, sacct,
> and sinfo). Basically, we want to create a subset of the s* commands
> that can be run from some arbitrary machine if the user has the
> appropriate token.
> It’d be surprising if we were the first people to go down this path,
> but searching has turned up nothing. Is there a project anyone
> knows about out there for providing command-line SLURM commands that
> use REST to talk to the daemons? Or am I missing some obvious
> solution here?
> Chip Seraphine
> Grid Operations
> For support please use help-grid in email or slack.
> This e-mail and any attachments may contain information that is
> confidential and proprietary and otherwise protected from disclosure.
> If you are not the intended recipient of this e-mail, do not read,
> duplicate or redistribute it by any means. Please immediately delete
> it and any attachments and notify the sender that you have received
> it by mistake. Unintended recipients are prohibited from taking
> action on the basis of information in this e-mail or any attachments.
> The DRW Companies make no representations that this e-mail or any
> attachments are free of computer viruses or other defects.
Charité – Universitätsmedizin Berlin
Geschäftsbereich IT | Scientific Computing
Campus Charité Mitte
BALTIC - Invalidenstraße 120/121
magnus.hagdorn at charite.de <mailto:magnus.hagdorn at charite.de>
HPC Helpdesk: sc-hpc-helpdesk at charite.de <mailto:sc-hpc-helpdesk at charite.de>
More information about the slurm-users