<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">Hi:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">slurmctld runs as an unprivileged user ('slurm' by default) who probably doesn't have read access to the user's job scripts. 'sbatch' submits the scripts via network to slurmctld, who stores them in the slurm.conf 'StateSaveLocation',
and sends them to slurmds at dispatch time, who store them on each node in the slurm.conf 'SlurmdSpoolDir', as Steffen noted.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">All this to say that the slurmctld host doesn't need to see the users' home dirs and/or job script dirs.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal"><span style="color:black">== <o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">Paul Brunk, system administrator</span><o:p></o:p></p>
<p class="MsoNormal"><span style="color:black">Georgia Advanced Resource Computing Center<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">Enterprise IT Svcs, the University of Georgia<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">On 2/10/22, 6:26 AM, "slurm-users" <slurm-users-bounces@lists.schedmd.com> wrote:<o:p></o:p></p>
<div>
<p class="MsoNormal">[EXTERNAL SENDER - PROCEED CAUTIOUSLY]<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">On Thu, 2022-02-10 at 11:59:58 +0100, Diego Zuccato wrote:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">> Hello all.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">> Does slurmctld (or slurmdbd) need to access the same filesystems used on<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">> submit nodes? Or they just receive the needed information in the request?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">> Does slurmctld need read access to /home/userA/myjob.sh or does it receive<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">> the job script as a "blob" or as a path? Does it even need to know userA's<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">> GID or will it simply use 'userA' to lookup associations in dbd?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Looking into one of our Slurm installations (pre-installed):<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">- file systems must not be shared with the machine running the dbd/ctld,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> the job script is copied into a subdirectory of /var/spool/slurm on<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> the exec node (but I can't say for sure who does this)<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">- UIDs are reported by the ctld so they "should" be identical for the<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> controller and submit machines (and the execute ones, of course) -<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> I never saw GIDs mentioned though.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Does this help?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">- Steffen<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">--<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Steffen Grunewald, Cluster Administrator<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Max Planck Institute for Gravitational Physics (Albert Einstein Institute)<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Am Mühlenberg 1 * D-14476 Potsdam-Golm * Germany<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">~~~<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Fon: +49-331-567 7274<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Mail: steffen.grunewald(at)aei.mpg.de<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">~~~<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</body>
</html>