<!DOCTYPE html>
<html>
<head>
<title></title>
<style type="text/css">p.MsoNormal,p.MsoNoSpacing{margin:0}</style>
</head>
<body><div style="font-size:16px;">Hello all.<br></div>
<div style="font-size:16px;"><br></div>
<div style="font-size:16px;">I'm seeing something strange related to group memberships and how it bothers Slurm. Appreciate any ideas to understand what is going on.<br></div>
<div style="font-size:16px;"><br></div>
<div style="font-size:16px;">It appears that only the primary group of the user is propagated when Slurm runs a job. The additional group memberships vanish. This is not expected behaviour. I'm wondering if I'm missing any configuration with slurm.<br></div>
<div style="font-size:16px;"><br></div>
<div style="font-size:16px;"><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;">navtp@console2:~> id</span><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;"><br></span></div>
<div style="font-size:16px;"><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;">uid=29865(navtp) gid=510(finland) groups=510(finland),508(nav),5001(ghpc) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023</span><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;"><br></span></div>
<div style="font-size:16px;"><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;"><br></span></div>
<div style="font-size:16px;"><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;">navtp@console2:~> ssh c07b07 id</span><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;"><br></span></div>
<div style="font-size:16px;"><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;">uid=29865(navtp) gid=510(finland) groups=510(finland),508(nav),5001(ghpc) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023</span><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;"><br></span></div>
<div style="font-size:16px;"><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;"><br></span></div>
<div style="font-size:16px;"><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;">navtp@console2:~> srun -p nav hostname</span><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;"><br></span></div>
<div style="font-size:16px;"><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;">slurmstepd: error: couldn't chdir to `/usr/home/nav/finland/navtp': Permission denied: going to /tmp instead</span><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;"><br></span></div>
<div style="font-size:16px;"><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;">c07b07.ghpc.au.dk</span><br></div>
<div style="font-size:16px;"><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;"><br></span></div>
<div style="font-size:16px;"><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;">navtp@console2:~> srun -p nav id</span><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;"><br></span></div>
<div style="font-size:16px;"><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;">slurmstepd: error: couldn't chdir to `/usr/home/nav/finland/navtp': Permission denied: going to /tmp instead</span><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;"><br></span></div>
<div style="font-size:16px;"><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;">uid=29865(navtp) gid=510(finland) groups=510(finland) context=system_u:system_r:unconfined_service_t:s0</span><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;"><br></span></div>
<div style="font-size:16px;"><span class="font" style="font-family: menlo, consolas, monospace, sans-serif;">navtp@console2:~></span></div>
<div style="font-size:16px;"><br></div>
<div style="font-size:16px;">Our cluster uses FreeIPA and hence sssd to provide central identity management.<br></div>
<div style="font-size:16px;"><br></div>
<div style="font-size:16px;">As you can see, the user - navtp is part of finland, nav, and ghpc groups. finland being primary group.<br></div>
<div style="font-size:16px;"><br></div>
<div style="font-size:16px;">when I ssh into a node directly, the groups are configured correctly as shown by ssh command.<br></div>
<div style="font-size:16px;"><br></div>
<div style="font-size:16px;">But, through Slurm the additional groups vanish. This means that the user now cannot access some directories they normally would. I believe this is also the reason for the slurmstepd errors.<br></div>
<div style="font-size:16px;"><br></div>
<div style="font-size:16px;">How can I make Slurm retain all group memberships? <br></div>
<div style="font-size:16px;"><br></div>
<div style="font-size:16px;">Thanks,<br></div>
<div style="font-size:16px;">Aravindh</div>
<div style="font-size:16px;"><br></div>
<div id="sig56753105"><div class="signature">--<br></div>
<div class="signature"> Aravindh Sampathkumar<br></div>
<div class="signature"> aravindh@fastmail.com<br></div>
<div class="signature"><br></div>
</div>
<div style="font-size:16px;"><br></div>
</body>
</html>