<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=ks_c_5601-1987">
<meta name="Generator" content="Microsoft Exchange Server">
<!-- converted from text --><style><!-- .EmailQuote { margin-left: 1pt; padding-left: 4pt; border-left: #800000 2px solid; } --></style>
</head>
<body>
<meta content="text/html; charset=UTF-8">
<style type="text/css" style="">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div dir="ltr">
<div id="x_divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Helvetica,sans-serif">
<p><span style="font-family:Calibri,Helvetica,sans-serif">Hello everyone,</span></p>
<p><br>
</p>
<p><span style="font-family:Calibri,Helvetica,sans-serif">Here it comes everything I've done.</span></p>
<p><br>
</p>
<p><span style="font-family:Calibri,Helvetica,sans-serif">- About Ole's answer:</span></p>
<p><span style="font-family:Calibri,Helvetica,sans-serif">Yes, we have slurm as the user to control munge. Following your comment, I have changed the ownership of the munge files and tried to start munge as munge user. However, it also failed.</span></p>
<p><span style="font-family:Calibri,Helvetica,sans-serif">Also, I first installed munge from a repository. I've seen your suggestion of installing from EPEL. So I uninstalled and installed again. Same result</span></p>
<p><span style="font-family:Calibri,Helvetica,sans-serif">- About SELinux: It is disables</span></p>
<p>- The output of <span style="color:rgb(33,33,33); font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif,serif,EmojiFont; font-size:15px">
ps -ef | grep munge <span style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
is:</span></span></p>
<p><span style="color:rgb(33,33,33); font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif,serif,EmojiFont; font-size:15px"><span style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt"><br>
</span></span></p>
<p><span style="color:rgb(33,33,33); font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif,serif,EmojiFont; font-size:15px"></p>
<p class="x_p1" style="margin-right:0px; margin-left:0px; font-size:11px; line-height:normal; font-family:Menlo">
<span class="x_s1" style="">root<span class="x_Apple-converted-space"> </span>
5340<span class="x_Apple-converted-space"> </span>5153<span class="x_Apple-converted-space">
</span>0 10:18 pts/0<span class="x_Apple-converted-space"> </span>00:00:00 grep --color=auto
</span><span class="x_s2" style="color:rgb(195,55,32)"><b>munge</b></span></p>
<p><span style="color:rgb(33,33,33); font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif,serif,EmojiFont; font-size:15px"><br>
</span></p>
- The outputs of munge -n is:</span>
<p></p>
<p><span style="color:rgb(33,33,33); font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif,serif,EmojiFont; font-size:15px"><br>
</span></p>
<p><span style="color:rgb(33,33,33); font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif,serif,EmojiFont; font-size:15px"></p>
<p class="x_p1" style="margin-right:0px; margin-left:0px; font-size:11px; line-height:normal; font-family:Menlo">
<span class="x_s1" style="">Failed to access "/var/run/munge/munge.socket.2": No such file or directory</span></p>
<p><span style="color:rgb(33,33,33); font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif,serif,EmojiFont; font-size:15px"><br>
</span></p>
- Same for unmunge</span>
<p></p>
<p><span style="color:rgb(33,33,33); font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif,serif,EmojiFont; font-size:15px"><br>
</span></p>
<p><span style="color:rgb(33,33,33); font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif,serif,EmojiFont; font-size:15px">- Output for </span><span style="font-family:Menlo; font-size:11px; color:rgb(33,33,33)">sudo systemctl status
--full munge</span></p>
<p><span style="font-family:Menlo; font-size:11px; color:rgb(33,33,33)"><br>
</span></p>
<p><span style="color:rgb(33,33,33); font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif,serif,EmojiFont; font-size:15px"></p>
<p class="x_p1" style="margin-right:0px; margin-left:0px; font-size:11px; line-height:normal; font-family:Menlo">
<span class="x_s1" style="color:rgb(195,55,32)"><b>¡Ü</b></span><span class="x_s2" style=""> munge.service - MUNGE authentication service</span></p>
<p class="x_p1" style="margin-right:0px; margin-left:0px; font-size:11px; line-height:normal; font-family:Menlo">
<span class="x_s2" style=""><span class="x_Apple-converted-space"> </span>Loaded: loaded (/usr/lib/systemd/system/munge.service; enabled; vendor preset: disabled)</span></p>
<p class="x_p1" style="margin-right:0px; margin-left:0px; font-size:11px; line-height:normal; font-family:Menlo">
<span class="x_s2" style=""><span class="x_Apple-converted-space"> </span>Active:
</span><span class="x_s1" style="color:rgb(195,55,32)"><b>failed</b></span><span class="x_s2" style=""> (Result: exit-code) since Fri 2020-05-29 10:15:52 CEST; 4min 18s ago</span></p>
<p class="x_p1" style="margin-right:0px; margin-left:0px; font-size:11px; line-height:normal; font-family:Menlo">
<span class="x_s2" style=""><span class="x_Apple-converted-space"> </span>Docs: man:munged(8)</span></p>
<p class="x_p1" style="margin-right:0px; margin-left:0px; font-size:11px; line-height:normal; font-family:Menlo">
<span class="x_s2" style=""><span class="x_Apple-converted-space"> </span>Process: 5333 ExecStart=/usr/sbin/munged
</span><span class="x_s1" style="color:rgb(195,55,32)"><b>(code=exited, status=1/FAILURE)</b></span></p>
<p class="x_p2" style="margin-right:0px; margin-left:0px; font-size:11px; line-height:normal; font-family:Menlo; min-height:13px">
<span class="x_s2" style=""></span><br>
</p>
<p class="x_p1" style="margin-right:0px; margin-left:0px; font-size:11px; line-height:normal; font-family:Menlo">
<span class="x_s2" style="">May 29 10:15:52 roos21.organ.su.se systemd[1]: Starting MUNGE authentication service...</span></p>
<p class="x_p1" style="margin-right:0px; margin-left:0px; font-size:11px; line-height:normal; font-family:Menlo">
<span class="x_s2" style="">May 29 10:15:52 roos21.organ.su.se systemd[1]: <b>munge.service: control process exited, code=exited status=1</b></span></p>
<p class="x_p1" style="margin-right:0px; margin-left:0px; font-size:11px; line-height:normal; font-family:Menlo">
<span class="x_s2" style="">May 29 10:15:52 roos21.organ.su.se systemd[1]: </span>
<span class="x_s1" style="color:rgb(195,55,32)"><b>Failed to start MUNGE authentication service.</b></span></p>
<p class="x_p1" style="margin-right:0px; margin-left:0px; font-size:11px; line-height:normal; font-family:Menlo">
<span class="x_s2" style="">May 29 10:15:52 roos21.organ.su.se systemd[1]: <b>Unit munge.service entered failed state.</b></span></p>
<p class="x_p1" style="margin-right:0px; margin-left:0px; font-size:11px; line-height:normal; font-family:Menlo">
<span class="x_s2" style="">May 29 10:15:52 roos21.organ.su.se systemd[1]: <b>munge.service failed.</b></span></p>
<br>
</span>
<p></p>
<p><span style="color:rgb(33,33,33); font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif,serif,EmojiFont; font-size:15px">- Regarding NTP, </span><span style="color:rgb(33,33,33); font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif,serif,EmojiFont; font-size:15px">I
get this message:</span></p>
<p><span style="color:rgb(33,33,33); font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif,serif,EmojiFont; font-size:15px"><br>
</span></p>
<p><span style="color:rgb(33,33,33); font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif,serif,EmojiFont; font-size:15px"></p>
<p class="x_p1" style="margin-right:0px; margin-left:0px; font-size:11px; line-height:normal; font-family:Menlo">
<span class="x_s1" style="">Unable to talk to NTP daemon. Is it running?</span></p>
<p class="x_p1" style="margin-right:0px; margin-left:0px; font-size:11px; line-height:normal; font-family:Menlo">
<span class="x_s1" style=""><br>
</span></p>
It is the same message I get in the nodes that DO work. All nodes are sync in time and date with the central node </span>
<p></p>
<p><span style="color:rgb(33,33,33); font-family:wf_segoe-ui_normal,"Segoe UI","Segoe WP",Tahoma,Arial,sans-serif,serif,EmojiFont; font-size:15px"><br>
</span></p>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="x_divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> slurm-users <slurm-users-bounces@lists.schedmd.com> on behalf of Ole Holm Nielsen <Ole.H.Nielsen@fysik.dtu.dk><br>
<b>Sent:</b> Friday, May 29, 2020 9:56:10 AM<br>
<b>To:</b> slurm-users@lists.schedmd.com<br>
<b>Subject:</b> Re: [slurm-users] Problem with permisions. CentOS 7.8</font>
<div> </div>
</div>
</div>
<font size="2"><span style="font-size:10pt;">
<div class="PlainText">On 29-05-2020 08:46, Sudeep Narayan Banerjee wrote:<br>
> also check:<br>
> a) whether NTP has been setup and communicating with master node<br>
> b) iptables may be flushed (iptables -L)<br>
> c) SeLinux to disabled, to check :<br>
> getenforce<br>
> vim /etc/sysconfig/selinux<br>
> (change SELINUX=enforcing to SELINUX=disabled and save the file and reboot)<br>
<br>
There is no reason to disable SELinux for running the Munge service.<br>
It's a pretty bad idea to lower the security just for the sake of <br>
convenience!<br>
<br>
/Ole<br>
<br>
<br>
> On Fri, May 29, 2020 at 12:08 PM Sudeep Narayan Banerjee <br>
> <snbanerjee@iitgn.ac.in <<a href="mailto:snbanerjee@iitgn.ac.in">mailto:snbanerjee@iitgn.ac.in</a>>> wrote:<br>
> <br>
> I have not checked on the CentOS7.8<br>
> a) if /var/run/munge folder does not exist then please double check<br>
> whether munge has been installed or not<br>
> b) user root or sudo user to do<br>
> ps -ef | grep munge<br>
> kill -9 <PID> //where PID is the Process ID for munge (if the<br>
> process is running at all); else<br>
> <br>
> which munged<br>
> /etc/init.d/munge start<br>
> <br>
> please let me know the the output of:<br>
> <br>
> |$ munge -n|<br>
> <br>
> |$ munge -n | unmunge|<br>
> <br>
> |$ sudo systemctl status --full munge<br>
> <br>
> |<br>
> <br>
> Thanks & Regards,<br>
> Sudeep Narayan Banerjee<br>
> System Analyst | Scientist B<br>
> Indian Institute of Technology Gandhinagar<br>
> Gujarat, INDIA<br>
> <br>
> <br>
> On Fri, May 29, 2020 at 11:55 AM Bj©ªrn-Helge Mevik<br>
> <b.h.mevik@usit.uio.no <<a href="mailto:b.h.mevik@usit.uio.no">mailto:b.h.mevik@usit.uio.no</a>>> wrote:<br>
> <br>
> Ferran Planas Padros <ferran.padros@su.se<br>
> <<a href="mailto:ferran.padros@su.se">mailto:ferran.padros@su.se</a>>> writes:<br>
> <br>
> > I run the command as slurm user, and the /var/log/munge<br>
> folder does belong to slurm.<br>
> <br>
> For security reasons, I strongly advise that you run munged as a<br>
> separate user, which is unprivileged and not used for anything else.<br>
> <br>
> -- <br>
> Regards,<br>
> Bj©ªrn-Helge Mevik, dr. scient,<br>
> Department for Research Computing, University of Oslo<br>
> <br>
<br>
<br>
</div>
</span></font>
</body>
</html>