<div dir="ltr"><div>Hi Mahmood,</div><div><br></div><div></div><div>I had the same problem some time ago when I took control of the cluster and wanted to update the OS. While the login node has access to internet, the calculation nodes are connected to the login node and is a private network. Therefore, the only machine with access to the internet was the login node, unless you configure each calculation node to use as a proxy the login node. I believe I followed the instructions in this webpage to configure the calculation nodes (CentOS7)<br></div><div><br></div><div><a href="https://forums.centos.org/viewtopic.php?f=16&t=8583&start=10">https://forums.centos.org/viewtopic.php?f=16&t=8583&start=10</a></div><div><br></div><div>Good luck configuring your machines.<br></div><div><br></div><div>Best regards<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">El dom., 2 ago. 2020 a las 17:15, Brian Andrus (<<a href="mailto:toomuchit@gmail.com">toomuchit@gmail.com</a>>) escribió:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
  
    
  
  <div>
    <p>This is very likely by design of the cluster and/or network.
      Otherwise users could use the cluster to mine bitcoin and such.</p>
    <p>Brian Andrus<br>
    </p>
    <div>On 8/2/2020 7:11 AM, Mahmood Naderan
      wrote:<br>
    </div>
    <blockquote type="cite">
      
      <div dir="ltr">
        <div class="gmail_default" style="font-family:tahoma,sans-serif">I
          thought that maybe srun doesn't transfer all settings from the
          head node to the compute node.</div>
        <div class="gmail_default" style="font-family:tahoma,sans-serif">The
          wget command works on frontend but doesn't work on the
          compute.</div>
        <div class="gmail_default" style="font-family:tahoma,sans-serif"><br>
        </div>
        <div class="gmail_default" style="font-family:tahoma,sans-serif">
          mahmood@main-proxy:~$ wget <a href="http://google.com" target="_blank">google.com</a><br>
          --2020-08-02 16:05:55--  <a href="http://google.com/" target="_blank">http://google.com/</a><br>
          Resolving <a href="http://google.com" target="_blank">google.com</a> (<a href="http://google.com" target="_blank">google.com</a>)... 216.58.215.238,
          2a00:1450:400a:800::200e<br>
          Connecting to <a href="http://google.com" target="_blank">google.com</a> (<a href="http://google.com" target="_blank">google.com</a>)|216.58.215.238|:80...
          connected.<br>
          HTTP request sent, awaiting response... 301 Moved Permanently<br>
          Location: <a href="http://www.google.com/" target="_blank">http://www.google.com/</a>
          [following]<br>
          --2020-08-02 16:05:55--  <a href="http://www.google.com/" target="_blank">http://www.google.com/</a><br>
          Resolving <a href="http://www.google.com" target="_blank">www.google.com</a> (<a href="http://www.google.com" target="_blank">www.google.com</a>)...
          172.217.168.68, 2a00:1450:400a:803::2004<br>
          Connecting to <a href="http://www.google.com" target="_blank">www.google.com</a> (<a href="http://www.google.com" target="_blank">www.google.com</a>)|172.217.168.68|:80...
          connected.<br>
          HTTP request sent, awaiting response... 200 OK<br>
          Length: unspecified [text/html]<br>
          Saving to: ‘index.html’<br>
          <br>
          index.html                         [ <=>                
                                        ]  12.68K  --.-KB/s    in 0s<br>
          <br>
          2020-08-02 16:05:56 (196 MB/s) - ‘index.html’ saved [12983]<br>
          <br>
          mahmood@main-proxy:~$ srun -p gpu_part --gres=gpu:titanv:1
           --pty /bin/bash<br>
          mahmood@fry0:~$ wget <a href="http://google.com" target="_blank">google.com</a><br>
          --2020-08-02 16:05:30--  <a href="http://google.com/" target="_blank">http://google.com/</a><br>
          Resolving <a href="http://google.com" target="_blank">google.com</a> (<a href="http://google.com" target="_blank">google.com</a>)... 216.58.215.238,
          2a00:1450:400a:800::200e<br>
          Connecting to <a href="http://google.com" target="_blank">google.com</a> (<a href="http://google.com" target="_blank">google.com</a>)|216.58.215.238|:80...
          ^C<br>
          mahmood@fry0:~$<br>
        </div>
        <div class="gmail_default" style="font-family:tahoma,sans-serif"><br>
        </div>
        <div class="gmail_default" style="font-family:tahoma,sans-serif"><br>
        </div>
        <div class="gmail_default" style="font-family:tahoma,sans-serif"><br>
        </div>
        <div class="gmail_default" style="font-family:tahoma,sans-serif"><br>
        </div>
        <div class="gmail_default" style="font-family:tahoma,sans-serif">I
          will check the gateway with the admin. </div>
        <div class="gmail_default" style="font-family:tahoma,sans-serif">Thanks
          for the hint.</div>
        <div class="gmail_default" style="font-family:tahoma,sans-serif"><br>
        </div>
        <div class="gmail_default" style="font-family:tahoma,sans-serif"><br>
        </div>
        <div class="gmail_default" style="font-family:tahoma,sans-serif"><br>
        </div>
        <div>
          <div dir="ltr">
            <div dir="ltr"><font face="tahoma,sans-serif">Regards,<br>
                Mahmood</font><br>
              <br>
              <br>
            </div>
          </div>
        </div>
        <br>
      </div>
      <br>
      <div class="gmail_quote">
        <div dir="ltr" class="gmail_attr">On Sun, Aug 2, 2020 at 5:58 PM
          Renfro, Michael <<a href="mailto:Renfro@tntech.edu" target="_blank">Renfro@tntech.edu</a>>
          wrote:<br>
        </div>
        <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
          <div>
            <div dir="ltr">
              <div>
              </div>
              <div>
                <div>
                  <div style="direction:ltr">Probably unrelated to slurm
                    entirely, and most likely has to do with lower-level
                    network diagnostics. I can guarantee that it’s
                    possible to access Internet resources from a compute
                    node. Notes and things to check:</div>
                  <div><br>
                  </div>
                  <div style="direction:ltr">1. Both ping and http/https
                    are IP protocols, but are very different (ping isn’t
                    even TCP or UDP, it’s ICMP), so even if you needed
                    proxy variables for http and https to work, they
                    shouldn’t affect ping.</div>
                  <div><br>
                  </div>
                  <div style="direction:ltr">2. Do http or https
                    transfers work from a compute node? A github clone,
                    a test with curl or wget to a nearby web server? Do
                    your proxy variables exist on the compute node, and
                    most importantly, is there a proxy server listening
                    and functional on the host and port that the
                    variables point to?</div>
                  <div><br>
                  </div>
                  <div style="direction:ltr">3. What’s the default
                    gateway for your compute nodes? Does that gateway
                    provide network address translation (NAT) for the
                    nodes, or does it work as a traditional router?</div>
                </div>
                <div><br>
                </div>
                <div>Get <a href="https://aka.ms/o0ukef" target="_blank">Outlook for
                    iOS</a></div>
              </div>
              <hr style="display:inline-block;width:98%">
              <div id="gmail-m_-5860576418763995298gmail-m_-3352875155037592075gmail-m_-6726695868362249448divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri,
                  sans-serif" color="#000000"><b>From:</b> slurm-users
                  <<a href="mailto:slurm-users-bounces@lists.schedmd.com" target="_blank">slurm-users-bounces@lists.schedmd.com</a>>
                  on behalf of Mahmood Naderan <<a href="mailto:mahmood.nt@gmail.com" target="_blank">mahmood.nt@gmail.com</a>><br>
                  <b>Sent:</b> Sunday, August 2, 2020 7:52:52 AM<br>
                  <b>To:</b> Slurm User Community List <<a href="mailto:slurm-users@lists.schedmd.com" target="_blank">slurm-users@lists.schedmd.com</a>><br>
                  <b>Subject:</b> [slurm-users] Internet connection loss
                  with srun to a node</font>
                <div> <span style="font-family:tahoma,sans-serif;font-size:inherit;text-align:center">Hi</span></div>
              </div>
              <div>
                <div>
                  <div dir="ltr">
                    <div style="font-family:tahoma,sans-serif">A
                      frontend machine is connected to the internet and
                      from that machine, I use srun to get a bash on
                      another node. But it seems that the node is unable
                      to access the internet. The http_proxy and
                      https_proxy are defined in ~/.bashrc</div>
                    <div style="font-family:tahoma,sans-serif"><br>
                    </div>
                    <div style="font-family:tahoma,sans-serif">mahmood@main-proxy:~$
                      ping
                      <a href="http://google.com" target="_blank">google.com</a><br>
                      PING <a href="http://google.com" target="_blank">google.com</a>
                      (216.58.215.238) 56(84) bytes of data.<br>
                      64 bytes from <a href="http://zrh11s02-in-f14.1e100.net" target="_blank">zrh11s02-in-f14.1e100.net</a>
                      (216.58.215.238): icmp_seq=1 ttl=114 time=1.38 ms<br>
                      ^C<br>
                      --- <a href="http://google.com" target="_blank">google.com</a> ping
                      statistics ---<br>
                      1 packets transmitted, 1 received, 0% packet loss,
                      time 0ms<br>
                      rtt min/avg/max/mdev = 1.384/1.384/1.384/0.000 ms<br>
                    </div>
                    <div style="font-family:tahoma,sans-serif">mahmood@main-proxy:~$ <span style="font-family:Arial,Helvetica,sans-serif">srun
                        -p gpu_part --gres=gpu:titanv:1  --pty /bin/bash</span></div>
                    <span style="font-family:tahoma,sans-serif"></span>mahmood 
                    @fry0:~$ ping
                    <a href="http://google.com" target="_blank">google.com</a><br>
                    PING <a href="http://google.com" target="_blank">google.com</a>
                    (216.58.215.238) 56(84) bytes of data.<br>
                    ^C<br>
                    --- <a href="http://google.com" target="_blank">google.com</a> ping
                    statistics ---<br>
                    3 packets transmitted, 0 received, 100% packet loss,
                    time 2026ms<br>
                    <br>
                    <br>
                    <br>
                    <div style="font-family:tahoma,sans-serif">I guess
                      that is related to slurm and srun.</div>
                    <div style="font-family:tahoma,sans-serif">Any idea
                      for that?</div>
                    <br>
                    <br>
                    <div style="font-family:tahoma,sans-serif"> <br>
                    </div>
                    <div style="font-family:tahoma,sans-serif"><br>
                    </div>
                    <div style="font-family:tahoma,sans-serif"><br>
                    </div>
                    <div style="font-family:tahoma,sans-serif"><br>
                    </div>
                    <div style="font-family:tahoma,sans-serif"><br>
                    </div>
                    <div>
                      <div dir="ltr">
                        <div dir="ltr"><font face="tahoma,sans-serif">Regards,<br>
                            Mahmood</font><br>
                          <br>
                          <br>
                        </div>
                      </div>
                    </div>
                  </div>
                </div>
              </div>
            </div>
          </div>
        </blockquote>
      </div>
    </blockquote>
  </div>

</blockquote></div>