<html style="direction: ltr;">
  <head>
    <meta content="text/html; charset=utf-8" http-equiv="Content-Type">
    <style type="text/css">body p { margin-bottom: 0cm; margin-top: 0pt; } </style>
  </head>
  <body style="direction: ltr;" bidimailui-charset-is-forced="true"
    bgcolor="#FFFFFF" text="#000000">
    Hey all,<br>
    We used to numbers from the following commands:<br>
    sinfo -o %G(as suggested above) - gives total gpu in cluster<br>
    <br>
    squeue -o %b   - gives amount of gpu in use for each running job<br>
    sum all the numbers under %b gives you gpu in use in cluster<br>
    <br>
    pestat was suggested by ole, but the flag required it is not
    supported yet.<br>
    <br>
    There are <br>
    <br>
    <div class="moz-cite-prefix">On 16/03/2018 20:44, jayraj shah wrote:<br>
    </div>
    <blockquote
cite="mid:CAAhpvo5eozxFSQhH44MkszDk472=8BsZngFvPjL1T9VxPthzXg@mail.gmail.com"
      type="cite">
      <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
      <div dir="ltr">
        <div>Thank you. </div>
        I tried that option but it gives me, how many gpus are
        available/attached to node. (such as gpu:8)
        <div>I want to know how many are used and how many are free (to
          run my jobs on free gpus).</div>
      </div>
      <div class="gmail_extra"><br>
        <div class="gmail_quote">On Fri, Mar 16, 2018 at 2:34 PM, <a
            moz-do-not-send="true"
            href="mailto:sefa.arslan@tubitak.gov.tr">sefa.arslan@tubitak.gov.tr</a>
          <span dir="ltr"><<a moz-do-not-send="true"
              href="mailto:sefa.arslan@tubitak.gov.tr" target="_blank">sefa.arslan@tubitak.gov.tr</a>></span>
          wrote:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0
            .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div style="margin-bottom:45px">
              <div style="font-size:10pt">
                <div dir="ltr" style="margin-top:0;margin-bottom:0">You
                  msy use sinfo with parameters i.e. %G .</div>
                <div dir="ltr" style="margin-top:0;margin-bottom:0"><br>
                </div>
                <div dir="ltr" style="margin-top:0;margin-bottom:0"><a
                    moz-do-not-send="true"
                    href="https://slurm.schedmd.com/sinfo.html"
                    target="_blank">https://slurm.schedmd.com/<wbr>sinfo.html</a><br>
                </div>
                <div dir="ltr" style="margin-top:0;margin-bottom:0"><br>
                </div>
                <div id="m_-8446362290111768562SignatureBox" dir="ltr"
                  style="margin-top:0;margin-bottom:0">
                  <div dir="ltr"
                    style="margin-top:0px;margin-bottom:0px">Sefa Arslan</div>
                </div>
              </div>
              <div style="font-size:10pt">
                <div id="m_-8446362290111768562LGEmailHeader" dir="ltr"
                  style="margin-top:0;margin-bottom:0">
                  <div dir="ltr" style="margin-top:0;margin-bottom:0"><br>
                  </div>
                  <div dir="ltr" style="margin-top:0;margin-bottom:0">------
                    Orijinal mesaj------</div>
                  <div dir="ltr" style="margin-top:0;margin-bottom:0"><b>Kimden:
                    </b>jayraj shah</div>
                  <div dir="ltr" style="margin-top:0;margin-bottom:0"><b>Tarih:
                    </b>Cum, 16 Mar 2018 21:18</div>
                  <div dir="ltr" style="margin-top:0;margin-bottom:0"><b>Kime:
                    </b><a moz-do-not-send="true"
                      href="mailto:slurm-users@schedmd.com"
                      target="_blank">slurm-users@schedmd.com</a>;</div>
                  <div dir="ltr" style="margin-top:0;margin-bottom:0"><b>Konu:</b>[slurm-users]
                    Available gpus ?</div>
                  <div dir="ltr" style="margin-top:0;margin-bottom:0"><br>
                  </div>
                </div>
                <div>
                  <div class="h5">
                    <div dir="ltr">
                      <div dir="ltr">I am trying to find out how as a
                        user, I can get information about
                        available/unused gpus on cluster. </div>
                      <div dir="ltr"><br>
                      </div>
                      <div dir="ltr">This cluster is setup in a way that
                        user can request gpus per node between 1 to 8.
                        Using sinfo it shows that STATE is "mix". But I
                        can't tell how many out of 8 are being used and
                        how many are available on that mix state node
                        for other user to use. </div>
                      <div dir="ltr"><br>
                      </div>
                      <div dir="ltr"><br>
                      </div>
                      <div dir="ltr">Please let me know your
                        suggestions. </div>
                      <div dir="ltr"><br>
                      </div>
                      <br clear="all">
                      <div dir="ltr"><br>
                      </div>
                      -- <br>
                      <div class="m_-8446362290111768562gmail_signature"
                        data-smartmail="gmail_signature" dir="ltr">
                        <div dir="ltr">Thanks</div>
                        <div dir="ltr">Jayraj</div>
                        <div dir="ltr"><br>
                        </div>
                      </div>
                    </div>
                  </div>
                </div>
              </div>
            </div>
          </blockquote>
        </div>
        <br>
        <br clear="all">
        <div><br>
        </div>
        -- <br>
        <div class="gmail_signature" data-smartmail="gmail_signature">
          <div>Thanks</div>
          <div>Jayraj</div>
          <div><br>
          </div>
        </div>
      </div>
    </blockquote>
    <br>
  </body>
</html>