<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Hi Loris,<br>
<br>
ok, THAT seems really much.<br>
What do you use for gathering these values? jobacct_gather/cgroup?<br>
<br>
If I remember right, there was a discussion lately in this list
regarding the JobAcctGatherType, yet I do not remember the outcame.
I remember though, that someone pointed to SLUG18 (or 17?).
Nonetheless there is the following whitepaper:<br>
<br>
<a class="moz-txt-link-freetext" href="https://slurm.schedmd.com/SLUG18/field_notes2.pdf">https://slurm.schedmd.com/SLUG18/field_notes2.pdf</a><br>
<br>
<div style="left: 112.156px; top: 194.5px; font-size: 36.6667px;
font-family: sans-serif; transform: scaleX(0.871923);"><font
size="-1">My current recommended deployment has:</font></div>
<div style="left: 124.0354039691328px; top: 244.13524218732744px;
font-size: 30.000000959999994px; font-family: sans-serif;"><font
size="-1">○</font></div>
<div style="left: 172.156px; top: 244.135px; font-size: 30px;
font-family: sans-serif; transform: scaleX(0.879913);"><font
size="-1">proctrack/cgroup, task/cgroup, jobacct_gather/cgroup</font></div>
<div style="left: 124.0354039691328px; top: 285.38524350732746px;
font-size: 30.000000959999994px; font-family: sans-serif;"><font
size="-1">○</font></div>
<div style="left: 172.156px; top: 285.385px; font-size: 30px;
font-family: sans-serif; transform: scaleX(0.90357);"><font
size="-1">cgroup.conf - ConstrainCores, ContrainDevices,
ConstrainRAMSpace, </font></div>
<div style="left: 172.156px; top: 326.635px; font-size: 30px;
font-family: sans-serif; transform: scaleX(0.905164);"><font
size="-1">ConstrainSwapSpace all enabled</font></div>
<div style="left: 124.0354039691328px; top: 367.88524614732745px;
font-size: 30.000000959999994px; font-family: sans-serif;"><font
size="-1">○</font></div>
<div style="left: 172.156px; top: 367.885px; font-size: 30px;
font-family: sans-serif; transform: scaleX(0.886506);"><font
size="-1">PrologFlags=contain with pam_slurm_adopt setup
appropriately</font></div>
<div style="left: 124.0354039691328px; top: 409.13524746732736px;
font-size: 30.000000959999994px; font-family: sans-serif;"><font
size="-1">○</font></div>
<div style="left: 172.156px; top: 409.135px; font-size: 30px;
font-family: sans-serif; transform: scaleX(0.899801);"><font
size="-1">LaunchParameters=send_gids</font></div>
<div style="left: 124.0354039691328px; top: 450.3852487873274px;
font-size: 30.000000959999994px; font-family: sans-serif;"><font
size="-1">○</font></div>
<div style="left: 172.156px; top: 450.385px; font-size: 30px;
font-family: sans-serif; transform: scaleX(0.908085);"><font
size="-1">ReconfigFlags=KeepPartInfo</font></div>
<br>
Best<br>
Marcus<br>
<br>
<br>
<div class="moz-cite-prefix">On 2/26/19 1:20 PM, Loris Bennett
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:87sgwa91wn.fsf@hornfels.zedat.fu-berlin.de">
<pre class="moz-quote-pre" wrap="">Hi Marcus,
Thanks for the response, but that doesn't seem to be the issue. The
problem seems to be that the raw data are incorrect:
Slurm data: ... Ncpus Nnodes Ntasks Reqmem PerNode Cput Walltime Mem ExitStatus
Slurm data: ... 50 2 1 102400000 0 503611 16310 1.8014398509482e+16 0
Cheers,
Loris
Marcus Wagner <a class="moz-txt-link-rfc2396E" href="mailto:wagner@itc.rwth-aachen.de"><wagner@itc.rwth-aachen.de></a> writes:
</pre>
<blockquote type="cite">
<pre class="moz-quote-pre" wrap="">Hi Loris,
I assume, this job used FAIRLY few memory, in the kb range, might that be true?
replace
sub kbytes2str {
my $kbytes = shift;
if ($kbytes == 0) {
return sprintf("%.2f %sB", 0.0, 'M');
}
my $mul = 1024;
my $exp = int(log($kbytes) / log($mul));
my @pre = qw/ M G T P E /;
my $pre = $pre[$exp-1];
return sprintf("%.2f %sB", ($kbytes / pow($mul, $exp)), $pre ? $pre : "");
}
with
my @pre = qw/ k M G T P E /;
my $pre = $pre[$exp];
Best
Marcus
On 2/26/19 10:08 AM, Loris Bennett wrote:
</pre>
<blockquote type="cite">
<pre class="moz-quote-pre" wrap="">48.00 EB (estimated maximum)
Memory Efficiency: 26388279066.62% of 195.31 GB (1.95 GB/core)
</pre>
</blockquote>
</blockquote>
</blockquote>
<br>
<pre class="moz-signature" cols="72">--
Marcus Wagner, Dipl.-Inf.
IT Center
Abteilung: Systeme und Betrieb
RWTH Aachen University
Seffenter Weg 23
52074 Aachen
Tel: +49 241 80-24383
Fax: +49 241 80-624383
<a class="moz-txt-link-abbreviated" href="mailto:wagner@itc.rwth-aachen.de">wagner@itc.rwth-aachen.de</a>
<a class="moz-txt-link-abbreviated" href="http://www.itc.rwth-aachen.de">www.itc.rwth-aachen.de</a>
</pre>
</body>
</html>