<div dir="ltr">On Tue, Mar 10, 2020 at 1:41 PM mike tie <<a href="mailto:mtie@carleton.edu">mtie@carleton.edu</a>> wrote:<br><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Here is the output of lstopo</div></blockquote><div></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><br></div><div>
<p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures;color:rgb(68,37,213)"><b>$</b></span><span style="font-variant-ligatures:no-common-ligatures"> lstopo -p</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures">Machine (63GB)</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>Package P#0 + L3 (16MB)</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#0 + PU P#0</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#1 + PU P#1</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#2 + PU P#2</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#3 + PU P#3</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>Package P#1 + L3 (16MB)</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#0 + PU P#4</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#1 + PU P#5</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#2 + PU P#6</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#3 + PU P#7</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>Package P#2 + L3 (16MB)</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#0 + PU P#8</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#1 + PU P#9</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#2 + PU P#10</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#3 + PU P#11</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>Package P#3 + L3 (16MB)</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#0 + PU P#12</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#1 + PU P#13</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#2 + PU P#14</span></span></p><span style="background-color:rgb(255,255,255)">
</span><p style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:13px;line-height:normal;font-family:Menlo;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)"><span style="font-variant-ligatures:no-common-ligatures"><span> </span>L2 (4096KB) + L1d (32KB) + L1i (32KB) + Core P#3 + PU P#15</span></span></p></div></div></blockquote><div><br></div><div>
<div>There is no sane way to derive the number 10 from this topology.
obviously: it has a prime factor of 5, but everything in the lstopo output is sized in powers of 2 (4 packages, a.k.a. sockets, 4 single-threaded CPU cores per). <br></div><div><br></div><div>I responded yesterday but somehow managed to plop my signature into the middle of it, so maybe you have missed inline replies?</div><div><br></div><div>It's
very, very likely
that the number is stored *somewhere*. First to eliminate is the hypothesis that the number is acquired from the control daemon. That's the simplest step and the largest landgrab in the divide-and-conquer analysis plan. Then just look where it comes from on the VM. strace(1) will reveal all files slurmd reads. <br></div><div><br></div><div>You are not rolling out the VMs from an image, ain't you? I'm wondering why do you need to tweak an existing VM that is already in a weird state. Is simply setting its snapshot aside and creating a new one from an image hard/impossible? I did not touch VMWare for more than 10 years, so I may be a bit naive; in the platform I'm working now (GCE), create-use-drop pattern of VM use is much more common and simpler than create and maintain it to either *ad infinitum* or *ad nauseam*, whichever will have been reached the earliest. But I don't know anything about VMWare; maybe it's not possible or feasible with it.</div><div><br></div><div> -kkm</div><br></div></div></div>