<html>
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
</head>
<body>
<p>Maybe too obvious, but have you checked your .bashrc,
.bash_profile and such?</p>
<p>Brian Andrus<br>
</p>
<div class="moz-cite-prefix">On 5/12/2020 10:27 AM, Ellestad, Erik
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:BY5PR05MB6900AF5E35B2F43BAB9A4B3D9ABE0@BY5PR05MB6900.namprd05.prod.outlook.com">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<meta name="Generator" content="Microsoft Word 15 (filtered
medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle18
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal"><span style="color:#1F497D">Which SLURM
prolog specifically?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">I’m not finding
that to work for me in either task-prolog or prolog.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">SLURM_TMPDIR
and TMPDIR are still both set to /tmp when I run a job.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">Erik<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-family:"Courier
New";color:#1F497D">--<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier
New";color:#1F497D">Erik Ellestad<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier
New";color:#1F497D">Wynton Cluster SysAdmin<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier
New";color:#1F497D">UCSF<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1
1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> slurm-users
<a class="moz-txt-link-rfc2396E" href="mailto:slurm-users-bounces@lists.schedmd.com"><slurm-users-bounces@lists.schedmd.com></a>
<b>On Behalf Of </b>Roger Moye<br>
<b>Sent:</b> Tuesday, May 12, 2020 9:12 AM<br>
<b>To:</b> Slurm User Community List
<a class="moz-txt-link-rfc2396E" href="mailto:slurm-users@lists.schedmd.com"><slurm-users@lists.schedmd.com></a><br>
<b>Subject:</b> Re: [slurm-users] Reset TMPDIR for All
Jobs<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">We had issues
getting TMPDIR to work as well. We finally did this in our
prolog:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">export
SLURM_TMPDIR="/tmp/slurm/${SLURM_JOB_ID}"<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">This works.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">-Roger<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1
1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> slurm-users <<a
href="mailto:slurm-users-bounces@lists.schedmd.com"
moz-do-not-send="true">slurm-users-bounces@lists.schedmd.com</a>>
<b>On Behalf Of </b>Ellestad, Erik<br>
<b>Sent:</b> Tuesday, May 12, 2020 10:40 AM<br>
<b>To:</b> <a href="mailto:slurm-users@lists.schedmd.com"
moz-do-not-send="true">slurm-users@lists.schedmd.com</a><br>
<b>Subject:</b> [slurm-users] Reset TMPDIR for All Jobs<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I was wanted to set TMPDIR from /tmp to a
per job directory I create in local /scratch/$SLURM_JOB_ID
(for example)<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">This bug suggests I should be able to do
this in a task-prolog.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><a
href="https://urldefense.proofpoint.com/v2/url?u=https-3A__bugs.schedmd.com_show-5Fbug.cgi-3Fid-3D2664&d=DwMFAg&c=iORugZls2LlYyCAZRB3XLg&r=Ct3zEADMmPgyUYfpHDJQWaWsE9mNbEHEhGxpsYoThbE&m=xPdUh7dM0hithU9gkyVB8sI8GVpqet6rKWAGEAyuPa4&s=6Zv-scnpqWg7bREwPfLGi8FJE8BOCCurK4pMiw91P84&e="
moz-do-not-send="true">https://bugs.schedmd.com/show_bug.cgi?id=2664</a><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">However adding the following to task-prolog
doesn’t seem to affect the variables the job script is running
with.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">unset TMPDIR<o:p></o:p></p>
<p class="MsoNormal">export TMPDIR=/scratch/$SLURM_JOB_ID<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">It does work if it is done in the job
script, rather than the task-prolog.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Am I missing something?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Erik<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier
New"">--<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier
New"">Erik Ellestad<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier
New"">Wynton Cluster SysAdmin<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier
New"">UCSF<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p><span
style="font-size:8.5pt;font-family:"Verdana",sans-serif"> -----------------------------------------------------------------------------------</span><o:p></o:p></p>
<p><span
style="font-size:8.5pt;font-family:"Verdana",sans-serif">The
information in this communication and any attachment is
confidential and intended solely for the attention and use
of the named addressee(s). All information and opinions
expressed herein are subject to change without notice. This
communication is not to be construed as an offer to sell or
the solicitation of an offer to buy any security. Any such
offer or solicitation can only be made by means of the
delivery of a confidential private offering memorandum
(which should be carefully reviewed for a complete
description of investment strategies and risks). Any
reliance one may place on the accuracy or validity of this
information is at their own risk. Past performance is not
necessarily indicative of the future results of an
investment. All figures are estimated and unaudited unless
otherwise noted. If you are not the intended recipient, or a
person responsible for delivering this to the intended
recipient, you are not authorized to and must not disclose,
copy, distribute, or retain this message or any part of it.
In this case, please notify the sender immediately at
713-333-5440</span><o:p></o:p></p>
</div>
</blockquote>
</body>
</html>