<html dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style>
<!--
@font-face
{font-family:"Cambria Math"}
@font-face
{font-family:Calibri}
@font-face
{font-family:Tahoma}
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif}
a:link, span.MsoHyperlink
{color:#0563C1;
text-decoration:underline}
a:visited, span.MsoHyperlinkFollowed
{color:#954F72;
text-decoration:underline}
p.msonormal0, li.msonormal0, div.msonormal0
{margin-right:0in;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif}
p.p1, li.p1, div.p1
{margin-right:0in;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif}
p.p2, li.p2, div.p2
{margin-right:0in;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif}
span.EmailStyle21
{font-family:"Calibri",sans-serif;
color:#1F497D}
.MsoChpDefault
{font-size:10.0pt}
@page WordSection1
{margin:1.0in 1.0in 1.0in 1.0in}
-->
</style><style type="text/css" id="owaParaStyle"></style>
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72" fpstyle="1" ocsi="0">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">We do have hyperthreading enabled. Here are some log extracts fomr various attempts to get it working.
<div><br>
</div>
<div>
<div>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T15:52:30.466] error: we don't have select plugin type 101</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T15:52:30.466] error: select_g_select_jobinfo_unpack: unpack error</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T15:52:30.466] error: Malformed RPC of type REQUEST_ABORT_JOB(6013) received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T15:52:30.466] error: slurm_receive_msg_and_forward: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T15:52:30.476] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T15:58:55.683] error: we don't have select plugin type 101</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T15:58:55.683] error: select_g_select_jobinfo_unpack: unpack error</span></p>
<p class="p1"><span class="s1"><br>
</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.490] error: we don't have select plugin type 101</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.490] error: select_g_select_jobinfo_unpack: unpack error</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.490] error: Malformed RPC of type REQUEST_TERMINATE_JOB(6011) received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.490] error: slurm_receive_msg_and_forward: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.491] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.491] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.492] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.492] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.493] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.496] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.496] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.498] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.498] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.498] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.498] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.498] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.500] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.500] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.500] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.500] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.500] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:02:21.500] error: service_connection: slurm_receive_msg: Header lengths are longer than data received</span></p>
<p class="p1"><span class="s1" style="font-size: 12pt;">[2017-</span><span class="s2" style="font-size: 12pt;">11-28</span><span class="s1" style="font-size: 12pt;">T16:03:21.535] error: we don't have select plugin type 101</span></p>
<p class="p1"><span style="font-family: Tahoma; font-size: 13px;"><br>
</span></p>
<p class="p1"><span style="font-family: Tahoma; font-size: 13px;"><br>
</span></p>
<p class="p1"><span style="font-family: Tahoma; font-size: 13px;">At one point using linear ( I think) I was able to get 4 jobs to run at once on this node/ We have 40 cpu....</span></p>
<p class="p1"><span style="font-family: Tahoma; font-size: 13px;"><br>
</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:37:36.023] _run_prolog: run job script took usec=4</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:37:36.023] _run_prolog: prolog with lock for job 6637 ran for 0 seconds</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:37:36.023] Launching batch job 6637 for UID 1000</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:37:36.024] _run_prolog: run job script took usec=4</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:37:36.024] _run_prolog: prolog with lock for job 6638 ran for 0 seconds</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:37:36.024] _run_prolog: run job script took usec=5</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:37:36.024] _run_prolog: prolog with lock for job 6639 ran for 0 seconds</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:37:36.025] _run_prolog: run job script took usec=4</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:37:36.025] _run_prolog: prolog with lock for job 6640 ran for 0 seconds</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:37:36.030] Launching batch job 6640 for UID 1000</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:37:36.037] Launching batch job 6638 for UID 1000</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:37:36.044] Launching batch job 6639 for UID 1000</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:38:18.011] [6639] sending REQUEST_COMPLETE_BATCH_SCRIPT, error:0 status 59648</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:38:18.011] [6638] sending REQUEST_COMPLETE_BATCH_SCRIPT, error:0 status 59648</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:38:18.011] [6640] sending REQUEST_COMPLETE_BATCH_SCRIPT, error:0 status 59648</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:38:18.012] [6637] sending REQUEST_COMPLETE_BATCH_SCRIPT, error:0 status 59648</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:38:18.015] [6640] done with job</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:38:18.015] [6639] done with job</span></p>
<p class="p1"><span class="s1">[2017-</span><span class="s2">11-28</span><span class="s1">T16:38:18.015] [6638] done with job</span></p>
<p class="p1"><span class="s1" style="font-size: 12pt;">[2017-</span><span class="s2" style="font-size: 12pt;">11-28</span><span class="s1" style="font-size: 12pt;">T16:38:18.015] [6637] done with job</span></p>
<p class="p1"><span style="font-family: Tahoma; font-size: 13px;"><br>
</span></p>
<p class="p1"><span style="font-family: Tahoma; font-size: 13px;"><br>
</span></p>
<p class="p1"><span style="font-family: Tahoma; font-size: 13px;"><br>
</span></p>
<p class="p1"><span style="font-family: Tahoma; font-size: 13px;"><br>
</span></p>
<p class="p1"><span style="font-family: Tahoma; font-size: 13px;">Ethan VanMatre</span></p>
<div style="font-family:Tahoma; font-size:13px">
<div style="font-family:Tahoma; font-size:13px">
<div style="font-family:Tahoma; font-size:13px">
<div style="font-family:Tahoma; font-size:13px">Informatics Research Analyst<br>
Institute on Development and Disability<br>
Oregon Health & Science University<br>
CSLU - GH40<br>
3181 SW Sam Jackson Park Rd<br>
Portland, OR 97239<br>
(503) 346-3764<br>
vanmatre@ohsu.edu<br>
</div>
</div>
</div>
</div>
</div>
<div style="font-family: Times New Roman; color: #000000; font-size: 16px">
<hr tabindex="-1">
<div id="divRpF490286" style="direction: ltr;"><font face="Tahoma" size="2" color="#000000"><b>From:</b> slurm-users [slurm-users-bounces@lists.schedmd.com] on behalf of Williams, Jenny Avis [jennyw@email.unc.edu]<br>
<b>Sent:</b> Tuesday, November 28, 2017 5:45 PM<br>
<b>To:</b> Slurm User Community List<br>
<b>Subject:</b> Re: [slurm-users] fail when trying to set up selection=con_res<br>
</font><br>
</div>
<div></div>
<div>
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">We run in that manner using this config on v.3.10.0-693.5.2.el7.x86_64 This is slurm 17.02.4</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">Do your compute nodes have hyperthreading enabled ?</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> AuthType=auth/munge</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> CryptoType=crypto/munge</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> AccountingStorageEnforce=limits,qos,safe</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">AccountingStoragePort=ANumber AccountingStorageType=accounting_storage/slurmdbd</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> AccountingStoreJobComment='yes'</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> AccountingStorageUser=slurm</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> CacheGroups=0</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> EnforcePartLimits='yes'</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> FastSchedule=1</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> GresTypes=gpu</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> InactiveLimit=0</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> JobAcctGatherFrequency=30</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> JobAcctGatherType=jobacct_gather/cgroup</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> KillWait=30</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> Licenses=mplus:1</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> MaxArraySize=40001</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> MaxJobCount=350000</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> MinJobAge=300</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> MpiDefault=none</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> PriorityDecayHalfLife=14-0</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> PriorityFavorSmall='no'</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> PriorityFlags=fair_tree</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> PriorityMaxAge=60-0</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> PriorityType=priority/multifactor</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> PriorityWeightAge=1000</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> PriorityWeightFairshare=10000</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> PriorityWeightJobSize=1000</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> PriorityWeightPartition=1000</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> PriorityWeightQOS=1000</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> ProctrackType=proctrack/cgroup</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> RebootProgram=/usr/sbin/reboot</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> ReturnToService=2</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> SallocDefaultCommand='"srun -n1 -N1 --gres=gpu:0 --mem-per-cpu=0 --pty --preserve-env --mpi=none $SHELL"'</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> SchedulerPort=ANumber</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> SchedulerParameters=kill_invalid_depend</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> SchedulerType=sched/backfill</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> SelectTypeParameters=CR_CPU_Memory</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> SelectType=select/cons_res</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> SlurmctldDebug=3</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> SlurmctldPort=NumberRange
</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> SlurmctldTimeout=120</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> SlurmdDebug=3</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> SlurmdPort=ANumber</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> SlurmdTimeout=300</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> SlurmUser=slurm</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> SwitchType=switch/none</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> TaskPlugin=task/cgroup</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> Waittime=0</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D">ANumber are port numbers or ranges.</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:#1F497D"> </span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> slurm-users [mailto:slurm-users-bounces@lists.schedmd.com]
<b>On Behalf Of </b>Ethan Van Matre<br>
<b>Sent:</b> Tuesday, November 28, 2017 7:32 PM<br>
<b>To:</b> slurm-users@lists.schedmd.com<br>
<b>Subject:</b> [slurm-users] fail when trying to set up selection=con_res</span></p>
</div>
</div>
<p class="MsoNormal"> </p>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black">I've been trying to setup a slurm cluster with con_res enabled. No luck.
</span></p>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"> </span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black">Running on ubuntu 16.04</span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"> </span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black">When using linear selection all works as expected. Jobs are schedules and run their course then exit. Exclusive use of the node is granted.</span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"> </span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black">We would like to schedule based on cpu (cores actually) and set thus:</span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"> </span></p>
</div>
<div>
<p class="p1"><span class="s1"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"># SCHEDULING</span></span><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"></span></p>
<p class="p2"><span class="s1"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black">FastSchedule=1</span></span><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"></span></p>
<p class="p2"><span class="s1"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black">SchedulerType=sched/backfill</span></span><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"></span></p>
<p class="p1"><span class="s1"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black">#SchedulerPort=7321</span></span><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"></span></p>
<p class="p1"><span class="s1"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black">#SelectType=select/linear</span></span><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"></span></p>
<p class="p2"><span class="s1"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black">SelectType=select/cons_res</span></span><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"></span></p>
<p class="p2"><span class="s1"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black">SelectTypeParameters=CR_CORE</span></span><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"></span></p>
<p class="p1"><span class="s1"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black">#SelectTypeParameters=CR_CPU</span></span><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"></span></p>
<p class="p1"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"> </span></p>
<p class="p1"><span class="s1"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black">When launching jobs we more than one at a time per node but the jobs become hung in a COMPLETING state. Not sure if they ever started.</span></span><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"></span></p>
<p class="p1"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"> </span></p>
<p class="p1"><span class="s1"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black">Can anyone point me to how to set up slurm so that allocation is on a cpu (core) basis with as many jobs as there are cores running on each node?</span></span><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"></span></p>
<p class="p1"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"> </span></p>
<p class="p1"><span class="s1"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black">Regards</span></span><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"> </span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black"> </span></p>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt; font-family:"Tahoma",sans-serif; color:black">Ethan VanMatre<br>
Informatics Research Analyst<br>
Institute on Development and Disability<br>
Oregon Health & Science University<br>
CSLU - GH40<br>
3181 SW Sam Jackson Park Rd<br>
Portland, OR 97239<br>
(503) 346-3764<br>
<a href="mailto:vanmatre@ohsu.edu" target="_blank">vanmatre@ohsu.edu</a></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>