<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div dir="auto" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
Good morning.
<div class="">I have having the same experience here. Wondering if you had a resolution?</div>
<div class="">Thank you.</div>
<div class="">Jodie</div>
<div class=""><br class="">
<div><br class="">
<div class="">On Jun 11, 2020, at 3:27 PM, Rhian Resnick <<a href="mailto:rresnick@fau.edu" class="">rresnick@fau.edu</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
We have several users submitting single GPU jobs to our cluster. <span style="margin: 0px;" class="">We expected the jobs to fill each node and fully utilize the available GPU's but we instead find that only 2 out of the 4 gpu's in each node gets allocated. </span></div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<br class="">
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
If we request 2 GPU's in the job and start two jobs, both jobs will start on the same node fully allocating the node. We are puzzled about is going on and any hints are welcome. </div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<br class="">
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
Thanks for your help,</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<br class="">
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
Rhian</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<br class="">
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<br class="">
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<br class="">
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<b class="">Example SBATCH Script</b></div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
#!/bin/bash<br class="">
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<div style="margin: 0px;" class="">#SBATCH --job-name=test<br class="">
</div>
<div style="margin: 0px;" class="">#SBATCH --partition=longq7-mri<br class="">
</div>
<div style="margin: 0px;" class="">#SBATCH -N 1<br class="">
</div>
<div style="margin: 0px;" class="">#SBATCH -n 1<br class="">
</div>
<div style="margin: 0px;" class="">#SBATCH --gres=gpu:1<br class="">
</div>
<div style="margin: 0px;" class="">#SBATCH --mail-type=ALL<br class="">
</div>
<div style="margin: 0px;" class="">hostname<br class="">
</div>
<div style="margin: 0px;" class="">echo CUDA_VISIBLE_DEVICES $CUDA_VISIBLE_DEVICES<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class="">set | grep SLURM<br class="">
</div>
<div style="margin: 0px;" class="">nvidia-smi<br class="">
</div>
<div style="margin: 0px;" class="">sleep 500<br class="">
</div>
<span style="margin: 0px;" class=""></span></div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<br class="">
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<br class="">
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<br class="">
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<br class="">
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<b class="">gres.conf</b></div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<span style="margin: 0px;" class="">#AutoDetect=nvml<br class="">
</span>
<div style="margin: 0px;" class="">Name=gpu Type=v100 File=/dev/nvidia0 Cores=0<br class="">
</div>
<div style="margin: 0px;" class="">Name=gpu Type=v100 File=/dev/nvidia1 Cores=1<br class="">
</div>
<div style="margin: 0px;" class="">Name=gpu Type=v100 File=/dev/nvidia2 Cores=2<br class="">
</div>
<div style="margin: 0px;" class="">Name=gpu Type=v100 File=/dev/nvidia3 Cores=3<br class="">
</div>
<span style="margin: 0px;" class=""></span><br class="">
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<br class="">
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<b class="">slurm.conf</b></div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
#<br class="">
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<div style="margin: 0px;" class=""># Example slurm.conf file. Please run configurator.html<br class="">
</div>
<div style="margin: 0px;" class=""># (in doc/html) to build a configuration file customized<br class="">
</div>
<div style="margin: 0px;" class=""># for your environment.<br class="">
</div>
<div style="margin: 0px;" class="">#<br class="">
</div>
<div style="margin: 0px;" class="">#<br class="">
</div>
<div style="margin: 0px;" class=""># slurm.conf file generated by configurator.html.<br class="">
</div>
<div style="margin: 0px;" class="">#<br class="">
</div>
<div style="margin: 0px;" class=""># See the slurm.conf man page for more information.<br class="">
</div>
<div style="margin: 0px;" class="">#<br class="">
</div>
<div style="margin: 0px;" class="">ClusterName=cluster<br class="">
</div>
<div style="margin: 0px;" class="">ControlMachine=<a href="http://cluster-slurm1.example.com/" class="">cluster-slurm1.example.com</a><br class="">
</div>
<div style="margin: 0px;" class="">ControlAddr=10.116.0.11<br class="">
</div>
<div style="margin: 0px;" class="">BackupController=<a href="http://cluster-slurm2.example.com/" class="">cluster-slurm2.</a><span style="margin: 0px; background-color: rgb(255, 255, 255); display: inline !important;" class=""><a href="http://cluster-slurm2.example.com/" class="">example.com</a></span><br class="">
</div>
<div style="margin: 0px;" class="">BackupAddr=10.116.0.17<br class="">
</div>
<div style="margin: 0px;" class="">#<br class="">
</div>
<div style="margin: 0px;" class="">SlurmUser=slurm<br class="">
</div>
<div style="margin: 0px;" class="">#SlurmdUser=root<br class="">
</div>
<div style="margin: 0px;" class="">SlurmctldPort=6817<br class="">
</div>
<div style="margin: 0px;" class="">SlurmdPort=6818<br class="">
</div>
<div style="margin: 0px;" class="">SchedulerPort=7321<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class="">RebootProgram="/usr/sbin/reboot"<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class="">AuthType=auth/munge<br class="">
</div>
<div style="margin: 0px;" class="">#JobCredentialPrivateKey=<br class="">
</div>
<div style="margin: 0px;" class="">#JobCredentialPublicCertificate=<br class="">
</div>
<div style="margin: 0px;" class="">StateSaveLocation=/var/spool/slurm/ctld<br class="">
</div>
<div style="margin: 0px;" class="">SlurmdSpoolDir=/var/spool/slurm/d<br class="">
</div>
<div style="margin: 0px;" class="">SwitchType=switch/none<br class="">
</div>
<div style="margin: 0px;" class="">MpiDefault=none<br class="">
</div>
<div style="margin: 0px;" class="">SlurmctldPidFile=/var/run/slurmctld.pid<br class="">
</div>
<div style="margin: 0px;" class="">SlurmdPidFile=/var/run/slurmd.pid<br class="">
</div>
<div style="margin: 0px;" class="">ProctrackType=proctrack/pgid<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class="">GresTypes=gpu,mps,bandwidth<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class="">PrologFlags=x11<br class="">
</div>
<div style="margin: 0px;" class="">#PluginDir=<br class="">
</div>
<div style="margin: 0px;" class="">#FirstJobId=<br class="">
</div>
<div style="margin: 0px;" class="">#MaxJobCount=<br class="">
</div>
<div style="margin: 0px;" class="">#PlugStackConfig=<br class="">
</div>
<div style="margin: 0px;" class="">#PropagatePrioProcess=<br class="">
</div>
<div style="margin: 0px;" class="">#PropagateResourceLimits=<br class="">
</div>
<div style="margin: 0px;" class="">#PropagateResourceLimitsExcept=<br class="">
</div>
<div style="margin: 0px;" class="">#Prolog=<br class="">
</div>
<div style="margin: 0px;" class="">#Epilog=/etc/slurm/slurm.epilog.clean<br class="">
</div>
<div style="margin: 0px;" class="">#SrunProlog=<br class="">
</div>
<div style="margin: 0px;" class="">#SrunEpilog=<br class="">
</div>
<div style="margin: 0px;" class="">#TaskProlog=<br class="">
</div>
<div style="margin: 0px;" class="">#TaskEpilog=<br class="">
</div>
<div style="margin: 0px;" class="">#TaskPlugin=<br class="">
</div>
<div style="margin: 0px;" class="">#TrackWCKey=no<br class="">
</div>
<div style="margin: 0px;" class="">#TreeWidth=50<br class="">
</div>
<div style="margin: 0px;" class="">#TmpFS=<br class="">
</div>
<div style="margin: 0px;" class="">#UsePAM=<br class="">
</div>
<div style="margin: 0px;" class="">#<br class="">
</div>
<div style="margin: 0px;" class=""># TIMERS<br class="">
</div>
<div style="margin: 0px;" class="">SlurmctldTimeout=300<br class="">
</div>
<div style="margin: 0px;" class="">SlurmdTimeout=300<br class="">
</div>
<div style="margin: 0px;" class="">InactiveLimit=0<br class="">
</div>
<div style="margin: 0px;" class="">MinJobAge=300<br class="">
</div>
<div style="margin: 0px;" class="">KillWait=30<br class="">
</div>
<div style="margin: 0px;" class="">Waittime=0<br class="">
</div>
<div style="margin: 0px;" class="">#<br class="">
</div>
<div style="margin: 0px;" class=""># SCHEDULING<br class="">
</div>
<div style="margin: 0px;" class="">SchedulerType=sched/backfill<br class="">
</div>
<div style="margin: 0px;" class="">#bf_interval=10<br class="">
</div>
<div style="margin: 0px;" class="">#SchedulerAuth=<br class="">
</div>
<div style="margin: 0px;" class="">#SelectType=select/linear<br class="">
</div>
<div style="margin: 0px;" class=""># Cores and memory are consumable<br class="">
</div>
<div style="margin: 0px;" class="">#SelectType=select/cons_res<br class="">
</div>
<div style="margin: 0px;" class="">#SelectTypeParameters=CR_Core_Memory<br class="">
</div>
<div style="margin: 0px;" class="">SchedulerParameters=bf_interval=10<br class="">
</div>
<div style="margin: 0px;" class="">SelectType=select/cons_res<br class="">
</div>
<div style="margin: 0px;" class="">SelectTypeParameters=CR_Core<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class="">FastSchedule=1<br class="">
</div>
<div style="margin: 0px;" class="">#PriorityType=priority/multifactor<br class="">
</div>
<div style="margin: 0px;" class="">#PriorityDecayHalfLife=14-0<br class="">
</div>
<div style="margin: 0px;" class="">#PriorityUsageResetPeriod=14-0<br class="">
</div>
<div style="margin: 0px;" class="">#PriorityWeightFairshare=100000<br class="">
</div>
<div style="margin: 0px;" class="">#PriorityWeightAge=1000<br class="">
</div>
<div style="margin: 0px;" class="">#PriorityWeightPartition=10000<br class="">
</div>
<div style="margin: 0px;" class="">#PriorityWeightJobSize=1000<br class="">
</div>
<div style="margin: 0px;" class="">#PriorityMaxAge=1-0<br class="">
</div>
<div style="margin: 0px;" class="">#<br class="">
</div>
<div style="margin: 0px;" class=""># LOGGING<br class="">
</div>
<div style="margin: 0px;" class="">SlurmctldDebug=3<br class="">
</div>
<div style="margin: 0px;" class="">SlurmctldLogFile=/var/log/slurmctld.log<br class="">
</div>
<div style="margin: 0px;" class="">SlurmdDebug=3<br class="">
</div>
<div style="margin: 0px;" class="">SlurmdLogFile=/var/log/slurmd.log<br class="">
</div>
<div style="margin: 0px;" class="">JobCompType=jobcomp/none<br class="">
</div>
<div style="margin: 0px;" class="">#JobCompLoc=<br class="">
</div>
<div style="margin: 0px;" class="">#<br class="">
</div>
<div style="margin: 0px;" class=""># ACCOUNTING<br class="">
</div>
<div style="margin: 0px;" class="">#JobAcctGatherType=jobacct_gather/linux<br class="">
</div>
<div style="margin: 0px;" class="">#JobAcctGatherFrequency=30<br class="">
</div>
<div style="margin: 0px;" class="">#<br class="">
</div>
<div style="margin: 0px;" class="">#AccountingStorageType=accounting_storage/slurmdbd<br class="">
</div>
<div style="margin: 0px;" class="">#AccountingStorageHost=<br class="">
</div>
<div style="margin: 0px;" class="">#AccountingStorageLoc=<br class="">
</div>
<div style="margin: 0px;" class="">#AccountingStoragePass=<br class="">
</div>
<div style="margin: 0px;" class="">#AccountingStorageUser=<br class="">
</div>
<div style="margin: 0px;" class="">#<br class="">
</div>
<div style="margin: 0px;" class="">#<br class="">
</div>
<div style="margin: 0px;" class="">#<br class="">
</div>
<div style="margin: 0px;" class=""># Default values<br class="">
</div>
<div style="margin: 0px;" class=""># DefMemPerNode=64000<br class="">
</div>
<div style="margin: 0px;" class=""># DefCpuPerGPU=4<br class="">
</div>
<div style="margin: 0px;" class=""># DefMemPerCPU=4000<br class="">
</div>
<div style="margin: 0px;" class=""># DefMemPerGPU=16000<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># OpenHPC default configuration<br class="">
</div>
<div style="margin: 0px;" class="">#TaskPlugin=task/affinity<br class="">
</div>
<div style="margin: 0px;" class="">TaskPlugin=task/affinity,task/cgroup<br class="">
</div>
<div style="margin: 0px;" class="">PropagateResourceLimitsExcept=MEMLOCK<br class="">
</div>
<div style="margin: 0px;" class="">TaskPluginParam=autobind=cores<br class="">
</div>
<div style="margin: 0px;" class="">#AccountingStorageType=accounting_storage/mysql<br class="">
</div>
<div style="margin: 0px;" class="">#StorageLoc=slurm_acct_db<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class="">AccountingStorageType=accounting_storage/slurmdbd<br class="">
</div>
<div style="margin: 0px;" class="">AccountingStorageHost=<a href="http://cluster-slurmdbd1.example.com/" class="">cluster-slurmdbd1.example.com</a><br class="">
</div>
<div style="margin: 0px;" class="">#AccountingStorageType=accounting_storage/filetxt<br class="">
</div>
<div style="margin: 0px;" class="">Epilog=/etc/slurm/slurm.epilog.clean<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class="">#PartitionName=normal Nodes=c[1-5] Default=YES MaxTime=24:00:00 State=UP<br class="">
</div>
<div style="margin: 0px;" class="">PartitionName=DEFAULT State=UP Default=NO AllowGroups=ALL Priority=10 DisableRootJobs=NO RootOnly=NO Hidden=NO Shared=NO GraceTime=0 PreemptMode=OFF ReqResv=NO AllowAccounts=ALL AllowQos=ALL LLN=NO ExclusiveUser=NO Nodes=nodeamd[009-016],c[1-4],nodehtc[001-025]<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># Partitions<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># Group Limited Queues</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># OIT DEBUG QUEUE<br class="">
</div>
<div style="margin: 0px;" class="">PartitionName=debug Nodes=c[1-4] MaxTime=24:00:00 State=UP AllowGroups=oit-hpc-admin <br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># RNA CHEM<br class="">
</div>
<div style="margin: 0px;" class="">PartitionName=longq7-rna MinNodes=1 MaxNodes=30 DefaultTime=168:00:00 MaxTime=UNLIMITED Priority=200 Nodes=nodeamd[001-008],nodegpu[021-025] AllowGroups=gpu-rnachem<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># V100's<br class="">
</div>
<div style="margin: 0px;" class="">PartitionName=longq7-mri MinNodes=1 MaxNodes=30 DefaultTime=168:00:00 MaxTime=168:00:00 Priority=200 Nodes=nodenviv100[001-016] AllowGroups=gpu-mri<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># BIGDATA GRANT<br class="">
</div>
<div style="margin: 0px;" class="">PartitionName=longq-bigdata7 MinNodes=1 MaxNodes=30 DefaultTime=168:00:00 MaxTime=168:00:00 Priority=200 Nodes=node[087-098],nodegpu001 AllowGroups=fau-bigdata,nsf-bigdata<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class="">PartitionName=gpu-bigdata7 Default=NO MinNodes=1 Priority=10 AllowAccounts=ALL Nodes=nodegpu001 AllowGroups=fau-bigdata,nsf-bigdata<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># CogNeuroLab<br class="">
</div>
<div style="margin: 0px;" class="">PartitionName=CogNeuroLab Default=NO MinNodes=1 MaxNodes=4 MaxTime=7-12:00:00 AllowGroups=cogneurolab Priority=200 State=UP Nodes=node[001-004]<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># Standard queues<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># OPEN TO ALL<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class="">#Short Queue</div>
<div style="margin: 0px;" class="">PartitionName=shortq7 MinNodes=1 MaxNodes=30 DefaultTime=06:00:00 MaxTime=06:00:00 Priority=100 Nodes=nodeamd[001-016],nodenviv100[001-015],nodegpu[001-025],node[001-100],nodehtc[001-025] Default=YES<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># Medium Queue<br class="">
</div>
<div style="margin: 0px;" class="">PartitionName=mediumq7 MinNodes=1 MaxNodes=30 DefaultTime=72:00:00 MaxTime=72:00:00 Priority=50 Nodes=nodeamd[009-016],node[004-100]<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># Long Queue</div>
<div style="margin: 0px;" class="">PartitionName=longq7 MinNodes=1 MaxNodes=30 DefaultTime=168:00:00 MaxTime=168:00:00 Priority=30 Nodes=nodeamd[009-016],node[004-100]<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># Interactive<br class="">
</div>
<div style="margin: 0px;" class="">PartitionName=interactive MinNodes=1 MaxNodes=4 DefaultTime=06:00:00 MaxTime=06:00:00 Priority=101 Nodes=node[001-100] Default=No Hidden=YES<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># Nodes<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># Test nodes, (vms)</div>
<div style="margin: 0px;" class="">NodeName=c[1-4] Cpus=4 Feature=virtual RealMemory=16000<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># AMD Nodes</div>
<div style="margin: 0px;" class="">NodeName=nodeamd[001-016] Procs=64 Boards=1 SocketsPerBoard=8 CoresPerSocket=8 ThreadsPerCore=1 Features=amd,epyc RealMemory=225436<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># V100 MRI<br class="">
</div>
<div style="margin: 0px;" class="">NodeName=nodenviv100[001-016] CPUs=64 Boards=1 SocketsPerBoard=2 CoresPerSocket=16 ThreadsPerCore=2 Gres=gpu:v100:4 Feature=v100 RealMemory=192006<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># GPU nodes</div>
<div style="margin: 0px;" class="">NodeName=nodegpu001 Procs=40 Boards=1 SocketsPerBoard=2 CoresPerSocket=10 ThreadsPerCore=2 Gres=gpu:k80:8 Feature=k80,intel RealMemory=64000<br class="">
</div>
<div style="margin: 0px;" class="">NodeName=nodegpu002 Procs=40 Boards=1 SocketsPerBoard=2 CoresPerSocket=10 ThreadsPerCore=2 Gres=gpu:gk1:8 Feature=gk1,intel RealMemory=128000<br class="">
</div>
<div style="margin: 0px;" class="">NodeName=nodegpu[003-020] Boards=1 SocketsPerBoard=2 CoresPerSocket=8 ThreadsPerCore=2 Gres=gpu:gk1:8 Feature=gk1,intel RealMemory=128000<br class="">
</div>
<div style="margin: 0px;" class="">NodeName=nodegpu[021-025] Procs=16 Boards=1 SocketsPerBoard=2 CoresPerSocket=8 ThreadsPerCore=1 Gres=gpu:4 Feature=exxact,intel RealMemory=128000<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># IvyBridge nodes<br class="">
</div>
<div style="margin: 0px;" class="">NodeName=node[001-021] Procs=20 Boards=1 SocketsPerBoard=2 CoresPerSocket=10 ThreadsPerCore=1 Feature=intel,ivybridge RealMemory=112750<br class="">
</div>
<div style="margin: 0px;" class=""># SandyBridge node(2)<br class="">
</div>
<div style="margin: 0px;" class="">NodeName=node022 Procs=16 Boards=1 SocketsPerBoard=2 CoresPerSocket=8 ThreadsPerCore=1 Feature=intel,sandybridge RealMemory=64000<br class="">
</div>
<div style="margin: 0px;" class=""># IvyBridge <br class="">
</div>
<div style="margin: 0px;" class="">NodeName=node[023-050] Procs=20 Boards=1 SocketsPerBoard=2 CoresPerSocket=10 ThreadsPerCore=1 Feature=intel,ivybridge RealMemory=112750<br class="">
</div>
<div style="margin: 0px;" class=""># Haswell<br class="">
</div>
<div style="margin: 0px;" class="">NodeName=node[051-100] Procs=20 Boards=1 SocketsPerBoard=2 CoresPerSocket=10 ThreadsPerCore=1 Feature=intel,haswell RealMemory=112750<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># Node health monitoring<br class="">
</div>
<div style="margin: 0px;" class="">HealthCheckProgram=/usr/sbin/nhc<br class="">
</div>
<div style="margin: 0px;" class="">HealthCheckInterval=300<br class="">
</div>
<div style="margin: 0px;" class="">ReturnToService=2<br class="">
</div>
<div style="margin: 0px;" class=""><br class="">
</div>
<div style="margin: 0px;" class=""># Fix for X11 issues</div>
<div style="margin: 0px;" class="">X11Parameters=use_raw_hostname<br class="">
</div>
<span style="margin: 0px;" class=""></span><br class="">
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255);" class="">
<br class="">
</div>
<div style="margin: 0px; font-size: 15px; font-family: "Segoe UI", "Segoe UI Web (West European)", "Segoe UI", -apple-system, BlinkMacSystemFont, Roboto, "Helvetica Neue", sans-serif; color: rgb(32, 31, 30); background-color: rgb(255, 255, 255);" class="">
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif;" class="">
<br class="">
</div>
<div style="margin: 0px;" class="">
<div style="margin: 0px;" class="">
<div dir="ltr" style="margin: 0px; background-color: rgb(255, 255, 255);" class="">
<div style="margin: 0px;" class="">
<div style="margin: 0px; background-color: rgb(255, 255, 255);" class="">
<div style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 12pt; background-color: rgb(255, 255, 255);" class="">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif;" class="">Rhian Resnick</span></div>
<div style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 16px; background-color: rgb(255, 255, 255);" class="">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif;" class="">Associate Director Research Computing</span><span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif;" class=""></span></div>
<div style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 16px; background-color: rgb(255, 255, 255);" class="">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif;" class="">Enterprise Systems</span></div>
<div style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 16px; background-color: rgb(255, 255, 255);" class="">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif;" class="">Office of Information Technology</span></div>
<div style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 12pt; background-color: rgb(255, 255, 255);" class="">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif;" class=""><br class="">
</span></div>
<div style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 12pt; background-color: rgb(255, 255, 255);" class="">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif;" class="">Florida Atlantic University</span><span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif;" class=""></span></div>
<div style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 12pt; background-color: rgb(255, 255, 255);" class="">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif;" class="">777 Glades Road, CM22, Rm 173B</span><span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif;" class=""></span></div>
<div style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 12pt; background-color: rgb(255, 255, 255);" class="">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif;" class="">Boca Raton, FL 33431</span><span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif;" class=""></span></div>
<div style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 12pt; background-color: rgb(255, 255, 255);" class="">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif;" class="">Phone 561.297.2647</span><span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif;" class=""></span></div>
<div style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 12pt; background-color: rgb(255, 255, 255);" class="">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif;" class="">Fax 561.297.0222</span></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<br class="">
</div>
</div>
</body>
</html>