<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
We have several users submitting single GPU jobs to our cluster. <span style="margin: 0px">We expected the jobs to fill each node and fully utilize the available GPU's but we instead find that only 2 out of the 4 gpu's in each node gets allocated. </span></div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<br>
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
If we request 2 GPU's in the job and start two jobs, both jobs will start on the same node fully allocating the node. We are puzzled about is going on and any hints are welcome. </div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<br>
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
Thanks for your help,</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<br>
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
Rhian</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<br>
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<br>
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<br>
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<b>Example SBATCH Script</b></div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
#!/bin/bash<br>
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<div style="margin: 0px">#SBATCH --job-name=test<br>
</div>
<div style="margin: 0px">#SBATCH --partition=longq7-mri<br>
</div>
<div style="margin: 0px">#SBATCH -N 1<br>
</div>
<div style="margin: 0px">#SBATCH -n 1<br>
</div>
<div style="margin: 0px">#SBATCH --gres=gpu:1<br>
</div>
<div style="margin: 0px">#SBATCH --mail-type=ALL<br>
</div>
<div style="margin: 0px">hostname<br>
</div>
<div style="margin: 0px">echo CUDA_VISIBLE_DEVICES $CUDA_VISIBLE_DEVICES<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px">set | grep SLURM<br>
</div>
<div style="margin: 0px">nvidia-smi<br>
</div>
<div style="margin: 0px">sleep 500<br>
</div>
<span style="margin: 0px"></span></div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<br>
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<br>
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<br>
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<br>
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<b>gres.conf</b></div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<span style="margin: 0px">#AutoDetect=nvml<br>
</span>
<div style="margin: 0px">Name=gpu Type=v100 File=/dev/nvidia0 Cores=0<br>
</div>
<div style="margin: 0px">Name=gpu Type=v100 File=/dev/nvidia1 Cores=1<br>
</div>
<div style="margin: 0px">Name=gpu Type=v100 File=/dev/nvidia2 Cores=2<br>
</div>
<div style="margin: 0px">Name=gpu Type=v100 File=/dev/nvidia3 Cores=3<br>
</div>
<span style="margin: 0px"></span><br>
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<br>
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<b>slurm.conf</b></div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
#<br>
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<div style="margin: 0px"># Example slurm.conf file. Please run configurator.html<br>
</div>
<div style="margin: 0px"># (in doc/html) to build a configuration file customized<br>
</div>
<div style="margin: 0px"># for your environment.<br>
</div>
<div style="margin: 0px">#<br>
</div>
<div style="margin: 0px">#<br>
</div>
<div style="margin: 0px"># slurm.conf file generated by configurator.html.<br>
</div>
<div style="margin: 0px">#<br>
</div>
<div style="margin: 0px"># See the slurm.conf man page for more information.<br>
</div>
<div style="margin: 0px">#<br>
</div>
<div style="margin: 0px">ClusterName=cluster<br>
</div>
<div style="margin: 0px">ControlMachine=cluster-slurm1.example.com<br>
</div>
<div style="margin: 0px">ControlAddr=10.116.0.11<br>
</div>
<div style="margin: 0px">BackupController=cluster-slurm2.<span style="margin: 0px; background-color: rgb(255, 255, 255); display: inline !important">example.com</span><br>
</div>
<div style="margin: 0px">BackupAddr=10.116.0.17<br>
</div>
<div style="margin: 0px">#<br>
</div>
<div style="margin: 0px">SlurmUser=slurm<br>
</div>
<div style="margin: 0px">#SlurmdUser=root<br>
</div>
<div style="margin: 0px">SlurmctldPort=6817<br>
</div>
<div style="margin: 0px">SlurmdPort=6818<br>
</div>
<div style="margin: 0px">SchedulerPort=7321<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px">RebootProgram="/usr/sbin/reboot"<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px">AuthType=auth/munge<br>
</div>
<div style="margin: 0px">#JobCredentialPrivateKey=<br>
</div>
<div style="margin: 0px">#JobCredentialPublicCertificate=<br>
</div>
<div style="margin: 0px">StateSaveLocation=/var/spool/slurm/ctld<br>
</div>
<div style="margin: 0px">SlurmdSpoolDir=/var/spool/slurm/d<br>
</div>
<div style="margin: 0px">SwitchType=switch/none<br>
</div>
<div style="margin: 0px">MpiDefault=none<br>
</div>
<div style="margin: 0px">SlurmctldPidFile=/var/run/slurmctld.pid<br>
</div>
<div style="margin: 0px">SlurmdPidFile=/var/run/slurmd.pid<br>
</div>
<div style="margin: 0px">ProctrackType=proctrack/pgid<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px">GresTypes=gpu,mps,bandwidth<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px">PrologFlags=x11<br>
</div>
<div style="margin: 0px">#PluginDir=<br>
</div>
<div style="margin: 0px">#FirstJobId=<br>
</div>
<div style="margin: 0px">#MaxJobCount=<br>
</div>
<div style="margin: 0px">#PlugStackConfig=<br>
</div>
<div style="margin: 0px">#PropagatePrioProcess=<br>
</div>
<div style="margin: 0px">#PropagateResourceLimits=<br>
</div>
<div style="margin: 0px">#PropagateResourceLimitsExcept=<br>
</div>
<div style="margin: 0px">#Prolog=<br>
</div>
<div style="margin: 0px">#Epilog=/etc/slurm/slurm.epilog.clean<br>
</div>
<div style="margin: 0px">#SrunProlog=<br>
</div>
<div style="margin: 0px">#SrunEpilog=<br>
</div>
<div style="margin: 0px">#TaskProlog=<br>
</div>
<div style="margin: 0px">#TaskEpilog=<br>
</div>
<div style="margin: 0px">#TaskPlugin=<br>
</div>
<div style="margin: 0px">#TrackWCKey=no<br>
</div>
<div style="margin: 0px">#TreeWidth=50<br>
</div>
<div style="margin: 0px">#TmpFS=<br>
</div>
<div style="margin: 0px">#UsePAM=<br>
</div>
<div style="margin: 0px">#<br>
</div>
<div style="margin: 0px"># TIMERS<br>
</div>
<div style="margin: 0px">SlurmctldTimeout=300<br>
</div>
<div style="margin: 0px">SlurmdTimeout=300<br>
</div>
<div style="margin: 0px">InactiveLimit=0<br>
</div>
<div style="margin: 0px">MinJobAge=300<br>
</div>
<div style="margin: 0px">KillWait=30<br>
</div>
<div style="margin: 0px">Waittime=0<br>
</div>
<div style="margin: 0px">#<br>
</div>
<div style="margin: 0px"># SCHEDULING<br>
</div>
<div style="margin: 0px">SchedulerType=sched/backfill<br>
</div>
<div style="margin: 0px">#bf_interval=10<br>
</div>
<div style="margin: 0px">#SchedulerAuth=<br>
</div>
<div style="margin: 0px">#SelectType=select/linear<br>
</div>
<div style="margin: 0px"># Cores and memory are consumable<br>
</div>
<div style="margin: 0px">#SelectType=select/cons_res<br>
</div>
<div style="margin: 0px">#SelectTypeParameters=CR_Core_Memory<br>
</div>
<div style="margin: 0px">SchedulerParameters=bf_interval=10<br>
</div>
<div style="margin: 0px">SelectType=select/cons_res<br>
</div>
<div style="margin: 0px">SelectTypeParameters=CR_Core<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px">FastSchedule=1<br>
</div>
<div style="margin: 0px">#PriorityType=priority/multifactor<br>
</div>
<div style="margin: 0px">#PriorityDecayHalfLife=14-0<br>
</div>
<div style="margin: 0px">#PriorityUsageResetPeriod=14-0<br>
</div>
<div style="margin: 0px">#PriorityWeightFairshare=100000<br>
</div>
<div style="margin: 0px">#PriorityWeightAge=1000<br>
</div>
<div style="margin: 0px">#PriorityWeightPartition=10000<br>
</div>
<div style="margin: 0px">#PriorityWeightJobSize=1000<br>
</div>
<div style="margin: 0px">#PriorityMaxAge=1-0<br>
</div>
<div style="margin: 0px">#<br>
</div>
<div style="margin: 0px"># LOGGING<br>
</div>
<div style="margin: 0px">SlurmctldDebug=3<br>
</div>
<div style="margin: 0px">SlurmctldLogFile=/var/log/slurmctld.log<br>
</div>
<div style="margin: 0px">SlurmdDebug=3<br>
</div>
<div style="margin: 0px">SlurmdLogFile=/var/log/slurmd.log<br>
</div>
<div style="margin: 0px">JobCompType=jobcomp/none<br>
</div>
<div style="margin: 0px">#JobCompLoc=<br>
</div>
<div style="margin: 0px">#<br>
</div>
<div style="margin: 0px"># ACCOUNTING<br>
</div>
<div style="margin: 0px">#JobAcctGatherType=jobacct_gather/linux<br>
</div>
<div style="margin: 0px">#JobAcctGatherFrequency=30<br>
</div>
<div style="margin: 0px">#<br>
</div>
<div style="margin: 0px">#AccountingStorageType=accounting_storage/slurmdbd<br>
</div>
<div style="margin: 0px">#AccountingStorageHost=<br>
</div>
<div style="margin: 0px">#AccountingStorageLoc=<br>
</div>
<div style="margin: 0px">#AccountingStoragePass=<br>
</div>
<div style="margin: 0px">#AccountingStorageUser=<br>
</div>
<div style="margin: 0px">#<br>
</div>
<div style="margin: 0px">#<br>
</div>
<div style="margin: 0px">#<br>
</div>
<div style="margin: 0px"># Default values<br>
</div>
<div style="margin: 0px"># DefMemPerNode=64000<br>
</div>
<div style="margin: 0px"># DefCpuPerGPU=4<br>
</div>
<div style="margin: 0px"># DefMemPerCPU=4000<br>
</div>
<div style="margin: 0px"># DefMemPerGPU=16000<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># OpenHPC default configuration<br>
</div>
<div style="margin: 0px">#TaskPlugin=task/affinity<br>
</div>
<div style="margin: 0px">TaskPlugin=task/affinity,task/cgroup<br>
</div>
<div style="margin: 0px">PropagateResourceLimitsExcept=MEMLOCK<br>
</div>
<div style="margin: 0px">TaskPluginParam=autobind=cores<br>
</div>
<div style="margin: 0px">#AccountingStorageType=accounting_storage/mysql<br>
</div>
<div style="margin: 0px">#StorageLoc=slurm_acct_db<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px">AccountingStorageType=accounting_storage/slurmdbd<br>
</div>
<div style="margin: 0px">AccountingStorageHost=cluster-slurmdbd1.example.com<br>
</div>
<div style="margin: 0px">#AccountingStorageType=accounting_storage/filetxt<br>
</div>
<div style="margin: 0px">Epilog=/etc/slurm/slurm.epilog.clean<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px">#PartitionName=normal Nodes=c[1-5] Default=YES MaxTime=24:00:00 State=UP<br>
</div>
<div style="margin: 0px">PartitionName=DEFAULT State=UP Default=NO AllowGroups=ALL Priority=10 DisableRootJobs=NO RootOnly=NO Hidden=NO Shared=NO GraceTime=0 PreemptMode=OFF ReqResv=NO AllowAccounts=ALL AllowQos=ALL LLN=NO ExclusiveUser=NO Nodes=nodeamd[009-016],c[1-4],nodehtc[001-025]<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># Partitions<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># Group Limited Queues</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># OIT DEBUG QUEUE<br>
</div>
<div style="margin: 0px">PartitionName=debug Nodes=c[1-4] MaxTime=24:00:00 State=UP AllowGroups=oit-hpc-admin <br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># RNA CHEM<br>
</div>
<div style="margin: 0px">PartitionName=longq7-rna MinNodes=1 MaxNodes=30 DefaultTime=168:00:00 MaxTime=UNLIMITED Priority=200 Nodes=nodeamd[001-008],nodegpu[021-025] AllowGroups=gpu-rnachem<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># V100's<br>
</div>
<div style="margin: 0px">PartitionName=longq7-mri MinNodes=1 MaxNodes=30 DefaultTime=168:00:00 MaxTime=168:00:00 Priority=200 Nodes=nodenviv100[001-016] AllowGroups=gpu-mri<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># BIGDATA GRANT<br>
</div>
<div style="margin: 0px">PartitionName=longq-bigdata7 MinNodes=1 MaxNodes=30 DefaultTime=168:00:00 MaxTime=168:00:00 Priority=200 Nodes=node[087-098],nodegpu001 AllowGroups=fau-bigdata,nsf-bigdata<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px">PartitionName=gpu-bigdata7 Default=NO MinNodes=1 Priority=10 AllowAccounts=ALL Nodes=nodegpu001 AllowGroups=fau-bigdata,nsf-bigdata<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># CogNeuroLab<br>
</div>
<div style="margin: 0px">PartitionName=CogNeuroLab Default=NO MinNodes=1 MaxNodes=4 MaxTime=7-12:00:00 AllowGroups=cogneurolab Priority=200 State=UP Nodes=node[001-004]<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># Standard queues<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># OPEN TO ALL<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px">#Short Queue</div>
<div style="margin: 0px">PartitionName=shortq7 MinNodes=1 MaxNodes=30 DefaultTime=06:00:00 MaxTime=06:00:00 Priority=100 Nodes=nodeamd[001-016],nodenviv100[001-015],nodegpu[001-025],node[001-100],nodehtc[001-025] Default=YES<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># Medium Queue<br>
</div>
<div style="margin: 0px">PartitionName=mediumq7 MinNodes=1 MaxNodes=30 DefaultTime=72:00:00 MaxTime=72:00:00 Priority=50 Nodes=nodeamd[009-016],node[004-100]<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># Long Queue</div>
<div style="margin: 0px">PartitionName=longq7 MinNodes=1 MaxNodes=30 DefaultTime=168:00:00 MaxTime=168:00:00 Priority=30 Nodes=nodeamd[009-016],node[004-100]<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># Interactive<br>
</div>
<div style="margin: 0px">PartitionName=interactive MinNodes=1 MaxNodes=4 DefaultTime=06:00:00 MaxTime=06:00:00 Priority=101 Nodes=node[001-100] Default=No Hidden=YES<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># Nodes<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># Test nodes, (vms)</div>
<div style="margin: 0px">NodeName=c[1-4] Cpus=4 Feature=virtual RealMemory=16000<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># AMD Nodes</div>
<div style="margin: 0px">NodeName=nodeamd[001-016] Procs=64 Boards=1 SocketsPerBoard=8 CoresPerSocket=8 ThreadsPerCore=1 Features=amd,epyc RealMemory=225436<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># V100 MRI<br>
</div>
<div style="margin: 0px">NodeName=nodenviv100[001-016] CPUs=64 Boards=1 SocketsPerBoard=2 CoresPerSocket=16 ThreadsPerCore=2 Gres=gpu:v100:4 Feature=v100 RealMemory=192006<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># GPU nodes</div>
<div style="margin: 0px">NodeName=nodegpu001 Procs=40 Boards=1 SocketsPerBoard=2 CoresPerSocket=10 ThreadsPerCore=2 Gres=gpu:k80:8 Feature=k80,intel RealMemory=64000<br>
</div>
<div style="margin: 0px">NodeName=nodegpu002 Procs=40 Boards=1 SocketsPerBoard=2 CoresPerSocket=10 ThreadsPerCore=2 Gres=gpu:gk1:8 Feature=gk1,intel RealMemory=128000<br>
</div>
<div style="margin: 0px">NodeName=nodegpu[003-020] Boards=1 SocketsPerBoard=2 CoresPerSocket=8 ThreadsPerCore=2 Gres=gpu:gk1:8 Feature=gk1,intel RealMemory=128000<br>
</div>
<div style="margin: 0px">NodeName=nodegpu[021-025] Procs=16 Boards=1 SocketsPerBoard=2 CoresPerSocket=8 ThreadsPerCore=1 Gres=gpu:4 Feature=exxact,intel RealMemory=128000<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># IvyBridge nodes<br>
</div>
<div style="margin: 0px">NodeName=node[001-021] Procs=20 Boards=1 SocketsPerBoard=2 CoresPerSocket=10 ThreadsPerCore=1 Feature=intel,ivybridge RealMemory=112750<br>
</div>
<div style="margin: 0px"># SandyBridge node(2)<br>
</div>
<div style="margin: 0px">NodeName=node022 Procs=16 Boards=1 SocketsPerBoard=2 CoresPerSocket=8 ThreadsPerCore=1 Feature=intel,sandybridge RealMemory=64000<br>
</div>
<div style="margin: 0px"># IvyBridge <br>
</div>
<div style="margin: 0px">NodeName=node[023-050] Procs=20 Boards=1 SocketsPerBoard=2 CoresPerSocket=10 ThreadsPerCore=1 Feature=intel,ivybridge RealMemory=112750<br>
</div>
<div style="margin: 0px"># Haswell<br>
</div>
<div style="margin: 0px">NodeName=node[051-100] Procs=20 Boards=1 SocketsPerBoard=2 CoresPerSocket=10 ThreadsPerCore=1 Feature=intel,haswell RealMemory=112750<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># Node health monitoring<br>
</div>
<div style="margin: 0px">HealthCheckProgram=/usr/sbin/nhc<br>
</div>
<div style="margin: 0px">HealthCheckInterval=300<br>
</div>
<div style="margin: 0px">ReturnToService=2<br>
</div>
<div style="margin: 0px"><br>
</div>
<div style="margin: 0px"># Fix for X11 issues</div>
<div style="margin: 0px">X11Parameters=use_raw_hostname<br>
</div>
<span style="margin: 0px"></span><br>
</div>
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; background-color: rgb(255, 255, 255)">
<br>
</div>
<div style="margin: 0px; font-size: 15px; font-family: "Segoe UI", "Segoe UI Web (West European)", "Segoe UI", -apple-system, BlinkMacSystemFont, Roboto, "Helvetica Neue", sans-serif; color: rgb(32, 31, 30); background-color: rgb(255, 255, 255)">
<div style="margin: 0px; font-size: 12pt; font-family: Calibri, Arial, Helvetica, sans-serif; color: rgb(0, 0, 0)">
<br>
</div>
<div style="margin: 0px">
<div style="margin: 0px">
<div dir="ltr" style="margin: 0px; background-color: rgb(255, 255, 255)">
<div style="margin: 0px">
<div style="margin: 0px; background-color: rgb(255, 255, 255)">
<p style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 12pt; background-color: rgb(255, 255, 255)">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif; color: black">Rhian Resnick</span></p>
<p style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 16px; background-color: rgb(255, 255, 255)">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif; color: black">Associate Director Research Computing</span><span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif; color: black"></span></p>
<p style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 16px; background-color: rgb(255, 255, 255)">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif; color: black">Enterprise Systems</span></p>
<p style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 16px; background-color: rgb(255, 255, 255)">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif; color: black">Office of Information Technology</span></p>
<p style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 12pt; background-color: rgb(255, 255, 255)">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif; color: black"><br>
</span></p>
<p style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 12pt; background-color: rgb(255, 255, 255)">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif; color: black">Florida Atlantic University</span><span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif; color: black"></span></p>
<p style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 12pt; background-color: rgb(255, 255, 255)">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif; color: black">777 Glades Road, CM22, Rm 173B</span><span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif; color: black"></span></p>
<p style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 12pt; background-color: rgb(255, 255, 255)">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif; color: black">Boca Raton, FL 33431</span><span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif; color: black"></span></p>
<p style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 12pt; background-color: rgb(255, 255, 255)">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif; color: black">Phone 561.297.2647</span><span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif; color: black"></span></p>
<p style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 12pt; background-color: rgb(255, 255, 255)">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif; color: black">Fax 561.297.0222</span></p>
<p style="margin: 0in 0in 0pt; color: rgb(33, 33, 33); font-family: "Times New Roman", serif; font-size: 12pt; background-color: rgb(255, 255, 255)">
<span style="margin: 0px; font-size: 10.5pt; font-family: Calibri, sans-serif; color: black"> </span><span style="margin: 0px; font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125)"><a href="https://hpc.fau.edu/wp-content/uploads/2015/01/image.jpg" target="_blank" rel="noopener noreferrer" style="margin: 0px; font-size: 13px; line-height: 21px; font-family: Arial, Helvetica, sans-serif; color: rgb(0, 102, 204); background-color: rgb(239, 239, 239)"><img alt="image" style="margin: 5px; vertical-align: middle; max-width: 100%; width: 195px" src="http://hpc.fau.edu/wp-content/uploads/2015/01/image.jpg"></a></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
</div>
<div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id="Signature">
<div id="divtagdefaultwrapper" dir="ltr" style="background-color:rgb(255,255,255)">
<div name="divtagdefaultwrapper" style="margin:0px">
<div style="background-color:rgb(255,255,255)">
<p class="x_MsoNormal" style="margin-top: 0px; margin-bottom: 0px;color:rgb(33,33,33); font-family:'Times New Roman',serif; font-size:12pt; margin:0in 0in 0pt; background-color:rgb(255,255,255)">
<br>
</p>
</div>
</div>
</div>
</div>
</div>
</body>
</html>