<div dir="ltr"><div dir="auto"><font face="arial, sans-serif">We've settled on the idea of using a glusterfs file system for rolling out an HA Slurm controller. <span class="gmail_default" style="">Over the last year we've averaged</span> 88,000 job submissions per da<span class="gmail_default" style="">y</span><span class="gmail_default" style="">, though it's usually lower than that (10-20K)</span>.<span class="gmail_default" style=""> Disk</span> activity <span class="gmail_default" style="">on</span> the existing state database<span class="gmail_default" style=""></span><span class="gmail_default" style="">seems to be </span>maxing out around 40-50 io/s with a peak disk usage under 700<span class="gmail_default" style="">MB</span>.</font><div dir="auto"><font face="arial, sans-serif"><br></font></div><div dir="auto"><font face="arial, sans-serif">We're replacing that with two controller hosts<span class="gmail_default" style=""> (eventually configured as an HA pair)</span> and a DBD host. I've spun up a 3 replica <span class="gmail_default" style="">glusterfs </span>mirror between the<span class="gmail_default" style=""></span>s<span class="gmail_default" style="">e hosts </span>for the state database.<span class="gmail_default" style=""> The physical disks backing this storage are all SSD.</span></font></div><div><font face="arial, sans-serif"><br></font></div><div><font face="arial, sans-serif">A<span class="gmail_default" style="">re there any hints, tips, or problems anyone has run into with Glusterfs for the state database? Any recommended tunings?</span></font></div><div><font face="arial, sans-serif"><span class="gmail_default" style=""><br></span></font></div><div><font face="arial, sans-serif"><span class="gmail_default" style="">Thanks much</span></font></div><div><font face="arial, sans-serif"><span class="gmail_default" style=""><br></span></font></div><div><font face="arial, sans-serif"><span class="gmail_default" style=""> - Michael</span></font></div><div><font face="arial, sans-serif"><span class="gmail_default" style=""><br></span></font></div></div>
</div>