[slurm-users] Evenly use all nodes
angelosching at clustertech.com
Fri Jul 3 01:18:54 UTC 2020
We have faced similar problem and our solution was to run an hourly cron job to set a random node weight for each node. It works pretty well for us.
(Sent from mobile, please pardon me for typos and cursoriness.)
> 2020/07/03 2:24、Timo Rothenpieler <timo.rothenpieler at uni-bremen.de>のメール:
> Our cluster is very rarely fully utilized, often only a handful of jobs are running.
> This has the effect that the first couple nodes get used a whole lot more frequently than the ones further near the end of the list.
> This is primarily a problem because of the SSDs in the nodes. They already show a significant difference in their wear level between the first couple and all the remaining nodes.
> Is there some way to nicely assign jobs to nodes such that all nodes get roughly equal amounts of jobs/work?
> I looked through possible options to the SelectType, but nothing looks like it does anything like that.
More information about the slurm-users