[slurm-users] Is it safe to convert cons_res to cons_tres on a running system?

[Nathan R Crawford]

Sounds pretty safe, but with the current COVID-19 difficulties, including
Spring quarter classes being taught remotely (starts tomorrow, fun times
ahead), I'm a bit reluctant to poke a running system. This will get put on
the giant list of things waiting for a scheduled downtime once campus
re-opens.
Thanks,
Nate

On Thu, Mar 26, 2020 at 8:26 AM Steven Dick <kg4ydw at gmail.com> wrote:

> When I changed this on a running system, no jobs were killed, but
> slurm lost track of jobs on nodes and was unable to kill them or tell
> when they were finished until slurmd on each node was restarted.  I
> let running jobs complete and monitored them manually, and restarted
> slurmd on each node as they finished.
>
> In desperation, you can do it, but it might be better to wait until no
> jobs (or few jobs) are running.
>
> On Thu, Mar 26, 2020 at 10:40 AM Pär Lindfors <par.lindfors at uppmax.uu.se>
> wrote:
> >
> > Hi Nate,
> >
> > On Fri, 2020-02-21 at 11:38 -0800, Nathan R Crawford wrote:
> > >   If it just requires restarting slurmctld and the slurmd processes
> > > on the nodes, I will be happy! Can you confirm that no running or
> > > pending jobs were lost in the transition?
> >
> > Did you change your SelectType to cons_tres? How did it go?
> >
> > We need to do the same change on one of our clusters. I have done a few
> > tests on a tiny test cluster which so far indicates that changing works
> > even with jobs running, but a configuration change with even a small
> > risk of purging the job list makes me a little nervous.
> >
> > Regards,
> > Pär Lindfors,
> > UPPMAX
> >
> >
> >
> >
> >
> >
> >
> >
> > När du har kontakt med oss på Uppsala universitet med e-post så innebär
> det att vi behandlar dina personuppgifter. För att läsa mer om hur vi gör
> det kan du läsa här: http://www.uu.se/om-uu/dataskydd-personuppgifter/
> >
> > E-mailing Uppsala University means that we will process your personal
> data. For more information on how this is performed, please read here:
> http://www.uu.se/en/about-uu/data-protection-policy
>
>

-- 

Dr. Nathan Crawford              nathan.crawford at uci.edu
Director of Scientific Computing
School of Physical Sciences
164 Rowland Hall                 Office: 2101 Natural Sciences II
University of California, Irvine  Phone: 949-824-4508
Irvine, CA 92697-2025, USA
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20200329/fcc1e6f6/attachment.htm>