[slurm-users] Possible to get cluster utilization by partition?

[Chin,David]

I cooked one up myself using Python (with Pandas) which I feel is more
maintainable.

https://github.com/prehensilecode/slurm_utilization/blob/main/utilization_from_sacct.py

It's still in pretty rough shape, and could certainly use some refining.

Cheers,
    Dave

--
David Chin, PhD (he/him)   Sr. SysAdmin, URCF, Drexel
dwc62 at drexel.edu                     215.571.4335 (o)
For URCF support: urcf-support at drexel.edu
https://proteusmaster.urcf.drexel.edu/urcfwiki
github:prehensilecode
researchgate.NET:David-Chin-6
________________________________
From: slurm-users <slurm-users-bounces at lists.schedmd.com> on behalf of Chin,David <dwc62 at drexel.edu>
Sent: Friday, November 5, 2021 14:50
To: Slurm User Community List <slurm-users at lists.schedmd.com>
Subject: Re: [slurm-users] Possible to get cluster utilization by partition?


External.

Hi, Ole:

Thanks for the link to your tools. I'll take a closer look at them.

I wanted to make sure it wasn't something Slurm already had before I
started writing my own.

Perhaps someone out there can make that feature request and sponsor its
development at SchedMD. I feel like it would be a generally useful feature.

Cheers,
    Dave

--
David Chin, PhD (he/him)   Sr. SysAdmin, URCF, Drexel
dwc62 at drexel.edu                     215.571.4335 (o)
For URCF support: urcf-support at drexel.edu
https://proteusmaster.urcf.drexel.edu/urcfwiki
github:prehensilecode
________________________________
From: slurm-users <slurm-users-bounces at lists.schedmd.com> on behalf of Ole Holm Nielsen <Ole.H.Nielsen at fysik.dtu.dk>
Sent: Friday, November 5, 2021 03:26
To: slurm-users at lists.schedmd.com <slurm-users at lists.schedmd.com>
Subject: Re: [slurm-users] Possible to get cluster utilization by partition?

External.

Hi Dave,

On 11/4/21 21:47, Chin,David wrote:
> I am running Slurm 20.02.7. I would like to generate cluster utilization
> report based on the billing TRES, but separated by partition.
>
> I can get full cluster utilization using:
>
>      sreport cluster utilization -T billing start=2021-01-01 end=2021-06-30
>
> but it would be useful for understanding usage if a similar report could
> be produced for each partition.

This should probably be a FAQ :-)  The sreport utility can't provide
accounting information for partitions :-(

Alternatively, I have written the accounting tools slurmacct and
topreports which are available from
https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FOleHolmNielsen%2FSlurm_tools%2Ftree%2Fmaster%2Fslurmacct&data=04%7C01%7Cdwc62%40drexel.edu%7C0973c68a3b754bce6d6908d9a02dc25d%7C3664e6fa47bd45a696708c4f080f8ca6%7C0%7C0%7C637716940669785528%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=sqLpg4Ep94EaCeKYR5funLXV4ukxb6WxY3%2Brgx2KG5s%3D&reserved=0<https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FOleHolmNielsen%2FSlurm_tools%2Ftree%2Fmaster%2Fslurmacct&data=04%7C01%7Cdwc62%40drexel.edu%7C1c8abdb8ef854f6e544008d9a08d3a12%7C3664e6fa47bd45a696708c4f080f8ca6%7C0%7C0%7C637717350694465973%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=i%2BLRK3XNpAJx7Qfv4TSi%2BAcm96PXhjVDREh8JKr3hro%3D&reserved=0>

While the output has a different format, we find this more useful than
sreport because the lines are sorted in the order of usage percentages.

/Ole



Drexel Internal Data


Drexel Internal Data


Drexel Internal Data
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.schedmd.com/pipermail/slurm-users/attachments/20220824/726724d2/attachment.htm>