Hi Ole,
On Wed, Aug 21, 2024 at 1:06 PM Ole Holm Nielsen via slurm-users < slurm-users@lists.schedmd.com> wrote:
The slurmacct script can actually break down statistics by partition, which I guess is what you're asking for? The usage of the command is:
Yes, this is almost what I was asking for. And admittedly I now realize that with perhaps some minor algebra (using the TOTAL-all line) I could get what I need. What confused me is that running it from everything or one partition reported the same beginning, rather than a partition-specific beginning:
[davide ~]$ slurmacct -s 0101 -e 0202 Start date 0101 End date 0202 Report generated to file /tmp/Slurm_report_acct_0101_0202 [davide ~]$ cat /tmp/Slurm_report_acct_0101_0202 -------------------------------------------------------------------------------- Cluster Utilization 01-Jan-2024_00:00 - 01-Feb-2024_23:59 Usage reported in Percentage of Total -------------------------------------------------------------------------------- Cluster Allocated Down PLND Dow Idle Planned Reported --------- ---------- ---------- -------- --------- -------- ---------- cluster 23.25% 67.85% 0.00% 8.89% 0.01% 100.00%
Usage sorted by top users: (omitted)
[davide ~]$ slurmacct -s 0101 -e 0202 Start date 0101 End date 0202 Print only accounting in Slurm partition gpu Report generated to file /tmp/Slurm_report_acct_0101_0202 [davide ~]$ cat /tmp/Slurm_report_acct_0101_0202 -------------------------------------------------------------------------------- Cluster Utilization 01-Jan-2024_00:00 - 01-Feb-2024_23:59 Usage reported in Percentage of Total -------------------------------------------------------------------------------- Cluster Allocated Down PLND Dow Idle Planned Reported --------- ---------- ---------- -------- --------- -------- ---------- cluster 23.25% 67.85% 0.00% 8.89% 0.01% 100.00%
Partition selected: gpu Usage sorted by top users: (omitted)
Also, what you label "Wallclock hours" in the table of users is actually core-hours? Not even node-hours, otherwise I am reading things incorrectly.
The Start_time and End_time values specify the date/time interval of
job completion/termination (see "man sacct").
Hint: Specify Start/End time as MMDD (Month and Date)
Small suggestion: change this to
Hint: Specify Start/End time as MMDD (Month and Day) or as MMDDYY (Month and Day and Year) since sreport accepts it and your tool appears to otherwise understand that format.
> - statistics about wait-in-queue for jobs, due to unavailable resourcesThe slurmacct report prints "Average q-hours" (starttime minus submittime).
Ahaha! That's it! Super useful, I was wondering what "q" was (wait-in-Queue, I guess). You are super.
We use the "topreports" script to gather weekly, monthly and yearly
reports (using slurmacct) for management (professors at our university).
I knew that I must not have been the only one with this need ;-)
Thanks again!