[slurm-users] Calculating total elapsed time of all jobs, per user, per month, for a given partition?

[Ole Holm Nielsen]

Hi Mark,

Thanks very much for your positive feedback regarding my new "slurmacct" 
accounting script.  I'm replying to the slurm-users list so that others 
may follow the developments.

I've addressed the issue of string lengths exceeding the default width 
of the output of sacct.  I made some additional checks, and changed the 
specification of start and end times to use flags -s and -e.

Could you kindly try out the updated script in
    https://github.com/OleHolmNielsen/Slurm_tools/tree/master/slurmacct
and report your experiences back to me?

/Ole


On 01/07/2018 09:34 PM, Mark London wrote:
> Ole - Thanks !  This works very nicely.   Except that our partition name 
> is too long, and was getting truncated by the sacct command, since it 
> was 14 characters long.  So I had to modify the sacct line in your script:
> 
> export 
> FORMAT="JobID,User,Group,Partition%15,AllocNodes,AllocCPUS,Submit,Eligile,Start,End,CPUTimeRAW,State" 
> 
> 
> Of course, the correct way to fix the script, is replace 15 in the above 
> command, with the length of the specified partition.  :)
> 
> Your script arrived at a good time.  Tomorrow, I have a meeting, where I 
> had to show how I was going to create a monthly report. Your script is 
> simpler than the other script I had found, which was written in the "R" 
> language.   Much appreciated! - Mark
> 
> On 1/3/2018 2:22 AM, Ole Holm Nielsen wrote:
>> Hi Mark,
>>
>> Perhaps my new script slurmacct may fit your requirements?  See:
>>
>> https://lists.schedmd.com/pipermail/slurm-users/2018-January/000317.html
>> https://github.com/OleHolmNielsen/Slurm_tools/tree/master/slurmacct
>>
>> Best regards,
>> Ole
>>
>> On 12/18/2017 05:45 PM, Mark London wrote:
>>> Hi - Unfortunately, that script outputs statistics for a cluster. We 
>>> need statistics for s specific partition. - Mark
>>>
>>> On 12/18/2017 2:21 AM, Ole Holm Nielsen wrote:
>>>> We generate monthly Slurm reports using this script:
>>>> https://github.com/OleHolmNielsen/Slurm_tools/tree/master/slurmreportmonth 
>>>>
>>>>
>>>> If you miss something from the output, you're welcome to send me 
>>>> suggestions.
>>>>
>>>> /Ole
>>>>
>>>> On 12/18/2017 06:09 AM, Mark London wrote:
>>>>> Hi - For a given partition, how can I generate a monthly output of 
>>>>> total elapsed time, of all the jobs, run by each user?
>>>>>
>>>>> I.e., I'm looking for a script similar to that found in slurm-stats:
>>>>>
>>>>> https://github.com/CSCfi/slurm-stats
>>>>>
>>>>> However, that script doesn't compute total times.  Instead, it 
>>>>> outputsminimum, mean, maximum and standard deviation statistic.
>>>>>
>>>>> The script is written in R, which I'm not familiar with, so I don't 
>>>>> know how to modify it to output what I want.
>>>>>
>>>>> Perhaps there's a more easier way for me to obtain the information, 
>>>>> without using such a script?
>>>>>
>>>>> Thanks very much.
>>>>>
>>>>> Mark London
>>>>> mrl at psfc.mit.edu