[slurm-users] Calculating total elapsed time of all jobs, per user, per month, for a given partition?

Ole Holm Nielsen Ole.H.Nielsen at fysik.dtu.dk
Mon Jan 8 03:43:34 MST 2018

Hi Mark,

Thanks very much for your positive feedback regarding my new "slurmacct" 
accounting script.  I'm replying to the slurm-users list so that others 
may follow the developments.

I've addressed the issue of string lengths exceeding the default width 
of the output of sacct.  I made some additional checks, and changed the 
specification of start and end times to use flags -s and -e.

Could you kindly try out the updated script in
and report your experiences back to me?


On 01/07/2018 09:34 PM, Mark London wrote:
> Ole - Thanks !  This works very nicely.   Except that our partition name 
> is too long, and was getting truncated by the sacct command, since it 
> was 14 characters long.  So I had to modify the sacct line in your script:
> export 
> FORMAT="JobID,User,Group,Partition%15,AllocNodes,AllocCPUS,Submit,Eligile,Start,End,CPUTimeRAW,State" 
> Of course, the correct way to fix the script, is replace 15 in the above 
> command, with the length of the specified partition.  :)
> Your script arrived at a good time.  Tomorrow, I have a meeting, where I 
> had to show how I was going to create a monthly report. Your script is 
> simpler than the other script I had found, which was written in the "R" 
> language.   Much appreciated! - Mark
> On 1/3/2018 2:22 AM, Ole Holm Nielsen wrote:
>> Hi Mark,
>> Perhaps my new script slurmacct may fit your requirements?  See:
>> https://lists.schedmd.com/pipermail/slurm-users/2018-January/000317.html
>> https://github.com/OleHolmNielsen/Slurm_tools/tree/master/slurmacct
>> Best regards,
>> Ole
>> On 12/18/2017 05:45 PM, Mark London wrote:
>>> Hi - Unfortunately, that script outputs statistics for a cluster. We 
>>> need statistics for s specific partition. - Mark
>>> On 12/18/2017 2:21 AM, Ole Holm Nielsen wrote:
>>>> We generate monthly Slurm reports using this script:
>>>> https://github.com/OleHolmNielsen/Slurm_tools/tree/master/slurmreportmonth 
>>>> If you miss something from the output, you're welcome to send me 
>>>> suggestions.
>>>> /Ole
>>>> On 12/18/2017 06:09 AM, Mark London wrote:
>>>>> Hi - For a given partition, how can I generate a monthly output of 
>>>>> total elapsed time, of all the jobs, run by each user?
>>>>> I.e., I'm looking for a script similar to that found in slurm-stats:
>>>>> https://github.com/CSCfi/slurm-stats
>>>>> However, that script doesn't compute total times.  Instead, it 
>>>>> outputsminimum, mean, maximum and standard deviation statistic.
>>>>> The script is written in R, which I'm not familiar with, so I don't 
>>>>> know how to modify it to output what I want.
>>>>> Perhaps there's a more easier way for me to obtain the information, 
>>>>> without using such a script?
>>>>> Thanks very much.
>>>>> Mark London
>>>>> mrl at psfc.mit.edu

More information about the slurm-users mailing list