[slurm-users] jobacct_gather/linux vs jobacct_gather/cgroup

[Christopher Benjamin Coffey]

Hi Marcus, yes we are talking about the jobacct_gather/cgroup plugin. Yes, if you want cgroups you need:

ProctrackType=proctrack/cgroup
TaskPlugin=task/cgroup,task/affinity

But that doesn't mean you have to run the jobacct_gather/cgroup plugin, you have the option to use jobacct_gather/linux instead. Per the devs at SLUG19, they say the linux version has less overhead than the cgroup variant. I made a switch in production and haven't really seen any differences except for seeing extra info on the extern step which is a bonus I guess.

It would be nice to have some more clarification from other sites, or devs on this.

Best,
Chris
 
-- 
Christopher Coffey
High-Performance Computing
Northern Arizona University
928-523-1167
 
 

On 10/25/19, 6:15 AM, "slurm-users on behalf of Marcus Wagner" <slurm-users-bounces at lists.schedmd.com on behalf of wagner at itc.rwth-aachen.de> wrote:

    Aren't we here talking about the job accounting gather plugin?
    
    I would say, you have to use cgroups, together with 
    ProctrackType=proctrack/cgroup and TaskPlugin=task/cgroup if you want ot 
    use the jobacct_gather/cgroup plugin, because elsewise SLURMdoes not 
    pack the jobs into cgroups.
    
    Best
    Marcus
    
    On 10/25/19 1:48 AM, Brian Andrus wrote:
    > IIRC, the big difference is if you want to use cgroups on the nodes. 
    > You must use the cgroup plugin.
    >
    > Brian Andrus
    >
    > On 10/24/2019 3:54 PM, Christopher Benjamin Coffey wrote:
    >> Hi Juergen,
    >>
    >>  From what I see so far, there is nothing missing from the 
    >> jobacct_gather/linux plugin vs the cgroup version. In fact, the 
    >> extern step now has data where as it is empty when using the cgroup 
    >> version.
    >>
    >> Anyone know the differences?
    >>
    >> Best,
    >> Chris
    >
    
    -- 
    Marcus Wagner, Dipl.-Inf.
    
    IT Center
    Abteilung: Systeme und Betrieb
    RWTH Aachen University
    Seffenter Weg 23
    52074 Aachen
    Tel: +49 241 80-24383
    Fax: +49 241 80-624383
    wagner at itc.rwth-aachen.de
    https://nam05.safelinks.protection.outlook.com/?url=www.itc.rwth-aachen.de&data=02%7C01%7Cchris.coffey%40nau.edu%7Ce7877bc1ea7943061a6708d7594d5d07%7C27d49e9f89e14aa099a3d35b57b2ba03%7C0%7C0%7C637076061119561065&sdata=Oaib%2F4nWtIlj1JhocXmDc2yByg9bDnquqVmeT6ZKTpU%3D&reserved=0