Job information if job is completed
Hello, Is there any way to get all information (like submit script or submit node) from a job that is completed? Something like "scontrol show jobid=XXX" when job is "running" or "pending". I need to inspect the submit script of a job but I only know job_id. Thanks.
Hi Gestió, you can try `sacct -B -j YOUR_JOB_ID` to get the submit script, and `sacct --env-vars -j YOUR_JOB_ID` for the environment. You need to have set `AccountingStoreFlags: job_comment,job_env,job_extra,job_script` in slurm.conf to store respective data. Otherwise it will not be available via sacct. Hope this helps. Cheers, Le 17/06/2025 à 12:42, Gestió Servidors via slurm-users a écrit :
Hello,
Is there any way to get all information (like submit script or submit node) from a job that is completed? Something like “scontrol show jobid=XXX” when job is “running” or “pending”. I need to inspect the submit script of a job but I only know job_id.
Thanks.
Yeah, that's an annoying thing which I have not understood why has been designed that way. The information is there and it can be queried, just with a different command and spitting it out in a different format. The syntax is sacct -j XXX which gives you only some fields, or sacct -o fields,you,want -j XXX the (super long) list of possible fields (case insensitive) can be queried with sacct -e HTH On Tue, Jun 17, 2025 at 4:45 AM Gestió Servidors via slurm-users < slurm-users@lists.schedmd.com> wrote:
Hello,
Is there any way to get all information (like submit script or submit node) from a job that is completed? Something like “scontrol show jobid=XXX” when job is “running” or “pending”. I need to inspect the submit script of a job but I only know job_id.
Thanks.
-- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-leave@lists.schedmd.com
We developed a script "showjob" which will obtain all interesting information from Slurm for jobs that are pending, running, or completed. You may try this tool: https://github.com/OleHolmNielsen/Slurm_tools/blob/master/jobs/showjob Best regards, Ole On 6/17/25 13:42, Davide DelVento via slurm-users wrote:
Yeah, that's an annoying thing which I have not understood why has been designed that way. The information is there and it can be queried, just with a different command and spitting it out in a different format. The syntax is
sacct -j XXX
which gives you only some fields, or
sacct -o fields,you,want -j XXX
the (super long) list of possible fields (case insensitive) can be queried with
sacct -e
HTH
On Tue, Jun 17, 2025 at 4:45 AM Gestió Servidors via slurm-users <slurm- users@lists.schedmd.com <mailto:slurm-users@lists.schedmd.com>> wrote:
Hello,____
__ __
Is there any way to get all information (like submit script or submit node) from a job that is completed? Something like “scontrol show jobid=XXX” when job is “running” or “pending”. I need to inspect the submit script of a job but I only know job_id.____
My understand from talking with the Slurm devs is that the reason why the scontrol and sacct are different formats goes back to the origins of those two commands in the misty past. Basically they were written by two different devs looking at two different things in different ways as one is querying the scheduler directly while the other is querying the database. I have asked if command options and outputs could be unified but the devs are worried about breaking existing scripts that rely on the current formatting. Suffice it to say the differences will likely never be resolved with out everyone accepting that their existing tools will break in favor of unifying all the command structures. -Paul Edmon- On 6/17/2025 7:42 AM, Davide DelVento via slurm-users wrote:
Yeah, that's an annoying thing which I have not understood why has been designed that way. The information is there and it can be queried, just with a different command and spitting it out in a different format. The syntax is
sacct -j XXX
which gives you only some fields, or
sacct -o fields,you,want -j XXX
the (super long) list of possible fields (case insensitive) can be queried with
sacct -e
HTH
On Tue, Jun 17, 2025 at 4:45 AM Gestió Servidors via slurm-users <slurm-users@lists.schedmd.com> wrote:
Hello,
Is there any way to get all information (like submit script or submit node) from a job that is completed? Something like “scontrol show jobid=XXX” when job is “running” or “pending”. I need to inspect the submit script of a job but I only know job_id.
Thanks.
-- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-leave@lists.schedmd.com
Think of it this way: scontrol is to control the behavior of the cluster now(ish). Once jobs are done, they can't really be controlled any more, so you use sacct to look back at their history. That's a logical way of thinking about it. Architecturally, I assume it's because scontrol gets it's data from the state information, which only concerns the current state of the cluster and sacct, gets its data from the accounting DB, which is for historical information. That's just a guess - I haven't read the source code, but the last I checked, state data was in /var/lib/slurm, or something like that, and accounting information was in a mysql DB, so two different data formats. Prentice On 6/17/25 7:42 AM, Davide DelVento via slurm-users wrote:
Yeah, that's an annoying thing which I have not understood why has been designed that way. The information is there and it can be queried, just with a different command and spitting it out in a different format. The syntax is
sacct -j XXX
which gives you only some fields, or
sacct -o fields,you,want -j XXX
the (super long) list of possible fields (case insensitive) can be queried with
sacct -e
HTH
On Tue, Jun 17, 2025 at 4:45 AM Gestió Servidors via slurm-users <slurm-users@lists.schedmd.com> wrote:
Hello,
Is there any way to get all information (like submit script or submit node) from a job that is completed? Something like “scontrol show jobid=XXX” when job is “running” or “pending”. I need to inspect the submit script of a job but I only know job_id.
Thanks.
-- slurm-users mailing list -- slurm-users@lists.schedmd.com To unsubscribe send an email to slurm-users-leave@lists.schedmd.com
-- Prentice Bisbal HPC Systems Engineer III Computational & Information Systems Laboratory (CISL) NSF National Center for Atmospheric Research (NSF NCAR) https://www.cisl.ucar.edu https://ncar.ucar.edu
participants (6)
-
Davide DelVento -
Eric Le Lay -
Gestió Servidors -
Ole Holm Nielsen -
Paul Edmon -
Prentice Bisbal