[slurm-users] How can I get complete field values with without specify the length

Reuti reuti at staff.uni-marburg.de
Fri Mar 12 10:53:53 UTC 2021


> Am 10.03.2021 um 16:29 schrieb Brian Andrus <toomuchit at gmail.com>:
> 
> Marcus is right here. Filtering the input so you don't have GIGO is on the admin.
> 
> There are too many different languages/characters to expect that to be handled by slurm and would make it bulkier for most users with no benefit.

Well, yes. I can see the point. The longterm solution might be to exclude characters 0x00–0x1F and/or allow only printable UTF-8 characters with proper spacing in `squeue` and alike, as some characters take 2 or more bytes. for their representation.

-- Reuti


> Wrapper scripts and job_submit.lua are definitely your friends.
> 
> Brian Andrus
> 
> On 3/10/2021 5:05 AM, Marcus Boden wrote:
>> Yeah, I wondered something like that too, as it makes some of my scripts quite fragile. I just tried your name on a test system and now calling squeue paints my cli yellow :D
>> 
>> You could write a job_submit plugin to catch 'malicious' input, but so far no user ever did something like that on our system, so I don't think that's necessary.
>> 
>> Best,
>> Marcus
>> 
>> On 10.03.21 12:06, Reuti wrote:
>>> 
>>>> Am 09.03.2021 um 13:37 schrieb Marcus Boden <mboden at gwdg.de>:
>>>> 
>>>> Then I have good news for you! There is the --delimiter option:
>>>> https://slurm.schedmd.com/sacct.html#OPT_delimiter=
>>> 
>>> Aha, perfect – thx. Maybe it should be noted in the man page for the "-p"/"-P".
>>> 
>>> But this leads to another question: there is no well defined character set for allowed job names, and I can have a job:
>>> 
>>> $ sbatch --job-name="fu"$'\007'$'\033[32m'"bar" slurm-job.sh
>>> 
>>> which might make some noise when using `squeue` and messes up the output?
>>> 
>>> -- Reuti
>>> 
>>> 
>>>> Best,
>>>> Marcus
>>>> 
>>>> On 09.03.21 12:10, Reuti wrote:
>>>>> Hi:
>>>>>> Am 09.03.2021 um 08:19 schrieb Bjørn-Helge Mevik <b.h.mevik at usit.uio.no>:
>>>>>> 
>>>>>> "xiaojinghu93 at 163.com" <xiaojinghu93 at 163.com> writes:
>>>>>> 
>>>>>>> I am doing a parsing job on slurm fields. Sometimes when one field is
>>>>>>> too long, slum will limit the length with a “+”.
>>>>>> 
>>>>>> You don't say which slurm command you are trying to parse the output
>>>>>> from, but if it is sacctmgr, it has an option --parsable2(*)
>>>>>> specifically designed for parsing output, and which does not truncate
>>>>>> long field values.
>>>>>> 
>>>>>> (*) There is also --parsable, but that puts an extra "|" at the end of
>>>>>> the line, so I prefer --parsable2.
>>>>> It would even be better to have the option to use an argument for these two options or even --parsable='`\000' like in `tr`. For now users can use "|" in jobname, account or comment which might break any parsing.
>>>>> -- Reuti
>>>>>> -- 
>>>>>> Cheers,
>>>>>> Bjørn-Helge Mevik, dr. scient,
>>>>>> Department for Research Computing, University of Oslo
>>>>>> 
>>>> 
>>>> -- 
>>>> Marcus Vincent Boden, M.Sc.
>>>> Arbeitsgruppe eScience, HPC-Team
>>>> Tel.:   +49 (0)551 201-2191, E-Mail: mboden at gwdg.de
>>>> ------------------------------------------------------------------------- 
>>>> Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG)
>>>> Am Faßberg 11, 37077 Göttingen, URL: https://www.gwdg.de
>>>> 
>>>> Support: Tel.: +49 551 201-1523, URL: https://www.gwdg.de/support
>>>> Sekretariat: Tel.: +49 551 201-1510, Fax: -2150, E-Mail: gwdg at gwdg.de
>>>> 
>>>> Geschäftsführer: Prof. Dr. Ramin Yahyapour
>>>> Aufsichtsratsvorsitzender: Prof. Dr. Norbert Lossau
>>>> Sitz der Gesellschaft: Göttingen
>>>> Registergericht: Göttingen, Handelsregister-Nr. B 598
>>>> 
>>>> Zertifiziert nach ISO 9001
>>>> ------------------------------------------------------------------------- 
>>>> 
>>> 
>>> 
>> 
> 




More information about the slurm-users mailing list