[slurm-users] sacct fields AllocCPUS and ReqMem are empty

[marcels...@gmail.com]

Hi,

I have Slurm 17.02.10 installed in a test environment. When I use sacct
-o "JobID,JobName,AllocCPUs,ReqMem,Elapsed" and AccountingStorageType =
accounting_storage/filetxt, the fields AllocCPUS and ReqMem are empty.

JobID JobName AllocCPUS ReqMem Elapsed
------------ ---------- ---------- ---------- ----------
371 stress_20s 0 0n 00:00:21
372 stress_20s 0 0n 00:00:21
373 stress_20s 0 0n 00:00:21

When I switch to AccountingStorageType = accounting_storage/slurmdbd and
start the same jobs, the output works fine:

JobID JobName AllocCPUS ReqMem Elapsed
------------ ---------- ---------- ---------- ----------
382 stress_20s 1 32004Mn 00:00:20
383 stress_20s 1 2000Mn 00:00:20
384 stress_20s 1 2000Mn 00:00:20

Also, when I set the --starttime filter, it works only with the database.

Does anyone have an explanation for this?

Marcel

[Marcel Sommer]

[Marcel Sommer]

[marcels...@gmail.com]

[marcels...@gmail.com]

Hi,

I have Slurm 17.02.10 installed in a test environment. When I use sacct
-o "JobID,JobName,AllocCPUs,ReqMem,Elapsed" and AccountingStorageType =
accounting_storage/filetxt, the fields AllocCPUS and ReqMem are empty.

JobID JobName AllocCPUS ReqMem Elapsed
------------ ---------- ---------- ---------- ----------
371 stress_20s 0 0n 00:00:21
372 stress_20s 0 0n 00:00:21
373 stress_20s 0 0n 00:00:21

But when I switch to AccountingStorageType = accounting_storage/slurmdbd

[Marcel Sommer]

Hi,

I have Slurm 17.02.10 installed in a test environment. When I use sacct
-o "JobID,JobName,AllocCPUs,ReqMem,Elapsed" and AccountingStorageType =
accounting_storage/filetxt, the fields AllocCPUS and ReqMem are empty.

       JobID    JobName  AllocCPUS     ReqMem    Elapsed
------------ ---------- ---------- ---------- ----------
371          stress_20s          0         0n   00:00:21
372          stress_20s          0         0n   00:00:21
373          stress_20s          0         0n   00:00:21

When I switch to AccountingStorageType = accounting_storage/slurmdbd and
start the same jobs, the output works fine:

       JobID    JobName  AllocCPUS     ReqMem    Elapsed
------------ ---------- ---------- ---------- ----------
382          stress_20s          1    32004Mn   00:00:20
383          stress_20s          1     2000Mn   00:00:20
384          stress_20s          1     2000Mn   00:00:20

Also, when I set the --starttime filter, it works only with the database.

Does anyone have an explanation for this?

Marcel

[Chris Samuel]

On Friday, 4 May 2018 4:25:04 PM AEST Marcel Sommer wrote:

> Does anyone have an explanation for this?

I think you're asking for functionality that is only supported with slurmdbd.

All the best,
Chris
--
Chris Samuel : http://www.csamuel.org/ : Melbourne, VIC

[Benjamin Rampe]

Hello everybody,

On 04/05/18 16:06, Chris Samuel wrote:
> On Friday, 4 May 2018 4:25:04 PM AEST Marcel Sommer wrote:
>> Does anyone have an explanation for this?

> I think you're asking for functionality that is only supported with slurmdbd.

I'm interested in that problem too.
I haven't found anything in the documentation that talks about
limitations regarding job accounting.
Until now, I thought the database is mainly needed for the (fair-)shares.
Additionally I find the sacct -o behavior (at least on 16.05) weird /
unstrict: it matches the options as long as it is a prefix of a
documented one, e.g., "Alloc". Is that by intention?

"
Fair-share Factor
Note: Computing the fair-share factor requires the installation and
operation of the Slurm Accounting Database to provide the assigned
shares and the consumed, computing resources described below.
"
on
https://slurm.schedmd.com/priority_multifactor.html#fairshare
could be interpreted that a database is strictly needed, but nothing in
the man page to slurm.conf nor "Accounting and Resource Limits"
(https://slurm.schedmd.com/accounting.html) point towards any details
where the plugins differ.

Does anyone know a compact comparison of plugin settins where features /
limitations are listed?

Regards,
Benjamin
--
FSU Jena | JULIELab.de/Staff/Benjamin+Redling.html
☎ +49 3641 9 44323

[Chris Samuel]

On Saturday, 5 May 2018 12:43:32 AM AEST Benjamin Rampe wrote:

> I haven't found anything in the documentation that talks about
> limitations regarding job accounting.

Yeah, the documentation is pretty poor on this. :-(

The best I can find is this email to the old slurm-dev list from 6 years ago.

http://narkive.com/jjGqzRLO.2

# I would highly recommend you not use the filetxt plugin and you the
# mysql instead. It is unclear if many of the sacct options work on the
# filetxt plugin. I wouldn't expect the -N to work, but the -S or -E
# probably should, but no future developement is expected for the filetxt
# plugin.

Best of luck,

[marcels...@gmail.com]

Does anyone have an explanation for this?

Marcel

[Coulter, John Eric]

This reply is a little late, but 
I filed a bug report a while back for this problem... 
https://bugs.schedmd.com/show_bug.cgi?id=4808

This related issue actually describes which fields are available in
JobComp/filetxt, which I *assume* is similar to
AccountingStorage/filetxt:
https://bugs.schedmd.com/show_bug.cgi?id=3229

but that's the only place I could find (other than the source code)
where the fields are listed for either plugin.

Nice to know that the filetxt plugin is not expected to change, at
least. 

Best,

--
Eric Coulter         jeco...@iu.edu
XSEDE Capabilities and Resource Integration Engineer 
IU Campus Bridging & Research Infrastructure
RT/PTI/UITS
https://www.xsede.org/ecosystem/xcri-mission