[slurm-users] Default SelectTypeParameters option

[Thomas Green]

Hi,

 

I have noticed our site relies on the default value SelectTypeParameters (e.g. not specified in slurm.conf) which should be same as:

 

SelectTypeParameters=CR_Core_Memory

 

I have noticed some strange behaviour where the compute nodes do not seem to use memory cgroup e.g. in the log without the above specified in slurm.conf and assuming default value I see:

 

[2023-11-10T10:47:52.087] [7307368.batch] debug:  task/cgroup: init: core enforcement enabled

[2023-11-10T10:47:52.088] [7307368.batch] debug:  task/cgroup: init: device enforcement enabled

 

And with the above option in slurm.conf I see:

 

[2023-11-10T11:00:28.059] [7307370.extern] debug:  task/cgroup: init: core enforcement enabled

[2023-11-10T11:00:28.059] [7307370.extern] debug:  task/cgroup: task_cgroup_memory_init: task/cgroup/memory: TotCfgRealMem:191000M allowed:100%(enforced), swap:0%(enforced), max:100%(191000M) max+swap:100%(382000M) min:30M kmem:100%(191000M permissive) min:30M

[2023-11-10T11:00:28.059] [7307370.extern] debug:  task/cgroup: init: memory enforcement enabled

[2023-11-10T11:00:28.060] [7307370.extern] debug:  task/cgroup: init: device enforcement enabled

 

This relates to

 

https://github.com/SchedMD/slurm/blob/master/src/plugins/task/cgroup/task_cgroup.c

 

Specifically

 

https://github.com/SchedMD/slurm/blob/d59bf870f660bed022f08aff073c9ae65119c37c/src/plugins/task/cgroup/task_cgroup.c#L78C2-L78C2

 

Whilst I can only see the default possibly set on slurmctld but not on slurmd:

 

https://github.com/SchedMD/slurm/blob/d59bf870f660bed022f08aff073c9ae65119c37c/src/plugins/select/cons_tres/select_cons_tres.c#L288

 

Should the documentation be updated to require use of SelectTypeParameters or the code has better handling of defaulting this parameter?

 

Specifying the option seemed to fix odd behaviour but wanted to report the observation and whether I have misunderstood how this parameter is defaulted and whether other options also may need special care with defaults.

 

Tom

 

--

Thomas Green                         Senior Programmer

ARCCA, Redwood Building, King Edward VII Avenue, Cardiff, CF10 3NB

Tel: +44 (0)29 208 79269             Fax: +44 (0)29 208 70734

Email: gree...@cardiff.ac.uk        Web: http://www.cardiff.ac.uk/arcca

  

Thomas Green                         Uwch Raglennydd

ARCCA, Adeilad Redwood, King Edward VII Avenue, Caerdydd, CF10 3NB

Ffôn: +44 (0)29 208 79269            Ffacs: +44 (0)29 208 70734

E-bost: gree...@caerdydd.ac.uk      Gwefan: http://www.caerdydd.ac.uk/arcca