[slurm-users] Plese help [CPUs=24 Boards=1 SocketsPerBoard=1 CoresPerSocket=16 ThreadsPerCore=1]

[Hugo Solís via slurm-users]

I am installing slurm on a small cluster of 3 identical computers at the
university.

It turns out that I get the message when starting:

error: NodeNames=hugo-big-1 CPUs=24 match no Sockets,
Sockets*CoresPerSocket or Sockets*CoresPerSocket*ThreadsPerCore.
Resetting CPUs.

error: NodeNames=hugo-big-2 CPUs=24 match no Sockets,
Sockets*CoresPerSocket or Sockets*CoresPerSocket*ThreadsPerCore.
Resetting CPUs.

error: NodeNames=hugo-big-3 CPUs=24 match no Sockets,
Sockets*CoresPerSocket or Sockets*CoresPerSocket*ThreadsPerCore.
Resetting CPUs.

if I run

sudo slurmd -C

I get

NodeName=hugo-big-1 CPUs=24 Boards=1 SocketsPerBoard=1 CoresPerSocket=16
ThreadsPerCore=1 RealMemory=128586


reading many post it seems there is a bug starting in version 18.
However I had modify the slurm.conf file

NodeName=hugo-big-1 CPUs=24 Boards=1 SocketsPerBoard=1 CoresPerSocket=16
ThreadsPerCore=1 RealMemory=128586 Gres=gpu:nvidia_geforce_rtx_3090:2

to several different version where I do not specify CPUs or sockets and
I failed everytime.

I do need help, any idea?

warm regards

Hugo Solis

BTW. if I run lscpu I got that any product of Thread, cores or sockets
do not result in 24.


Architecture:             x86_64
  CPU op-mode(s):         32-bit, 64-bit
  Address sizes:          46 bits physical, 48 bits virtual
  Byte Order:             Little Endian
CPU(s):                   24
  On-line CPU(s) list:    0-23
Vendor ID:                GenuineIntel
  Model name:             12th Gen Intel(R) Core(TM) i9-12900K
    CPU family:           6
    Model:                151
    Thread(s) per core:   2
    Core(s) per socket:   16
    Socket(s):            1
    Stepping:             2
    CPU max MHz:          5200.0000
    CPU min MHz:          800.0000
    BogoMIPS:             6374.40
    Flags:                fpu vme de pse tsc msr pae mce cx8 apic sep
mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm
pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts
rep_good
                           nopl xtopology nonstop_tsc cpuid aperfmperf
tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3
sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt
tsc_deadline_ti
                          mer aes xsave avx f16c rdrand lahf_lm abm
3dnowprefetch cpuid_fault cat_l2 cdp_l2 ssbd ibrs ibpb stibp
ibrs_enhanced tpr_shadow flexpriority ept vpid ept_ad fsgsbase
tsc_adjust bmi1 avx2 smep bmi2
                           erms invpcid rdt_a rdseed adx smap
clflushopt clwb intel_pt sha_ni xsaveopt xsavec xgetbv1 xsaves
split_lock_detect user_shstk avx_vnni dtherm ida arat pln pts hwp
hwp_notify hwp_act_window hwp_e
                          pp hwp_pkg_req hfi vnmi umip pku ospke
waitpkg gfni vaes vpclmulqdq tme rdpid movdiri movdir64b fsrm md_clear
serialize pconfig arch_lbr ibt flush_l1d arch_capabilities
Virtualization features:
  Virtualization:         VT-x
Caches (sum of all):
  L1d:                    640 KiB (16 instances)
  L1i:                    768 KiB (16 instances)
  L2:                     14 MiB (10 instances)
  L3:                     30 MiB (1 instance)
NUMA:
  NUMA node(s):           1
  NUMA node0 CPU(s):      0-23

--
slurm-users mailing list -- slurm...@lists.schedmd.com
To unsubscribe send an email to slurm-us...@lists.schedmd.com

[Diego Zuccato via slurm-users]

Hi Hugo.

i[3-9] have 2 kinds of cores: the more performant ones with
hyperthreading and the slower ones without.

From
https://www.intel.com/content/www/us/en/products/docs/processors/core/core-14th-gen-desktop-brief.html
:
-8<--
These processors feature performance hybrid architecture1, combining two
core microarchitectures on a single processor die. This architecture
features Performance-cores, Efficient-cores and Intel® Thread Director2.
With up to 24 cores (8 Performance-cores and 16 Efficient-cores) and up
to 32 threads.
-8<--
(similar to what's written in the page for 12th gen i9).

How to handle these strange beasts in Slurm is another issue and I have
no idea... We're only using Xeons (and AMDs) that have omogeneous cores.

Diego

Diego Zuccato
DIFA - Dip. di Fisica e Astronomia
Servizi Informatici
Alma Mater Studiorum - Università di Bologna
V.le Berti-Pichat 6/2 - 40127 Bologna - Italy
tel.: +39 051 20 95786

[Hugo Solís via slurm-users]

dear people,

Few days ago I wrote this email. Diego Zuccato kindly reply with an
email that lead to the proper solution. I disabled hyperthreading in the
bios, the computers gave now 16 Cpus and Slurm is not complaining. Very
nice now. Knowing the possible mistake I did a search with better
results on google and I got this link

https://utcc.utoronto.ca/~cks/space/blog/linux/IntelHyperthreadingSurprise

It seems it explains details but I did not go thru it since I was able
to keep moving on my work.

cheers