topic Re: NUMA node count not right in ESXi Discussions

NUMA node count not right

zenivox — Sat, 02 Nov 2019 18:41:41 GMT

Hello again, I hope to get a reply on this one.. I have a vCluster with 8 nodes ESXi 6.5, all HP DL560 G10 with 4 sockets. All with HT enabled. However 7 show the following numa nodes count:

[root@esx000009:~] esxcli hardware memory get | grep NUMA

NUMA Node Count: 8

and one only shows the following:

[root@esx000008:~] esxcli hardware memory get | grep NUMA

NUMA Node Count: 4

why would that be?? They are all alike... I can't think of anything that clarifies this ackward host

Re: NUMA node count not right

KocPawel — Sat, 02 Nov 2019 19:42:52 GMT

Are servers with the same memory size, DIMMs etc. ?

Does it have the same processors?

Compare BIOS settings in regard to NUMA and Memeory interleaving.

Re: NUMA node count not right

zenivox — Sat, 02 Nov 2019 19:57:08 GMT

Hi Pawel, they are identical in everything. They were purchased at the same time. They all have 1.5TB RAM each. The ones that show 8 numa nodes in esxtop they show 8 numa nodes of 196GB RAM while that only one that has 4 shows 4 numa nodes of 375GB RAM. I don't understand why the difference..

Re: NUMA node count not right

KocPawel — Sat, 02 Nov 2019 20:02:31 GMT

Compare BIOS settings in regard to NUMA and Memeory interleaving.

That's only one thing which comes to my mind.

Re: NUMA node count not right

zenivox — Sun, 03 Nov 2019 07:52:19 GMT

thanks! As soon as I can powr off the servers I will check..

Re: NUMA node count not right

hussainbte — Sun, 03 Nov 2019 08:06:50 GMT

how many cores per socket ..? i would like to know the total number of cores you have on the server..

also can you navigate through these BIOS setting and share an output..

Setting NUMA Group Size Optimization

From the System Utilities screen, select System Configuration > BIOS/Platform Configuration (RBSU) > Performance Options > Advanced Performance Tuning Options > NUMA Group Size Optimization

Re: NUMA node count not right

zenivox — Sun, 03 Nov 2019 09:17:44 GMT

Thanks Hussain, each CPU has 22 cores and HT is enabled. As soon as I can schedule an activity to power off the server I'll post the result of that setting, thanks again

Re: NUMA node count not right

hussainbte — Sun, 03 Nov 2019 09:40:20 GMT

22 cores per socket and 4 sockets..

so that is a total of 88 cores. that is a lot of compute power