Recently in my vSphere environment after trying to create new NSX-V backed network I got a following warning:
Add Distributed Port Group
The spec.numPorts exceeds the limit 2048. Cannot increase the number of ports according to the specification, because total number of ports 2051 after increase will then exceed 2048, maximum number of ports allowed on vDS.
Cannot increase the number of ports according to the specification, because total number of ports 2051 after increase will then exceed 2048, maximum number of ports allowed on vDS
After checking from vCenter\Distributed Switch\Summary\Switch Details I noticed that current number of ports is 2048.
This number 2048 was very strange to me since distributed switch static (non-ephemeral binding) ports maximus is around 10000.. and for NSX-T default ephemeral binding is only the one lower around 1016.
However when checking with VMware support they mentioned that there is another configuration maximus under https://configmax.esp.vmware.com/ -> NSX \ Layer 2 Networking \ MAC Identifiers per Overlay Logical Switch (VNI) and it is 2048. WIth description: If this number of MAC entries is exceeded then newer MAC entries will not be added until l the older MAC entries expire. This condition can lead to flooding in the logical network.
Currently this maximus is only impacting NSX-V and is not impacting NSX-T Port Groups that can be created (they are being created because of migrating from NSX-V). However the same maximus is present for NSX-T.
Please note that hosts are using two physical 25G uplinks.
What would be a proper way to scale this ? Creating Additional vDS ?