VMware Networking Community
DarMan1969
Contributor
Contributor

NSX-T 3.1.1 communication between edges - poor performance

Hello,

I'm struggling with network performance between 2 VMs (Ubuntu server 20.04, MTU 8800, 4vCPU, 32 GB).

vm-2 to vm-4 (client, server for iperf3) are in different segments and communication is as follows:

vm-2 (segment-1 )=> T1x => edge cluster-2 (edge-3) => QFX 10G ports => edge cluster-1 (edge-1) => T1y - (segment-2) => vm-4

edge cluster-2 Active / Standby (edge-3 - active)

edge cluster-1 Active / Standby (edge-1 - active)

segment-1 - available on edge cluster-1 only

segment-2 - available on edge-cluster-2 only

VMs works on dirrerent hosts

Edges works on different hosts

Both Edge VMs (LARGE) during tests (bidirectional) - CPU 10 to 14 GHz

vCenter 7.0U1, NSX-T 3.1.1 (global MTU 9k, Remote 1700)

Cluster - 4 hosts (Dell R740 2xGOLD, 768GB , NIC x710 4x10 SPF+,

Driver: i40en ,Firmware Version: 7.10 0x800075e5 19.5.12 , Version: 1.10.9.0

 

iperf3 -c <server>  -P4  =======> bitrate = 9,78 Gbit/s

iperf3 -c <server>  -P4 -R =======> bitrate = 9,78 Gbit/s (reverse mode)

but bidirectional traffic

iperf3 -c <server>  -P4  --bidir =======> bitrate = 4,7 Gbit/s - why ?

Is it issue with design configuration or problem with edges (high CPU) ?

Maybe ENS driver should be installed ?

Thank you for any advices.

Berst Regards

Darek

0 Kudos
0 Replies