VMware Cloud Community
SignatureIT
Contributor
Contributor
‎12-14-2015 09:47 AM

ESX 5.5U3b Poor 10Gb performance

Hello we are seeking for assistance.

We have the following configuration all servers same HW config

Single 10Gb Switch MTU 9000 enabled

Node 1 Linux Bare Metal 10Gb Dual port Intel x540 NIC MTU 9000

Node 2 Linux Bare Metal 10Gb Dual port Intel x540 NIC MTU 9000

Node 3 ESXi 5.53b 10Gb Dual port Intel x540 NIC MTU 9000

We are doing network throughput testing following VMware KB


Testing the vmkernel network performance using the nc command (2052119)

Testing from Node 1 to Node 2 and Node 2 to Node 1 (Linux bare metal to Linux bare metal) performance is great


Ncat: Version 6.40 ( http://nmap.org/ncat )

Ncat: Connected to 10.1.1.112:8100.

1024+0 records in

1024+0 records out

10510925824 bytes (11 GB) copied, 10.5302 s, 998 MB/s

Ncat: 10510925824 bytes sent, 0 bytes received in 10.53 seconds.

Testing from Node 1 (Linux bare metal) or Node 2 (Linux bare metal) to Node 3 (ESXi 5.5U3b) performance is very poor

Please note we are testing performance to the ESXi VMkernel, not to a virtual machine within ESX

Ncat: Version 6.40 ( http://nmap.org/ncat )

Ncat: Connected to 10.1.1.84:8100.

1024+0 records in

1024+0 records out

10510925824 bytes (11 GB) copied, 51.3748 s, 205 MB/s

9:12:34am up  1:17, 536 worlds, 0 VMs, 0 vCPUs; CPU load average: 0.01, 0.02, 0.02

   PORT-ID              USED-BY  TEAM-PNIC DNAME              PKTTX/s  MbTX/s    PKTRX/s  MbRX/s %DRPTX %DRPRX

  33554433                Management        n/a vSwitch0                        0.00    0.00       0.00    0.00   0.00   0.00

  33554434               vmnic0          - vSwitch0                              69581.29   35.04  131394.83 1517.66   0.00   0.00

  33554435          Shadow of vmnic0        n/a vSwitch0                   0.00    0.00       0.00    0.00   0.00   0.00

  33554436                 vmk0     vmnic0 vSwitch0                         69581.09   35.04       3.55    0.00   0.00   0.00

  50331649           Management        n/a vSwitch1                             0.00    0.00       0.00    0.00   0.00   0.00

  50331650               vmnic1          - vSwitch1                                  0.00    0.00  131396.21 1517.69   0.00   0.00

  50331651          Shadow of vmnic1        n/a vSwitch1                   0.00    0.00       0.00    0.00   0.00   0.00

  50331653                 vmk1     vmnic1 vSwitch1                             0.00    0.00   11711.85 1457.40   0.00   0.00

We attempted to troubleshot the performance by upgrading the stock ESXi Intel x540 driver to

ixgbe-3.21.4-1710123

And

ixgbe-4.1.1.1-1331820-3187103

We tried the same scenario to an ESXi 6.01a host, the performance issue repeats.

The performance issue is still unresolved.

Please advice, we been struggling with this problem for 3 days now.

Thank you!

0 Kudos
0 Replies