VMware Communities > VMTN > VMware vSphereâ„¢ > vSphere Networking > Discussions

This Question is Possibly Answered

1 "correct" answer available (10 pts) 2 "helpful" answers available (6 pts)
5 Replies Last post: Jul 10, 2009 1:48 AM by jasoncllsystems
Reply

Slow Performance with 10 Gb CNA card on vSphere 4

Jul 2, 2009 8:33 PM

Click to view malaysiavm's profile Expert malaysiavm 556 posts since
Aug 24, 2008


anyone here test the nexus 5000 with 10Gb CNA card on ESX 4 with the virtual machine? I got a very slow performance and yet to sort out until now with my POC and need some advice here. We use the VMXNET3 which show up as 10Gb connection in the virtual machine, but the bandwidth utilization could not even reach 1Gbps from the virtual machine when we do file copy and network speed test.

When I tried the Vmotion on the 10Gbps connection, I am able to utilize up to 1.5Gbps

Any idea or suggestion could help on this?

Craig

http://engineering.ucsb.edu/~duonglt/vmware/vexpert_silver_icon.jpg
vExpert 2009
Malaysia VMware Communities - http://www.malaysiavm.com

Reply Re: Slow Performance with 10 Gb CNA card on vSphere 4 Jul 2, 2009 9:05 PM
Click to view malaysiavm's profile Expert malaysiavm 556 posts since
Aug 24, 2008

You may refer to http://malaysiavm.com/blog/cisco-nexus-5000-poc/ for more information.


Regards,

Superman
Malaysia VMware Communities - http://www.malaysiavm.com

Reply Re: Slow Performance with 10 Gb CNA card on vSphere 4 Jul 2, 2009 11:55 PM
Click to view benma's profile Hot Shot benma 197 posts since
Jul 2, 2008

Hey buddy,

the QLE8042 is not on the HCL for ESX4.

There is a driver for 3.5U2 http://www.vmware.com/support/vi3/doc/drivercd/esx35-qla2300_707_vmw_7.08-vm60.html

If you are brave you can try to install the module on a ESX4 testserver(!)

Have you tried your tests with the normal mtu?

Reply Re: Slow Performance with 10 Gb CNA card on vSphere 4 Jul 3, 2009 12:02 AM
in response to: benma
Click to view malaysiavm's profile Expert malaysiavm 556 posts since
Aug 24, 2008

vSphere was auto detect as ISP8432 4Gb FCoE PCI Express HBA & Intel 82598EB 10 Gigabit.

MTU 1500 have the similar result.

Both CNA connected to PCIe 8x slot.

Superman
Malaysia VMware Communities - http://www.malaysiavm.com

Reply Re: Slow Performance with 10 Gb CNA card on vSphere 4 Jul 9, 2009 1:56 PM
in response to: malaysiavm
Click to view leninS's profile Lurker leninS 1 posts since
Jul 6, 2009
The socket buffer sizes you are using in the VM are quite small.

Could you try with larger socket buffer sizes:
netperf (or netclient) -l 60 -t TCP_STREAM -H <IP> -- -m 8K -s 64K -S 64K

-m is for message size
-s is for local socket buffer size : You should use larger socket buffers for high throughput networks (64K+ is better)
-S is for remote socket buffer size

If this helps, you could try modifying the default windows socket buffer size (MSFT provides some kb articles to achieve this.). This should help your file transfer apps.

Are you using Server2003 SP2. Because prior to that, Windows Server 2003 does not support TSO. TSO improves transmit performance (copying out of a VM) quite a bit. You could also try different VMs (64 bit version on Server 2003 SP2, Linux etc...) to see if your VM configuration is an issue.
Reply Re: Slow Performance with 10 Gb CNA card on vSphere 4 Jul 10, 2009 1:48 AM
in response to: leninS
Click to view jasoncllsystems's profile Hot Shot jasoncllsystems 103 posts since
Mar 16, 2009

Thanks.

Yes I did that as suggested by VMware White Paper.

You may refer to my latest updated @ http://malaysiavm.com/blog/cisco-nexus-5000-poc/

Regards,
Jas aka Superman
MALAYSIA VMware Communities
http://www.malaysiavm.com

'If you found this or any other answer useful please consider allocating points for helpful or correct answers ***

Actions