VMware

This Question is Possibly Answered

1 "correct" answer available (10 pts) 2 "helpful" answers available (6 pts)
1 2 Previous Next 15 Replies Last post: Oct 15, 2009 2:20 AM by SistemiRadici  

NFS writes horrendously slow posted: May 14, 2008 7:45 AM

Click to view myxiplx's profile Enthusiast 113 posts since
Apr 4, 2006

We have a new Windows 2003 storage server that I would like to use for storing virtual machines. I've installed Services for Unix, and configured NFS as per this document: http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1004490

Everything works, but NFS writes are incredibly slow despite running over a gigabit link. We're getting just 6.6MB/s on the virtual machine running over NFS, as opposed to 215MB/s on the W2k3 server, and 62MB/s on a virtual machine running off a single local SATA disk. I don't think it's a network issue as NFS reads are fine (around 73MB/s on the virtual machine).

The raid card on the server is battery backed, and write caching is enabled on the controller, however I don't believe ESX is taking advantage of this. I've looked into enabling write caching on the server, but according to Microsoft's performance tuning docs, with NFS v3 it's no longer a server side setting but something that has to be configured at the client.

Does anybody know if there are any settings in ESX to improve NFS performance?

Re: NFS writes horrendously slow

1. May 14, 2008 10:04 AM in response to: myxiplx
Click to view Texiwill's profile Guru 10,213 posts since
Jan 13, 2004
Hello,

Just a little debugging on this first.... There is not much you can do about NFS from the ESX side, only the server side.

Run from the SC:

esxcfg-nics -l

Are the settings proper for the connection NFS is using?

Also, you could look at /var/log/vmkernel and see if there are any errors with the data store access.


Best regards,
Edward L. Haletky
VMware Communities User Moderator
====
Author of the book 'VMWare ESX Server in the Enterprise: Planning and Securing Virtualization Servers', Copyright 2008 Pearson Education. CIO Virtualization Blog: http://www.cio.com/blog/index/topic/168354, As well as the Virtualization Wiki at http://www.astroarch.com/wiki/index.php/Virtualization

Re: NFS writes horrendously slow

2. May 14, 2008 10:14 AM in response to: myxiplx
Click to view Paul Lalonde's profile Master 767 posts since
Jan 16, 2006
There are known performance issues with Windows NFS services and VMware ESX Server.

During my time with VMware Technical Support, we discovered a very large number of TCP packet retransmissions, timeouts, and missed ACKs with Windows Services for Unix. It didn't matter which version of the product (ie. Windows Server with Services for Unix, Windows Storage Server, or Windows Unified Data Storage Server), we always saw the same issues.

Your best bet is to move away from Windows NFS services for now and use a decent Linux or BSD distribution. You'll find a tremendous improvement in overall performance and reliability this way.

Regards,
Paul Lalonde

Re: NFS writes horrendously slow

4. May 15, 2008 12:10 AM in response to: myxiplx
Click to view Dave.Mishchenko's profile Guru 8,974 posts since
Nov 15, 2005
Have you considered trying an iSCSI target on Windows?

Re: NFS writes horrendously slow

6. May 20, 2008 2:05 AM in response to: myxiplx
Click to view PiTRe44's profile Novice 25 posts since
Nov 10, 2004
Do you try to access your NFS server via the "normal" way, as a datastore ? ESX 3.5 is buggy this way (response from Vmware : we will fix it in ... ESX 4.0 !) and you got better perf using a NFS mount instead and do your files operation through the console. But either way, you will have bad perf, something seems broken in NFS.

Re: NFS writes horrendously slow

11. Nov 11, 2008 9:52 PM in response to: myxiplx
Click to view ecohen's profile Novice 39 posts since
Sep 12, 2007

Did you get an update on this finally?

Did you finally fix the problem? Please let us know as we are having the same issues.

Thanks

Re: NFS writes horrendously slow

12. Dec 11, 2008 9:43 PM in response to: ecohen
Click to view boschb's profile Novice 10 posts since
Nov 18, 2006
I too am having the issue. Anyone have a solution or fix. I would hate to have to fry my whole windows storage server installation from HP and move to linux based os just for NFS.

Re: NFS writes horrendously slow

13. Dec 16, 2008 8:11 AM in response to: myxiplx
Click to view ipatelvmware's profile Novice 23 posts since
Nov 13, 2008

Hi

I am having the same problems that you are, have you got an update on this issue yet.

regards

IP

Re: NFS writes horrendously slow

14. Sep 22, 2009 7:47 AM in response to: ipatelvmware
Click to view AWoroch2's profile Lurker 1 posts since
Sep 22, 2009

http://support.microsoft.com/KB/945660

Give that a try - it made a world of difference to us and it's made it usable. It seems that with NFS and Windows 2003 each NFS packet does an LDAP/SID lookup, and becuase Root isn't typically in the mapped list, and only root is trying from an ESX system, each packet has to time out on it's lookup first.

I was working on something else NFS/Linux/Windows related and also hoping to get a single shared ISO/Installs NFS DataStore mount for our ESX servers and found a number of people here in the forums with the same issue, but no real solution. So far, I'm happy with this one, knock on wood.

VMware Developer

SDKs, APIs, Videos, Learn and much more in the Developer community.

Learn More

Developer Sample Code

Increase your developer productivity with VMware API sample code.

Learn More

VMworld Sessions & Labs

Online access to the latest VMworld Sessions & Labs and online services.

Learn more

Purchase PSO Credits Online

Purchase credits to redeem training and consulting services online.

Buy Now

Community Hardware Software

View reported configurations or report your own.

Learn More

VMware vSphere

Come witness the next giant leap in virtualization.

Register Today

Communities