Unable to boot any VMs on a NFS share

[creiche]

I recently added a Solaris NFS share to my ESX host and migrated my virtual machines over to it. Now when I try to boot my machines, I get "Permission denied" when I try to boot them and in my vmkernel.log I get:

Mar 27 12:47:54 syn-esxt-03 vmkernel: 0:01:04:42.242 cpu1:1036)World: vm 1082: 895: Starting world vmware-vmx with flags 4

Mar 27 12:47:55 syn-esxt-03 vmkernel: 0:01:04:42.927 cpu3:1082)World: vm 1083: 895: Starting world vmm0:Test-02 with flags 8

Mar 27 12:47:55 syn-esxt-03 vmkernel: 0:01:04:42.927 cpu3:1082)Sched: vm 1083: 5333: adding 'vmm0:Test-02': group 'host/user': cpu: shares=-1 min=-1 minLimit=-1 max=-1

Mar 27 12:47:55 syn-esxt-03 vmkernel: 0:01:04:42.927 cpu3:1082)Sched: vm 1083: 5352: renamed group 25 to vm.1082

Mar 27 12:47:55 syn-esxt-03 vmkernel: 0:01:04:42.927 cpu3:1082)Sched: vm 1083: 5366: moved group 25 to be under group 4

Mar 27 12:47:55 syn-esxt-03 vmkernel: 0:01:04:42.929 cpu3:1082)Swap: vm 1083: 2169: extending swap to 524288 KB

Mar 27 12:47:55 syn-esxt-03 vmkernel: 0:01:04:42.929 cpu3:1082)WARNING: Swap: 2056: Set file length failed:status Permission denied, length 524288KB

Mar 27 12:47:55 syn-esxt-03 vmkernel: 0:01:04:42.929 cpu3:1082)WARNING: MemSched: vm 1083: 2957: insufficient swap: need=524288K

Mar 27 12:47:55 syn-esxt-03 vmkernel: 0:01:04:42.929 cpu3:1082)WARNING: World: vm 1083: 905: init fn memsched failed with: Permission denied!

Mar 27 12:47:55 syn-esxt-03 vmkernel: 0:01:04:42.929 cpu3:1082)WARNING: World: vm 1083: 1770: WorldInit failed: trying to cleanup.

Mar 27 12:47:55 syn-esxt-03 vmkernel: 0:01:04:42.930 cpu3:1082)WARNING: NFSLock: 1794: Failed to create .lck-2100000000000000 : Permission denied

Mar 27 12:47:55 syn-esxt-03 vmkernel: 0:01:04:42.930 cpu3:1082)NFSLock: 2497: failed to get lock on file Test-02-0fb10e40.vswp 0x3f61a250 on 172.16.69.6 (172.16.69.6): Permission denied

[RParker]

Browse datastore on the NFS, and see if you can create a folder. If not you may have some permissions.

make sure the NFS volumes are set to rw,async,no_root_squash, to enable read/write, asynchronous writes, and inhibit the block of the root account from the ESX servers.

[creiche]

yes, I can browse, create folders, delete, upload files, and create VMs on the datastore. The only problem I notice is when I try to boot and it looks like it may be related to when it's trying to make a file lock.

I use a VMWare Delegate named nfsuser and he has a matching UID to the one setup for the user on the NFS server so there is no root squash on that end.

[davlloyd]

How did you get around this? we are working through the same issue at the moment.