Hi all,
I am running a 3 ESXi 5 u1 hosts in a HP BLc7000 blade enclosure connected to a P6000 storage array. We recently updated the firmware on the P6000 to enable VAAI support, and taking advantage of the downtime, also chanbged the controllers that the LUNs were presented via to the hosts. The hosts were powered down at the time of the change.
Over the last few days I have had hosts becoming disconnected in vCenter, despite remaining pingable. Running any command on the hosts (particularly to interrogate the storage) is very slow.
Running dmesg shows:
WARNING: HBX: 1889: Failed to initialize VMFS3 distributed locking on volume <UUID>: Timeout
VMware KB: 2006858, seems to relate to the problem.
Following command ran as suggested by KB article shows:
# vmkfstools -Ph -v1 /vmfs/volumes/ESXVD06
VMFS-5.54 file system spanning 1 partitions.
File system label (if any): ESXVD06
Mode: public
Capacity 699.8 GB, 331.3 GB available, file block size 1 MB
Volume Creation Time: Tue Mar 13 08:12:41 2012
Files (max/free): 130000/129884
Ptr Blocks (max/free): 64512/64108
Sub Blocks (max/free): 32000/31982
Secondary Ptr Blocks (max/free): 256/256
File Blocks (overcommit/used/overcommit %): 0/377307/0
Ptr Blocks (overcommit/used/overcommit %): 0/404/0
Sub Blocks (overcommit/used/overcommit %): 0/18/0
UUID: 4f5f0179-ae59290c-28d9-101f74350100
Partitions spanned (on "lvm"):
naa.6001438009b038360000f000002b0000:1
DISKLIB-LIB : Getting VAAI support status for /vmfs/volumes/ESXVD06
Is Native Snapshot Capable: NO
Does this mean VMware doesn't think the volume is VAAI capable?
Have also run the following command but waiting for it to return anything...
# esxcli system settings advanced list -o /VMFS3/HardwareAcceleratedLocking
Any help very much appreciated
You can check the supported VAAI features for an Array from the below SAN compatiblity portal:
take a particular note of the firmware levels.
some more info here as well:
What does it say if you run "# esxcli storage core device vaai status get" ?
All show the same message
<UUID>
VAAI Plugin Name:
ATS Status: supported
Clone Status: supported
Zero status: supported
Delete status: unsupported
Having to disable VAAI on the hosts now as getting desperate...