We have same problem with VmWare 6.5. We try add more space for disk on one virtual machine and get error:
The disk extend operation failed: There is not enough space on the file system for the selected operation
On datastore (it's SAN) we have more free space (1 Tb free)
One node see right size. I migrate VM on this node and change hdd size, then i migrate back vm and other node see right size of Lun too. Thanks all for help!
Is this a thin provisioned LUN, if yes can you look at SAN array to verify if there is any space issue?
Also from ESXi, host run the following commnds to identify if the mapped LUN is thin-povisioned
esxcfg-scsidevs -m
<Copy the naa,id of VMW-Vol1_DX440>
esxcli storage core device list -d <naa.id from above results>
That i see:
naa.600000e00d1000000010049000020000
Display Name: FUJITSU Fibre Channel Disk (naa.600000e00d1000000010049000020000)
Has Settable Display Name: true
Size: 2072576
Device Type: Direct-Access
Multipath Plugin: NMP
Devfs Path: /vmfs/devices/disks/naa.600000e00d1000000010049000020000
Vendor: FUJITSU
Model: ETERNUS_DX400
Revision: 0000
SCSI Level: 5
Is Pseudo: false
Status: on
Is RDM Capable: true
Is Local: false
Is Removable: false
Is SSD: false
Is VVOL PE: false
Is Offline: false
Is Perennially Reserved: false
Queue Full Sample Size: 0
Queue Full Threshold: 0
Thin Provisioning Status: unknown
Attached Filters:
VAAI Status: supported
Other UIDs: vml.0200000000600000e00d1000000010049000020000455445524e55
Is Shared Clusterwide: true
Is Local SAS Device: false
Is SAS: false
Is USB: false
Is Boot USB Device: false
Is Boot Device: false
Device Max Queue Depth: 30
No of outstanding IOs with competing worlds: 32
Drive Type: unknown
RAID Level: unknown
Number of Physical Drives: unknown
Protection Enabled: false
PI Activated: false
PI Type: 0
PI Protection Mask: NO PROTECTION
Supported Guard Types: NO GUARD SUPPORT
DIX Enabled: false
DIX Guard Type: NO GUARD SUPPORT
Emulated DIX/DIF Enabled: false
Thin Provisioning Status: unknown
Can you check from SAN side if the LUN's are thin-provisioned and you have enough storage at physical level.
I add space 1Tb for this LUN and now he have more than 1Tb free space. On SAN it's RAW LUN that present Vmware nodes
vmware.log:
2018-08-01T07:08:49.700Z| vcpu-0| I125: DISKLIB-VMFS : "/vmfs/volumes/58ecf795-841d1fce-1171-901b0e828a40/OwnCloud-test/OwnCloud-test-flat.vmdk" : closed.
2018-08-01T07:08:49.701Z| vcpu-0| I125: DISKLIB-VMFS : "/vmfs/volumes/58ecf795-841d1fce-1171-901b0e828a40/OwnCloud-test/OwnCloud-test-flat.vmdk" : open successful (24) size = 118111600640, hd = 244402575. Type 3
2018-08-01T07:08:49.701Z| vcpu-0| I125: DISKLIB-DSCPTR: Opened [0]: "OwnCloud-test-flat.vmdk" (0x18)
2018-08-01T07:08:49.701Z| vcpu-0| I125: DISKLIB-LINK : Opened '/vmfs/volumes/58ecf795-841d1fce-1171-901b0e828a40/OwnCloud-test/OwnCloud-test.vmdk' (0x18): vmfs, 83886080 sectors / 40 GB.
2018-08-01T07:08:49.701Z| vcpu-0| I125: DISKLIB-LIB : Opened "/vmfs/volumes/58ecf795-841d1fce-1171-901b0e828a40/OwnCloud-test/OwnCloud-test.vmdk" (flags 0x18, type vmfs).
2018-08-01T07:08:49.701Z| vcpu-0| I125: DISKLIB-LIB : Growing disk '/vmfs/volumes/58ecf795-841d1fce-1171-901b0e828a40/OwnCloud-test/OwnCloud-test.vmdk' : createType = vmfs
2018-08-01T07:08:49.701Z| vcpu-0| I125: DISKLIB-LIB : Growing disk '/vmfs/volumes/58ecf795-841d1fce-1171-901b0e828a40/OwnCloud-test/OwnCloud-test.vmdk' : capacity = 83886080 sectors - 40 GB
2018-08-01T07:08:49.701Z| vcpu-0| I125: DISKLIB-LIB : Growing disk '/vmfs/volumes/58ecf795-841d1fce-1171-901b0e828a40/OwnCloud-test/OwnCloud-test.vmdk' : new capacity = 314572800 sectors - 150 GB
2018-08-01T07:08:49.958Z| vcpu-0| I125: OBJLIB-FILEBE : FileBEIoctl: ioctl operation IOCTLCMD_VMFS_SET_FILE_LENGTH(3004) failed on '/vmfs/volumes/58ecf795-841d1fce-1171-901b0e828a40/OwnCloud-test/OwnCloud-test-flat.vmdk' : No space left on device (1835010)
2018-08-01T07:08:49.958Z| vcpu-0| I125: DISKLIB-LINK : Failed to grow/create '/vmfs/volumes/58ecf795-841d1fce-1171-901b0e828a40/OwnCloud-test/OwnCloud-test-flat.vmdk'
2018-08-01T07:08:49.958Z| vcpu-0| I125+ .DISKLIB-LIB : Unable to grow disk '/vmfs/volumes/58ecf795-841d1fce-1171-901b0e828a40/OwnCloud-test/OwnCloud-test.vmdk' : There is not enough space on the file system for the selected operation (13).
2018-08-01T07:08:49.958Z| vcpu-0| I125: DISKLIB-LIB : Unable to grow disk '/vmfs/volumes/58ecf795-841d1fce-1171-901b0e828a40/OwnCloud-test/OwnCloud-test.vmdk' : There is not enough space on the file system for the selected operation (13).
2018-08-01T07:08:49.958Z| vcpu-0| I125: DISKLIB-LIB : Failed to grow disk '/vmfs/volumes/58ecf795-841d1fce-1171-901b0e828a40/OwnCloud-test/OwnCloud-test.vmdk' : There is not enough space on the file system for the selected operation (13).
2018-08-01T07:08:49.958Z| vcpu-0| I125: DISKLIB-VMFS : "/vmfs/volumes/58ecf795-841d1fce-1171-901b0e828a40/OwnCloud-test/OwnCloud-test-flat.vmdk" : closed.
if i run df, i see:
Filesystem | Bytes | Used | Available Use% Mounted on |
NFS | 52078608384 14675062784 37403545600 28% /vmfs/volumes/PCD7711_NFS | ||
VMFS-5 | 291252469760 | 1020264448 290232205312 0% /vmfs/volumes/datastore2 | |
VMFS-5 | 1099243192320 1096193933312 | 3049259008 100% /vmfs/volumes/VMW-Vol1_DX440 | |
VMFS-5 | 2198754820096 943426895872 1255327924224 43% /vmfs/volumes/CUCM-vmw | ||
vfat | 299712512 | 216743936 | 82968576 72% /vmfs/volumes/58be94dd-6140d702-6e16-901b0e828de0 |
vfat | 261853184 | 162996224 | 98856960 62% /vmfs/volumes/a3e9d37e-9cae6dab-b680-cf3fccc1bd30 |
vfat | 4293591040 | 238813184 | 4054777856 6% /vmfs/volumes/58be94f2-f124e78c-87d3-901b0e828de0 |
vfat | 261853184 | 158744576 | 103108608 61% /vmfs/volumes/709f2a7a-3607418c-fbd6-c6e009068e7d |
but in GUI i see 1Tb free space
Could you do a rescan from GUI??
Do you mean refresh capacity information?
df -h shows 0% available space ryt.
Would it be possible to expand the LUN from storage array and expand the datastore?
1) Directly login to the host (on which the affected VM is running) and check the free space available.
2) If there is free space shown even on the host directly, try to expand the disk from the host connection.
3) If it fails even from the host, there is high chance that the backend pool on the storage has run out of free space.
Please consider marking this answer as "correct" or "helpful" if you think your questions have been answered.
Cheers,
Supreet
Early we expanded the LUN from storage array and expanded the datastore from GUI. In GUI i see free 1Tb
One node see right size. I migrate VM on this node and change hdd size, then i migrate back vm and other node see right size of Lun too. Thanks all for help!
What is the total size of VM?
What is the size of Memory ?
What is size in GB/TB you are extending by ?