Hi All,
My ESXI 6.5 installation has lost a VMFS volume and associated datastore, which housed 9 virtual machines. All 9 of the virtual machines are now showing as "Invalid" in the GUI. (See below.) I am not a vmware expert, so please bear with me. Any advice on how to recover the volume and datastore would be appreciated.
I have read through the discussions and tried a number of the recommendations all without success. I am running ESXI 6.5.0 Update 2 (Build 9298722).
- The missing volume is: 5a97e509-f6ed4a1b-2104-70106f3ee998
- It no longer appears in the system
- The system had 2 datastores: ESXI_SSD_1 and ESXI_HDD_2
- The missing datastore is: ESXI_HDD_2
I tried running the following command to check for snapshots, per the following thread: Recover-vmfs-volume-or-datastore :
esxcfg-volume -l
With no return.
All of the HDD drives (4x) are still showing up properly in the system. There is no sign of the missing volume however.
I tried running the following script, looking for the missing datastore, per the following thread: Recovering a Deleted VMFS Datastore on VMware ESXi/vSphere
offset="128 2048"; for dev in `esxcfg-scsidevs -l | grep "Console Device:" | awk {'print $3'}`; do disk=$dev; echo $disk; partedUtil getptbl $disk; { for i in `echo $off
set`; do echo "Checking offset found at $i:"; hexdump -n4 -s $((0x100000+(512*$i))) $disk; hexdump -n4 -s $((0x1300000+(512*$i))) $disk; hexdump -C -n 128 -s $((0x130001d + (512*$i))) $dis
k; done; } | grep -B 1 -A 5 d00d; echo "---------------------"; done
It did not show the missing datastore ("ESXI_HDD_2") on any of the HDD. (See below.)
/vmfs/devices/disks/mpx.vmhba32:C0:T0:L0
gpt
125 255 63 2017280
1 64 8191 C12A7328F81F11D2BA4B00A0C93EC93B systemPartition 128
5 8224 520191 EBD0A0A2B9E5443387C068B6B72699C7 linuxNative 0
6 520224 1032191 EBD0A0A2B9E5443387C068B6B72699C7 linuxNative 0
7 1032224 1257471 9D27538040AD11DBBF97000C2911D1B8 vmkDiagnostic 0
8 1257504 1843199 EBD0A0A2B9E5443387C068B6B72699C7 linuxNative 0
---------------------
/vmfs/devices/disks/t10.ATA_____SPCC_Solid_State_Disk___________________A44907841AE300147862
gpt
29185 255 63 468862128
1 2048 468860927 AA31E02A400F11DB9590000C2911D1B8 vmfs 0
Checking offset found at 2048:
0200000 d00d c001
0200004
1400000 f15e 2fab
1400004
0140001d 45 53 58 49 5f 53 53 44 5f 31 00 00 00 00 00 00 |ESXI_SSD_1......|
0140002d 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
---------------------
/vmfs/devices/disks/t10.ATA_____ST4000DM0042D2CV104__________________________________Z9706YJD
gpt
486401 255 63 7814037168
1 2048 209717247 AA31E02A400F11DB9590000C2911D1B8 vmfs 0
2 209717248 1887438847 AA31E02A400F11DB9590000C2911D1B8 vmfs 0
---------------------
/vmfs/devices/disks/t10.ATA_____ST4000DM0042D2CV104__________________________________ZFN19WVL
gpt
486401 255 63 7814037168
1 2048 4982527 A19D880F05FC4D3BA006743F0F84911E unknown 0
2 4982528 9176831 A19D880F05FC4D3BA006743F0F84911E unknown 0
3 9437184 7813832351 A19D880F05FC4D3BA006743F0F84911E unknown 0
---------------------
/vmfs/devices/disks/t10.ATA_____ST4000VN0082D2DR166__________________________________ZDH1ZFHX
gpt
486401 255 63 7814037168
1 2048 4982527 A19D880F05FC4D3BA006743F0F84911E unknown 0
2 4982528 9176831 A19D880F05FC4D3BA006743F0F84911E unknown 0
3 9437184 7813832351 A19D880F05FC4D3BA006743F0F84911E unknown 0
Note: The following disks were setup as RDM (raw device mapping) passthrough for one of the virtual machines --- therefore they are not relevant:
/vmfs/devices/disks/t10.ATA_____ST4000DM0042D2CV104__________________________________ZFN19WVL
/vmfs/devices/disks/t10.ATA_____ST4000VN0082D2DR166__________________________________ZDH1ZFHX
Finally, there are two VMFS partitions on the following HDD (Identifier "Z9706YJD"). I suspect the missing volume and datastore resided in one of these partitions:
/vmfs/devices/disks/t10.ATA_____ST4000DM0042D2CV104__________________________________Z9706YJD
gpt
486401 255 63 7814037168
1 2048 209717247 AA31E02A400F11DB9590000C2911D1B8 vmfs 0
2 209717248 1887438847 AA31E02A400F11DB9590000C2911D1B8 vmfs 0
Any help or advice would be much appreciated.
Please feel free to requests any additional data that would be helpful.
Thanks in advance!