Running voma -f check and -f fix gave a lot of errors.
The "fixing" took care of a few of them, but the only errors that were fixes was this kind:
Found stale lock [type 10c00001 offset 78708736 v 63, hb offset 3219456
gen 89, mode 1, owner 5fb667e6-bc0f4452-dba3-141877464cbc mtime 1028
num 0 gblnum 0 gblgen 0 gblbrk 0]
After "fix" and "check" again, log looks like this
All the missing files are listed here in Phase 4, with "Invalid direntry"
System:
Checking if device is actively used by other hosts
Running VMFS Checker version 1.2 in default mode
Initializing LVM metadata, Basic Checks will be done
Phase 1: Checking VMFS header and resource files
Detected VMFS file system (labeled:'System') with UUID:5671255b-3b21621a-0c7c-141877464cbc, Version 5:61
ON-DISK ERROR: Cluster number 0 should be 3570
ON-DISK ERROR: Cluster 3570 total resources 0 should be 16
ON-DISK ERROR: Cluster number 0 should be 17
ON-DISK ERROR: Cluster 17 total resources 0 should be 200
ON-DISK ERROR: Cluster 17 free count 0 should be 7
ON-DISK ERROR: Cluster number 0 should be 18
... a lot of lines like this ...
Phase 2: Checking VMFS heartbeat region
Phase 3: Checking all file descriptors.
ON-DISK ERROR: <FD c130 r26> corrupted address <INVALID c0 r0>
ON-DISK ERROR: <FD c130 r26> invalid generation 0
ON-DISK ERROR: <FD c130 r26> : invalid FD type 0x0
ON-DISK ERROR: <FD c130 r27> corrupted address <INVALID c0 r0>
ON-DISK ERROR: <FD c130 r27> invalid generation 0
ON-DISK ERROR: <FD c130 r27> : invalid FD type 0x0
ON-DISK ERROR: <FD c130 r34> corrupted address <INVALID c0 r0>
...
Phase 4: Checking pathname and connectivity.
ON-DISK ERROR: Invalid direntry <MissingVM01.vmx, 130, 26>
ON-DISK ERROR: Invalid direntry <MissingVM01-flat.vmdk, 130, 27>
ON-DISK ERROR: Invalid direntry <MissingVM01.nvram, 130, 41>
ON-DISK ERROR: Invalid direntry <MissingVM01.vmx~, 130, 70>
ON-DISK ERROR: Invalid direntry <vmware.log, 130, 71>
ON-DISK ERROR: Invalid direntry <MissingVM02.vmx, 130, 63>
ON-DISK ERROR: Invalid direntry <MissingVM02-flat.vmdk, 130, 64>
ON-DISK ERROR: Invalid direntry <MissingVM02.nvram, 130, 73>
ON-DISK ERROR: Invalid direntry <MissingVM02-5e6625e3.vswp, 130, 39>
ON-DISK ERROR: Invalid direntry <MissingVM02.vmx~, 130, 68>
ON-DISK ERROR: Invalid direntry <vmx-MissingVM02-1583752675-1.vswp, 130, 34>
ON-DISK ERROR: Invalid direntry <vmware.log, 130, 69>
Phase 5: Checking resource reference counts.
ON-DISK ERROR: PB inconsistency found: (3570,0) allocated in bitmap, but never used
ON-DISK ERROR: PB inconsistency found: (3570,1) allocated in bitmap, but never used
ON-DISK ERROR: PB inconsistency found: (3570,2) allocated in bitmap, but never used
ON-DISK ERROR: PB inconsistency found: (3570,3) allocated in bitmap, but never used
ON-DISK ERROR: PB inconsistency found: (3570,4) allocated in bitmap, but never used
ON-DISK ERROR: PB inconsistency found: (3570,5) allocated in bitmap, but never used
ON-DISK ERROR: PB inconsistency found: (3570,6) allocated in bitmap, but never used
ON-DISK ERROR: PB inconsistency found: (3570,7) allocated in bitmap, but never used
ON-DISK ERROR: PB inconsistency found: (3570,8) allocated in bitmap, but never used
... a lot of lines like this ...
Total Errors Found: 172804
Data1
Checking if device is actively used by other hosts
Running VMFS Checker version 1.2 in check mode
Initializing LVM metadata, Basic Checks will be done
Phase 1: Checking VMFS header and resource files
Detected VMFS file system (labeled:'Data1') with UUID:567113cd-d5fef9d4-2934-141877464cbc, Version 5:61
Phase 2: Checking VMFS heartbeat region
Phase 3: Checking all file descriptors.
ON-DISK ERROR: <FD c130 r5> corrupted address <INVALID c0 r0>
ON-DISK ERROR: <FD c130 r5> invalid generation 0
ON-DISK ERROR: <FD c130 r5> : invalid FD type 0x0
Phase 4: Checking pathname and connectivity.
ON-DISK ERROR: Invalid direntry <MissingVM01_2-flat.vmdk, 130, 5>
Phase 5: Checking resource reference counts.
ON-DISK ERROR: PB inconsistency found: (3730,10) allocated in bitmap, but never used
ON-DISK ERROR: PB inconsistency found: (3730,11) allocated in bitmap, but never used
... a lot of lines like this ...
Total Errors Found: 512506
(I have renamed VMs to MissingVM01 and MissingVM02)
