Hey,
Im running 6.5.0 (Build 4887370) with a few VMs. Today one of the VMs locked up but so i rebooted it from the webUI and i got the following error.
ESXI 6.5 Failed - Transport (VMDB) error -45: Failed to connect to peer process.
I rebooted the host and now all VMs are not starting and giving me that error. I did some digging and it found this issue is related to not enough memory but I appear to have plently of memory on the datastore.
df -h
Filesystem Size Used Available Use% Mounted on
VMFS-5 924.0G 714.5G 209.5G 77% /vmfs/volumes/ds
vfat 285.8M 205.8M 80.0M 72% /vmfs/volumes/5d89fad8-4ab19fd8-5648-0cc47a4e7280
vfat 249.7M 8.0K 249.7M 0% /vmfs/volumes/5c709076-7043e11a-cc87-02f30dbee357
vfat 4.0G 28.8M 4.0G 1% /vmfs/volumes/5d89fae1-6a6e3db0-64f7-0cc47a4e7280
vfat 249.7M 143.7M 106.0M 58% /vmfs/volumes/7153e27e-c2a7c27b-bbf0-cbdb95a4732e
I tired to create a files on the datastore and i get an Input/output error. I can delete files from the data store but not create them.
I checked the logs on the host and found the following
==> /var/log/vmkwarning.log <==
2021-11-24T14:42:19.850Z cpu0:65561)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "t10.ATA_____HGST_HTS721010A9E630__________________________JR10006P22HK7E" state in doubt; requested fast path state update...
2021-11-24T14:42:19.864Z cpu1:72569)WARNING: Swap: 3723: Failed to create swap file '/vmfs/volumes/5d89fae0-d7174380-cab5-0cc47a4e7280/vu18/vmx-vu18-1523612192-1.vswp' : I/O error
The host also appears to have plenty of inodes so that should not be the problem.
stat -f /
File: "/"
ID: 100000000 Namelen: 127 Type: visorfs
Block size: 4096
Blocks: Total: 299613 Free: 110003 Available: 110003
Inodes: Total: 655360 Free: 649192
anyone have any ideas what the cause could be there were no changes made to this Host in months so im not sure whats going on?
