Reply to Message

View discussion in a popup

Replying to:
DanMc85
Enthusiast
Enthusiast

I seen this issue too in my homelab. 

 

Typically required a hard reboot of the VSAN host, in this case a Dell R740. You may also find when this happens to the identified host, as shown in Skyline health, that you cannot do things with the VMs on that host in vCenter, i.e. Shutdown, open console, vmotion.   Others seem unaffected.  Also if the Check for Compliance does work, it comes back with a bunch of updates needed out of nowhere which isn't really true and vanish after a hard reset and checking again.

I have seen this happen randomly with multiple hosts in the cluster at random times since updating to 7.0.2, at first I thought it was a compatibility issue with Veeam Backup and Replication as it always seems to happen overnight, maybe a random coincidence. 

 

I also see this in ESXi logs when this happens.

2021-05-13T09:25:35.737Z cpu16:2097481)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "mpx.vmhba32:C0:T0:L0" state in doubt; requested fast path state update...

2021-05-13T09:33:14.398Z cpu0:2103384)WARNING: Fil3: 1534: Failed to reserve volume f533 28 1 60310ddb de7e2394 e9f40d4b f4297dd4 0 0 0 0 0 0 0

2021-05-13T11:07:41.152Z cpu23:2252335)ALERT: Bootbank cannot be found at path '/bootbank'

 

2021-05-13T14:24:55.591Z cpu0:2097482)ScsiPath: 8058: Cancelled Cmd(0x45bbed5987c0) 0x0, cmdId.initiator=0x4538be99bc58 CmdSN 0x0 from world 0 to path "vmhba32:C0:T0:L0". Cmd count Active:0 Queued:1.
2021-05-13T14:24:55.591Z cpu1:2241148)VMW_SATP_LOCAL: satp_local_updatePath:856: Failed to update path "vmhba32:C0:T0:L0" state. Status=Transient storage condition, suggest retry
2021-05-13T14:25:14.512Z cpu6:2097481)ScsiPath: 8058: Cancelled Cmd(0x45bbed5874c0) 0x9e, cmdId.initiator=0x4538b229a708 CmdSN 0x2bd81 from world 0 to path "vmhba32:C0:T0:L0". Cmd count Active:0 Queued:0.
2021-05-13T14:25:14.512Z cpu6:2097481)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "mpx.vmhba32:C0:T0:L0" state in doubt; requested fast path state update...
2021-05-13T14:25:14.512Z cpu6:2097481)ScsiDeviceIO: 4315: Cmd(0x45bbed5874c0) 0x9e, cmdId.initiator=0x4538b229a708 CmdSN 0x2bd81 from world 0 to dev "mpx.vmhba32:C0:T0:L0" failed H:0x5 D:0x0 P:0x0 Cancelled from path layer. Cmd count Active:1
2021-05-13T14:25:14.512Z cpu6:2097481)Queued:1

 

Found this thread @ Dell if your issue is also with a Dell Server or similar using SD Cards for ESXi boot: VMware 7.0 U2 losing contact with SD card - Dell Community

- DanMc85
VCP-DCV 2021
Reply
0 Kudos