VMware Cloud Community
Pollard
Enthusiast
Enthusiast
‎10-25-2023 03:50 PM

Esxi 7 lun reset on device,

I've noticed LUN reset errors on one of my Dell servers. I have a somewhat unconventional setup where TrueNAS runs inside a virtual machine on the host and shares data to another VM using iSCSI. These errors have only recently started occurring. I suspect that one of the drives on the H730 that is not passed through to TrueNAS, may have gone bad and started causing everything to act up. I was experiencing issues with reading data from that drive, but I could still write to it. So, I removed the RDM from the VM.
 

Dell T430
2x CPU E5-2680 v4 
2 x H730
128GB Ram

ESXi version:
7.0.3

ESXi build number:
21930508

 

 

2023-10-25T16:23:40.263Z cpu10:2097892)WARNING: NMP: nmpDeviceAttemptFailover:647: Retry world failover device "naa.6589cfc000000156a2174d1330c05158" - issuing command 0x45b8da5b6388
2023-10-25T16:23:40.263Z cpu18:2098186)WARNING: NMP: nmpCompleteRetryForPath:364: Retry cmd 0x9e (0x45b8da5b6388) to dev "naa.6589cfc000000156a2174d1330c05158" failed on path "vmhba67:C0:T0:L0" H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x4 0x2.
2023-10-25T16:23:40.263Z cpu18:2098186)WARNING: NMP: nmpCompleteRetryForPath:394: Logical device "naa.6589cfc000000156a2174d1330c05158": awaiting fast path state update before retrying failed command again...
2023-10-25T16:23:41.263Z cpu10:2097892)WARNING: NMP: nmpDeviceAttemptFailover:647: Retry world failover device "naa.6589cfc000000156a2174d1330c05158" - issuing command 0x45b8da5b6388
2023-10-25T16:23:41.263Z cpu18:2098186)WARNING: NMP: nmpCompleteRetryForPath:364: Retry cmd 0x9e (0x45b8da5b6388) to dev "naa.6589cfc000000156a2174d1330c05158" failed on path "vmhba67:C0:T0:L0" H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x4 0x2.
2023-10-25T16:23:41.263Z cpu18:2098186)WARNING: NMP: nmpCompleteRetryForPath:394: Logical device "naa.6589cfc000000156a2174d1330c05158": awaiting fast path state update before retrying failed command again...
2023-10-25T16:23:41.273Z cpu32:2097564)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "naa.6589cfc000000156a2174d1330c05158" is blocked. Not starting I/O from device.
2023-10-25T16:23:41.273Z cpu25:2116720)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "naa.6589cfc000000156a2174d1330c05158" is blocked. Not starting I/O from device.
2023-10-25T16:23:41.513Z cpu36:2097284)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "naa.6589cfc000000156a2174d1330c05158" is blocked. Not starting I/O from device.
2023-10-25T16:23:41.763Z cpu36:2097284)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "naa.6589cfc000000156a2174d1330c05158" is blocked. Not starting I/O from device.
2023-10-25T16:23:42.013Z cpu36:2097284)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "naa.6589cfc000000156a2174d1330c05158" is blocked. Not starting I/O from device.
2023-10-25T16:23:42.263Z cpu36:2097284)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "naa.6589cfc000000156a2174d1330c05158" is blocked. Not starting I/O from device.
2023-10-25T16:23:42.263Z cpu7:2097892)WARNING: NMP: nmpDeviceAttemptFailover:610: Retry world restore device "naa.6589cfc000000156a2174d1330c05158" - no more commands to retry
2023-10-25T16:23:42.271Z cpu18:2098186)WARNING: NMP: nmp_DeviceRetryCommand:133: Device "naa.6589cfc000000156a2174d1330c05158": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
2023-10-25T16:23:43.263Z cpu7:2097892)WARNING: NMP: nmpDeviceAttemptFailover:647: Retry world failover device "naa.6589cfc000000156a2174d1330c05158" - issuing command 0x45b8da5b6388
2023-10-25T16:23:43.264Z cpu7:2098186)WARNING: NMP: nmpCompleteRetryForPath:364: Retry cmd 0x25 (0x45b8da5b6388) to dev "naa.6589cfc000000156a2174d1330c05158" failed on path "vmhba67:C0:T0:L0" H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x4 0x2.
2023-10-25T16:23:43.264Z cpu7:2098186)WARNING: NMP: nmpCompleteRetryForPath:394: Logical device "naa.6589cfc000000156a2174d1330c05158": awaiting fast path state update before retrying failed command again...
2023-10-25T16:23:44.263Z cpu12:2097892)WARNING: NMP: nmpDeviceAttemptFailover:647: Retry world failover device "naa.6589cfc000000156a2174d1330c05158" - issuing command 0x45b8da5b6388
2023-10-25T16:23:44.263Z cpu12:2098186)WARNING: NMP: nmpCompleteRetryForPath:364: Retry cmd 0x25 (0x45b8da5b6388) to dev "naa.6589cfc000000156a2174d1330c05158" failed on path "vmhba67:C0:T0:L0" H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x4 0x2.
2023-10-25T16:23:44.263Z cpu12:2098186)WARNING: NMP: nmpCompleteRetryForPath:394: Logical device "naa.6589cfc000000156a2174d1330c05158": awaiting fast path state update before retrying failed command again...
2023-10-25T16:23:45.263Z cpu10:2097892)WARNING: NMP: nmpDeviceAttemptFailover:647: Retry world failover device "naa.6589cfc000000156a2174d1330c05158" - issuing command 0x45b8da5b6388
2023-10-25T16:23:45.264Z cpu22:2098186)WARNING: NMP: nmpCompleteRetryForPath:364: Retry cmd 0x25 (0x45b8da5b6388) to dev "naa.6589cfc000000156a2174d1330c05158" failed on path "vmhba67:C0:T0:L0" H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x4 0x2.
2023-10-25T16:23:45.264Z cpu22:2098186)WARNING: NMP: nmpCompleteRetryForPath:394: Logical device "naa.6589cfc000000156a2174d1330c05158": awaiting fast path state update before retrying failed command again...
2023-10-25T16:23:45.514Z cpu10:2098186)WARNING: iscsi_vmk: iscsivmk_ConnReceiveAtomic:476: vmhba67:CH:0 T:0 CN:0: Failed to receive data: Connection closed by peer
2023-10-25T16:23:45.514Z cpu10:2098186)WARNING: iscsi_vmk: iscsivmk_ConnReceiveAtomic:484: Sess [ISID: 00023d000001 TARGET: iqn.2005-10.org.freenas.ctl:plex TPGT: 1 TSIH: 0]
2023-10-25T16:23:45.514Z cpu10:2098186)WARNING: iscsi_vmk: iscsivmk_ConnReceiveAtomic:485: Conn [CID: 0 L: 10.0.0.1:36281 R: 10.0.0.2:3260]
2023-10-25T16:23:45.514Z cpu9:2097916)WARNING: iscsi_vmk: iscsivmk_StopConnection:738: vmhba67:CH:0 T:0 CN:0: iSCSI connection is being marked "OFFLINE" (Event:6)
2023-10-25T16:23:45.514Z cpu9:2097916)WARNING: iscsi_vmk: iscsivmk_StopConnection:739: Sess [ISID: 00023d000001 TARGET: iqn.2005-10.org.freenas.ctl:plex TPGT: 1 TSIH: 0]
2023-10-25T16:23:45.514Z cpu9:2097916)WARNING: iscsi_vmk: iscsivmk_StopConnection:740: Conn [CID: 0 L: 10.0.0.1:36281 R: 10.0.0.2:3260]
2023-10-25T16:23:46.263Z cpu40:2114461)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - Transient storage condition, suggest retry (195887294)
2023-10-25T16:23:46.263Z cpu10:2097892)WARNING: NMP: nmpDeviceAttemptFailover:647: Retry world failover device "naa.6589cfc000000156a2174d1330c05158" - issuing command 0x45b8da5b6388
2023-10-25T16:23:46.263Z cpu10:2097938)WARNING: NMP: nmpCompleteRetryForPath:364: Retry cmd 0x25 (0x45b8da5b6388) to dev "naa.6589cfc000000156a2174d1330c05158" failed on path "vmhba67:C0:T0:L0" H:0x2 D:0x0 P:0x0 .
2023-10-25T16:23:46.263Z cpu10:2097938)WARNING: NMP: nmpCompleteRetryForPath:445: Retry world restored device "naa.6589cfc000000156a2174d1330c05158" - no more commands to retry
2023-10-25T16:23:46.263Z cpu10:2097938)WARNING: NMP: nmpCompleteRetryForPath:459: NMP device "naa.6589cfc000000156a2174d1330c05158": requested fast path state update...
2023-10-25T16:23:47.263Z cpu7:2111104)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - Transient storage condition, suggest retry (195887294)
2023-10-25T16:23:47.293Z cpu10:2097938)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6589cfc000000156a2174d1330c05158" state in doubt; requested fast path state update...
2023-10-25T16:23:48.263Z cpu19:2111106)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - Transient storage condition, suggest retry (195887294)
2023-10-25T16:23:48.267Z cpu10:2097938)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6589cfc000000156a2174d1330c05158" state in doubt; requested fast path state update...
2023-10-25T16:23:49.263Z cpu38:2111101)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - Transient storage condition, suggest retry (195887294)
2023-10-25T16:23:49.305Z cpu10:2097938)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6589cfc000000156a2174d1330c05158" state in doubt; requested fast path state update...
2023-10-25T16:23:50.263Z cpu40:2111105)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - Transient storage condition, suggest retry (195887294)
2023-10-25T16:23:50.294Z cpu10:2097938)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6589cfc000000156a2174d1330c05158" state in doubt; requested fast path state update...
2023-10-25T16:23:51.263Z cpu5:2111100)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - Transient storage condition, suggest retry (195887294)
2023-10-25T16:23:51.265Z cpu10:2097938)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6589cfc000000156a2174d1330c05158" state in doubt; requested fast path state update...
2023-10-25T16:23:52.263Z cpu55:2111102)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - Transient storage condition, suggest retry (195887294)
2023-10-25T16:23:52.277Z cpu10:2097938)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6589cfc000000156a2174d1330c05158" state in doubt; requested fast path state update...
2023-10-25T16:23:53.263Z cpu40:2114461)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - Transient storage condition, suggest retry (195887294)
2023-10-25T16:23:53.296Z cpu10:2097938)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6589cfc000000156a2174d1330c05158" state in doubt; requested fast path state update...
2023-10-25T16:23:54.263Z cpu7:2111104)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - Transient storage condition, suggest retry (195887294)
2023-10-25T16:23:54.310Z cpu10:2097938)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6589cfc000000156a2174d1330c05158" state in doubt; requested fast path state update...
2023-10-25T16:23:55.263Z cpu19:2111106)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - Transient storage condition, suggest retry (195887294)
2023-10-25T16:23:55.273Z cpu10:2097938)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "naa.6589cfc000000156a2174d1330c05158" state in doubt; requested fast path state update...
2023-10-25T16:23:55.516Z cpu12:2097360)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:23:55.527Z cpu10:2101522)WARNING: NMP: nmp_IssueCommandToDevice:5950: I/O could not be issued to device "naa.6589cfc000000156a2174d1330c05158" due to Not found
2023-10-25T16:23:55.527Z cpu10:2101522)WARNING: NMP: nmp_DeviceRetryCommand:133: Device "naa.6589cfc000000156a2174d1330c05158": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
2023-10-25T16:23:55.527Z cpu10:2101522)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "naa.6589cfc000000156a2174d1330c05158" is blocked. Not starting I/O from device.
2023-10-25T16:23:56.263Z cpu38:2111101)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:23:56.263Z cpu10:2097892)WARNING: NMP: nmpDeviceAttemptFailover:647: Retry world failover device "naa.6589cfc000000156a2174d1330c05158" - issuing command 0x45b8da5b6388
2023-10-25T16:23:56.263Z cpu10:2097892)WARNING: NMP: nmpDeviceAttemptFailover:722: Retry world failover device "naa.6589cfc000000156a2174d1330c05158" - failed to issue command due to Not found (APD), try again...
2023-10-25T16:23:56.263Z cpu10:2097892)WARNING: NMP: nmpDeviceAttemptFailover:772: Logical device "naa.6589cfc000000156a2174d1330c05158": awaiting fast path state update...
2023-10-25T16:23:57.263Z cpu36:2111105)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:23:57.263Z cpu10:2097892)WARNING: NMP: nmpDeviceAttemptFailover:647: Retry world failover device "naa.6589cfc000000156a2174d1330c05158" - issuing command 0x45b8da5b6388
2023-10-25T16:23:57.263Z cpu10:2097892)WARNING: NMP: nmpDeviceAttemptFailover:722: Retry world failover device "naa.6589cfc000000156a2174d1330c05158" - failed to issue command due to Not found (APD), try again...
2023-10-25T16:23:57.263Z cpu10:2097892)WARNING: NMP: nmpDeviceAttemptFailover:772: Logical device "naa.6589cfc000000156a2174d1330c05158": awaiting fast path state update...
2023-10-25T16:23:58.263Z cpu5:2111100)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:23:59.263Z cpu55:2111102)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:00.263Z cpu40:2114461)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:01.263Z cpu7:2111104)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:02.263Z cpu19:2111106)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:03.263Z cpu38:2111101)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:04.263Z cpu36:2111105)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:05.263Z cpu5:2111100)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:06.263Z cpu34:2111102)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:07.263Z cpu40:2114461)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:08.263Z cpu7:2111104)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:09.263Z cpu19:2111106)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:10.263Z cpu38:2111101)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:11.263Z cpu33:2111105)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:12.263Z cpu5:2111100)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:13.263Z cpu34:2111102)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:14.263Z cpu40:2114461)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:15.262Z cpu7:2111104)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:16.263Z cpu19:2111106)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:17.263Z cpu38:2111101)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:18.263Z cpu33:2111105)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:19.261Z cpu5:2111100)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:20.262Z cpu34:2111102)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:21.263Z cpu30:2114461)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:21.275Z cpu32:2097564)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "naa.6589cfc000000156a2174d1330c05158" is blocked. Not starting I/O from device.
2023-10-25T16:24:21.275Z cpu25:2116720)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "naa.6589cfc000000156a2174d1330c05158" is blocked. Not starting I/O from device.
2023-10-25T16:24:21.511Z cpu30:2097284)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "naa.6589cfc000000156a2174d1330c05158" is blocked. Not starting I/O from device.
2023-10-25T16:24:21.763Z cpu30:2097284)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "naa.6589cfc000000156a2174d1330c05158" is blocked. Not starting I/O from device.
2023-10-25T16:24:22.011Z cpu30:2097284)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "naa.6589cfc000000156a2174d1330c05158" is blocked. Not starting I/O from device.
2023-10-25T16:24:22.261Z cpu33:2097284)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "naa.6589cfc000000156a2174d1330c05158" is blocked. Not starting I/O from device.
2023-10-25T16:24:22.261Z cpu7:2111104)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:22.262Z cpu16:2097892)WARNING: NMP: nmpDeviceAttemptFailover:610: Retry world restore device "naa.6589cfc000000156a2174d1330c05158" - no more commands to retry
2023-10-25T16:24:22.269Z cpu47:2097891)WARNING: NMP: nmp_IssueCommandToDevice:5950: I/O could not be issued to device "naa.6589cfc000000156a2174d1330c05158" due to Not found
2023-10-25T16:24:22.269Z cpu47:2097891)WARNING: NMP: nmp_DeviceRetryCommand:133: Device "naa.6589cfc000000156a2174d1330c05158": awaiting fast path state update for failover with I/O blocked. No prior reservation exists on the device.
2023-10-25T16:24:22.269Z cpu47:2097891)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "naa.6589cfc000000156a2174d1330c05158" is blocked. Not starting I/O from device.
2023-10-25T16:24:23.263Z cpu19:2111106)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:23.263Z cpu16:2097892)WARNING: NMP: nmpDeviceAttemptFailover:647: Retry world failover device "naa.6589cfc000000156a2174d1330c05158" - issuing command 0x45b8da5b6388
2023-10-25T16:24:23.263Z cpu16:2097892)WARNING: NMP: nmpDeviceAttemptFailover:722: Retry world failover device "naa.6589cfc000000156a2174d1330c05158" - failed to issue command due to Not found (APD), try again...
2023-10-25T16:24:23.263Z cpu16:2097892)WARNING: NMP: nmpDeviceAttemptFailover:772: Logical device "naa.6589cfc000000156a2174d1330c05158": awaiting fast path state update...
2023-10-25T16:24:24.263Z cpu38:2111101)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:24.263Z cpu16:2097892)WARNING: NMP: nmpDeviceAttemptFailover:647: Retry world failover device "naa.6589cfc000000156a2174d1330c05158" - issuing command 0x45b8da5b6388
2023-10-25T16:24:24.263Z cpu16:2097892)WARNING: NMP: nmpDeviceAttemptFailover:722: Retry world failover device "naa.6589cfc000000156a2174d1330c05158" - failed to issue command due to Not found (APD), try again...
2023-10-25T16:24:24.263Z cpu16:2097892)WARNING: NMP: nmpDeviceAttemptFailover:772: Logical device "naa.6589cfc000000156a2174d1330c05158": awaiting fast path state update...
2023-10-25T16:24:25.263Z cpu35:2111105)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:26.263Z cpu5:2111100)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:27.261Z cpu34:2111102)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:28.263Z cpu30:2114461)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:29.263Z cpu7:2111104)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:30.263Z cpu19:2111106)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:31.263Z cpu39:2111101)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:32.263Z cpu35:2111105)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:33.263Z cpu5:2111100)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:34.263Z cpu34:2111102)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:35.263Z cpu36:2114461)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:36.263Z cpu7:2111104)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:37.263Z cpu19:2111106)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:38.261Z cpu39:2111101)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:39.261Z cpu35:2111105)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:40.263Z cpu5:2111100)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:41.263Z cpu34:2111102)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:42.261Z cpu36:2114461)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:43.263Z cpu7:2111104)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:44.263Z cpu19:2111106)WARNING: VMW_SATP_ALUA: satp_alua_getTargetPortInfo:160: Could not get page 83 INQUIRY data for path "vmhba67:C0:T0:L0" - No connection (195887168)
2023-10-25T16:24:44.747Z cpu34:2098251)WARNING: iscsi_vmk: iscsivmk_StartConnection:919: vmhba67:CH:0 T:0 CN:0: iSCSI connection is being marked "ONLINE"
2023-10-25T16:24:44.747Z cpu34:2098251)WARNING: iscsi_vmk: iscsivmk_StartConnection:920: Sess [ISID: 00023d000001 TARGET: iqn.2005-10.org.freenas.ctl:plex TPGT: 1 TSIH: 0]
2023-10-25T16:24:44.747Z cpu34:2098251)WARNING: iscsi_vmk: iscsivmk_StartConnection:921: Conn [CID: 0 L: 10.0.0.1:25817 R: 10.0.0.2:3260]
2023-10-25T16:24:45.261Z cpu17:2116720)WARNING: ScsiDeviceIO: 12155: READ CAPACITY on device "naa.6589cfc000000156a2174d1330c05158" from Plugin "NMP" failed. I/O error
2023-10-25T16:26:16.195Z cpu55:2097532)WARNING: NMP: nmpDeviceTaskMgmt:2570: Attempt to issue lun reset on device naa.6589cfc000000156a2174d1330c05158. This will clear any SCSI-2 reservations on the device.
2023-10-25T16:26:16.195Z cpu55:2097532)WARNING: HPP: HppDeviceTaskManagement:2502: Attempt to issue lun reset on device naa.50014ee2b93d8bff. This will clear any SCSI-2 reservations on the device.
2023-10-25T16:26:16.195Z cpu55:2097532)WARNING: HPP: HppDeviceTaskManagement:2502: Attempt to issue lun reset on device naa.5000cca255ee5b62. This will clear any SCSI-2 reservations on the device.
2023-10-25T16:26:16.196Z cpu55:2097532)WARNING: HPP: HppDeviceTaskManagement:2502: Attempt to issue lun reset on device naa.5000cca255ddb469. This will clear any SCSI-2 reservations on the device.
2023-10-25T16:26:16.196Z cpu55:2097532)WARNING: NMP: nmpDeviceTaskMgmt:2570: Attempt to issue lun reset on device naa.6589cfc000000156a2174d1330c05158. This will clear any SCSI-2 reservations on the device.
2023-10-25T16:26:16.196Z cpu55:2097532)WARNING: HPP: HppDeviceTaskManagement:2502: Attempt to issue lun reset on device naa.50014ee2b93d8bff. This will clear any SCSI-2 reservations on the device.
2023-10-25T16:26:16.196Z cpu55:2097532)WARNING: HPP: HppDeviceTaskManagement:2502: Attempt to issue lun reset on device naa.5000cca255ee5b62. This will clear any SCSI-2 reservations on the device.
2023-10-25T16:26:16.263Z cpu55:2097532)WARNING: HPP: HppDeviceTaskManagement:2502: Attempt to issue lun reset on device naa.5000cca255ddb469. This will clear any SCSI-2 reservations on the device.
2023-10-25T16:26:19.598Z cpu55:2097532)WARNING: NMP: nmpDeviceTaskMgmt:2570: Attempt to issue lun reset on device naa.6589cfc000000156a2174d1330c05158. This will clear any SCSI-2 reservations on the device.
2023-10-25T16:26:19.600Z cpu55:2097532)WARNING: HPP: HppDeviceTaskManagement:2502: Attempt to issue lun reset on device naa.50014ee2b93d8bff. This will clear any SCSI-2 reservations on the device.
2023-10-25T16:26:19.600Z cpu55:2097532)WARNING: HPP: HppDeviceTaskManagement:2502: Attempt to issue lun reset on device naa.5000cca255ee5b62. This will clear any SCSI-2 reservations on the device.
2023-10-25T16:26:19.600Z cpu55:2097532)WARNING: HPP: HppDeviceTaskManagement:2502: Attempt to issue lun reset on device naa.5000cca255ddb469. This will clear any SCSI-2 reservations on the device.

0 Kudos
0 Replies