VMware Cloud Community
mathieuintuitiv
Contributor
Contributor

Datastore1 becomes inactive

Hello,

I am under vSphere 4.1 free version and I have a problem with datastores.

ESXi is installed in the same disk as datastore1. It is the second time that my VMs are in read only mode. The cause is that my datastore1 is mentionned as inactive in vSphere.

I can connect to vSphere, I can connect to my ESXi host through SSH, I can access to my VMs through SSH too but they are in read only mode because of datstore1 is inactive.

Do you have any idea about what the problem is and how to solve it ?

I have nothing done as specific configuration in vSphere or ESXi.

Thank you for your help.

Reply
0 Kudos
6 Replies
mathieuintuitiv
Contributor
Contributor

I've checked logs and I've found that, in /var/log/messages :

How to retrieve my datastore1 ? Smiley Sad

Dec  6 00:54:09 vmkernel: 59:10:56:42.151 cpu0:4197)<6>ahci_scsi_abort: cmd 0x2a (0x41000e01dbc0), entering...
Dec  6 00:54:09 vmkernel: 59:10:56:42.151 cpu0:4197)<7>ata1: ahci_port_reset, entering...
Dec  6 00:54:11 vmkernel: 59:10:56:44.381 cpu0:4197)<6>ata1: ahci_port_reset, hard reseting port
Dec  6 00:54:11 vmkernel: 59:10:56:44.381 cpu0:4633)<3>ata1.00: exception Emask 0x10 SAct 0x1 SErr 0x10000 action 0x2 frozen
Dec  6 00:54:11 vmkernel: 59:10:56:44.381 cpu0:4633)<3>ata1.00: (irq_stat 0x00400000, PHY RDY changed)
Dec  6 00:54:11 vmkernel: 59:10:56:44.381 cpu0:4633)<3>ata1.00: tag 0 cmd 0x61 Emask 0x12 stat 0xff err 0x0 (ATA bus error)
Dec  6 00:54:11 vmkernel: 59:10:56:44.965 cpu0:4633)<6>ata1: waiting for device to spin up (8 secs)
Dec  6 00:54:18 vmkernel: 59:10:56:51.745 cpu4:4197)<4>ata1: port is slow to respond, please be patient (Status 0x80)
Dec  6 00:54:20 vmkernel: 59:10:56:53.125 cpu6:4633)<6>ata1: soft resetting port
Dec  6 00:54:20 vmkernel: 59:10:56:53.125 cpu6:4633)<6>ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
Dec  6 00:54:20 vmkernel: 59:10:56:53.135 cpu6:4633)<4>ATA: abnormal status 0x80 on port 0x0
Dec  6 00:54:20 vmkernel: 59:10:56:53.145 cpu6:4633)<4>ATA: abnormal status 0x80 on port 0x0
Dec  6 00:54:41 vmkernel: 59:10:57:14.783 cpu4:4197)<3>ata1: port failed to respond (30 secs, Status 0x80)
Dec  6 00:54:41 vmkernel: 59:10:57:14.783 cpu4:4197)<3>ata1: COMRESET failed (device not ready)
Dec  6 00:54:50 vmkernel: 59:10:57:23.145 cpu1:4633)<4>ata1.00: qc timeout (cmd 0xec)
Dec  6 00:54:50 vmkernel: 59:10:57:23.145 cpu1:4633)<4>ata1.00: failed to IDENTIFY (I/O error, err_mask=0x104)
Dec  6 00:54:50 vmkernel: 59:10:57:23.145 cpu1:4633)<3>ata1.00: revalidation failed (errno=-5)
Dec  6 00:54:50 vmkernel: 59:10:57:23.145 cpu1:4633)<4>ata1: failed to recover some devices, retrying in 5 secs
Dec  6 00:54:52 vmkernel: 59:10:57:25.390 cpu0:8215805)ScsiCore: 63: Starting taskmgmt handler world 8215805/2
Dec  6 00:54:52 vmkernel: 59:10:57:25.391 cpu0:8215805)NMP: nmp_CompleteCommandForPath: Command 0x28 (0x41027f4a2640) to NMP device "t10.ATA_____WDC_WD2002FAEX2D007BA0________________________WD2DWMAY03321975" failed on physical path "vmhba0:C0:T0:L0"
Dec  6 03:09:17  H:0x5 D:0x0 P:0x0 Possible se
Dec  6 00:54:52 vmkernel: 59:10:57:25.391 cpu0:8215805)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe: NMP device "t10.ATA_____WDC_WD2002FAEX2D007BA0________________________WD2DWMAY03321975" state in doubt; requested fast path state update...
Dec  6 00:54:52 vmkernel: 59:10:57:25.391 cpu0:8215805)ScsiDeviceIO: 1672: Command 0x28 to device "t10.ATA_____WDC_WD2002FAEX2D007BA0________________________WD2DWMAY03321975" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Dec  6 00:54:55 vmkernel: 59:10:57:28.693 cpu6:4633)<6>ata1: hard resetting port
Dec  6 00:55:03 vmkernel: 59:10:57:36.471 cpu4:4633)<4>ata1: port is slow to respond, please be patient (Status 0x80)
Dec  6 00:55:24 Hostd: [2011-12-06 00:55:24.436 FFD5EE80 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root
Dec  6 00:55:26 vmkernel: 59:10:57:59.503 cpu0:4633)<3>ata1: port failed to respond (30 secs, Status 0x80)
Dec  6 00:55:26 vmkernel: 59:10:57:59.503 cpu0:4633)<3>ata1: COMRESET failed (device not ready)
Dec  6 00:55:26 vmkernel: 59:10:57:59.503 cpu0:4633)<4>ata1: hardreset failed, retrying in 5 secs
Dec  6 00:55:31 vmkernel: 59:10:58:04.515 cpu0:4633)<6>ata1: hard resetting port
Dec  6 00:55:32 vmkernel: 59:10:58:05.389 cpu0:8215805)NMP: nmp_CompleteCommandForPath: Command 0x28 (0x41027f3ba940) to NMP device "t10.ATA_____WDC_WD2002FAEX2D007BA0________________________WD2DWMAY03321975" failed on physical path "vmhba0:C0:T0:L0"
Dec  6 04:22:37  H:0x5 D:0x0 P:0x0 Possible se
Dec  6 00:55:32 vmkernel: 59:10:58:05.389 cpu0:8215805)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe: NMP device "t10.ATA_____WDC_WD2002FAEX2D007BA0________________________WD2DWMAY03321975" state in doubt; requested fast path state update...
Dec  6 00:55:32 vmkernel: 59:10:58:05.389 cpu0:8215805)ScsiDeviceIO: 1672: Command 0x28 to device "t10.ATA_____WDC_WD2002FAEX2D007BA0________________________WD2DWMAY03321975" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Dec  6 00:55:33 vmkernel: 59:10:58:06.391 cpu4:4189)VMW_SATP_LOCAL: satp_local_updatePathStates: Failed to update path "vmhba0:C0:T0:L0" state. Status=Transient storage condition, suggest retry
Dec  6 00:55:39 vmkernel: 59:10:58:12.297 cpu0:4633)<4>ata1: port is slow to respond, please be patient (Status 0x80)
Dec  6 00:55:46 vmkernel: 59:10:58:19.407 cpu2:4197)<6>ata1: ahci_port_reset: FAILED
Dec  6 00:55:46 vmkernel: 59:10:58:19.407 cpu2:4197)<6>ahci_scsi_abort: cmd 0x2a (0x41000e01dbc0), FAILED
Dec  6 00:55:46 vmkernel: 59:10:58:19.407 cpu2:4197)WARNING: LinScsi: SCSILinuxAbortCommands: Failed, Driver ahci, for vmhba0
Dec  6 00:55:46 vmkernel: 59:10:58:19.407 cpu2:4197)ScsiCore: 97: Stopping taskMgmt handler world 41971
Dec  6 00:55:48 vmkernel: 59:10:58:21.408 cpu0:8215805)<6>ahci_scsi_abort: cmd 0x2a (0x41000e01dbc0), entering...
Dec  6 00:55:48 vmkernel: 59:10:58:21.408 cpu0:8215805)<7>ata1: ahci_port_reset, entering...
Dec  6 00:55:50 vmkernel: 59:10:58:23.633 cpu0:8215805)<6>ata1: ahci_port_reset, hard reseting port
Dec  6 00:55:58 vmkernel: 59:10:58:31.425 cpu0:8215805)<4>ata1: port is slow to respond, please be patient (Status 0x80)
Dec  6 00:56:02 vmkernel: 59:10:58:35.330 cpu0:4633)<3>ata1: port failed to respond (30 secs, Status 0x80)
Dec  6 00:56:02 vmkernel: 59:10:58:35.330 cpu0:4633)<3>ata1: COMRESET failed (device not ready)
Dec  6 00:56:02 vmkernel: 59:10:58:35.330 cpu0:4633)<4>ata1: hardreset failed, retrying in 5 secs
Dec  6 00:56:07 vmkernel: 59:10:58:40.341 cpu0:4633)<6>ata1: hard resetting port
Dec  6 00:56:14 vmkernel: 59:10:58:47.388 cpu3:8215704)VMW_SATP_LOCAL: satp_local_updatePathStates: Failed to update path "vmhba0:C0:T0:L0" state. Status=Transient storage condition, suggest retry
Dec  6 00:56:14 vmkernel: 59:10:58:47.453 cpu0:8215898)ScsiCore: 63: Starting taskmgmt handler world 8215898/2
Dec  6 00:56:14 vmkernel: 59:10:58:47.453 cpu0:8215898)NMP: nmp_CompleteCommandForPath: Command 0x28 (0x41027f364940) to NMP device "t10.ATA_____WDC_WD2002FAEX2D007BA0________________________WD2DWMAY03321975" failed on physical path "vmhba0:C0:T0:L0"
Dec  6 06:35:57  H:0x5 D:0x0 P:0x0 Possible se
Dec  6 00:56:14 vmkernel: 59:10:58:47.453 cpu0:8215898)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe: NMP device "t10.ATA_____WDC_WD2002FAEX2D007BA0________________________WD2DWMAY03321975" state in doubt; requested fast path state update...
Dec  6 00:56:14 vmkernel: 59:10:58:47.453 cpu0:8215898)ScsiDeviceIO: 1672: Command 0x28 to device "t10.ATA_____WDC_WD2002FAEX2D007BA0________________________WD2DWMAY03321975" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.
Dec  6 00:56:14 vmkernel: 59:10:58:48.121 cpu2:4633)<4>ata1: port is slow to respond, please be patient (Status 0x80)
Dec  6 00:56:21 vmkernel: 59:10:58:54.413 cpu4:8215805)<3>ata1: port failed to respond (30 secs, Status 0x80)
Dec  6 00:56:21 vmkernel: 59:10:58:54.413 cpu4:8215805)<3>ata1: COMRESET failed (device not ready)
Dec  6 00:56:37 vmkernel: 59:10:59:11.140 cpu2:4633)<3>ata1: port failed to respond (30 secs, Status 0x80)
Dec  6 00:56:37 vmkernel: 59:10:59:11.140 cpu2:4633)<3>ata1: COMRESET failed (device not ready)
Dec  6 00:56:37 vmkernel: 59:10:59:11.140 cpu2:4633)<3>ata1: reset failed, giving up
Dec  6 00:56:37 vmkernel: 59:10:59:11.140 cpu2:4633)<4>ata1.00: disabled
Dec  6 00:56:37 vmkernel: 59:10:59:11.140 cpu2:4633)<6>ata1: EH complete
Dec  6 00:56:38 vmkernel: 59:10:59:11.237 cpu3:8215805)<6>ata1: ahci_port_reset: SUCCEEDED
Dec  6 00:56:38 vmkernel: 59:10:59:11.237 cpu3:8215805)<6>ahci_scsi_abort: cmd 0x2a (0x41000e01dbc0), SUCCEEDED
Dec  6 00:56:38 vobd: Dec 06 00:56:38.094: 5137151237740us: [vob.scsi.scsipath.pathstate.dead] scsiPath vmhba0:C0:T0:L0 changed state from on.
Dec  6 00:57:18 vmkernel: 59:10:59:51.305 cpu1:4117)WARNING: FS3: 7096: Reservation error: IO was aborted
Dec  6 01:01:01 crond[5421]: USER root pid 8216392 cmd /sbin/tmpwatch.sh
Dec  6 01:05:18 vmkernel: 59:11:07:52.015 cpu2:4117)WARNING: FS3: 7096: Reservation error: IO was aborted
Dec  6 01:15:59 vmkernel: 59:11:18:32.725 cpu4:4118)WARNING: FS3: 7096: Reservation error: IO was aborted
Dec  6 01:22:39 vmkernel: 59:11:25:13.088 cpu2:4119)WARNING: FS3: 7096: Reservation error: IO was aborted
Dec  6 01:29:20 vmkernel: 59:11:31:53.468 cpu3:4117)WARNING: FS3: 7096: Reservation error: IO was aborted
Dec  6 01:36:00 vmkernel: 59:11:38:33.835 cpu0:4118)WARNING: FS3: 7096: Reservation error: IO was aborted
Reply
0 Kudos
artsiom0
Contributor
Contributor

Hi,

We have the same issue. Our datastore becomes inactive and there are the same warning/errors messages. If the system is power off and then on, the datastore will be active but it will become again inactive in 1-2 days.

Have you resolved your problem? Incampatible hardware? problems with hardware?

Thanks.

Reply
0 Kudos
mathieuintuitiv
Contributor
Contributor

Hi,

No i have to resinstall all the ESXi server...

Reply
0 Kudos
daftu
Contributor
Contributor

Same problem here but on ESXi 5.1.
vmkernel.log

2013-06-05T12:03:00.761Z cpu0:4100)ScsiDeviceIO: 2331: Cmd(0x4124007cd0c0) 0x2a, CmdSN 0x1d83d from world 4100 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.

2013-06-05T12:03:04.761Z cpu0:4100)ScsiDeviceIO: 2331: Cmd(0x4124007cd0c0) 0x2a, CmdSN 0x1d840 from world 4100 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.

2013-06-05T12:03:04.833Z cpu2:4113)NMP: nmp_ThrottleLogForDevice:2319: Cmd 0x2a (0x4124007d8640, 8191) to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" on path "vmhba34:C0:T0:L0" Failed: H:0x8 D:0x0 P:0x0 Possible sens$

2013-06-05T12:03:04.833Z cpu2:4113)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237:NMP device "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" state in doubt; requested fast path state update...

2013-06-05T12:03:04.833Z cpu2:4113)ScsiDeviceIO: 2300: Cmd(0x4124007d8640) 0x2a, CmdSN 0x800e0040 from world 8191 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x8 D:0x0 P:0x0

2013-06-05T12:03:04.833Z cpu2:4113)ScsiDeviceIO: 2300: Cmd(0x4124007fb780) 0x2a, CmdSN 0x800e0027 from world 8191 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x8 D:0x0 P:0x0

2013-06-05T12:03:04.833Z cpu2:4113)<6>ahci_scsi_abort: cmd 0x2a (0x412401a8a2c0), entering...

2013-06-05T12:03:04.833Z cpu2:4113)<7>ata3: ahci_port_reset, entering...

2013-06-05T12:03:04.833Z cpu2:4113)ScsiDeviceIO: 2300: Cmd(0x41240080c0c0) 0x2a, CmdSN 0x800e0000 from world 8191 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x8 D:0x0 P:0x0

2013-06-05T12:03:07.053Z cpu0:4113)<6>ata3: ahci_port_reset, hard reseting port

2013-06-05T12:03:12.155Z cpu0:4222)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237:NMP device "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" state in doubt; requested fast path state update...

2013-06-05T12:03:12.155Z cpu0:4222)ScsiDeviceIO: 2331: Cmd(0x4124007b91c0) 0x2a, CmdSN 0x1d83e from world 4100 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.

2013-06-05T12:03:12.570Z cpu3:4113)<4>ata3: port is slow to respond, please be patient (Status 0x80)

2013-06-05T12:03:18.544Z cpu1:4222)ScsiDeviceIO: 2331: Cmd(0x4124007dab40) 0x2a, CmdSN 0x1d841 from world 4100 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.

2013-06-05T12:03:37.068Z cpu0:4113)<3>ata3: COMRESET failed (errno=-16)

2013-06-05T12:03:40.042Z cpu2:4222)NMP: nmp_ThrottleLogForDevice:2319: Cmd 0x2a (0x4124007c3c00, 4157) to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" on path "vmhba34:C0:T0:L0" Failed: H:0x5 D:0x0 P:0x0 Possible sens$

2013-06-05T12:03:40.042Z cpu2:4222)ScsiDeviceIO: 2331: Cmd(0x4124007c3c00) 0x2a, CmdSN 0x1d83f from world 4157 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x5 0x20 0x0.

2013-06-05T12:03:40.042Z cpu0:4157)WARNING: J3: 2990: Error committing txn callerID: 0xc1d0000f to slot 0: Timeout

2013-06-05T12:03:43.044Z cpu1:4157)HBX: 2441: Waiting for timed out [HB state abcdef02 offset 3883008 gen 49 stampUS 101905355158 uuid 51ad9aff-49ab3864-7ad4-001e67340ea1 jrnl <FB 1858000> drv 14.58] on vol 'wd_red1'

2013-06-05T12:03:45.376Z cpu2:73484)VMW_SATP_LOCAL: satp_local_updatePathStates:454: Failed to update path "vmhba34:C0:T0:L0" state. Status=Transient storage condition, suggest retry

2013-06-05T12:03:57.039Z cpu0:69489)WARNING: VSCSI: 3481: handle 8222(vscsi4:0):WaitForCIF: Issuing reset;  number of CIF:1

2013-06-05T12:03:57.039Z cpu0:69489)VSCSI: 2374: handle 8222(vscsi4:0):Reset request on FSS handle 1011988 (1 outstanding commands) from (vmm0:magnet5xp)

2013-06-05T12:03:57.039Z cpu1:4170)VSCSI: 2653: handle 8222(vscsi4:0):Reset [Retries: 0/0] from (vmm0:magnet5xp)

2013-06-05T12:03:57.039Z cpu1:4170)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237:NMP device "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" state in doubt; requested fast path state update...

2013-06-05T12:03:57.039Z cpu1:4170)ScsiDeviceIO: 2300: Cmd(0x4124007c83c0) 0x2a, CmdSN 0x1 from world 69489 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x8 D:0x0 P:0x0

2013-06-05T12:03:57.039Z cpu1:4170)VSCSI: 2450: handle 8222(vscsi4:0):Completing reset (0 outstanding commands)

2013-06-05T12:04:26.378Z cpu1:4192)VMW_SATP_LOCAL: satp_local_updatePathStates:454: Failed to update path "vmhba34:C0:T0:L0" state. Status=Transient storage condition, suggest retry

2013-06-05T12:04:36.050Z cpu1:4157)HBX: 2441: Waiting for timed out [HB state abcdef02 offset 3883008 gen 49 stampUS 101905355158 uuid 51ad9aff-49ab3864-7ad4-001e67340ea1 jrnl <FB 1858000> drv 14.58] on vol 'wd_red1'

2013-06-05T12:04:41.545Z cpu3:4113)<6>ata3: ahci_port_reset: FAILED

2013-06-05T12:04:41.545Z cpu3:4113)<6>ahci_scsi_abort: cmd 0x2a (0x412401a8a2c0), FAILED

2013-06-05T12:04:41.545Z cpu3:4113)WARNING: LinScsi: SCSILinuxAbortCommands:1816:Failed, Driver ahci, for vmhba34

2013-06-05T12:04:41.545Z cpu3:4113)<6>ahci_scsi_abort: cmd 0x2a (0x412401a44a00), entering...

2013-06-05T12:04:41.545Z cpu3:4113)<7>ata3: ahci_port_reset, entering...

2013-06-05T12:04:43.767Z cpu3:4113)<6>ata3: ahci_port_reset, hard reseting port

2013-06-05T12:05:00.041Z cpu0:69489)WARNING: VSCSI: 3481: handle 8222(vscsi4:0):WaitForCIF: Issuing reset;  number of CIF:1

2013-06-05T12:05:00.041Z cpu0:69489)VSCSI: 2374: handle 8222(vscsi4:0):Reset request on FSS handle 1011988 (1 outstanding commands) from (vmm0:magnet5xp)

2013-06-05T12:05:00.041Z cpu1:4170)VSCSI: 2653: handle 8222(vscsi4:0):Reset [Retries: 0/0] from (vmm0:magnet5xp)

2013-06-05T12:05:00.041Z cpu1:4170)VSCSI: 2450: handle 8222(vscsi4:0):Completing reset (0 outstanding commands)

2013-06-05T12:05:07.380Z cpu0:73891)VMW_SATP_LOCAL: satp_local_updatePathStates:454: Failed to update path "vmhba34:C0:T0:L0" state. Status=Transient storage condition, suggest retry

2013-06-05T12:05:19.485Z cpu2:4098)ScsiDeviceIO: 2331: Cmd(0x4124007e3e40) 0x12, CmdSN 0x2722 from world 0 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.

2013-06-05T12:05:29.055Z cpu2:4157)HBX: 2441: Waiting for timed out [HB state abcdef02 offset 3883008 gen 49 stampUS 101905355158 uuid 51ad9aff-49ab3864-7ad4-001e67340ea1 jrnl <FB 1858000> drv 14.58] on vol 'wd_red1'

2013-06-05T12:05:48.788Z cpu0:4113)<6>ata3: ahci_port_reset: FAILED

2013-06-05T12:05:48.788Z cpu0:4113)<6>ahci_scsi_abort: cmd 0x2a (0x412401a44a00), FAILED

2013-06-05T12:05:48.788Z cpu0:4113)WARNING: LinScsi: SCSILinuxAbortCommands:1816:Failed, Driver ahci, for vmhba34

2013-06-05T12:05:48.788Z cpu0:4113)<6>ahci_scsi_abort: cmd 0x2a (0x412401a41a00), entering...

2013-06-05T12:05:48.788Z cpu0:4113)<7>ata3: ahci_port_reset, entering...

2013-06-05T12:05:51.011Z cpu3:4113)<6>ata3: ahci_port_reset, hard reseting port

2013-06-05T12:05:51.845Z cpu2:6001)NMP: nmp_ThrottleLogForDevice:2319: Cmd 0x2a (0x4124007ee280, 6001) to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" on path "vmhba34:C0:T0:L0" Failed: H:0x5 D:0x0 P:0x0 Possible sens$

2013-06-05T12:05:51.845Z cpu2:6001)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237:NMP device "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" state in doubt; requested fast path state update...

2013-06-05T12:05:51.845Z cpu2:6001)ScsiDeviceIO: 2318: Cmd(0x4124007ee280) 0x2a, CmdSN 0x800e0024 from world 6001 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0$

2013-06-05T12:05:59.488Z cpu2:4222)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237:NMP device "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" state in doubt; requested fast path state update...

2013-06-05T12:05:59.488Z cpu2:4222)ScsiDeviceIO: 2331: Cmd(0x4124007e3e40) 0x12, CmdSN 0x2723 from world 0 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.

2013-06-05T12:06:06.501Z cpu2:8231)VSCSI: 2374: handle 8219(vscsi0:0):Reset request on FSS handle 186460 (7 outstanding commands) from (vmm0:magnet3backup)

2013-06-05T12:06:06.501Z cpu2:8231)VSCSI: 2374: handle 8220(vscsi0:2):Reset request on FSS handle 219229 (0 outstanding commands) from (vmm0:magnet3backup)

2013-06-05T12:06:06.501Z cpu1:4170)VSCSI: 2653: handle 8219(vscsi0:0):Reset [Retries: 0/0] from (vmm0:magnet3backup)

2013-06-05T12:06:06.501Z cpu2:8231)VSCSI: 2374: handle 8221(vscsi0:3):Reset request on FSS handle 743518 (29 outstanding commands) from (vmm0:magnet3backup)

2013-06-05T12:06:06.501Z cpu1:4170)ScsiDeviceIO: 2300: Cmd(0x4124007f4700) 0x2a, CmdSN 0x800e003d from world 8191 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x8 D:0x0 P:0x0

2013-06-05T12:06:06.501Z cpu1:4170)ScsiDeviceIO: 2300: Cmd(0x4124007de140) 0x2a, CmdSN 0x800e0071 from world 8191 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x8 D:0x0 P:0x0

2013-06-05T12:06:06.501Z cpu1:4170)VSCSI: 2653: handle 8220(vscsi0:2):Reset [Retries: 0/0] from (vmm0:magnet3backup)

2013-06-05T12:06:06.501Z cpu1:4170)VSCSI: 2450: handle 8220(vscsi0:2):Completing reset (0 outstanding commands)

2013-06-05T12:06:06.501Z cpu1:4170)VSCSI: 2653: handle 8221(vscsi0:3):Reset [Retries: 0/0] from (vmm0:magnet3backup)

2013-06-05T12:06:06.501Z cpu1:4170)ScsiDeviceIO: 2300: Cmd(0x4124007e6040) 0x2a, CmdSN 0x800e0011 from world 8191 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x8 D:0x0 P:0x0

2013-06-05T12:06:06.501Z cpu1:4170)ScsiDeviceIO: 2300: Cmd(0x41240080cfc0) 0x2a, CmdSN 0x800e007f from world 8191 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x8 D:0x0 P:0x0

2013-06-05T12:06:06.501Z cpu1:4170)ScsiDeviceIO: 2300: Cmd(0x412400808cc0) 0x2a, CmdSN 0x800e0005 from world 8191 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x8 D:0x0 P:0x0

2013-06-05T12:06:06.501Z cpu1:4170)ScsiDeviceIO: 2300: Cmd(0x4124008085c0) 0x2a, CmdSN 0x800e0039 from world 8191 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x8 D:0x0 P:0x0

2013-06-05T12:06:06.501Z cpu1:4170)ScsiDeviceIO: 2300: Cmd(0x4124007d5ac0) 0x2a, CmdSN 0x800e0006 from world 8191 to dev "t10.ATA_____WDC_WD20EFRX2D68AX9N0_________________________WD2DWCC1T0407884" failed H:0x8 D:0x0 P:0x0

2013-06-05T12:06:06.501Z cpu1:4170)VSCSI: 2450: handle 8219(vscsi0:0):Completing reset (0 outstanding commands)

2013-06-05T12:06:09.532Z cpu2:8231)WARNING: VSCSI: 3481: handle 8221(vscsi0:3):WaitForCIF: Issuing reset;  number of CIF:30

2013-06-05T12:06:09.532Z cpu2:8231)WARNING: VSCSI: 2416: handle 8221(vscsi0:3):Ignoring double reset

2013-06-05T12:06:22.060Z cpu0:4157)HBX: 2441: Waiting for timed out [HB state abcdef02 offset 3883008 gen 49 stampUS 101905355158 uuid 51ad9aff-49ab3864-7ad4-001e67340ea1 jrnl <FB 1858000> drv 14.58] on vol 'wd_red1'

2013-06-05T12:06:32.383Z cpu1:4192)VMW_SATP_LOCAL: satp_local_updatePathStates:454: Failed to update path "vmhba34:C0:T0:L0" state. Status=Transient storage condition, suggest retry

2013-06-05T12:06:36.944Z cpu1:4170)VSCSI: 2653: handle 8221(vscsi0:3):Reset [Retries: 1/0] from (vmm0:magnet3backup)

2013-06-05T12:06:55.907Z cpu0:4113)<6>ata3: ahci_port_reset: FAILED

2013-06-05T12:06:55.907Z cpu0:4113)<6>ahci_scsi_abort: cmd 0x2a (0x412401a41a00), FAILED

2013-06-05T12:06:55.907Z cpu0:4113)WARNING: LinScsi: SCSILinuxAbortCommands:1816:Failed, Driver ahci, for vmhba34

2013-06-05T12:06:55.907Z cpu0:4113)<6>ahci_scsi_abort: cmd 0x2a (0x412401ad1ac0), entering...

2013-06-05T12:06:55.907Z cpu0:4113)<7>ata3: ahci_port_reset, entering...

2013-06-05T12:06:57.047Z cpu3:69489)WARNING: VSCSI: 3481: handle 8222(vscsi4:0):WaitForCIF: Issuing reset;  number of CIF:1

2013-06-05T12:06:57.047Z cpu3:69489)VSCSI: 2374: handle 8222(vscsi4:0):Reset request on FSS handle 1011988 (1 outstanding commands) from (vmm0:magnet5xp)

2013-06-05T12:06:57.047Z cpu1:4170)VSCSI: 2653: handle 8222(vscsi4:0):Reset [Retries: 0/0] from (vmm0:magnet5xp)

2013-06-05T12:06:57.047Z cpu1:4170)VSCSI: 2450: handle 8222(vscsi4:0):Completing reset (0 outstanding commands)

2013-06-05T12:06:58.120Z cpu1:4113)<6>ata3: ahci_port_reset, hard reseting port

2013-06-05T12:07:06.978Z cpu0:4170)VSCSI: 2653: handle 8221(vscsi0:3):Reset [Retries: 2/0] from (vmm0:magnet3backup)

2013-06-05T12:07:13.386Z cpu2:74325)VMW_SATP_LOCAL: satp_local_updatePathStates:454: Failed to update path "vmhba34:C0:T0:L0" state. Status=Transient storage condition, suggest retry

2013-06-05T12:07:15.064Z cpu0:4157)HBX: 2441: Waiting for timed out [HB state abcdef02 offset 3883008 gen 49 stampUS 101905355158 uuid 51ad9aff-49ab3864-7ad4-001e67340ea1 jrnl <FB 1858000> drv 14.58] on vol 'wd_red1'

2013-06-05T12:07:37.000Z cpu2:4170)VSCSI: 2653: handle 8221(vscsi0:3):Reset [Retries: 3/0] from (vmm0:magnet3backup)

Did esxi host reinstallation solved your problem?

Reply
0 Kudos
jpiscaer
Enthusiast
Enthusiast

Same issues here, but vmnics start to go down/up/down/up/etc. just shortly after the ahci reset. I'm running NSX and dvSwitches.

Cheers, Joep Piscaer VMware vExpert 2009 Virtual Lifestyle: http://www.virtuallifestyle.nl Twitter: http://www.twitter.com/jpiscaer LinkedIn: http://www.linkedin.com/in/jpiscaer **If you found this information useful, please consider awarding points**
Reply
0 Kudos
Nithy07cs055
Hot Shot
Hot Shot

Did you check for the any Harddrive failure? RAID issues ?

if it goes in active check the kernel and Device latency . since it is on Local storage i am sure it should be with disk problems .

Thanks and Regards, Nithyanathan R Please follow my page and Blog for more updates. Blog : https://communities.vmware.com/blogs/Nithyanathan Twitter @Nithy55 Facebook Vmware page : https://www.facebook.com/Virtualizationworld
Reply
0 Kudos