VMware Cloud Community
Paedy
Contributor
Contributor

ESXi really slow - dmesg: Transient storage condition, suggest retry / state in doubt

Hey guys,

do you know if the hard disk is defekt?
Or maybe something else?

I wanted to create a new VM. Then I saw that I can't connect via the vSphere Client.

After checking via SSH I restarted the server.

Then I can connect to the machine, but after few machines started its really slow.

So I going to debug it.

[root@static:~] dmesg

2016-04-08T13:58:41.969Z cpu5:32921)<6>ahci_scsi_abort: cmd 0x28 (0x439d8182b840), entering...

2016-04-08T13:58:41.969Z cpu5:32921)<7>ata2: ahci_port_reset, entering...

2016-04-08T13:58:44.207Z cpu5:32921)<6>ata2: ahci_port_reset, hard reseting port

2016-04-08T13:58:58.961Z cpu2:32809)ScsiDeviceIO: 4889: Waited for completion for all issued commands for partition t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30:1, for 120 secs. 3 completions still awaited. Giving up !

2016-04-08T13:59:06.489Z cpu2:32922)VSCSI: 2966: Retry 20 on handle 8192 still in progress after 62 seconds

2016-04-08T13:59:07.489Z cpu6:32797)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x12 (0x439d8065a040, 0) to dev "t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30" on path "vmhba32:C0:T0:L0" Failed: H:0x5 D:0x0 P:0x0 Possible sense d$

2016-04-08T13:59:07.489Z cpu6:32797)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30" state in doubt; requested fast path state update...

2016-04-08T13:59:07.489Z cpu6:32797)ScsiDeviceIO: 2646: Cmd(0x439d8065a040) 0x12, CmdSN 0xa8c from world 0 to dev "t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.

2016-04-08T13:59:07.489Z cpu6:36458)VMW_SATP_LOCAL: satp_local_updatePathStates:458: Failed to update path "vmhba32:C0:T0:L0" state. Status=Transient storage condition, suggest retry

2016-04-08T13:59:47.491Z cpu6:32797)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30" state in doubt; requested fast path state update...

2016-04-08T13:59:47.491Z cpu6:32797)ScsiDeviceIO: 2646: Cmd(0x439d8065a040) 0x12, CmdSN 0xa8d from world 0 to dev "t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.

2016-04-08T13:59:48.489Z cpu1:37826)VMW_SATP_LOCAL: satp_local_updatePathStates:458: Failed to update path "vmhba32:C0:T0:L0" state. Status=Transient storage condition, suggest retry

2016-04-08T13:59:49.689Z cpu5:32921)<6>ata2: ahci_port_reset: FAILED

2016-04-08T13:59:49.689Z cpu5:32921)<6>ahci_scsi_abort: cmd 0x28 (0x439d8182b840), FAILED

2016-04-08T13:59:49.689Z cpu5:32921)WARNING: LinScsi: SCSILinuxAbortCommands:1837: Failed, Driver ahci, for vmhba32

2016-04-08T13:59:49.689Z cpu5:32921)WARNING: VSCSIFs: 352: handle 8192(vscsi4:0):Failed reset of virtual target 1442670, (initiator 0x43025c9893c0, 0): Failure

2016-04-08T13:59:49.689Z cpu5:32921)VSCSI: 2841: handle 8192(vscsi4:0):Reset [Retries: 21/0] from (vmm0:Router-VM)

2016-04-08T13:59:49.689Z cpu5:32921)<6>ahci_scsi_abort: cmd 0x28 (0x439d8182b840), entering...

2016-04-08T13:59:49.689Z cpu5:32921)<7>ata2: ahci_port_reset, entering...

2016-04-08T13:59:51.929Z cpu0:32921)<6>ata2: ahci_port_reset, hard reseting port

2016-04-08T13:59:57.489Z cpu3:33151)NMP: nmp_ResetDeviceLogThrottling:3345: last error status from device t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30 repeated 1 times

2016-04-08T14:00:07.489Z cpu6:32922)VSCSI: 2966: Retry 21 on handle 8192 still in progress after 56 seconds

2016-04-08T14:00:29.489Z cpu0:38005)VMW_SATP_LOCAL: satp_local_updatePathStates:458: Failed to update path "vmhba32:C0:T0:L0" state. Status=Transient storage condition, suggest retry

2016-04-08T14:00:57.367Z cpu1:32921)<6>ata2: ahci_port_reset: FAILED

2016-04-08T14:00:57.367Z cpu1:32921)<6>ahci_scsi_abort: cmd 0x28 (0x439d8182b840), FAILED

2016-04-08T14:00:57.367Z cpu1:32921)WARNING: LinScsi: SCSILinuxAbortCommands:1837: Failed, Driver ahci, for vmhba32

2016-04-08T14:00:57.367Z cpu1:32921)WARNING: VSCSIFs: 352: handle 8192(vscsi4:0):Failed reset of virtual target 1442670, (initiator 0x43025c9893c0, 0): Failure

2016-04-08T14:00:57.367Z cpu1:32921)VSCSI: 2841: handle 8192(vscsi4:0):Reset [Retries: 22/0] from (vmm0:Router-VM)

2016-04-08T14:00:57.367Z cpu1:32921)<6>ahci_scsi_abort: cmd 0x28 (0x439d8182b840), entering...

2016-04-08T14:00:57.367Z cpu1:32921)<7>ata2: ahci_port_reset, entering...

2016-04-08T14:00:59.605Z cpu1:32921)<6>ata2: ahci_port_reset, hard reseting port

2016-04-08T14:01:01.179Z cpu2:32809)ScsiDeviceIO: 4889: Waited for completion for all issued commands for partition t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30:1, for 120 secs. 3 completions still awaited. Giving up !

2016-04-08T14:01:07.491Z cpu7:32922)VSCSI: 2966: Retry 22 on handle 8192 still in progress after 48 seconds

2016-04-08T14:02:05.075Z cpu4:32921)<6>ata2: ahci_port_reset: FAILED

2016-04-08T14:02:05.075Z cpu4:32921)<6>ahci_scsi_abort: cmd 0x28 (0x439d8182b840), FAILED

2016-04-08T14:02:05.075Z cpu4:32921)WARNING: LinScsi: SCSILinuxAbortCommands:1837: Failed, Driver ahci, for vmhba32

2016-04-08T14:02:05.075Z cpu4:32921)WARNING: VSCSIFs: 352: handle 8192(vscsi4:0):Failed reset of virtual target 1442670, (initiator 0x43025c9893c0, 0): Failure

2016-04-08T14:02:05.075Z cpu4:32921)VSCSI: 2841: handle 8192(vscsi4:0):Reset [Retries: 23/0] from (vmm0:Router-VM)

2016-04-08T14:02:05.075Z cpu4:32921)<6>ahci_scsi_abort: cmd 0x28 (0x439d8182b840), entering...

2016-04-08T14:02:05.075Z cpu4:32921)<7>ata2: ahci_port_reset, entering...

2016-04-08T14:02:07.315Z cpu0:32921)<6>ata2: ahci_port_reset, hard reseting port

2016-04-08T14:02:08.491Z cpu3:32922)VSCSI: 2966: Retry 23 on handle 8192 still in progress after 41 seconds

2016-04-08T14:03:03.509Z cpu0:32809)ScsiDeviceIO: 4889: Waited for completion for all issued commands for partition t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30:1, for 120 secs. 3 completions still awaited. Giving up !

2016-04-08T14:03:09.491Z cpu7:32922)VSCSI: 2966: Retry 23 on handle 8192 still in progress after 102 seconds

2016-04-08T14:03:12.757Z cpu6:32921)<6>ata2: ahci_port_reset: FAILED

2016-04-08T14:03:12.757Z cpu6:32921)<6>ahci_scsi_abort: cmd 0x28 (0x439d8182b840), FAILED

2016-04-08T14:03:12.757Z cpu6:32921)WARNING: LinScsi: SCSILinuxAbortCommands:1837: Failed, Driver ahci, for vmhba32

2016-04-08T14:03:12.757Z cpu6:32921)WARNING: VSCSIFs: 352: handle 8192(vscsi4:0):Failed reset of virtual target 1442670, (initiator 0x43025c9893c0, 0): Failure

2016-04-08T14:03:12.757Z cpu6:32921)VSCSI: 2841: handle 8192(vscsi4:0):Reset [Retries: 24/0] from (vmm0:Router-VM)

2016-04-08T14:03:12.757Z cpu6:32921)<6>ahci_scsi_abort: cmd 0x28 (0x439d8182b840), entering...

2016-04-08T14:03:12.757Z cpu6:32921)<7>ata2: ahci_port_reset, entering...

2016-04-08T14:03:14.997Z cpu6:32921)<6>ata2: ahci_port_reset, hard reseting port

2016-04-08T14:04:07.489Z cpu5:36458)VMW_SATP_LOCAL: satp_local_updatePathStates:458: Failed to update path "vmhba32:C0:T0:L0" state. Status=Transient storage condition, suggest retry

2016-04-08T14:04:07.489Z cpu6:32996)ScsiCore: 97: Stopping taskMgmt handler world 329962

2016-04-08T14:04:07.489Z cpu6:32797)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x12 (0x439d8060c840, 0) to dev "t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30" on path "vmhba32:C0:T0:L0" Failed: H:0x5 D:0x0 P:0x0 Possible sense d$

2016-04-08T14:04:07.489Z cpu6:32797)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30" state in doubt; requested fast path state update...

2016-04-08T14:04:07.489Z cpu6:32797)ScsiDeviceIO: 2646: Cmd(0x439d8060c840) 0x12, CmdSN 0xa9c from world 0 to dev "t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.

2016-04-08T14:04:10.489Z cpu6:32922)VSCSI: 2966: Retry 24 on handle 8192 still in progress after 95 seconds

2016-04-08T14:04:20.467Z cpu4:32921)<6>ata2: ahci_port_reset: FAILED

2016-04-08T14:04:20.467Z cpu4:32921)<6>ahci_scsi_abort: cmd 0x28 (0x439d8182b840), FAILED

2016-04-08T14:04:20.467Z cpu4:32921)WARNING: LinScsi: SCSILinuxAbortCommands:1837: Failed, Driver ahci, for vmhba32

2016-04-08T14:04:20.467Z cpu4:32921)WARNING: VSCSIFs: 352: handle 8192(vscsi4:0):Failed reset of virtual target 1442670, (initiator 0x43025c9893c0, 0): Failure

2016-04-08T14:04:20.467Z cpu4:32921)VSCSI: 2841: handle 8192(vscsi4:0):Reset [Retries: 25/0] from (vmm0:Router-VM)

2016-04-08T14:04:20.467Z cpu4:32921)<6>ahci_scsi_abort: cmd 0x28 (0x439d8182b840), entering...

2016-04-08T14:04:20.467Z cpu4:32921)<7>ata2: ahci_port_reset, entering...

2016-04-08T14:04:22.707Z cpu3:32921)<6>ata2: ahci_port_reset, hard reseting port

2016-04-08T14:04:37.489Z cpu5:39922)ScsiCore: 62: Starting taskmgmt handler world 39922/3

2016-04-08T14:04:39.489Z cpu1:39923)ScsiCore: 62: Starting taskmgmt handler world 39923/4

2016-04-08T14:04:39.489Z cpu2:32793)WARNING: NMP: nmp_DeviceRequestFastDeviceProbe:237: NMP device "t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30" state in doubt; requested fast path state update...

2016-04-08T14:04:39.489Z cpu2:32793)ScsiDeviceIO: 2646: Cmd(0x439d80696d00) 0x9e, CmdSN 0xa9d from world 0 to dev "t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.

2016-04-08T14:04:47.491Z cpu0:39923)ScsiDeviceIO: 2646: Cmd(0x439d8060c840) 0x12, CmdSN 0xa9e from world 0 to dev "t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30" failed H:0x5 D:0x0 P:0x0 Possible sense data: 0x0 0x0 0x0.

2016-04-08T14:04:47.491Z cpu6:39302)VMW_SATP_LOCAL: satp_local_updatePathStates:458: Failed to update path "vmhba32:C0:T0:L0" state. Status=Transient storage condition, suggest retry

Then I got virtual heart attack and thinking "O.m.g., this seems dangerous". :smileyshocked:

But ok. In the rescue mode I can mount it and copy it to another place if it's broken. And I have backups for the case of cases.

After searching how to fix ESXi problems I found this community. There is a tool called "voma" but I can't fix something with this - so that I not used this now.

Here is the hard disk list.

[root@static:~]  esxcli storage core path list

sata.vmhba32-sata.0:0-t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30

   UID: sata.vmhba32-sata.0:0-t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30

   Runtime Name: vmhba32:C0:T0:L0

   Device: t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30

   Device Display Name: Local ATA Disk (t10.ATA_____ST3000DM0012D9YN166__________________________________Z1F0YF30)

   Adapter: vmhba32

   Channel: 0

   Target: 0

   LUN: 0

   Plugin: NMP

   State: active

   Transport: sata

   Adapter Identifier: sata.vmhba32

   Target Identifier: sata.0:0

   Adapter Transport Details: Unavailable or path is unclaimed

   Target Transport Details: Unavailable or path is unclaimed

   Maximum IO Size: 33553920

sata.vmhba0-sata.0:0-t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z

   UID: sata.vmhba0-sata.0:0-t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z

   Runtime Name: vmhba0:C0:T0:L0

   Device: t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z

   Device Display Name: Local ATA Disk (t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z)

   Adapter: vmhba0

   Channel: 0

   Target: 0

   LUN: 0

   Plugin: NMP

   State: active

   Transport: sata

   Adapter Identifier: sata.vmhba0

   Target Identifier: sata.0:0

   Adapter Transport Details: Unavailable or path is unclaimed

   Target Transport Details: Unavailable or path is unclaimed

   Maximum IO Size: 33553920

Do you know if the hard disk is defect?
And maybe how I can fix this problem?

Or is something else broken on the hardware?

A really big thank you in Advance! Smiley Wink

0 Kudos
1 Reply
Paedy
Contributor
Contributor

Ok the smartctl said the disk have some errors - the other disk not.

So I thought it's good to remove the old one and get a new one.

But now I get this problem "sometimes".

Is it possible that some controller is defect or something else?

Everything works fine - but I see this messages in dmesg. - And don't know if this is good or not, because the new hard disk is affected, too Smiley Sad

2016-04-09T20:18:34.801Z cpu2:59024)VMMVMKCall: 235: Received INIT from world 59024

2016-04-09T20:18:34.801Z cpu5:59025)VMMVMKCall: 235: Received INIT from world 59025

2016-04-09T20:18:34.801Z cpu6:59026)VMMVMKCall: 235: Received INIT from world 59026

2016-04-09T20:18:34.802Z cpu7:59027)VMMVMKCall: 235: Received INIT from world 59027

2016-04-09T20:18:34.802Z cpu1:59028)VMMVMKCall: 235: Received INIT from world 59028

2016-04-09T20:18:34.802Z cpu3:59029)VMMVMKCall: 235: Received INIT from world 59029

2016-04-09T20:18:34.802Z cpu5:59030)VMMVMKCall: 235: Received INIT from world 59030

2016-04-09T20:18:34.802Z cpu7:59035)WARNING: NetDVS: 658: portAlias is NULL

2016-04-09T20:18:34.802Z cpu7:59035)Net: 2444: connected Web eth0 to NAT, portID 0x3000028

2016-04-09T20:18:34.802Z cpu7:59035)NetPort: 1573: enabled port 0x3000028 with mac 00:00:00:00:00:00

2016-04-09T20:18:40.074Z cpu6:32797)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80658e40, 32899) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T20:18:53.635Z cpu3:59027)VSCSIFs: 2235: handle 8295(vscsi0:1):Invalid Opcode (0x85) from (vmm0:Web)

2016-04-09T20:18:53.635Z cpu3:59027)VSCSIFs: 2235: handle 8295(vscsi0:1):Invalid Opcode (0x85) from (vmm0:Web)

2016-04-09T20:18:54.279Z cpu4:59027)VSCSIFs: 2235: handle 8294(vscsi0:0):Invalid Opcode (0x85) from (vmm0:Web)

2016-04-09T20:18:54.279Z cpu4:59027)VSCSIFs: 2235: handle 8294(vscsi0:0):Invalid Opcode (0x85) from (vmm0:Web)

2016-04-09T20:19:03.540Z cpu5:59021)VSCSIFs: 2235: handle 8294(vscsi0:0):Invalid Opcode (0x85) from (vmm0:Web)

2016-04-09T20:19:03.542Z cpu5:59021)VSCSIFs: 2235: handle 8295(vscsi0:1):Invalid Opcode (0x85) from (vmm0:Web)

2016-04-09T20:21:51.231Z cpu3:32794)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d8061d300, 34458) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T20:28:29.621Z cpu1:32888)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80644480, 32888) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T20:29:22.485Z cpu5:33151)NMP: nmp_ResetDeviceLogThrottling:3345: last error status from device t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z repeated 1 times

2016-04-09T20:37:37.314Z cpu1:49966)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80648400, 32888) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T20:44:21.575Z cpu6:59027)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d806aa000, 32888) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T20:47:35.601Z cpu0:32791)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d806e2140, 32888) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T20:48:52.505Z cpu5:32796)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d806e6940, 60105) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T20:48:52.505Z cpu5:32796)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d806bcec0, 32888) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T20:53:52.509Z cpu3:32785)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d8062a740, 60105) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T20:53:52.509Z cpu3:32785)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80669880, 32888) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T20:58:52.490Z cpu6:32797)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d8061c400, 60103) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T20:58:52.490Z cpu4:60100)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80685080, 60100) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T21:03:52.487Z cpu5:32796)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80688200, 60099) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T21:03:52.487Z cpu5:32796)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d8067a600, 60104) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T21:08:52.501Z cpu5:32888)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80646b80, 32888) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T21:08:52.501Z cpu5:32888)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d8067bc80, 60103) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T21:13:52.490Z cpu3:60100)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80699700, 60100) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T21:13:52.490Z cpu3:60100)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d806eb6c0, 60105) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T21:18:52.486Z cpu2:60103)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80666200, 60103) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T21:18:52.486Z cpu2:60103)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d805e9900, 60100) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T21:23:52.493Z cpu6:32797)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80658240, 60102) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T21:23:52.493Z cpu7:32798)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80634600, 60104) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T21:28:52.502Z cpu5:32796)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d806fb7c0, 60099) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T21:28:52.502Z cpu5:32796)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80602600, 32888) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T21:33:52.499Z cpu5:32796)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d806e1cc0, 60099) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T21:33:52.499Z cpu4:60099)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d806beb40, 60100) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T21:38:52.498Z cpu2:32793)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d806e6040, 60100) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T21:38:52.498Z cpu2:32793)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80682b00, 60103) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T21:43:52.521Z cpu7:49967)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d806a0f80, 62176) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T21:43:52.521Z cpu7:49967)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80648100, 62178) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T21:48:52.497Z cpu3:32794)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d805e1c00, 62175) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T21:48:52.497Z cpu3:32794)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80631d80, 62143) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T21:53:52.490Z cpu0:62143)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d805e3580, 62143) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T21:53:52.490Z cpu7:32798)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d806a6680, 62175) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T21:58:52.493Z cpu3:32794)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80680400, 62176) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T21:58:52.493Z cpu6:49964)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d8068b980, 62178) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

2016-04-09T22:01:42.197Z cpu7:48088)NetPort: 1780: disabled port 0x3000028

2016-04-09T22:01:42.197Z cpu7:48088)Net: 3649: disconnected client from port 0x3000028

2016-04-09T22:01:42.198Z cpu7:48088)VSCSI: 6699: handle 8294(vscsi0:0):Destroying Device for world 59021 (pendCom 0)

2016-04-09T22:01:42.198Z cpu7:48088)VSCSI: 6699: handle 8295(vscsi0:1):Destroying Device for world 59021 (pendCom 0)

2016-04-09T22:01:42.499Z cpu0:32827)WARNING: SP: 1523: Smashing barrier dealloc-Barrier.

2016-04-09T22:01:43.000Z cpu6:37203)NetPort: 1780: disabled port 0x3000006

2016-04-09T22:01:44.693Z cpu2:37196)VSCSI: 6699: handle 8209(vscsi0:0):Destroying Device for world 37197 (pendCom 0)

2016-04-09T22:01:44.693Z cpu2:37196)VSCSI: 6699: handle 8210(vscsi0:1):Destroying Device for world 37197 (pendCom 0)

2016-04-09T22:01:44.782Z cpu6:32826)Net: 3649: disconnected client from port 0x3000006

2016-04-09T22:01:53.649Z cpu0:42193)NetPort: 1780: disabled port 0x3000016

2016-04-09T22:01:53.649Z cpu0:42193)Net: 3649: disconnected client from port 0x3000016

2016-04-09T22:01:53.650Z cpu0:42193)VSCSI: 6699: handle 8279(vscsi0:0):Destroying Device for world 42955 (pendCom 0)

2016-04-09T22:01:53.650Z cpu0:42193)VSCSI: 6699: handle 8280(vscsi0:1):Destroying Device for world 42955 (pendCom 0)

2016-04-09T22:03:52.520Z cpu2:49967)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d80634780, 62175) to dev "t10.ATA_____WDC_WD3000FYYZ2D01UL1B2_______________________WD2DWMC1F0E2345Z" on path "vmhba0:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense $

2016-04-09T22:03:52.520Z cpu4:49968)NMP: nmp_ThrottleLogForDevice:3178: Cmd 0x93 (0x439d8070b100, 62177) to dev "t10.ATA_____ST33000650NS________________________________________Z297YV1S" on path "vmhba32:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense d$

Thank's in Advance!

0 Kudos