frequent error message 'nmp_ThrottleLogForDevice:3298:' in vmkernel.log

[csco11907589]

Dear Community,

I get these error message from esxi 6.0U2 .

The machine is base on E2630v4 *2 ,C612 Motherboard ,256G RAM, there has two RAID array ,ONE is RAID 0 with 2 HDD,mapping to device "naa.600605b0090741b01f3bf52b0f5d88c0", esxi OS installed on it.Another is RAID 5 with 3 HDD,mapping  device "naa.600605b0090741b01f3bf4f00bd35c85" ,5 virtual machine installed on it.

The Host has been halted when  runing about 10 days , press  NumLock key on keyboard without any response.

After reboot,the system seems working normal,no data lost.All Storage is active.

Can you explain the means of these error logs ?  Is there any solution to solve this error log?

From,

Joe.

The logs in vmkernel:

201,6-11-12T07:51:37.585Z cpu5:33127)ScsiDeviceIO: 2651: Cmd(0x439e0f06b380) 0x1a, CmdSN 0x3ee9 from world 0 to dev "naa.600605b0090741b01f3bf52b0f5d88c0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2016-11-12T07:51:37.585Z cpu5:33127)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x85 (0x439e0f06b380, 34599) to dev "naa.600605b0090741b01f3bf52b0f5d88c0" on path "vmhba2:C2:T1:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE

2016-11-12T07:51:37.585Z cpu5:33127)ScsiDeviceIO: 2651: Cmd(0x439e0f06b380) 0x4d, CmdSN 0xefd from world 34599 to dev "naa.600605b0090741b01f3bf52b0f5d88c0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.

2016-11-12T07:51:37.585Z cpu5:33127)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x1a (0x439e0f06b380, 34599) to dev "naa.600605b0090741b01f3bf52b0f5d88c0" on path "vmhba2:C2:T1:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0. Act:NONE

2016-11-12T07:51:37.585Z cpu5:33127)ScsiDeviceIO: 2651: Cmd(0x439e0f06b380) 0x1a, CmdSN 0xefe from world 34599 to dev "naa.600605b0090741b01f3bf52b0f5d88c0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2016-11-12T07:51:37.586Z cpu5:33127)ScsiDeviceIO: 2651: Cmd(0x439e0f06b380) 0x1a, CmdSN 0x3eee from world 0 to dev "naa.600605b0090741b01f3bf52b0f5d88c0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2016-11-12T07:51:37.586Z cpu5:33127)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x85 (0x439e0f06b380, 34599) to dev "naa.600605b0090741b01f3bf52b0f5d88c0" on path "vmhba2:C2:T1:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE

2016-11-12T07:55:20.006Z cpu10:419999)<6>megasas_service_aen[10]: aen received

2016-11-12T07:55:20.007Z cpu2:33319)<6>megasas_hotplug_work[10]: event code 0x0041

2016-11-12T07:55:20.010Z cpu3:33319)<6>megasas_hotplug_work[10]: aen registered

2016-11-12T08:00:30.320Z cpu10:420274)<6>megasas_service_aen[10]: aen received

2016-11-12T08:00:30.320Z cpu27:33330)<6>megasas_hotplug_work[10]: event code 0x0041

2016-11-12T08:00:30.324Z cpu27:33330)<6>megasas_hotplug_work[10]: aen registered

2016-11-12T08:01:01.927Z cpu4:419996)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x1a (0x439e0e431540, 0) to dev "naa.600605b0090741b01f3bf4f00bd35c85" on path "vmhba2:C2:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0. Act:NONE

2016-11-12T08:01:01.996Z cpu13:33931)ScsiDeviceIO: 2651: Cmd(0x439e0e431540) 0x1a, CmdSN 0x3ef4 from world 0 to dev "naa.600605b0090741b01f3bf4f00bd35c85" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2016-11-12T08:01:02.162Z cpu4:32772)ScsiDeviceIO: 2651: Cmd(0x439e0ec20500) 0x1a, CmdSN 0x3ef9 from world 0 to dev "naa.600605b0090741b01f3bf4f00bd35c85" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2016-11-12T08:02:01.057Z cpu24:33366)NMP: nmp_ResetDeviceLogThrottling:3349: last error status from device naa.600605b0090741b01f3bf4f00bd35c85 repeated 2 times

2016-11-12T08:05:42.266Z cpu10:419995)<6>megasas_service_aen[10]: aen received

2016-11-12T08:05:42.267Z cpu16:33318)<6>megasas_hotplug_work[10]: event code 0x0041

2016-11-12T08:05:42.270Z cpu16:33318)<6>megasas_hotplug_work[10]: aen registered

2016-11-12T08:10:55.892Z cpu10:419992)<6>megasas_service_aen[10]: aen received

2016-11-12T08:10:55.892Z cpu0:33328)<6>megasas_hotplug_work[10]: event code 0x0041

2016-11-12T08:10:55.896Z cpu0:33328)<6>megasas_hotplug_work[10]: aen registered

2016-11-12T08:16:14.306Z cpu10:419414)<6>megasas_service_aen[10]: aen received

2016-11-12T08:16:14.306Z cpu16:33308)<6>megasas_hotplug_work[10]: event code 0x0041

2016-11-12T08:16:14.309Z cpu16:33308)<6>megasas_hotplug_work[10]: aen registered

2016-11-12T08:21:33.583Z cpu10:419999)<6>megasas_service_aen[10]: aen received

2016-11-12T08:21:33.583Z cpu1:33333)<6>megasas_hotplug_work[10]: event code 0x0041

2016-11-12T08:21:33.587Z cpu1:33333)<6>megasas_hotplug_work[10]: aen registered

2016-11-12T08:21:37.615Z cpu1:33455)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x1a (0x439e0e2046c0, 0) to dev "naa.600605b0090741b01f3bf4f00bd35c85" on path "vmhba2:C2:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0. Act:NONE

2016-11-12T08:21:37.678Z cpu1:33155)ScsiDeviceIO: 2651: Cmd(0x439e0e2046c0) 0x1a, CmdSN 0x3eff from world 0 to dev "naa.600605b0090741b01f3bf4f00bd35c85" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2016-11-12T08:21:37.678Z cpu1:33155)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x85 (0x439e0e2046c0, 34599) to dev "naa.600605b0090741b01f3bf4f00bd35c85" on path "vmhba2:C2:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE

2016-11-12T08:21:37.678Z cpu1:33155)ScsiDeviceIO: 2635: Cmd(0x439e0e2046c0) 0x85, CmdSN 0xf00 from world 34599 to dev "naa.600605b0090741b01f3bf4f00bd35c85" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.

2016-11-12T08:21:37.678Z cpu1:33155)ScsiDeviceIO: 2651: Cmd(0x439e0e2046c0) 0x4d, CmdSN 0xf01 from world 34599 to dev "naa.600605b0090741b01f3bf4f00bd35c85" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.

2016-11-12T08:21:37.679Z cpu1:33155)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x1a (0x439e0e2046c0, 34599) to dev "naa.600605b0090741b01f3bf4f00bd35c85" on path "vmhba2:C2:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0. Act:NONE

2016-11-12T08:21:37.679Z cpu1:33155)ScsiDeviceIO: 2651: Cmd(0x439e0e2046c0) 0x1a, CmdSN 0xf02 from world 34599 to dev "naa.600605b0090741b01f3bf4f00bd35c85" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2016-11-12T08:21:37.679Z cpu1:33155)ScsiDeviceIO: 2651: Cmd(0x439e0e2046c0) 0x1a, CmdSN 0x3f04 from world 0 to dev "naa.600605b0090741b01f3bf4f00bd35c85" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2016-11-12T08:21:37.679Z cpu1:33155)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x85 (0x439e0e2046c0, 34599) to dev "naa.600605b0090741b01f3bf4f00bd35c85" on path "vmhba2:C2:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE

2016-11-12T08:21:37.680Z cpu1:33155)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x1a (0x439e0e2046c0, 0) to dev "naa.600605b0090741b01f3bf52b0f5d88c0" on path "vmhba2:C2:T1:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0. Act:NONE

2016-11-12T08:21:37.696Z cpu6:33238)ScsiDeviceIO: 2651: Cmd(0x439e0e2046c0) 0x1a, CmdSN 0x3f0a from world 0 to dev "naa.600605b0090741b01f3bf52b0f5d88c0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2016-11-12T08:21:37.696Z cpu6:33238)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x85 (0x439e0e2046c0, 34599) to dev "naa.600605b0090741b01f3bf52b0f5d88c0" on path "vmhba2:C2:T1:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE

2016-11-12T08:21:37.696Z cpu6:33238)ScsiDeviceIO: 2635: Cmd(0x439e0e2046c0) 0x85, CmdSN 0xf04 from world 34599 to dev "naa.600605b0090741b01f3bf52b0f5d88c0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.

2016-11-12T08:21:37.696Z cpu6:419996)ScsiDeviceIO: 2651: Cmd(0x439e0e2046c0) 0x4d, CmdSN 0xf05 from world 34599 to dev "naa.600605b0090741b01f3bf52b0f5d88c0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.

2016-11-12T08:21:37.696Z cpu6:33238)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x1a (0x439e0e2046c0, 34599) to dev "naa.600605b0090741b01f3bf52b0f5d88c0" on path "vmhba2:C2:T1:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0. Act:NONE

2016-11-12T08:21:37.696Z cpu6:33238)ScsiDeviceIO: 2651: Cmd(0x439e0e2046c0) 0x1a, CmdSN 0xf06 from world 34599 to dev "naa.600605b0090741b01f3bf52b0f5d88c0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2016-11-12T08:21:37.696Z cpu6:33238)ScsiDeviceIO: 2651: Cmd(0x439e0e2046c0) 0x1a, CmdSN 0x3f0f from world 0 to dev "naa.600605b0090741b01f3bf52b0f5d88c0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2016-11-12T08:21:37.697Z cpu6:33238)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x85 (0x439e0e2046c0, 34599) to dev "naa.600605b0090741b01f3bf52b0f5d88c0" on path "vmhba2:C2:T1:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONEb