VMware Cloud Community
louis_zhu123
Contributor
Contributor

vmkernel log

Hello,

I see some fail message in vmkernel log. is it ok?

My server is ESXI 6.5 U1. last day server auto reboot. not find the reason. i'm afraid it reboot again. Smiley Sad

2018-08-09T06:21:53.325Z cpu2:66102)<6>ixgbe 0000:06:00.1: vmnic3: NIC Link is Down

2018-08-09T06:21:53.325Z cpu2:66102)<3>ixgbe: vmnic3: ixgbe_watchdog_link_is_down: NIC CNA Link is Down

2018-08-09T06:24:27.759Z cpu0:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb141380) 0x1a, CmdSN 0x150fe from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2018-08-09T06:27:27.296Z cpu10:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb09b680) 0x1a, CmdSN 0x15162 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2018-08-09T06:30:57.819Z cpu0:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb085880) 0x1a, CmdSN 0x151c7 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2018-08-09T06:33:19.688Z cpu6:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb03e700) 0x1a, CmdSN 0x1521d from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2018-08-09T06:36:27.547Z cpu0:66336)ScsiDeviceIO: 2948: Cmd(0x4395c10893c0) 0x1a, CmdSN 0x1527c from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2018-08-09T06:39:27.564Z cpu2:66336)ScsiDeviceIO: 2948: Cmd(0x4395c10c6440) 0x1a, CmdSN 0x152e1 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2018-08-09T06:42:27.829Z cpu2:66336)ScsiDeviceIO: 2948: Cmd(0x4395c10b41c0) 0x1a, CmdSN 0x15345 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2018-08-09T06:45:57.541Z cpu6:66336)ScsiDeviceIO: 2948: Cmd(0x4395c11fce40) 0x1a, CmdSN 0x153aa from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

Reply
0 Kudos
5 Replies
RickVerstegen
Expert
Expert

Check the error states of the NIC using this command via SSH to host:

esxcli network nic stats get -n

There may be specific error counts that tell you whether the problem is on the switch or the NIC.

Also, check the latest drivers and firmware for the NIC.

Rick

Was I helpful? Give a kudo for appreciation!
Blog: https://rickverstegen84.wordpress.com/
Twitter: https://twitter.com/verstegenrick
Reply
0 Kudos
louis_zhu123
Contributor
Contributor

Hello Rick,

sorry, i miss copy some rows. NIC always up and down in log.

the server connect 1 network cable. see below picture.

nic.png

2018-08-09T05:47:27.835Z cpu8:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb05a700) 0x1a, CmdSN 0x14c5a from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2018-08-09T05:49:43.825Z cpu15:66089)<6>ixgbe 0000:06:00.1: vmnic3: NIC Link is Up 10 Gbps, Flow Control: None

2018-08-09T05:49:43.825Z cpu15:66089)<3>ixgbe: vmnic3: ixgbe_watchdog_link_is_up: NIC CNA Link is Up

2018-08-09T05:49:43.826Z cpu14:66090)<6>ixgbe 0000:06:00.1: vmnic3: NIC Link is Down

2018-08-09T05:49:43.826Z cpu14:66090)<3>ixgbe: vmnic3: ixgbe_watchdog_link_is_down: NIC CNA Link is Down

2018-08-09T05:50:57.521Z cpu13:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb0d3a00) 0x1a, CmdSN 0x14cbf from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2018-08-09T05:53:57.333Z cpu1:66336)ScsiDeviceIO: 2948: Cmd(0x4395c10a3440) 0x1a, CmdSN 0x14d24 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2018-08-09T05:57:19.212Z cpu30:66337)ScsiDeviceIO: 2948: Cmd(0x439dc0b0c840) 0x1a, CmdSN 0x14d88 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2018-08-09T06:00:27.866Z cpu14:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb1d7480) 0x1a, CmdSN 0x14ded from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2018-08-09T06:03:19.658Z cpu2:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb181500) 0x4d, CmdSN 0x175 from world 67761 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.

2018-08-09T06:21:53.325Z cpu5:66091)<6>ixgbe 0000:06:00.1: vmnic3: NIC Link is Up 10 Gbps, Flow Control: None

2018-08-09T06:21:53.325Z cpu5:66091)<3>ixgbe: vmnic3: ixgbe_watchdog_link_is_up: NIC CNA Link is Up

2018-08-09T06:21:53.325Z cpu2:66102)<6>ixgbe 0000:06:00.1: vmnic3: NIC Link is Down

2018-08-09T06:21:53.325Z cpu2:66102)<3>ixgbe: vmnic3: ixgbe_watchdog_link_is_down: NIC CNA Link is Down

2018-08-09T06:24:27.759Z cpu0:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb141380) 0x1a, CmdSN 0x150fe from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2018-08-09T06:27:27.296Z cpu10:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb09b680) 0x1a, CmdSN 0x15162 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2018-08-09T06:30:57.819Z cpu0:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb085880) 0x1a, CmdSN 0x151c7 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2018-08-09T06:33:19.688Z cpu6:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb03e700) 0x1a, CmdSN 0x1521d from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

Reply
0 Kudos
RickVerstegen
Expert
Expert

What kind of switch are you using? And only vmnic0 is connected to the switch with a physical cable?

Was I helpful? Give a kudo for appreciation!
Blog: https://rickverstegen84.wordpress.com/
Twitter: https://twitter.com/verstegenrick
Reply
0 Kudos
louis_zhu123
Contributor
Contributor

Yes, only 1 physical cable connect to server.

how about the disk failed message, is it critical?

Reply
0 Kudos
diegodco31
Leadership
Leadership

Check if the switch has an error (crc) in the port.

Diego Oliveira
LinkedIn: http://www.linkedin.com/in/dcodiego
Reply
0 Kudos