5 Replies Latest reply on Aug 9, 2018 4:36 AM by Diego Oliveira

    vmkernel log

    louis_zhu123 Lurker

      Hello,

       

      I see some fail message in vmkernel log. is it ok?

      My server is ESXI 6.5 U1. last day server auto reboot. not find the reason. i'm afraid it reboot again.

       

      2018-08-09T06:21:53.325Z cpu2:66102)<6>ixgbe 0000:06:00.1: vmnic3: NIC Link is Down

      2018-08-09T06:21:53.325Z cpu2:66102)<3>ixgbe: vmnic3: ixgbe_watchdog_link_is_down: NIC CNA Link is Down

      2018-08-09T06:24:27.759Z cpu0:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb141380) 0x1a, CmdSN 0x150fe from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

      2018-08-09T06:27:27.296Z cpu10:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb09b680) 0x1a, CmdSN 0x15162 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

      2018-08-09T06:30:57.819Z cpu0:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb085880) 0x1a, CmdSN 0x151c7 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

      2018-08-09T06:33:19.688Z cpu6:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb03e700) 0x1a, CmdSN 0x1521d from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

      2018-08-09T06:36:27.547Z cpu0:66336)ScsiDeviceIO: 2948: Cmd(0x4395c10893c0) 0x1a, CmdSN 0x1527c from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

      2018-08-09T06:39:27.564Z cpu2:66336)ScsiDeviceIO: 2948: Cmd(0x4395c10c6440) 0x1a, CmdSN 0x152e1 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

      2018-08-09T06:42:27.829Z cpu2:66336)ScsiDeviceIO: 2948: Cmd(0x4395c10b41c0) 0x1a, CmdSN 0x15345 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

      2018-08-09T06:45:57.541Z cpu6:66336)ScsiDeviceIO: 2948: Cmd(0x4395c11fce40) 0x1a, CmdSN 0x153aa from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

        • 1. Re: vmkernel log
          RickVerstegen Expert

          Check the error states of the NIC using this command via SSH to host:

          esxcli network nic stats get -n

           

          There may be specific error counts that tell you whether the problem is on the switch or the NIC.

          Also, check the latest drivers and firmware for the NIC.

           

          Rick

          • 2. Re: vmkernel log
            louis_zhu123 Lurker

            Hello Rick,

             

            sorry, i miss copy some rows. NIC always up and down in log.

            the server connect 1 network cable. see below picture.

            nic.png

             

            2018-08-09T05:47:27.835Z cpu8:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb05a700) 0x1a, CmdSN 0x14c5a from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

            2018-08-09T05:49:43.825Z cpu15:66089)<6>ixgbe 0000:06:00.1: vmnic3: NIC Link is Up 10 Gbps, Flow Control: None

            2018-08-09T05:49:43.825Z cpu15:66089)<3>ixgbe: vmnic3: ixgbe_watchdog_link_is_up: NIC CNA Link is Up

            2018-08-09T05:49:43.826Z cpu14:66090)<6>ixgbe 0000:06:00.1: vmnic3: NIC Link is Down

            2018-08-09T05:49:43.826Z cpu14:66090)<3>ixgbe: vmnic3: ixgbe_watchdog_link_is_down: NIC CNA Link is Down

            2018-08-09T05:50:57.521Z cpu13:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb0d3a00) 0x1a, CmdSN 0x14cbf from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

            2018-08-09T05:53:57.333Z cpu1:66336)ScsiDeviceIO: 2948: Cmd(0x4395c10a3440) 0x1a, CmdSN 0x14d24 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

            2018-08-09T05:57:19.212Z cpu30:66337)ScsiDeviceIO: 2948: Cmd(0x439dc0b0c840) 0x1a, CmdSN 0x14d88 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

            2018-08-09T06:00:27.866Z cpu14:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb1d7480) 0x1a, CmdSN 0x14ded from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

            2018-08-09T06:03:19.658Z cpu2:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb181500) 0x4d, CmdSN 0x175 from world 67761 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.

            2018-08-09T06:21:53.325Z cpu5:66091)<6>ixgbe 0000:06:00.1: vmnic3: NIC Link is Up 10 Gbps, Flow Control: None

            2018-08-09T06:21:53.325Z cpu5:66091)<3>ixgbe: vmnic3: ixgbe_watchdog_link_is_up: NIC CNA Link is Up

            2018-08-09T06:21:53.325Z cpu2:66102)<6>ixgbe 0000:06:00.1: vmnic3: NIC Link is Down

            2018-08-09T06:21:53.325Z cpu2:66102)<3>ixgbe: vmnic3: ixgbe_watchdog_link_is_down: NIC CNA Link is Down

            2018-08-09T06:24:27.759Z cpu0:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb141380) 0x1a, CmdSN 0x150fe from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

            2018-08-09T06:27:27.296Z cpu10:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb09b680) 0x1a, CmdSN 0x15162 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

            2018-08-09T06:30:57.819Z cpu0:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb085880) 0x1a, CmdSN 0x151c7 from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

            2018-08-09T06:33:19.688Z cpu6:66336)ScsiDeviceIO: 2948: Cmd(0x4395cb03e700) 0x1a, CmdSN 0x1521d from world 0 to dev "naa.600112f72000320000000d7f2864fa5f" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

            • 3. Re: vmkernel log
              RickVerstegen Expert

              What kind of switch are you using? And only vmnic0 is connected to the switch with a physical cable?

              • 4. Re: vmkernel log
                louis_zhu123 Lurker

                Yes, only 1 physical cable connect to server.

                how about the disk failed message, is it critical?

                • 5. Re: vmkernel log
                  Diego Oliveira Master
                  vExpert

                  Check if the switch has an error (crc) in the port.