2 Replies Latest reply on Sep 11, 2019 12:13 PM by fcocquyt16

    vmhba37 bnx2fc link-down fcoe vmkernel - flapping UP/DOWN every 20 seconds in vmkernel.log

    fcocquyt16 Novice

      Hi All,

       

      I'm trying to bring vmhba37 link UP (currently link-down):

       

      [root@esx-42:~] esxcfg-scsidevs -a

       

      vmhba36 bnx2fc            link-up   fcoe.2000e0db5522ff03:2001e0db5522ff03  (0000:01:00.1) Broadcom Corporation QLogic 57810 10 Gigabit Ethernet Multi Function Adapter

      vmhba37 bnx2fc            link-down fcoe.2000e0db5522ff01:2001e0db5522ff01  (0000:01:00.0) Broadcom Corporation QLogic 57810 10 Gigabit Ethernet Multi Function Adapter

       

      This is a Dell M620 running the latest BIOS, firmwares running the latest Dell custom ESXi 6.5 U3 build 13932383

       

      [root@esx-42:~] esxcli network nic get -n vmnic0

         Advertised Auto Negotiation: true

         Advertised Link Modes: 1000BaseKX/Full, 10000BaseKR/Full

         Auto Negotiation: true

         Cable Type: FIBRE

         Current Message Level: 0

         Driver Info:

               Bus Info: 0000:01:00.0

               Driver: bnx2x

               Firmware Version: FFV14.10.07 bc 7.14.11

               Version: 2.713.70.v60.6

         Link Detected: true

         Link Status: Up

         Name: vmnic0

         PHYAddress: 1

         Pause Autonegotiate: true

         Pause RX: true

         Pause TX: true

         Supported Ports: FIBRE

         Supports Auto Negotiation: true

         Supports Pause: true

         Supports Wakeon: true

         Transceiver: internal

         Virtual Address: 00:50:56:59:3f:aa

         Wakeon: MagicPacket(tm)

       

       

      vmhba36 (vmnic1) is link-up

       

      In vmkernel.log I see looping messages - flapping UP/DOWN every 20 seconds in vmkernel.log:

       

      2019-09-09T20:18:44.853Z cpu4:66114)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_timeout:242 VLAN Discovery Failed.Trying default VLAN 1002                                                                     

      2019-09-09T20:18:44.853Z cpu4:66114)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_cmpl:319 vmnic0: vlan_disc_cmpl: hba is on vlan_id 1002                                                                        

      2019-09-09T20:18:44.853Z cpu4:66114)<6>host9: libfc: Link up on port (     0)                                                                                                                                       

      2019-09-09T20:19:04.855Z cpu23:66096)<6>host9: fip: link down.                                                                                                                                                     

      2019-09-09T20:19:04.855Z cpu23:66096)<6>host9: libfc: Link down on port (     0)                                                                                                                                   

      2019-09-09T20:19:04.855Z cpu23:66096)fcoe_ctlr_link_up: setting fabric mode for vmnic0                                                                                                                               

      2019-09-09T20:19:04.855Z cpu23:66096)<6>host9: libfc: Link up on port (     0)                                                                                                                                       

      2019-09-09T20:19:04.855Z cpu23:66096)<6>host9: fip: fcoe_ctlr_vlan_request() is done                                                                                                                               

      2019-09-09T20:19:24.856Z cpu27:66109)<6>host9: fip: link down.                                                                                                                                                     

      2019-09-09T20:19:24.856Z cpu27:66109)<6>host9: libfc: Link down on port (     0)                                                                                                                                   

      2019-09-09T20:19:24.856Z cpu27:66109)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_timeout:242 VLAN Discovery Failed.Trying default VLAN 1002                                                                   

      2019-09-09T20:19:24.856Z cpu27:66109)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_cmpl:319 vmnic0: vlan_disc_cmpl: hba is on vlan_id 1002                                                     

      2019-09-09T20:19:24.856Z cpu27:66109)<6>host9: libfc: Link up on port (     0)                                                                                                                                     

      2019-09-09T20:19:41.048Z cpu9:66364)DVFilter: 5927: Checking disconnected filters for timeouts                                                                                                                     

      2019-09-09T20:19:44.857Z cpu13:66101)<6>host9: fip: link down.                                                                                                                                                    

      2019-09-09T20:19:44.857Z cpu13:66101)<6>host9: libfc: Link down on port (     0)                                                                                                                                  

      2019-09-09T20:19:44.857Z cpu13:66101)fcoe_ctlr_link_up: setting fabric mode for vmnic0                                                                                                                             

      2019-09-09T20:19:44.857Z cpu13:66101)<6>host9: libfc: Link up on port (     0)                                                                                                                                     

      2019-09-09T20:19:44.857Z cpu13:66101)<6>host9: fip: fcoe_ctlr_vlan_request() is done                                                                                                                              

      2019-09-09T20:20:04.859Z cpu6:66120)<6>host9: fip: link down.                                                                                                                                                        

      2019-09-09T20:20:04.859Z cpu6:66120)<6>host9: libfc: Link down on port (     0)                                                                                                                                    

      2019-09-09T20:20:04.859Z cpu6:66120)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_timeout:242 VLAN Discovery Failed.Trying default VLAN 1002                                                                    

      2019-09-09T20:20:04.859Z cpu6:66120)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_cmpl:319 vmnic0: vlan_disc_cmpl: hba is on vlan_id 1002                                                                       

      2019-09-09T20:20:04.859Z cpu6:66120)<6>host9: libfc: Link up on port (     0)                                                                                                                                      

      2019-09-09T20:20:24.862Z cpu8:66114)<6>host9: fip: link down.                                                                                                                                                     

      2019-09-09T20:20:24.862Z cpu8:66114)<6>host9: libfc: Link down on port (     0)                                                                                                                                    

      2019-09-09T20:20:24.862Z cpu8:66114)fcoe_ctlr_link_up: setting fabric mode for vmnic0                                                                                                                              

      2019-09-09T20:20:24.862Z cpu8:66114)<6>host9: libfc: Link up on port (     0)                                                                                                                                     

      2019-09-09T20:20:24.862Z cpu8:66114)<6>host9: fip: fcoe_ctlr_vlan_request() is done                                                                                                                                

      2019-09-09T20:20:44.864Z cpu4:66099)<6>host9: fip: link down.                                                                                                                                                      

      2019-09-09T20:20:44.864Z cpu4:66099)<6>host9: libfc: Link down on port (     0)                                                                                                                                    

      2019-09-09T20:20:44.864Z cpu4:66099)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_timeout:242 VLAN Discovery Failed.Trying default VLAN 1002                                                                    

      2019-09-09T20:20:44.864Z cpu4:66099)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_cmpl:319 vmnic0: vlan_disc_cmpl: hba is on vlan_id 1002                                                                       

      2019-09-09T20:20:44.864Z cpu4:66099)<6>host9: libfc: Link up on port (     0)           

       

      Anyone seen a solution for this ?

       

      Many thanks!

      Fletcher