VMware Cloud Community
fcocquyt16
Contributor
Contributor

vmhba37 bnx2fc link-down fcoe vmkernel - flapping UP/DOWN every 20 seconds in vmkernel.log

Hi All,

I'm trying to bring vmhba37 link UP (currently link-down):

[root@esx-42:~] esxcfg-scsidevs -a

vmhba36 bnx2fc            link-up   fcoe.2000e0db5522ff03:2001e0db5522ff03  (0000:01:00.1) Broadcom Corporation QLogic 57810 10 Gigabit Ethernet Multi Function Adapter

vmhba37 bnx2fc            link-down fcoe.2000e0db5522ff01:2001e0db5522ff01  (0000:01:00.0) Broadcom Corporation QLogic 57810 10 Gigabit Ethernet Multi Function Adapter

This is a Dell M620 running the latest BIOS, firmwares running the latest Dell custom ESXi 6.5 U3 build 13932383

[root@esx-42:~] esxcli network nic get -n vmnic0

   Advertised Auto Negotiation: true

   Advertised Link Modes: 1000BaseKX/Full, 10000BaseKR/Full

   Auto Negotiation: true

   Cable Type: FIBRE

   Current Message Level: 0

   Driver Info:

         Bus Info: 0000:01:00.0

         Driver: bnx2x

         Firmware Version: FFV14.10.07 bc 7.14.11

         Version: 2.713.70.v60.6

   Link Detected: true

   Link Status: Up

   Name: vmnic0

   PHYAddress: 1

   Pause Autonegotiate: true

   Pause RX: true

   Pause TX: true

   Supported Ports: FIBRE

   Supports Auto Negotiation: true

   Supports Pause: true

   Supports Wakeon: true

   Transceiver: internal

   Virtual Address: 00:50:56:59:3f:aa

   Wakeon: MagicPacket(tm)

vmhba36 (vmnic1) is link-up

In vmkernel.log I see looping messages - flapping UP/DOWN every 20 seconds in vmkernel.log:

2019-09-09T20:18:44.853Z cpu4:66114)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_timeout:242 VLAN Discovery Failed.Trying default VLAN 1002                                                                     

2019-09-09T20:18:44.853Z cpu4:66114)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_cmpl:319 vmnic0: vlan_disc_cmpl: hba is on vlan_id 1002                                                                        

2019-09-09T20:18:44.853Z cpu4:66114)<6>host9: libfc: Link up on port (     0)                                                                                                                                       

2019-09-09T20:19:04.855Z cpu23:66096)<6>host9: fip: link down.                                                                                                                                                     

2019-09-09T20:19:04.855Z cpu23:66096)<6>host9: libfc: Link down on port (     0)                                                                                                                                   

2019-09-09T20:19:04.855Z cpu23:66096)fcoe_ctlr_link_up: setting fabric mode for vmnic0                                                                                                                               

2019-09-09T20:19:04.855Z cpu23:66096)<6>host9: libfc: Link up on port (     0)                                                                                                                                       

2019-09-09T20:19:04.855Z cpu23:66096)<6>host9: fip: fcoe_ctlr_vlan_request() is done                                                                                                                               

2019-09-09T20:19:24.856Z cpu27:66109)<6>host9: fip: link down.                                                                                                                                                     

2019-09-09T20:19:24.856Z cpu27:66109)<6>host9: libfc: Link down on port (     0)                                                                                                                                   

2019-09-09T20:19:24.856Z cpu27:66109)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_timeout:242 VLAN Discovery Failed.Trying default VLAN 1002                                                                   

2019-09-09T20:19:24.856Z cpu27:66109)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_cmpl:319 vmnic0: vlan_disc_cmpl: hba is on vlan_id 1002                                                     

2019-09-09T20:19:24.856Z cpu27:66109)<6>host9: libfc: Link up on port (     0)                                                                                                                                     

2019-09-09T20:19:41.048Z cpu9:66364)DVFilter: 5927: Checking disconnected filters for timeouts                                                                                                                     

2019-09-09T20:19:44.857Z cpu13:66101)<6>host9: fip: link down.                                                                                                                                                    

2019-09-09T20:19:44.857Z cpu13:66101)<6>host9: libfc: Link down on port (     0)                                                                                                                                  

2019-09-09T20:19:44.857Z cpu13:66101)fcoe_ctlr_link_up: setting fabric mode for vmnic0                                                                                                                             

2019-09-09T20:19:44.857Z cpu13:66101)<6>host9: libfc: Link up on port (     0)                                                                                                                                     

2019-09-09T20:19:44.857Z cpu13:66101)<6>host9: fip: fcoe_ctlr_vlan_request() is done                                                                                                                              

2019-09-09T20:20:04.859Z cpu6:66120)<6>host9: fip: link down.                                                                                                                                                        

2019-09-09T20:20:04.859Z cpu6:66120)<6>host9: libfc: Link down on port (     0)                                                                                                                                    

2019-09-09T20:20:04.859Z cpu6:66120)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_timeout:242 VLAN Discovery Failed.Trying default VLAN 1002                                                                    

2019-09-09T20:20:04.859Z cpu6:66120)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_cmpl:319 vmnic0: vlan_disc_cmpl: hba is on vlan_id 1002                                                                       

2019-09-09T20:20:04.859Z cpu6:66120)<6>host9: libfc: Link up on port (     0)                                                                                                                                      

2019-09-09T20:20:24.862Z cpu8:66114)<6>host9: fip: link down.                                                                                                                                                     

2019-09-09T20:20:24.862Z cpu8:66114)<6>host9: libfc: Link down on port (     0)                                                                                                                                    

2019-09-09T20:20:24.862Z cpu8:66114)fcoe_ctlr_link_up: setting fabric mode for vmnic0                                                                                                                              

2019-09-09T20:20:24.862Z cpu8:66114)<6>host9: libfc: Link up on port (     0)                                                                                                                                     

2019-09-09T20:20:24.862Z cpu8:66114)<6>host9: fip: fcoe_ctlr_vlan_request() is done                                                                                                                                

2019-09-09T20:20:44.864Z cpu4:66099)<6>host9: fip: link down.                                                                                                                                                      

2019-09-09T20:20:44.864Z cpu4:66099)<6>host9: libfc: Link down on port (     0)                                                                                                                                    

2019-09-09T20:20:44.864Z cpu4:66099)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_timeout:242 VLAN Discovery Failed.Trying default VLAN 1002                                                                    

2019-09-09T20:20:44.864Z cpu4:66099)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_cmpl:319 vmnic0: vlan_disc_cmpl: hba is on vlan_id 1002                                                                       

2019-09-09T20:20:44.864Z cpu4:66099)<6>host9: libfc: Link up on port (     0)           

Anyone seen a solution for this ?

Many thanks!

Fletcher

Reply
0 Kudos
2 Replies
zenivox
Hot Shot
Hot Shot

the latest bios is not necessarily a good thing all the time. Did you check the compatibility matrix ? Maybe vmware has not tested yet the latest drivers for your hbas:

VMware Compatibility Guide - I/O Device Search 

when did the problem start? After the drivers update? is the vmhba37 the only hba affected? If yes, did you check the switch port for errors/analysis?

Reply
0 Kudos
fcocquyt16
Contributor
Contributor

Yes, in fact vmware support advised to update to this version of BIOS, firmware on the Dell side before upgrading the vmware driver side

thanks

Reply
0 Kudos