Hi All,
I'm trying to bring vmhba37 link UP (currently link-down):
[root@esx-42:~] esxcfg-scsidevs -a
vmhba36 bnx2fc link-up fcoe.2000e0db5522ff03:2001e0db5522ff03 (0000:01:00.1) Broadcom Corporation QLogic 57810 10 Gigabit Ethernet Multi Function Adapter
vmhba37 bnx2fc link-down fcoe.2000e0db5522ff01:2001e0db5522ff01 (0000:01:00.0) Broadcom Corporation QLogic 57810 10 Gigabit Ethernet Multi Function Adapter
This is a Dell M620 running the latest BIOS, firmwares running the latest Dell custom ESXi 6.5 U3 build 13932383
[root@esx-42:~] esxcli network nic get -n vmnic0
Advertised Auto Negotiation: true
Advertised Link Modes: 1000BaseKX/Full, 10000BaseKR/Full
Auto Negotiation: true
Cable Type: FIBRE
Current Message Level: 0
Driver Info:
Bus Info: 0000:01:00.0
Driver: bnx2x
Firmware Version: FFV14.10.07 bc 7.14.11
Version: 2.713.70.v60.6
Link Detected: true
Link Status: Up
Name: vmnic0
PHYAddress: 1
Pause Autonegotiate: true
Pause RX: true
Pause TX: true
Supported Ports: FIBRE
Supports Auto Negotiation: true
Supports Pause: true
Supports Wakeon: true
Transceiver: internal
Virtual Address: 00:50:56:59:3f:aa
Wakeon: MagicPacket(tm)
vmhba36 (vmnic1) is link-up
In vmkernel.log I see looping messages - flapping UP/DOWN every 20 seconds in vmkernel.log:
2019-09-09T20:18:44.853Z cpu4:66114)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_timeout:242 VLAN Discovery Failed.Trying default VLAN 1002
2019-09-09T20:18:44.853Z cpu4:66114)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_cmpl:319 vmnic0: vlan_disc_cmpl: hba is on vlan_id 1002
2019-09-09T20:18:44.853Z cpu4:66114)<6>host9: libfc: Link up on port ( 0)
2019-09-09T20:19:04.855Z cpu23:66096)<6>host9: fip: link down.
2019-09-09T20:19:04.855Z cpu23:66096)<6>host9: libfc: Link down on port ( 0)
2019-09-09T20:19:04.855Z cpu23:66096)fcoe_ctlr_link_up: setting fabric mode for vmnic0
2019-09-09T20:19:04.855Z cpu23:66096)<6>host9: libfc: Link up on port ( 0)
2019-09-09T20:19:04.855Z cpu23:66096)<6>host9: fip: fcoe_ctlr_vlan_request() is done
2019-09-09T20:19:24.856Z cpu27:66109)<6>host9: fip: link down.
2019-09-09T20:19:24.856Z cpu27:66109)<6>host9: libfc: Link down on port ( 0)
2019-09-09T20:19:24.856Z cpu27:66109)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_timeout:242 VLAN Discovery Failed.Trying default VLAN 1002
2019-09-09T20:19:24.856Z cpu27:66109)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_cmpl:319 vmnic0: vlan_disc_cmpl: hba is on vlan_id 1002
2019-09-09T20:19:24.856Z cpu27:66109)<6>host9: libfc: Link up on port ( 0)
2019-09-09T20:19:41.048Z cpu9:66364)DVFilter: 5927: Checking disconnected filters for timeouts
2019-09-09T20:19:44.857Z cpu13:66101)<6>host9: fip: link down.
2019-09-09T20:19:44.857Z cpu13:66101)<6>host9: libfc: Link down on port ( 0)
2019-09-09T20:19:44.857Z cpu13:66101)fcoe_ctlr_link_up: setting fabric mode for vmnic0
2019-09-09T20:19:44.857Z cpu13:66101)<6>host9: libfc: Link up on port ( 0)
2019-09-09T20:19:44.857Z cpu13:66101)<6>host9: fip: fcoe_ctlr_vlan_request() is done
2019-09-09T20:20:04.859Z cpu6:66120)<6>host9: fip: link down.
2019-09-09T20:20:04.859Z cpu6:66120)<6>host9: libfc: Link down on port ( 0)
2019-09-09T20:20:04.859Z cpu6:66120)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_timeout:242 VLAN Discovery Failed.Trying default VLAN 1002
2019-09-09T20:20:04.859Z cpu6:66120)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_cmpl:319 vmnic0: vlan_disc_cmpl: hba is on vlan_id 1002
2019-09-09T20:20:04.859Z cpu6:66120)<6>host9: libfc: Link up on port ( 0)
2019-09-09T20:20:24.862Z cpu8:66114)<6>host9: fip: link down.
2019-09-09T20:20:24.862Z cpu8:66114)<6>host9: libfc: Link down on port ( 0)
2019-09-09T20:20:24.862Z cpu8:66114)fcoe_ctlr_link_up: setting fabric mode for vmnic0
2019-09-09T20:20:24.862Z cpu8:66114)<6>host9: libfc: Link up on port ( 0)
2019-09-09T20:20:24.862Z cpu8:66114)<6>host9: fip: fcoe_ctlr_vlan_request() is done
2019-09-09T20:20:44.864Z cpu4:66099)<6>host9: fip: link down.
2019-09-09T20:20:44.864Z cpu4:66099)<6>host9: libfc: Link down on port ( 0)
2019-09-09T20:20:44.864Z cpu4:66099)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_timeout:242 VLAN Discovery Failed.Trying default VLAN 1002
2019-09-09T20:20:44.864Z cpu4:66099)<3>bnx2fc:vmhba37:0000:01:00.0: bnx2fc_vlan_disc_cmpl:319 vmnic0: vlan_disc_cmpl: hba is on vlan_id 1002
2019-09-09T20:20:44.864Z cpu4:66099)<6>host9: libfc: Link up on port ( 0)
Anyone seen a solution for this ?
Many thanks!
Fletcher
the latest bios is not necessarily a good thing all the time. Did you check the compatibility matrix ? Maybe vmware has not tested yet the latest drivers for your hbas:
VMware Compatibility Guide - I/O Device Search
when did the problem start? After the drivers update? is the vmhba37 the only hba affected? If yes, did you check the switch port for errors/analysis?
Yes, in fact vmware support advised to update to this version of BIOS, firmware on the Dell side before upgrading the vmware driver side
thanks