Sean_c6
Contributor
Contributor

HPE Gen9 NX1 NIC Flapping after upgrade to ESXI 6.7U3

Jump to solution

Hey, we have a HPE GEN9 DL380 host that we upgraded from 6.5u3 to 6.7u3 and are experiencing flapping on the NIC. We upgraded the NIC to the latest firmware via HPE VMWare firmware last friday night, it had no issues, after rebooting the firmware was updated, however when upgrading the ESXI to 6.7U3 we are experiencing flapping on the iscsi NICs to the SAN. Any thoughts? 

0 Kudos
1 Solution

Accepted Solutions
e_espinel
Virtuoso
Virtuoso

Hello
As sent you have the latest firmware and driver installed
Firmware version: bc 1.46 ncsi 1.5.27
Driver 4.1.5.0
At this point, there is nothing left but to try with the previous driver version
ntg3 version 4.1.3.2-1vmw

 

Enrique Espinel
Senior Technical Support IBM, Lenovo, VMware vSphere and Veeam Backup.
VMware VSP-SV, VTSP-SV, VTSP-HCI, VTSP 5
Please mark my comment as Correct Answer or assign Kudos if my answer was helpful to you, Thank you.
Пожалуйста, отметьте мой комментарий как Правильный ответ или поставьте Кудо, если мой ответ был вам полезен, Спасибо.

View solution in original post

0 Kudos
11 Replies
e_espinel
Virtuoso
Virtuoso

Hello.
Attached is a link that might help you

https://kb.vmware.com/s/article/2038869

https://www.cisco.com/c/en/us/support/docs/smb/switches/cisco-350-series-managed-switches/smb5783-co...

You should also perform (or verify) that
change the MTU from the default of 1500 to 9000 in the vswitch and Nics that are in your ISCSI configuration.


Is your connection to the stroage direct or through Switch ?

Enrique Espinel
Senior Technical Support IBM, Lenovo, VMware vSphere and Veeam Backup.
VMware VSP-SV, VTSP-SV, VTSP-HCI, VTSP 5
Please mark my comment as Correct Answer or assign Kudos if my answer was helpful to you, Thank you.
Пожалуйста, отметьте мой комментарий как Правильный ответ или поставьте Кудо, если мой ответ был вам полезен, Спасибо.
Sean_c6
Contributor
Contributor

Sorry for the delay on the response. I will have to see about enabling linkflapprevention on the switch. Yes, the connection goes through a cisco switch to the SAN. We have applied the latest patch to 6.7U3 which was supposed to have updated NTG3 drivers included. We have confirmed it is using the NTG3 driver/module/VIB and identified as a Broadcom 5719. We have worked with HPE and VMWare support and really have just gotten passed back and forth between them. They both have indicated a physical layer 1 issue, however when we load 6.5 esxi back on the host, the flapping is gone and no longer present. Also up for debate is upgrading the NIC in the server to a 10 gb PCIe card that is supported by VMWare. 

0 Kudos
e_espinel
Virtuoso
Virtuoso

Hello.
Please indicate the type and model of the NIC as well as its part number.
In general, when updating a version or a driver, factors may occur that were not considered in the previous version or had greater tolerance.

 

Enrique Espinel
Senior Technical Support IBM, Lenovo, VMware vSphere and Veeam Backup.
VMware VSP-SV, VTSP-SV, VTSP-HCI, VTSP 5
Please mark my comment as Correct Answer or assign Kudos if my answer was helpful to you, Thank you.
Пожалуйста, отметьте мой комментарий как Правильный ответ или поставьте Кудо, если мой ответ был вам полезен, Спасибо.
Sean_c6
Contributor
Contributor

The NIC is the 331i 4 port 1gb NIC, also falls under the NX1 Broadcom on HP Support. 

 

https://citrixready.citrix.com/hewlett-packard-enterprise/ethernet-1gb-4-port-331i-adapter.html

 

0 Kudos
e_espinel
Virtuoso
Virtuoso

Hello.

Log into the ESXi host and in an SSH session run the following commands to identify the NIC name (vmnicxx) and then identify its firmware and current driver.
esxcli network nic list
esxcli network nic get -n vmnicxx

Last Firmware

link: https://support.hpe.com/hpesc/public/swd/detail?swItemId=MTX_648f0b90d7c2438b82851940e2#tab3

 

 

Enrique Espinel
Senior Technical Support IBM, Lenovo, VMware vSphere and Veeam Backup.
VMware VSP-SV, VTSP-SV, VTSP-HCI, VTSP 5
Please mark my comment as Correct Answer or assign Kudos if my answer was helpful to you, Thank you.
Пожалуйста, отметьте мой комментарий как Правильный ответ или поставьте Кудо, если мой ответ был вам полезен, Спасибо.
Sean_c6
Contributor
Contributor

https://imgur.com/a/HSnexp8

Let me know if you cannot read them. 

 

HPE just asked us to put this Firmware on that was released 3 days ago: https://support.hpe.com/hpesc/public/swd/detail?swItemId=MTX_4f19da2bceff4b73a31531d71e#tab1 that is now done, but did not help . 

 

 

 

 

 

0 Kudos
e_espinel
Virtuoso
Virtuoso

Hello
As sent you have the latest firmware and driver installed
Firmware version: bc 1.46 ncsi 1.5.27
Driver 4.1.5.0
At this point, there is nothing left but to try with the previous driver version
ntg3 version 4.1.3.2-1vmw

 

Enrique Espinel
Senior Technical Support IBM, Lenovo, VMware vSphere and Veeam Backup.
VMware VSP-SV, VTSP-SV, VTSP-HCI, VTSP 5
Please mark my comment as Correct Answer or assign Kudos if my answer was helpful to you, Thank you.
Пожалуйста, отметьте мой комментарий как Правильный ответ или поставьте Кудо, если мой ответ был вам полезен, Спасибо.
0 Kudos
Sean_c6
Contributor
Contributor

Honestly I am not sure how we do that, do we just run the older VIB?

0 Kudos
e_espinel
Virtuoso
Virtuoso

Hello.
you can get the indicated version of the driver
in the offline Bundle
VMware-ESXi-6.7.0-Update2-13006603-HPE-Gen9plus-670.U2.10.4.1.8-Apr2019-depot.zip
ntg3--4.1.3.2-1vmw.670.1.28.10302608--VMW--VMwareCertified--2019-04-02

https://customerconnect.vmware.com/downloads/details?downloadGroup=OEM-ESXI67U2-HPE&productId=742

Downgrading device drivers in VMware ESXi

https://kb.vmware.com/s/article/2079279

 

 

 

Enrique Espinel
Senior Technical Support IBM, Lenovo, VMware vSphere and Veeam Backup.
VMware VSP-SV, VTSP-SV, VTSP-HCI, VTSP 5
Please mark my comment as Correct Answer or assign Kudos if my answer was helpful to you, Thank you.
Пожалуйста, отметьте мой комментарий как Правильный ответ или поставьте Кудо, если мой ответ был вам полезен, Спасибо.
Sean_c6
Contributor
Contributor

I am remote to this sytem as it is in a colocation, pretty sure I will lose connectivity to the device doing this, lol. Let me see if I can do this through iLO. 

0 Kudos
Sean_c6
Contributor
Contributor

okay downloaded the offline bundle, found the ntg3 folder, it contains VIB: VMW_bootbank_ntg3_4.1.3.2-1vmw.670.1.28.10302608.vib

I will follow the instructions provided to uninstall the module, I believe I can use HP's iLo console to maintain access to the host even though no where close to being near me. 

0 Kudos