7 Replies Latest reply on Feb 12, 2018 10:28 AM by gdev87

    Intel 82599 10 Gigabit Dual Port Network Adapter missing after ESXi 6.0 to 6.5u1 upgrade

    Azmidiske Lurker

      After upgrading a Cisco UCS server using the Vmware-ESXi-6.5.0-5969303-Custom-Cisco-6.5.1.2.zip image, an Intel 82599 10 Gigabit Dual Port Network Adapter is missing. The 10Gb adapter that is missing happens to be the one that has active ports. The link on the switch is still active and the system sees all (the missing adapter) of the adapters:

      lspci -v | grep -A1 -i ethernet

      0000:02:00.0 Ethernet controller Network controller: Intel Corporation I350 Gigabit Network Connection [vmnic0]

               Class 0200: 8086:1521

      --

      0000:02:00.1 Ethernet controller Network controller: Intel Corporation I350 Gigabit Network Connection [vmnic1]

               Class 0200: 8086:1521

      --

      0000:02:00.2 Ethernet controller Network controller: Intel Corporation I350 Gigabit Network Connection [vmnic2]

               Class 0200: 8086:1521

      --

      0000:02:00.3 Ethernet controller Network controller: Intel Corporation I350 Gigabit Network Connection [vmnic3]

               Class 0200: 8086:1521

      --

      0000:04:00.0 Ethernet controller Network controller: Intel(R) 82599 10 Gigabit Dual Port Network Connection [vmnic4]

               Class 0200: 8086:10fb

      --

      0000:04:00.1 Ethernet controller Network controller: Intel(R) 82599 10 Gigabit Dual Port Network Connection [vmnic5]

               Class 0200: 8086:10fb

      --

      0000:07:00.0 Ethernet controller Network controller: Intel(R) 82599 10 Gigabit Dual Port Network Connection [vmnic6]

               Class 0200: 8086:10fb

      --

      0000:07:00.1 Ethernet controller Network controller: Intel(R) 82599 10 Gigabit Dual Port Network Connection [vmnic7]

               Class 0200: 8086:10fb

      --

      0000:83:00.0 Ethernet controller Network controller: Intel(R) 82599 10 Gigabit Dual Port Network Connection [vmnic10]

               Class 0200: 8086:10fb

      --

      0000:83:00.1 Ethernet controller Network controller: Intel(R) 82599 10 Gigabit Dual Port Network Connection [vmnic11]

               Class 0200: 8086:10fb

      Here are the device contents of /etc/vmware/esx.conf:

      /device/00000:131:00.0/vmkname = "vmnic10"

      /device/00000:002:00.1/vmkname = "vmnic1"

      /device/00000:004:00.0/vmkname = "vmnic4"

      /device/00000:002:00.3/vmkname = "vmnic3"

      /device/00000:007:00.0/vmkname = "vmnic6"

      /device/00000:007:00.1/vmkname = "vmnic7"

      /device/00000:130:00.0/vmkname = "vmhba0"

      /device/00000:002:00.2/vmkname = "vmnic2"

      /device/00000:002:00.0/vmkname = "vmnic0"

      /device/00000:131:00.1/vmkname = "vmnic11"

      /device/00000:004:00.1/vmkname = "vmnic5"

      But ESXi is not registering one of them, previous vmnic4 and 5:

      esxcfg-nics -l

      Name    PCI          Driver      Link Speed      Duplex MAC Address       MTU    Description

      vmnic0  0000:02:00.0 igbn        Up   1000Mbps   Full   50:57:a8:e1:3c:34 1500   Intel Corporation I350 Gigabit Network Connection

      vmnic1  0000:02:00.1 igbn        Down 0Mbps      Half   50:57:a8:e1:3c:35 1500   Intel Corporation I350 Gigabit Network Connection

      vmnic10 0000:83:00.0 ixgbe       Down 0Mbps      Half   90:e2:ba:99:27:1c 1500   Intel(R) 82599 10 Gigabit Dual Port Network Connection

      vmnic11 0000:83:00.1 ixgbe       Down 0Mbps      Half   90:e2:ba:99:27:1d 1500   Intel(R) 82599 10 Gigabit Dual Port Network Connection

      vmnic2  0000:02:00.2 igbn        Down 0Mbps      Half   50:57:a8:e1:3c:36 1500   Intel Corporation I350 Gigabit Network Connection

      vmnic3  0000:02:00.3 igbn        Down 0Mbps      Half   50:57:a8:e1:3c:37 1500   Intel Corporation I350 Gigabit Network Connection

      vmnic6  0000:07:00.0 ixgbe       Down 0Mbps      Half   90:e2:ba:99:95:88 9000   Intel(R) 82599 10 Gigabit Dual Port Network Connection

      vmnic7  0000:07:00.1 ixgbe       Down 0Mbps      Half   90:e2:ba:99:95:89 9000   Intel(R) 82599 10 Gigabit Dual Port Network Connection

      Updating to the latest driver does not seem to help:

      esxcli software vib update -v "/vmfs/volumes/datastore1/net-ixgbe_4.5.3-1OEM.600.0.0.2494585.vib"

       

         VIBs Installed: INT_bootbank_net-ixgbe_4.5.3-1OEM.600.0.0.2494585

         VIBs Removed: INT_bootbank_net-ixgbe_4.4.1-1OEM.600.0.0.2159203

      Also tried this setting this:

      esxcli system settings kernel set --setting="netNetqueueEnabled" --value="FALSE"

      Here are the currently installed drivers when querying for ixgbe:

      esxcli software vib list | grep ixgbe

      net-ixgbe                      4.5.3-1OEM.600.0.0.2494585             INT                 VMwareCertified   2018-01-26

      ixgben                         1.4.1-2vmw.650.1.26.5969303            VMW                 VMwareCertified   2018-01-26

      The driver that worked with version 6.0 was 3.7.13 but I was unable to find/download it for 6.5u1.

      net-ixgbe                      3.7.13.7.14iov-20vmw.600.0.0.2494585  VMware  VMwareCertified   2016-02-11

      Any troubleshooting tips would be appreciated!