How do I enable my 10GBE ports for use (Need to create new VMKernel) they are not listed in list of adapters.

[hec1979]

I have an ESX server  running.

~ # vmware -l

VMware ESXi 5.0.0 Update 1

When I run lspci I get the following output.

000:002:00.0 Network controller: Intel Corporation I350 Gigabit Network Connection [vmnic0]

000:002:00.1 Network controller: Intel Corporation I350 Gigabit Network Connection [vmnic1]

000:004:00.0 Network controller: Intel Corporation 82599EB 10 Gigabit Network Connection [vmnic2]

000:004:00.1 Network controller: Intel Corporation 82599EB 10 Gigabit Network Connection [vmnic3]

However when I list my NICs i get the following

~ # esxcli network nic list

Name    PCI Device     Driver  Link  Speed  Duplex  MAC Address         MTU  Description

------  -------------  ------  ----  -----  ------  -----------------  ----  -------------------------------------------------

vmnic0  0000:002:00.0  igb     Up     1000  Full    00:25:90:58:5c:3c  1500  Intel Corporation I350 Gigabit Network Connection

vmnic1  0000:002:00.1  igb     Up     1000  Full    00:25:90:58:5c:3d  1500  Intel Corporation I350 Gigabit Network Connection

My 10GBE don't show I cannot create a VMkernel the system does have t he ixgbe driver loaded,  Am I missing anything I didnt really find anything in regards to this besides making sure the driver was loaded and that the NIC is compatible.

[john23]

from vi-client, can you see the nic while creating virtual switch??

"esxcfg-module -l" output and esxcfg-nics -l output, can you share it.

-A

[hec1979]

Hello John,

Thanks for your help, see my outputs below.

~ # esxcfg-module -l

Name                     Used Size (kb)

vmkernel                 76   8515

procfs                   2    16

vmkplexer                1    24

vmklinux_9               21   536

vmklinux_9_2_0_0         17   48

random                   1    32

usb                      3    128

ehci-hcd                 0    44

hid                      0    24

dm                       2    12

nmp                      13   144

vmw_satp_local           3    12

vmw_satp_default_aa      0    8

vmw_psp_lib              6    12

vmw_psp_fixed            4    12

vmw_psp_rr               0    16

vmw_psp_mru              0    12

libata                   1    140

usb-storage              0    72

vfat                     1    48

vprobe                   0    396

vmci                     0    152

iscsi_trans              4    52

etherswitch              4    208

netsched                 3    40

cnic_register            0    12

igb                      0    112

ixgbe                    0    180

iscsi_linux              0    16

libfc                    1    112

libfcoe                  0    28

ahci                     6    28

rste                     0    372

megaraid_sas             1    80

lvmdriver                0    100

deltadisk                0    128

multiextent              0    12

heartbeat                0    124

shaper                   0    40

cdp                      7    140

ipfix                    0    120

fence_overlay            0    40

tcpip3                   4    816

dvsdev                   0    16

dvfilter                 2    80

esxfw                    1    136

vmkibft                  0    28

iscsi_vmk                2    204

vmfs3                    0    316

nfsclient                0    128

ipmi_msghandler          2    40

ipmi_si_drv              0    44

ipmi_devintf             1    16

vmkstatelogger           0    132

migrate                  2    320

cbt                      0    12

svmmirror                0    20

hbr_filter               1    136

vmkapei                  Not Loaded

~ #

~ # esxcfg-nics -l

Name    PCI           Driver      Link Speed     Duplex MAC Address       MTU    Description

vmnic0  0000:02:00.00 igb         Up   1000Mbps  Full   00:25:90:58:5c:3c 1500   Intel Corporation I350 Gigabit Network Connection

vmnic1  0000:02:00.01 igb         Up   1000Mbps  Full   00:25:90:58:5c:3d 1500   Intel Corporation I350 Gigabit Network Connection

[john23]

can you check this KB:VMware KB: Intel 82598EB 10 Gigabit AF DA Dual Port does not work in ESX/ESXi

are you observing the same error message??

-A

[admin]

Hello,

I recently encountered this problem.,  lspci shows up the card, which means the hardware is seen.

To fix the problem,

I had to upgrade the firmware on the 10 Gig Cards and downloaded the recommended drivers from VMware site. That did the trick.

Thanks,

Avinash

[hec1979]

I still see the same issue it does not show the 10GB cards.

[hec1979]

Avinash,

How did you go about updating the firmware for your 10GBE?  What model did you have an issue with?   I updated the driver so far and still have the problem.

[hec1979]

Hello All,

I have tried various drivers for ESX 5.0 update 1 even the following below.

ESXi 5.0 U1

ixgbe version 3.19.1

0x61bf0001

async

According to the compatibility site states it comes with the firmware but I still see the following in the log. The devices are not claimed.

2014-02-10T00:22:10.710Z cpu12:4739)module heap vmklnx_ixgbe: creation succeeded. id = 0x41001b920000

2014-02-10T00:22:10.710Z cpu12:4739)<6>Intel(R) 10 Gigabit PCI Express Network Driver - version 3.18.7iov

2014-02-10T00:22:10.710Z cpu12:4739)<6>Copyright (c) 1999-2013 Intel Corporation.

2014-02-10T00:22:10.710Z cpu12:4739)PCI: driver ixgbe is looking for devices

2014-02-10T00:22:10.710Z cpu12:4739)DMA: 524: DMA Engine 'vmklnxpci-0:4:0.0' created.

2014-02-10T00:22:10.710Z cpu12:4739)DMA: 524: DMA Engine 'vmklnxpci-0:4:0.0' created.

2014-02-10T00:22:10.710Z cpu12:4739)DMA: 524: DMA Engine 'vmklnxpci-0:4:0.0' created.

2014-02-10T00:22:10.710Z cpu12:4739)DMA: 569: DMA Engine 'vmklnxpci-0:4:0.0' destroyed.

2014-02-10T00:22:10.710Z cpu12:4739)LinPCI: LinuxPCI_DeviceUnclaimed:147: Device 0000:04:00 unclaimed.

2014-02-10T00:22:10.710Z cpu12:4739)DMA: 524: DMA Engine 'vmklnxpci-0:4:0.1' created.

2014-02-10T00:22:10.710Z cpu12:4739)DMA: 524: DMA Engine 'vmklnxpci-0:4:0.1' created.

2014-02-10T00:22:10.710Z cpu12:4739)DMA: 524: DMA Engine 'vmklnxpci-0:4:0.1' created.

2014-02-10T00:22:10.710Z cpu12:4739)DMA: 569: DMA Engine 'vmklnxpci-0:4:0.1' destroyed.

2014-02-10T00:22:10.710Z cpu12:4739)LinPCI: LinuxPCI_DeviceUnclaimed:147: Device 0000:04:01 unclaimed.

2014-02-10T00:22:10.710Z cpu12:4739)PCI: driver ixgbe claimed 0 device

2014-02-10T00:22:10.710Z cpu12:4739)Mod: 4015: Initialization of ixgbe succeeded with module ID 27.

2014-02-10T00:22:10.710Z cpu12:4739)ixgbe loaded successfully.

[admin · Accepted solution]

Can you check if this option is there in your BIOS " Default Memory Mapped IO above 4 GB option in the BIOS.". If yes please disable it

[hec1979]

Aakash thank you so much!  That was the issue and I can now see my 10GBE nic.

[anthony2005]

I also had the same issue, but in my BIOS (m/b supermicro X9DRH) have not option about disabling MMIO.

Firmware for i82599 controllers there.

[feders]

How can the firmware be upgraded? Can anyone reply with some instructions?

Thanks in advance

[hec1979]

This may point you in the right direction "VMware KB: Installing async drivers on VMware ESXi 5.0, 5.1, and 5.5 " You need to find the correct package now.

[suhag79]

Sory for replying on old post,

i was referring the solution provided as below...

""""Can you check if this option is there in your BIOS " Default Memory Mapped IO above 4 GB option in the BIOS.". If yes please disable it""""

However, in my server IBM x3850 X5, there is an option for MM config base with options as "1GB, 2 GB and 3 GB"...i tried both the lower level setting 1 GB and 2 GB but it did not worked.......could not found any option to completely disable it.....

- Also tried with updating the driver without luck.....any other option you can suggest?

[tciesielski]

Do  cat vmkernel.log  | grep ixgbe

and look for the info regarding driver.

Probably it issue with SFP+

<3>ixgbe 0000:81:00.0: failed to load because an unsupported SFP+ module type was detected