VMware Cloud Community
vPatrickS
Enthusiast
Enthusiast

ESXi 5.5 & Mellanox IB Dual Port Card card showing just a sinlge vmnic

Hi guys

I just got two Mellanox cards from eBay to use those as 10GbE adapters.

However there are two things I don't get.

1. One card shows up as expected with two ports / vmnics. OK the namig of one vmnic is a bit off but at least it's working. Also the card shows some regular MAC addresses.

2. The other card pops up with just a single vmnic and a weird MAC (this is probably normal in the IB world?)

esx2.JPGesx3.JPG

esx2 - MT26418

MHGH29-XTC

esx3 - MT25418

MHGH28-XTC

~ # esxcli network nic list

Name          PCI Device     Driver   Link  Speed  Duplex  MAC Address         MTU  Description

------------  -------------  -------  ----  -----  ------  -----------------  ----  --------------------------------------------------------------------------------

vmnic0        0000:001:00.0  bnx2     Up     1000  Full    00:24:e8:74:fb:07  1500  Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T

vmnic1        0000:001:00.1  bnx2     Up     1000  Full    00:24:e8:74:fb:09  1500  Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T

vmnic1000402  0000:006:00.0  mlx4_en  Up    10000  Full    00:02:c9:25:85:8a  1500  Mellanox Technologies MT25418 [ConnectX VPI - 10GigE / IB DDR, PCIe 2.0 2.5GT/s]

vmnic2        0000:002:00.0  bnx2     Up     1000  Full    00:24:e8:74:fb:0b  1500  Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T

vmnic3        0000:002:00.1  bnx2     Up     1000  Full    00:24:e8:74:fb:0d  1500  Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T

vmnic4        0000:006:00.0  mlx4_en  Down      0  Half    00:02:c9:25:85:89  1500  Mellanox Technologies MT25418 [ConnectX VPI - 10GigE / IB DDR, PCIe 2.0 2.5GT/s]

~ # esxcli network nic list

Name    PCI Device     Driver   Link  Speed  Duplex  MAC Address         MTU  Description

------  -------------  -------  ----  -----  ------  -----------------  ----  ------------------------------------------------------------------------------

vmnic0  0000:001:00.0  bnx2     Up     1000  Full    84:2b:2b:07:b7:d4  1500  Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T

vmnic1  0000:001:00.1  bnx2     Up     1000  Full    84:2b:2b:07:b7:d6  1500  Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T

vmnic2  0000:002:00.0  bnx2     Up     1000  Full    84:2b:2b:07:b7:d8  1500  Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T

vmnic3  0000:002:00.1  bnx2     Up     1000  Full    84:2b:2b:07:b7:da  1500  Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T

vmnic4  0000:006:00.0  mlx4_en  Up    10000  Full    00:00:00:00:00:01  1500  Mellanox Technologies MT26418 [ConnectX VPI - 10GigE / IB DDR, PCIe 2.0 5GT/s]

~ # esxcli software vib list | grep Mellanox

mft                            3.8.0.56-0                            Mellanox    PartnerSupported  2015-01-21

net-ib-addr                    1.9.10.0-1OEM.550.0.0.1331820         Mellanox    PartnerSupported  2015-01-21

net-ib-cm                      1.9.10.0-1OEM.550.0.0.1331820         Mellanox    PartnerSupported  2015-01-21

net-ib-core                    1.9.10.0-1OEM.550.0.0.1331820         Mellanox    PartnerSupported  2015-01-21

net-ib-mad                     1.9.10.0-1OEM.550.0.0.1331820         Mellanox    PartnerSupported  2015-01-21

net-ib-sa                      1.9.10.0-1OEM.550.0.0.1331820         Mellanox    PartnerSupported  2015-01-21

net-ib-umad                    1.9.10.0-1OEM.550.0.0.1331820         Mellanox    PartnerSupported  2015-01-21

net-mlx4-core                  1.9.10.0-1OEM.550.0.0.1331820         Mellanox    PartnerSupported  2015-01-21

net-mlx4-en                    1.9.10.0-1OEM.550.0.0.1331820         Mellanox    PartnerSupported  2015-01-21

net-mlx4-ib                    1.9.10.0-1OEM.550.0.0.1331820         Mellanox    PartnerSupported  2015-01-21

net-rdma-cm                    1.9.10.0-1OEM.550.0.0.1331820         Mellanox    PartnerSupported  2015-01-21

scsi-ib-iser                   1.9.10.0-1OEM.550.0.0.1331820         Mellanox    PartnerSupported  2015-01-21

However I would like to find out why one card only shows up with a single port, any ideas? I have seen some similar screenshots floating around but no fix.

Some tips would be really appreciated!

Patrick

0 Kudos
2 Replies
drspecvirt
Contributor
Contributor

Hi Patrick,

Were you able to find a resolution on this?  I am seeing the same issue using ESXi 5.1 U2.

Thanks,

Darren

0 Kudos
mbdean
Contributor
Contributor

drspecvirtvPatrickS
TLDR: VMware detects some network cards as one PCI-E address with multiple physical nics.

It then uses an algorithm to generate a vmnic alias for the other ports on the card, its a non-issue overall.

1000000 + (pciIndex*100) + p#

I have a connectx-3 dual port card that does the same thing in 6.0 U2.

Heres the VMware article on it with instructions how to change the alias under "Changing the names assigned by the ESXi host":

VMware Knowledge Base

0 Kudos