VMware Cloud Community
dplus
Contributor
Contributor

Esxi 5 update 1/HP DL380g6 with bnx2 driver doesn't load all network ports

Hi,


I have a HP DL360 G6 with 4 physical Broadcom NetXtreme II BCM5709 1000Base-T network interfaces.

But Esxi v5.0.0 U1 build 623860 only gives me 2 ports:

~ # esxcli network nic list        
Name    PCI Device     Driver  Link  Speed  Duplex  MAC Address         MTU  Description                                                 
------  -------------  ------  ----  -----  ------  -----------------  ----  -------------------------------------------------------------
vmnic2  0000:003:00.0  bnx2    Down      0  Half    98:4b:e1:07:27:ba  1500  Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T
vmnic3  0000:003:00.1  bnx2    Up      100  Full    98:4b:e1:07:27:bc  1500  Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T

But there are 4 available:

~ # lspci
000:000:00.0 Bridge: Intel Corporation 5520 I/O Hub to ESI Port [PCIe RP[000:000:00.0]]
000:000:01.0 Bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 1 [PCIe RP[000:000:01.0]]
000:000:02.0 Bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 2 [PCIe RP[000:000:02.0]]
000:000:03.0 Bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 3 [PCIe RP[000:000:03.0]]
000:000:04.0 Bridge: Intel Corporation 5520/X58 I/O Hub PCI Express Root Port 4 [PCIe RP[000:000:04.0]]
000:000:05.0 Bridge: Intel Corporation 5520/X58 I/O Hub PCI Express Root Port 5 [PCIe RP[000:000:05.0]]
000:000:06.0 Bridge: Intel Corporation 5520/X58 I/O Hub PCI Express Root Port 6 [PCIe RP[000:000:06.0]]
000:000:07.0 Bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 7 [PCIe RP[000:000:07.0]]
000:000:08.0 Bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 8 [PCIe RP[000:000:08.0]]
000:000:09.0 Bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 9 [PCIe RP[000:000:09.0]]
000:000:10.0 Bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 10 [PCIe RP[000:000:10.0]]
000:000:13.0 Bridge: Intel Corporation 
000:000:13.1 Bridge: Intel Corporation 
000:000:13.2 Bridge: Intel Corporation 
000:000:13.3 Bridge: Intel Corporation 
000:000:13.4 Bridge: Intel Corporation 5520/5500/X58 Physical Layer Port 0
000:000:13.5 Bridge: Intel Corporation 5520/5500 Physical Layer Port 1
000:000:13.6 Bridge: Intel Corporation 
000:000:14.0 Bridge: Intel Corporation 
000:000:14.1 Bridge: Intel Corporation 
000:000:14.2 Bridge: Intel Corporation 
000:000:14.3 Bridge: Intel Corporation 
000:000:14.4 Bridge: Intel Corporation 
000:000:20.0 Generic system peripheral: Intel Corporation 5520/5500/X58 I/O Hub System Management Registers
000:000:20.1 Generic system peripheral: Intel Corporation 5520/5500/X58 I/O Hub GPIO and Scratch Pad Registers
000:000:20.2 Generic system peripheral: Intel Corporation 5520/5500/X58 I/O Hub Control Status and RAS Registers
000:000:28.0 Bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 1 [PCIe RP[000:000:28.0]]
000:000:28.2 Bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 3 [PCIe RP[000:000:28.2]]
000:000:29.0 Serial bus controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #1
000:000:29.1 Serial bus controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #2
000:000:29.2 Serial bus controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #3
000:000:29.3 Serial bus controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #6
000:000:29.7 Serial bus controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #1
000:000:30.0 Bridge: Intel Corporation 82801 PCI Bridge
000:000:31.0 Bridge: Intel Corporation 82801JIB (ICH10) LPC Interface Controller
000:000:31.2 Mass storage controller: Intel Corporation ICH10 4 port SATA IDE Controller [vmhba0]
000:001:03.0 Display controller: ATI Technologies Inc ES1000
000:001:04.0 Generic system peripheral: Compaq Computer Corporation Integrated Lights Out Controller
000:001:04.2 Generic system peripheral: Compaq Computer Corporation Integrated Lights Out  Processor
000:001:04.4 Serial bus controller: Hewlett-Packard Company Proliant iLO2/iLO3 virtual USB controller
000:001:04.6 Serial bus controller: Hewlett-Packard Company Proliant iLO2 virtual UART
000:002:00.0 Network controller: Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T [vmnic0]
000:002:00.1 Network controller: Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T [vmnic1]
000:003:00.0 Network controller: Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T [vmnic2]
000:003:00.1 Network controller: Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T [vmnic3]
000:004:00.0 Mass storage controller: Hewlett-Packard Company Smart Array P410i [vmhba1]

As you can see, the BNX2 driver is loaded, but only for 2 nics:

~ # lspci -p
Seg:Bus:Sl.F Vend:Dvid Subv:Subd ISA/irq/Vec P M Module       Name   
                                Spawned bus                         
000:000:00.0 8086:3406 103c:330b               V              PCIe RP[000:000:00.0]
000:000:01.0 8086:3408 0000:0000               V              PCIe RP[000:000:01.0]
                                 004     
000:000:02.0 8086:3409 0000:0000               V              PCIe RP[000:000:02.0]
                                 005     
000:000:03.0 8086:340a 0000:0000               V              PCIe RP[000:000:03.0]
                                 016     
000:000:04.0 8086:340b 0000:0000               V              PCIe RP[000:000:04.0]
                                 019     
000:000:05.0 8086:340c 0000:0000               V              PCIe RP[000:000:05.0]
                                 020     
000:000:06.0 8086:340d 0000:0000               V              PCIe RP[000:000:06.0]
                                 023     
000:000:07.0 8086:340e 0000:0000               V              PCIe RP[000:000:07.0]
                                 013     
000:000:08.0 8086:340f 0000:0000               V              PCIe RP[000:000:08.0]
                                 010     
000:000:09.0 8086:3410 0000:0000               V              PCIe RP[000:000:09.0]
                                 007     
000:000:10.0 8086:3411 0000:0000               V              PCIe RP[000:000:10.0]
                                 006     
000:000:13.0 8086:343a 0000:0000               V             
000:000:13.1 8086:343b 0000:0000               V             
000:000:13.2 8086:343c 0000:0000               V             
000:000:13.3 8086:343d 0000:0000               V             
000:000:13.4 8086:3418 0000:0000               V             
000:000:13.5 8086:3419 0000:0000               V             
000:000:13.6 8086:341a 0000:0000               V             
000:000:14.0 8086:341c 0000:0000               V             
000:000:14.1 8086:341d 0000:0000               V             
000:000:14.2 8086:341e 0000:0000               V             
000:000:14.3 8086:341f 0000:0000               V             
000:000:14.4 8086:3439 0000:0000               V             
000:000:20.0 8086:342e 003c:000b               V             
000:000:20.1 8086:3422 003c:000b               V             
000:000:20.2 8086:3423 003c:000b               V             
000:000:28.0 8086:3a40 0000:0000 255/   /0x98 A V              PCIe RP[000:000:28.0]
                                 002     
000:000:28.2 8086:3a44 0000:0000 255/   /0x98 C V              PCIe RP[000:000:28.2]
                                 003     
000:000:29.0 8086:3a34 103c:330d  5/  5/0xb8 A V usb-uhci    
000:000:29.1 8086:3a35 103c:330d  7/  7/0xc0 B V usb-uhci    
000:000:29.2 8086:3a36 103c:330d 10/ 10/0xc8 C V usb-uhci    
000:000:29.3 8086:3a39 103c:330d  7/  7/0xc0 D V usb-uhci    
000:000:29.7 8086:3a3a 103c:330d  5/  5/0xb8 A V ehci-hcd    
000:000:30.0 8086:244e 0000:0000               V             
                                 001     
000:000:31.0 8086:3a18 0000:0000               V             
000:000:31.2 8086:3a20 103c:330d 11/ 11/0xa0 B V ata_piix     vmhba0
000:001:03.0 1002:515e 103c:31fb  7/  7/0xc0 A V             
000:001:04.0 0e11:b203 103c:3305 10/ 10/0xd0 A V             
000:001:04.2 0e11:b204 103c:3305 10/ 10/0xc8 B V             
000:001:04.4 103c:3300 103c:3305 10/ 10/0xc8 B V usb-uhci    
000:001:04.6 103c:3302 103c:3305 10/ 10/0xd0 A V ipmi_si_drv 
000:002:00.0 14e4:1639 14e4:1639  7/  7/0x98 A V              vmnic0
000:002:00.1 14e4:1639 14e4:1639 11/ 11/0xa0 B V              vmnic1
000:003:00.0 14e4:1639 103c:7055  5/  5/0xa8 A V bnx2         vmnic2
000:003:00.1 14e4:1639 103c:7055 10/ 10/0xb0 B V bnx2         vmnic3
000:004:00.0 103c:323a 103c:3245  7/  7/0x88 A V hpsa         vmhba1

How can I make all 4 ports available?

Tags (1)
11 Replies
VirtuallyMikeB

Good morning,

Could they be disabled in the BIOS?

Cheers,

Mike

----------------------------------------- Please consider marking this answer "correct" or "helpful" if you found it useful (you'll get points too). Mike Brown VMware, Cisco Data Center, and NetApp dude Sr. Systems Engineer michael.b.brown3@gmail.com Twitter: @VirtuallyMikeB Blog: http://VirtuallyMikeBrown.com LinkedIn: http://LinkedIn.com/in/michaelbbrown
Reply
0 Kudos
dplus
Contributor
Contributor

No, they are all enabled in the BIOS.

If I install another OS, like WIndows Server, I can see them all.

This problem only occurs with ESXi.

Reply
0 Kudos
VirtuallyMikeB

Since the driver's are loaded and the server and NICs are supported, it should recognize the NICs.  You'll want to investigate why the NICs aren't being claimed or if there are other errors.  Check the log

/var/log/messages

and search for /vmnic or the driver name.

Cheers,

Mike

http://VirtuallyMikeBrown.com

https://twitter.com/#!/VirtuallyMikeB

http://LinkedIn.com/in/michaelbbrown

----------------------------------------- Please consider marking this answer "correct" or "helpful" if you found it useful (you'll get points too). Mike Brown VMware, Cisco Data Center, and NetApp dude Sr. Systems Engineer michael.b.brown3@gmail.com Twitter: @VirtuallyMikeB Blog: http://VirtuallyMikeBrown.com LinkedIn: http://LinkedIn.com/in/michaelbbrown
Reply
0 Kudos
iw123
Commander
Commander

Are you using the HP customised build of ESXi ?

*Please, don't forget the awarding points for "helpful" and/or "correct" answers
Reply
0 Kudos
dplus
Contributor
Contributor

No, but I have also tried installing the HP Bundle for ESXi 5:

http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=15...

but that did not solve the issue either.

I am now installing ESXi v5 (not Update 1) just to see what will happen then, so I have no access to my previous logs anymore.

Reply
0 Kudos
dplus
Contributor
Contributor

Well, in ESXi v5 (first version) the remaining 2 network ports weren't available either.

I have now installed ESXi v5 update 1 again, and when I look in vmkernel.log I see these lines, where I wonder if this could be the problem:

"2012-08-03T16:15:09.382Z cpu3:2627)<3>bnx2 0000:02:00.0: Firmware not running, aborting"

What is meant by Firmware not running? Because today I ran the Smart Update Firmware DVD v10.10....

2012-08-03T16:15:09.211Z cpu3:2627)PCI: 3938: 000:000:31.2 named 'vmhba0' (was '')
2012-08-03T16:15:09.295Z cpu3:2627)PCI: 3938: 000:002:00.0 named 'vmnic0' (was '')
2012-08-03T16:15:09.310Z cpu3:2627)PCI: 3938: 000:002:00.1 named 'vmnic1' (was '')
2012-08-03T16:15:09.325Z cpu3:2627)PCI: 3938: 000:003:00.0 named 'vmnic2' (was '')
2012-08-03T16:15:09.339Z cpu3:2627)PCI: 3938: 000:003:00.1 named 'vmnic3' (was '')
2012-08-03T16:15:09.354Z cpu3:2627)PCI: 3938: 000:004:00.0 named 'vmhba1' (was '')
2012-08-03T16:15:09.378Z cpu3:2627)Loading module bnx2 ...
2012-08-03T16:15:09.379Z cpu3:2627)Elf: 1862: module bnx2 has license GPL
2012-08-03T16:15:09.382Z cpu3:2627)module heap: Initial heap size: 4194304, max heap size: 68476928
2012-08-03T16:15:09.382Z cpu3:2627)vmklnx_module_mempool_init: Mempool max 68476928 being used for module: 27

2012-08-03T16:15:09.382Z cpu3:2627)vmk_MemPoolCreate passed for 1024 pages

2012-08-03T16:15:09.382Z cpu3:2627)skb_mem_info mempool for module bnx2 created - max size 37748736
2012-08-03T16:15:09.382Z cpu3:2627)module heap: using memType 0
2012-08-03T16:15:09.382Z cpu3:2627)module heap vmklnx_bnx2: creation succeeded. id = 0x41000a800000
2012-08-03T16:15:09.382Z cpu3:2627)PCI: driver bnx2 is looking for devices
<6>Broadcom NetXtreme II Gigabit Ethernet Driver bnx2 v2.1.12b.v50.3 (Oct 28, 2011)
2012-08-03T16:15:09.382Z cpu3:2627)VMK_PCI: 790: device 000:002:00.0 capType 1 capIndex 72
2012-08-03T16:15:09.382Z cpu3:2627)VMK_PCI: 790: device 000:002:00.0 capType 16 capIndex 172
2012-08-03T16:15:09.382Z cpu3:2627)VMK_PCI: 790: device 000:002:00.0 capType 17 capIndex 160
2012-08-03T16:15:09.382Z cpu3:2627)VMK_PCI: 790: device 000:002:00.0 capType 5 capIndex 88
2012-08-03T16:15:09.382Z cpu3:2627)DMA: 524: DMA Engine 'vmklnxpci-0:2:0.0' created.
2012-08-03T16:15:09.382Z cpu3:2627)DMA: 524: DMA Engine 'vmklnxpci-0:2:0.0' created.
2012-08-03T16:15:09.382Z cpu3:2627)DMA: 524: DMA Engine 'vmklnxpci-0:2:0.0' created.
2012-08-03T16:15:09.382Z cpu3:2627)DMA: 569: DMA Engine 'vmklnxpci-0:2:0.0' destroyed.
2012-08-03T16:15:09.382Z cpu3:2627)<3>bnx2 0000:02:00.0: Firmware not running, aborting
2012-08-03T16:15:09.382Z cpu3:2627)LinPCI: LinuxPCI_DeviceUnclaimed:147: Device 0000:02:00 unclaimed.
2012-08-03T16:15:09.382Z cpu3:2627)VMK_PCI: 790: device 000:002:00.1 capType 1 capIndex 72
2012-08-03T16:15:09.382Z cpu3:2627)VMK_PCI: 790: device 000:002:00.1 capType 16 capIndex 172
2012-08-03T16:15:09.382Z cpu3:2627)VMK_PCI: 790: device 000:002:00.1 capType 17 capIndex 160
2012-08-03T16:15:09.382Z cpu3:2627)VMK_PCI: 790: device 000:002:00.1 capType 5 capIndex 88
2012-08-03T16:15:09.382Z cpu3:2627)DMA: 524: DMA Engine 'vmklnxpci-0:2:0.1' created.
2012-08-03T16:15:09.382Z cpu3:2627)DMA: 524: DMA Engine 'vmklnxpci-0:2:0.1' created.
2012-08-03T16:15:09.382Z cpu3:2627)DMA: 524: DMA Engine 'vmklnxpci-0:2:0.1' created.
2012-08-03T16:15:09.382Z cpu3:2627)DMA: 569: DMA Engine 'vmklnxpci-0:2:0.1' destroyed.
2012-08-03T16:15:09.382Z cpu3:2627)<3>bnx2 0000:02:00.1: Firmware not running, aborting
2012-08-03T16:15:09.382Z cpu3:2627)LinPCI: LinuxPCI_DeviceUnclaimed:147: Device 0000:02:01 unclaimed.
2012-08-03T16:15:09.382Z cpu3:2627)VMK_PCI: 790: device 000:003:00.0 capType 1 capIndex 72
2012-08-03T16:15:09.382Z cpu3:2627)VMK_PCI: 790: device 000:003:00.0 capType 16 capIndex 172
2012-08-03T16:15:09.382Z cpu3:2627)VMK_PCI: 790: device 000:003:00.0 capType 17 capIndex 160
2012-08-03T16:15:09.382Z cpu3:2627)VMK_PCI: 790: device 000:003:00.0 capType 5 capIndex 88
2012-08-03T16:15:09.382Z cpu3:2627)DMA: 524: DMA Engine 'vmklnxpci-0:3:0.0' created.
2012-08-03T16:15:09.382Z cpu3:2627)DMA: 524: DMA Engine 'vmklnxpci-0:3:0.0' created.
2012-08-03T16:15:09.382Z cpu3:2627)DMA: 524: DMA Engine 'vmklnxpci-0:3:0.0' created.
2012-08-03T16:15:09.382Z cpu3:2627)DMA: 569: DMA Engine 'vmklnxpci-0:3:0.0' destroyed.
2012-08-03T16:15:09.382Z cpu3:2627)IntrVector: 283: 0xd8
2012-08-03T16:15:09.382Z cpu3:2627)IntrVector: 283: 0x21
2012-08-03T16:15:09.382Z cpu3:2627)IntrVector: 283: 0x29
2012-08-03T16:15:09.382Z cpu3:2627)IntrVector: 283: 0x31
2012-08-03T16:15:09.382Z cpu3:2627)IntrVector: 283: 0x39
2012-08-03T16:15:09.382Z cpu3:2627)IntrVector: 283: 0x41
2012-08-03T16:15:09.382Z cpu3:2627)VMK_PCI: 1177: device 000:003:00.0 allocated 6 vectors (intrType 3)
2012-08-03T16:15:09.382Z cpu3:2627)MSIX enabled for dev 0000:03:00.0
2012-08-03T16:15:09.382Z cpu3:2627)<6>bnx2 0000:03:00.0: vmnic0: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f8000000, IRQ 168, node addr 98:4b:e1:07:27:ba
2012-08-03T16:15:09.382Z cpu3:2627)<6>bnx2 0000:03:00.0: vmnic0: NetQueue Ops registered [0]
2012-08-03T16:15:09.382Z cpu3:2627)PCI: Registering network device 0000:03:00.0
2012-08-03T16:15:09.382Z cpu3:2627)VMK_PCI: 684: Device 000:003:00.0 name: vmnic2
2012-08-03T16:15:09.382Z cpu3:2627)Uplink: 5262: Device vmnic2 not yet opened
2012-08-03T16:15:09.382Z cpu3:2627)PCI: driver bnx2 claimed device 0000:03:00.0
2012-08-03T16:15:09.383Z cpu3:2627)VMK_PCI: 790: device 000:003:00.1 capType 1 capIndex 72
2012-08-03T16:15:09.383Z cpu3:2627)VMK_PCI: 790: device 000:003:00.1 capType 16 capIndex 172
2012-08-03T16:15:09.383Z cpu3:2627)VMK_PCI: 790: device 000:003:00.1 capType 17 capIndex 160
2012-08-03T16:15:09.383Z cpu3:2627)VMK_PCI: 790: device 000:003:00.1 capType 5 capIndex 88
2012-08-03T16:15:09.383Z cpu3:2627)DMA: 524: DMA Engine 'vmklnxpci-0:3:0.1' created.
2012-08-03T16:15:09.383Z cpu3:2627)DMA: 524: DMA Engine 'vmklnxpci-0:3:0.1' created.
2012-08-03T16:15:09.383Z cpu3:2627)DMA: 524: DMA Engine 'vmklnxpci-0:3:0.1' created.
2012-08-03T16:15:09.383Z cpu3:2627)DMA: 569: DMA Engine 'vmklnxpci-0:3:0.1' destroyed.
2012-08-03T16:15:09.383Z cpu3:2627)IntrVector: 283: 0x49
2012-08-03T16:15:09.383Z cpu3:2627)IntrVector: 283: 0x51
2012-08-03T16:15:09.383Z cpu3:2627)IntrVector: 283: 0x59
2012-08-03T16:15:09.383Z cpu3:2627)IntrVector: 283: 0x61
2012-08-03T16:15:09.383Z cpu3:2627)IntrVector: 283: 0x69
2012-08-03T16:15:09.383Z cpu3:2627)IntrVector: 283: 0x71
2012-08-03T16:15:09.383Z cpu3:2627)VMK_PCI: 1177: device 000:003:00.1 allocated 6 vectors (intrType 3)
2012-08-03T16:15:09.383Z cpu3:2627)MSIX enabled for dev 0000:03:00.1
2012-08-03T16:15:09.383Z cpu3:2627)<6>bnx2 0000:03:00.1: vmnic0: Broadcom NetXtreme II BCM5709 1000Base-T (C0) PCI Express found at mem f6000000, IRQ 176, node addr 98:4b:e1:07:27:bc
2012-08-03T16:15:09.383Z cpu3:2627)<6>bnx2 0000:03:00.1: vmnic0: NetQueue Ops registered [1]
2012-08-03T16:15:09.383Z cpu3:2627)PCI: Registering network device 0000:03:00.1
2012-08-03T16:15:09.383Z cpu3:2627)VMK_PCI: 684: Device 000:003:00.1 name: vmnic3
2012-08-03T16:15:09.383Z cpu3:2627)Uplink: 5262: Device vmnic3 not yet opened
2012-08-03T16:15:09.383Z cpu3:2627)PCI: driver bnx2 claimed device 0000:03:00.1
2012-08-03T16:15:09.383Z cpu3:2627)PCI: driver bnx2 claimed 2 devices
2012-08-03T16:15:09.383Z cpu3:2627)Uplink: 6912: Opening device vmnic2
2012-08-03T16:15:09.383Z cpu7:2083)DMA: 524: DMA Engine 'vmnic2' created.
2012-08-03T16:15:09.383Z cpu7:2083)IDT: 991: 0xd8 <vmnic2-0> exclusive (entropy source), flags 0x10
2012-08-03T16:15:09.383Z cpu7:2083)VMK_VECTOR: 137: Added handler for  vector 216, flags 0x10
2012-08-03T16:15:09.383Z cpu7:2083)IDT: 991: 0x21 <vmnic2-1> exclusive (entropy source), flags 0x10
2012-08-03T16:15:09.383Z cpu7:2083)VMK_VECTOR: 137: Added handler for  vector 33, flags 0x10
2012-08-03T16:15:09.383Z cpu7:2083)IDT: 991: 0x29 <vmnic2-2> exclusive (entropy source), flags 0x10
2012-08-03T16:15:09.383Z cpu7:2083)VMK_VECTOR: 137: Added handler for  vector 41, flags 0x10
2012-08-03T16:15:09.383Z cpu7:2083)IDT: 991: 0x31 <vmnic2-3> exclusive (entropy source), flags 0x10
2012-08-03T16:15:09.383Z cpu7:2083)VMK_VECTOR: 137: Added handler for  vector 49, flags 0x10
2012-08-03T16:15:09.383Z cpu7:2083)IDT: 991: 0x39 <vmnic2-4> exclusive (entropy source), flags 0x10
2012-08-03T16:15:09.383Z cpu7:2083)VMK_VECTOR: 137: Added handler for  vector 57, flags 0x10
<6>bnx2 0000:03:00.0: vmnic2: CPU fw versions: TXP: 'txp6.2.1b' TPAT: 'tpa6.2.1b' RXP: 'rxp6.2.1b' COM: 'com6.2.1b' CP: 'cp6.2.1b'
2012-08-03T16:15:09.485Z cpu7:2083)<6>bnx2 0000:03:00.0: vmnic2: using MSIX
2012-08-03T16:15:09.485Z cpu7:2083)<6>bnx2 0000:03:00.0: vmnic2: NetQueue hardware support is enabled
2012-08-03T16:15:09.485Z cpu7:2627)<6>bnx2 0000:03:00.0: vmnic2: Using 4 RX NetQ rings
2012-08-03T16:15:09.485Z cpu7:2627)<4>bnx2 0000:03:00.0: vmnic2: Unhandled NETQUEUE OP 16
2012-08-03T16:15:09.485Z cpu7:2627)<4>bnx2 0000:03:00.0: vmnic2: Unhandled NETQUEUE OP 17
2012-08-03T16:15:09.485Z cpu7:2627)<6>bnx2 0000:03:00.0: vmnic2: Using 4 TX NetQ rings
2012-08-03T16:15:09.485Z cpu7:2627)Uplink: 5280: enabled port 0x2 with mac 98:4b:e1:07:27:ba
2012-08-03T16:15:09.747Z cpu4:2083)<6>bnx2 0000:03:00.0: vmnic2: flushed default TX queue
2012-08-03T16:15:09.747Z cpu4:2083)<6>bnx2 0000:03:00.0: vmnic2: flushed TX queue 1
2012-08-03T16:15:09.748Z cpu4:2083)<6>bnx2 0000:03:00.0: vmnic2: flushed TX queue 2
2012-08-03T16:15:09.748Z cpu4:2083)<6>bnx2 0000:03:00.0: vmnic2: flushed TX queue 3
2012-08-03T16:15:09.748Z cpu4:2083)<6>bnx2 0000:03:00.0: vmnic2: flushed TX queue 4
2012-08-03T16:15:09.748Z cpu4:2083)<6>bnx2 0000:03:00.0: vmnic2: TX NetQ allocated on 1
2012-08-03T16:15:09.748Z cpu4:2083)<6>bnx2 0000:03:00.0: vmnic2: TX NetQ allocated on 2
2012-08-03T16:15:09.748Z cpu4:2083)<6>bnx2 0000:03:00.0: vmnic2: TX NetQ allocated on 3
2012-08-03T16:15:09.748Z cpu4:2083)<6>bnx2 0000:03:00.0: vmnic2: TX NetQ allocated on 4
2012-08-03T16:15:09.748Z cpu7:2627)Uplink: 6912: Opening device vmnic3
2012-08-03T16:15:09.748Z cpu7:2083)DMA: 524: DMA Engine 'vmnic3' created.
2012-08-03T16:15:09.748Z cpu7:2083)IDT: 991: 0x49 <vmnic3-0> exclusive (entropy source), flags 0x10
2012-08-03T16:15:09.748Z cpu7:2083)VMK_VECTOR: 137: Added handler for  vector 73, flags 0x10
2012-08-03T16:15:09.748Z cpu7:2083)IDT: 991: 0x51 <vmnic3-1> exclusive (entropy source), flags 0x10
2012-08-03T16:15:09.748Z cpu7:2083)VMK_VECTOR: 137: Added handler for  vector 81, flags 0x10
2012-08-03T16:15:09.748Z cpu7:2083)IDT: 991: 0x59 <vmnic3-2> exclusive (entropy source), flags 0x10
2012-08-03T16:15:09.748Z cpu7:2083)VMK_VECTOR: 137: Added handler for  vector 89, flags 0x10
2012-08-03T16:15:09.748Z cpu7:2083)IDT: 991: 0x61 <vmnic3-3> exclusive (entropy source), flags 0x10
2012-08-03T16:15:09.748Z cpu7:2083)VMK_VECTOR: 137: Added handler for  vector 97, flags 0x10
2012-08-03T16:15:09.748Z cpu7:2083)IDT: 991: 0x69 <vmnic3-4> exclusive (entropy source), flags 0x10
2012-08-03T16:15:09.748Z cpu7:2083)VMK_VECTOR: 137: Added handler for  vector 105, flags 0x10
<6>bnx2 0000:03:00.1: vmnic3: CPU fw versions: TXP: 'txp6.2.1b' TPAT: 'tpa6.2.1b' RXP: 'rxp6.2.1b' COM: 'com6.2.1b' CP: 'cp6.2.1b'
2012-08-03T16:15:09.848Z cpu4:2083)<6>bnx2 0000:03:00.1: vmnic3: using MSIX
2012-08-03T16:15:09.849Z cpu4:2083)<6>bnx2 0000:03:00.1: vmnic3: NetQueue hardware support is enabled
2012-08-03T16:15:09.849Z cpu0:2627)<6>bnx2 0000:03:00.1: vmnic3: Using 4 RX NetQ rings
2012-08-03T16:15:09.849Z cpu0:2627)<4>bnx2 0000:03:00.1: vmnic3: Unhandled NETQUEUE OP 16
2012-08-03T16:15:09.849Z cpu0:2627)<4>bnx2 0000:03:00.1: vmnic3: Unhandled NETQUEUE OP 17
2012-08-03T16:15:09.849Z cpu0:2627)<6>bnx2 0000:03:00.1: vmnic3: Using 4 TX NetQ rings
2012-08-03T16:15:09.849Z cpu0:2627)Uplink: 5280: enabled port 0x3 with mac 98:4b:e1:07:27:bc
2012-08-03T16:15:10.111Z cpu4:2083)<6>bnx2 0000:03:00.1: vmnic3: flushed default TX queue
2012-08-03T16:15:10.111Z cpu4:2083)<6>bnx2 0000:03:00.1: vmnic3: flushed TX queue 1
2012-08-03T16:15:10.111Z cpu4:2083)<6>bnx2 0000:03:00.1: vmnic3: flushed TX queue 2
2012-08-03T16:15:10.111Z cpu4:2083)<6>bnx2 0000:03:00.1: vmnic3: flushed TX queue 3
2012-08-03T16:15:10.111Z cpu4:2083)<6>bnx2 0000:03:00.1: vmnic3: flushed TX queue 4
2012-08-03T16:15:10.111Z cpu4:2083)<6>bnx2 0000:03:00.1: vmnic3: TX NetQ allocated on 1
2012-08-03T16:15:10.111Z cpu4:2083)<6>bnx2 0000:03:00.1: vmnic3: TX NetQ allocated on 2
2012-08-03T16:15:10.111Z cpu4:2083)<6>bnx2 0000:03:00.1: vmnic3: TX NetQ allocated on 3
2012-08-03T16:15:10.111Z cpu4:2083)<6>bnx2 0000:03:00.1: vmnic3: TX NetQ allocated on 4
2012-08-03T16:15:10.111Z cpu6:2627)Mod: 4015: Initialization of bnx2 succeeded with module ID 27.
2012-08-03T16:15:10.111Z cpu6:2627)bnx2 loaded successfully.
2012-08-03T16:15:10.483Z cpu6:2627)Loading module cnic ...
2012-08-03T16:15:10.485Z cpu6:2627)Elf: 1862: module cnic has license GPL
2012-08-03T16:15:10.486Z cpu6:2627)module heap: Initial heap size: 1048576, max heap size: 68476928
2012-08-03T16:15:10.486Z cpu6:2627)vmklnx_module_mempool_init: Mempool max 68476928 being used for module: 28

2012-08-03T16:15:10.486Z cpu6:2627)vmk_MemPoolCreate passed for 256 pages

2012-08-03T16:15:10.486Z cpu6:2627)skb_mem_info mempool for module cnic created - max size 23068672
2012-08-03T16:15:10.486Z cpu6:2627)module heap: using memType 2
2012-08-03T16:15:10.486Z cpu6:2627)module heap vmklnx_cnic: creation succeeded. id = 0x410018200000
<6>Broadcom NetXtreme II CNIC Driver cnic v1.11.18.v50.1 (October 20, 2011)
2012-08-03T16:15:10.486Z cpu6:2627)<6>cnic: Added CNIC device: vmnic3
2012-08-03T16:15:10.486Z cpu6:2627)<3>cnic: vmnic3 - Num 1G iSCSI licenses = 65535
2012-08-03T16:15:10.487Z cpu6:2627)IDT: 991: 0x71 <cnic> exclusive (entropy source), flags 0x10
2012-08-03T16:15:10.487Z cpu6:2627)VMK_VECTOR: 137: Added handler for  vector 113, flags 0x10
2012-08-03T16:15:10.488Z cpu6:2627)<6>cnic: Added CNIC device: vmnic2
2012-08-03T16:15:10.488Z cpu6:2627)<3>cnic: vmnic2 - Num 1G iSCSI licenses = 65535
2012-08-03T16:15:10.489Z cpu6:2627)IDT: 991: 0x41 <cnic> exclusive (entropy source), flags 0x10
2012-08-03T16:15:10.489Z cpu6:2627)VMK_VECTOR: 137: Added handler for  vector 65, flags 0x10
2012-08-03T16:15:10.490Z cpu6:2627)Mod: 4015: Initialization of cnic succeeded with module ID 28.
2012-08-03T16:15:10.490Z cpu6:2627)cnic loaded successfully.
2012-08-03T16:15:10.508Z cpu6:2627)Loading module iscsi_linux ...
2012-08-03T16:15:10.510Z cpu6:2627)Elf: 1862: module iscsi_linux has license GPLv2
2012-08-03T16:15:10.510Z cpu6:2627)module heap: Initial heap size: 0, max heap size: 7659520
2012-08-03T16:15:10.510Z cpu6:2627)vmklnx_module_mempool_init: Mempool max 7659520 being used for module: 29

2012-08-03T16:15:10.510Z cpu6:2627)vmk_MemPoolCreate passed for 0 pages

2012-08-03T16:15:10.510Z cpu6:2627)module heap: using memType 2
2012-08-03T16:15:10.510Z cpu6:2627)module heap vmklnx_iscsi_linux: creation succeeded. id = 0x41000536c000
2012-08-03T16:15:10.510Z cpu6:2627)Mod: 4015: Initialization of iscsi_linux succeeded with module ID 29.
2012-08-03T16:15:10.510Z cpu6:2627)iscsi_linux loaded successfully.
2012-08-03T16:15:10.533Z cpu6:2627)Loading module bnx2i ...
2012-08-03T16:15:10.535Z cpu6:2627)Elf: 1862: module bnx2i has license GPL
2012-08-03T16:15:10.537Z cpu6:2627)module heap: Initial heap size: 2097152, max heap size: 68476928
2012-08-03T16:15:10.537Z cpu6:2627)vmklnx_module_mempool_init: Mempool max 68476928 being used for module: 30

2012-08-03T16:15:10.537Z cpu6:2627)vmk_MemPoolCreate passed for 512 pages

2012-08-03T16:15:10.537Z cpu6:2627)module heap: using memType 2
2012-08-03T16:15:10.537Z cpu6:2627)module heap vmklnx_bnx2i: creation succeeded. id = 0x41001c000000
<6>Broadcom NetXtreme II iSCSI Driver bnx2i v2.70.1k.v50.2 (Oct 20, 2011)
2012-08-03T16:15:10.537Z cpu6:2627)<6>bnx2i::0x4100148028d0: bnx2i: sq_size 1 out of range, using 64
2012-08-03T16:15:10.537Z cpu3:2051)<6>bnx2i::0x4100148028d0: [03:00.00]: ISCSI_INIT passed
2012-08-03T16:15:10.559Z cpu6:2627)<1>bnx2i::0x4100148028d0: netif=vmnic2, iscsi=bnx2i-984be10727ba-vmnic2
2012-08-03T16:15:10.559Z cpu6:2627)DMA: 524: DMA Engine 'vmhba33' created.
2012-08-03T16:15:10.559Z cpu6:2627)<6>bnx2i::0x410014803990: bnx2i: sq_size 1 out of range, using 64
2012-08-03T16:15:10.560Z cpu3:2051)<6>bnx2i::0x410014803990: [03:00.01]: ISCSI_INIT passed
2012-08-03T16:15:10.581Z cpu6:2627)<1>bnx2i::0x410014803990: netif=vmnic3, iscsi=bnx2i-984be10727bc-vmnic3
2012-08-03T16:15:10.581Z cpu6:2627)DMA: 524: DMA Engine 'vmhba34' created.
2012-08-03T16:15:10.581Z cpu6:2627)ScsiNpiv: 1525: GetInfo for adapter vmhba33, [0x4100070cbf80], max_vports=0, vports_inuse=0, linktype=0, state=0, failreason=0, rv=-1, sts=bad0020
2012-08-03T16:15:10.581Z cpu6:2627)ScsiNpiv: 1525: GetInfo for adapter vmhba34, [0x4100070cc580], max_vports=0, vports_inuse=0, linktype=0, state=0, failreason=0, rv=-1, sts=bad0020
2012-08-03T16:15:10.581Z cpu6:2627)Mod: 4015: Initialization of bnx2i succeeded with module ID 30.
2012-08-03T16:15:10.581Z cpu6:2627)bnx2i loaded successfully.
2012-08-03T16:15:10.604Z cpu6:2627)Loading module libfc ...
2012-08-03T16:15:10.606Z cpu6:2627)Elf: 1862: module libfc has license GPLv2
2012-08-03T16:15:10.609Z cpu6:2627)module heap: Initial heap size: 409600, max heap size: 85254144
2012-08-03T16:15:10.609Z cpu6:2627)vmklnx_module_mempool_init: Mempool max 85254144 being used for module: 31

2012-08-03T16:15:10.609Z cpu6:2627)vmk_MemPoolCreate passed for 100 pages

2012-08-03T16:15:10.609Z cpu6:2627)skb_mem_info mempool for module libfc created - max size 23068672
2012-08-03T16:15:10.609Z cpu6:2627)module heap: using memType 2
2012-08-03T16:15:10.609Z cpu6:2627)module heap vmklnx_libfc: creation succeeded. id = 0x41000a180000
2012-08-03T16:15:10.609Z cpu6:2627)Mod: 4015: Initialization of libfc succeeded with module ID 31.
2012-08-03T16:15:10.609Z cpu6:2627)libfc loaded successfully.
2012-08-03T16:15:10.628Z cpu6:2627)Loading module libfcoe ...
2012-08-03T16:15:10.629Z cpu6:2627)Elf: 1862: module libfcoe has license GPLv2
2012-08-03T16:15:10.630Z cpu6:2627)module heap: Initial heap size: 409600, max heap size: 43311104
2012-08-03T16:15:10.630Z cpu6:2627)vmklnx_module_mempool_init: Mempool max 43311104 being used for module: 32

2012-08-03T16:15:10.630Z cpu6:2627)vmk_MemPoolCreate passed for 100 pages

2012-08-03T16:15:10.630Z cpu6:2627)skb_mem_info mempool for module libfcoe created - max size 23068672
2012-08-03T16:15:10.630Z cpu6:2627)module heap: using memType 2
2012-08-03T16:15:10.630Z cpu6:2627)module heap vmklnx_libfcoe: creation succeeded. id = 0x41001c500000
2012-08-03T16:15:10.630Z cpu6:2627)Mod: 4015: Initialization of libfcoe succeeded with module ID 32.
2012-08-03T16:15:10.630Z cpu6:2627)libfcoe loaded successfully.
2012-08-03T16:15:10.631Z cpu6:2627)ScsiClaimrule: 2378: Disabling claimrules for MP plugins.
<6>bnx2 0000:03:00.0: vmnic2: NIC Copper Link is Up, 100 Mbps full duplex<c>, receive <c>& transmit <c>flow control ON2012-08-03T16:15:11.110Z cpu2:2050)<c>
2012-08-03T16:15:11.300Z cpu6:2627)Loading module ata_piix ...
2012-08-03T16:15:11.302Z cpu6:2627)Elf: 1862: module ata_piix has license GPL
2012-08-03T16:15:11.302Z cpu6:2627)module heap: Initial heap size: 65536, max heap size: 9756672
2012-08-03T16:15:11.302Z cpu6:2627)vmklnx_module_mempool_init: Mempool max 9756672 being used for module: 33

2012-08-03T16:15:11.302Z cpu6:2627)vmk_MemPoolCreate passed for 16 pages

2012-08-03T16:15:11.302Z cpu6:2627)module heap: using memType 2
2012-08-03T16:15:11.302Z cpu6:2627)module heap vmklnx_ata_piix: creation succeeded. id = 0x4100013a0000
2012-08-03T16:15:11.302Z cpu6:2627)PCI: driver ata_piix is looking for devices
2012-08-03T16:15:11.302Z cpu6:2627)<7>ata_piix 0000:00:1f.2: version 2.12-4vmw
<6>ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P32012-08-03T16:15:11.302Z cpu6:2627) ]
2012-08-03T16:15:11.302Z cpu6:2627)DMA: 524: DMA Engine 'vmklnxpci-0:0:31.2' created.
2012-08-03T16:15:11.302Z cpu6:2627)DMA: 524: DMA Engine 'vmklnxpci-0:0:31.2' created.
2012-08-03T16:15:11.464Z cpu6:2627)IDT: 991: 0xa0 <ata_piix> sharable (entropy source), flags 0x10
2012-08-03T16:15:11.464Z cpu6:2627)VMK_VECTOR: 137: Added handler for shared vector 160, flags 0x10
2012-08-03T16:15:11.465Z cpu6:2627)VMK_PCI: 684: Device 000:000:31.2 name: vmhba0
2012-08-03T16:15:11.465Z cpu6:2627)DMA: 524: DMA Engine 'vmhba0' created.
2012-08-03T16:15:11.465Z cpu6:2627)VMK_PCI: 684: Device 000:000:31.2 name: vmhba0
2012-08-03T16:15:11.465Z cpu6:2627)DMA: 524: DMA Engine 'vmhba0' created.
2012-08-03T16:15:11.465Z cpu6:2627)DMA: 569: DMA Engine 'vmhba0' destroyed.
2012-08-03T16:15:11.465Z cpu6:2627)DMA: 524: DMA Engine 'vmhba35' created.
2012-08-03T16:15:11.465Z cpu6:2627)<6>ata1: SATA max UDMA/133 cmd 0x1080 ctl 0x1088 bmdma 0x10a0 irq 160
2012-08-03T16:15:11.465Z cpu6:2627)<6>ata2: SATA max UDMA/133 cmd 0x1090 ctl 0x1098 bmdma 0x10a8 irq 160
2012-08-03T16:15:11.949Z cpu7:2672)<6>ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
2012-08-03T16:15:12.111Z cpu7:2672)<7>ata1.01: NODEV after polling detection
2012-08-03T16:15:12.295Z cpu1:2672)<6>ata1.00: ATAPI: DV-28S-W, C.2D, max UDMA/100
2012-08-03T16:15:12.501Z cpu1:2672)<6>ata1.00: configured for UDMA/100
2012-08-03T16:15:12.823Z cpu5:2673)<6>ata2: SATA link down (SStatus 4 SControl 300)
2012-08-03T16:15:12.844Z cpu6:2627)ScsiScan: 1098: Path 'vmhba0:C0:T0:L0': Vendor: 'TEAC    '  Model: 'DV-28S-W        '  Rev: 'C.2D'
2012-08-03T16:15:12.844Z cpu6:2627)ScsiScan: 1101: Path 'vmhba0:C0:T0:L0': Type: 0x5, ANSI rev: 5, TPGS: 0 (none)
2012-08-03T16:15:12.846Z cpu4:2627)ScsiUid: 273: Path 'vmhba0:C0:T0:L0' does not support VPD Device Id page.
2012-08-03T16:15:12.846Z cpu4:2627)ScsiScan: 1225: Path 'vmhba0:C0:T0:L0' : No standard UID: Failure. ANSI version 'SCSI-3 SPC3' (0x5).
2012-08-03T16:15:12.848Z cpu6:2627)VMWARE SCSI Id: Could not get disk id for vmhba0:C0:T0:L0
2012-08-03T16:15:12.848Z cpu6:2627)ScsiScan: 1582: Add path: vmhba0:C0:T0:L0
2012-08-03T16:15:12.848Z cpu6:2627)PCI: driver ata_piix claimed device 0000:00:1f.2
2012-08-03T16:15:12.848Z cpu6:2627)PCI: driver ata_piix claimed 1 device
2012-08-03T16:15:12.848Z cpu6:2627)ScsiNpiv: 1525: GetInfo for adapter vmhba0, [0x4100070ccb80], max_vports=0, vports_inuse=0, linktype=0, state=0, failreason=0, rv=-1, sts=bad0020
2012-08-03T16:15:12.848Z cpu6:2627)ScsiNpiv: 1525: GetInfo for adapter vmhba35, [0x4100070cd180], max_vports=0, vports_inuse=0, linktype=0, state=0, failreason=0, rv=-1, sts=bad0020
2012-08-03T16:15:12.848Z cpu6:2627)Mod: 4015: Initialization of ata_piix succeeded with module ID 33.
2012-08-03T16:15:12.848Z cpu6:2627)ata_piix loaded successfully.
2012-08-03T16:15:12.870Z cpu6:2627)Loading module hpsa ...
2012-08-03T16:15:12.872Z cpu6:2627)Elf: 1862: module hpsa has license GPL
2012-08-03T16:15:12.874Z cpu6:2627)module heap: Initial heap size: 2097152, max heap size: 39116800
2012-08-03T16:15:12.874Z cpu6:2627)vmklnx_module_mempool_init: Mempool max 39116800 being used for module: 34

2012-08-03T16:15:12.874Z cpu6:2627)vmk_MemPoolCreate passed for 512 pages

Reply
0 Kudos
VirtuallyMikeB

Yeah, you found it.  I haven't run the HP firmware update disc, so I don't know what it looks like when everything is updated.  If you've run their disc to upgrade your server's firmware across the board, and you're sure it's all at the latest release, you may be looking at bad hardware.  You say the NICs show up in Windows, though? That doesn't sound right...

----------------------------------------- Please consider marking this answer "correct" or "helpful" if you found it useful (you'll get points too). Mike Brown VMware, Cisco Data Center, and NetApp dude Sr. Systems Engineer michael.b.brown3@gmail.com Twitter: @VirtuallyMikeB Blog: http://VirtuallyMikeBrown.com LinkedIn: http://LinkedIn.com/in/michaelbbrown
Reply
0 Kudos
dplus
Contributor
Contributor

I fixed it, you will never believe how:

COMPLETELY REMOVE POWER FROM THE SERVER

I got hinted by this blogpost:

http://blog.jensschanz.de/?p=995

This guy had the same problem, in the end he stated that he fixed the network issue by pulling out the power cable for a moment, so that the Broadcom's get kind of resetted...

That did the trick.

Unfortunately I spent my whole day on this issue....

VirtuallyMikeB

Wonderful! Very interesting...

Thumbed from my Android

--

Mike Brown

573-433-0872 (Cell)

michael.b.brown3@gmail.com<mailto:michael.b.brown3@gmail.com>

Blog: http://VirtuallyMikeBrown.com

Twitter: http://twitter.com/#!/VirtuallyMikeB

LinkedIn: http://linkedin.com/in/michaelbbrown

----------------------------------------- Please consider marking this answer "correct" or "helpful" if you found it useful (you'll get points too). Mike Brown VMware, Cisco Data Center, and NetApp dude Sr. Systems Engineer michael.b.brown3@gmail.com Twitter: @VirtuallyMikeB Blog: http://VirtuallyMikeBrown.com LinkedIn: http://LinkedIn.com/in/michaelbbrown
Reply
0 Kudos
PxPxger
Contributor
Contributor

Thank you so much I had the exact same problem and pulling the power after I shut down the HP server allowed the NICS to loose power and fixed ILO and fixed ESXI booting. 

Reply
0 Kudos
MikeF0209
Contributor
Contributor

This work for me as well in a Dell PowerEdge M605

A complete Poweroff , wait 30 seconds and Poweron corrected the problem.

Thanks

Mike Fernandez Sr. Systems Engineer VCP-DCV5, MCSE 2008, MCSA 2012
Reply
0 Kudos