DL380 G7 - Broadcom NICs- VLAN issue

[kopper27]

hi guys

I have 2 DL380 G7 NICs Broadcom NetXtreme II BCM5709 which has very weird behaviors.

First of all I can ping servers from my office network, but they can not pint each other.

Second they have 4 pNICs all in VLAN 2 - 4 and 5.

for example I have this config:

vCenter cannot ping my ESXi host (vCenter cannot add the ESXi host to the cluster).

But I can ping my vcenter from my network office.

so I move my vCenter to the VLAN2-Temp in vmnic0 and I cannot ping or access vCenter anymore even when my vmnic0 is configured in trunk. I mean all my vmnics are.

like this

any idea guys?

thanks a lot

[a_p_]

Please post the physical switch port's configuration.

André

[MKguy]

The tg3 driver for these NICs is known to cause some trouble:

http://communities.vmware.com/thread/408890?start=15&tstart=0

http://kb.vmware.com/kb/2035701

Disable NetQueue and/or update the tg3 driver with this recent version:

https://my.vmware.com/group/vmware/details?downloadGroup=DT-ESXI50-Broadcom-tg3-3124cv501&productId=...

[kopper27]

I already saw that my doubt is my broadcom are BCM5709 not the ones listed

[MKguy]

Oh, you're right, I missed the G7 (NC382i NIC with bnx2 driver) in your initial post and assumed it might be the common issue with the gen8 server 331FLR NICs.

For the communication issues within the same VLAN with your ESXi host/vCenter, can you check if they can resolve each other via ARP? On the ESXi shell run:

esxcli network ip neighbor list

You could also try check if you see any traffic at all on the management vmkernel port with tcpdump-uw.

[kopper27]

I just run te ARP command

and only gateway is visible

Neighbor      Mac Address        Vmknic   Expiry  State

------------  -----------------  ------  -------  -----

10.x.x.x  00:08:e3:ff:fc:04  vmk0    242 sec

[vmfcraig]

Generally speaking, when I see these kind of issues it's normally because of either a subnet issue or a routing issue.

What I suggest you do is go back to basics and put another device e.g. your laptop into one of the switch ports that is in the correct VLAN and see if you can SSH/Ping your ESXi hosts.