Eth0 and Eth1 not found on VMWare 3.5 install on HS22 Blade

[fuldagap]

I have installed VMWare ESX 3.5.4 on an IBM HS22 blade. The install went fine however it will not find Eth0 or Eth1. After install it says to log into the IP address I assigned during install but the browser does not find the IP. We have checked and double checked the vlan settings on the relevant switch ports. Here is some more info:

Broadcom Netxtreme II 5709 nics (on HCL)

From the CLI I can only ping the assigned IP address, but not the gateway or any other device on the vlan.

Running esxcfg-nics -l shows only the vmnics..not eth0 or eth1

Ifconfig shows only lo, vmnics and vswif..no eth0 or eth1

ifconfig eth0 reports "error fetching interface information, device not found

vmkload_mod -l shows the bnx2 driver (which I loaded manually with the most current file available)

the /etc/vmware/pciid/ folder contains the bnx2.xml and bnx2x.xml files

added rmmod CDCEther insmod CDCEther ifconfig cdceth0 169.254.95.118 up to /etc/rc.local

I have reloaded the operating system three times and have tried on two different, completely new HS22 blades

I suspect I am missing some very simple config but just can't seem to see through the fog.

Any help?

[AndreTheGiant]

Remember that ESX is not Linux.

So your "ethX" adapters is called "vmnicX" and work in a different way (are just "uplink" with NO IP address).

The vswifX adapters are the service console interfaces and each has its own IP address.

Andre

[fuldagap]

Andre;

Thanks for your quick response. I've kind of gotten that impression, but the bottom line is I still can not ping anywhere from the command line (except for the IP address I assigned during the setup process) and nothing else on the network can see/ping that IP address...so call it Eth0 or vmnicX...this installation is incommunicado...I'm really lost on this one. Our ESX 2.5 install does see Eth0 on a different type of blade.

TCK

[AndreTheGiant]

Send the output of those commands:

esxcfg-nics -l

esxcfg-vswitch -l

Andre

[fuldagap]

Andre;

Here are the results of the two commands you requested. Thanks again for taking your time to look into this.

results of esxcfg-nic -l

vmnic1 10:00.01 bnx2 Up 1000Mbps Full 1500 Broadcom Corporation Broadcom NetXtremen II BCM5709 1000Base-SX

vmnic0 10:00.01 bnx2 Up 1000Mbps Full 1500 Broadcom Corporation Broadcom NetXtremen II BCM5709 1000Base-SX

results of esxcfg-vswitch -l

Switch Name Num Ports Used Ports Configured Ports MTU Uplinks

vSwitch0 64 4 64 1500 vmnic0

PortGroupName VLAN ID Used Ports Uplinks

VM Network 180 0 vmnic0

Service Console 180 1 vmnic0

TCK

[AndreTheGiant]

From your report both NIC are connected and UP.

I see that COS is connected to vSwitch0 that has a single uplink (with the first vmnic0).

But you are using VLAN (is tagged 180).

On the physical switch have you configured the port where vmnic0 is connected to permit VLAN 180?

Andre

[fuldagap]

Yes, we have confirmed that the port on the Cisco switch is configured as part of VLAN 180..

TCK

[AndreTheGiant]

And your client is connected to VLAN 180?

Do you have 1 IP for each VLAN in your switch? So you can try to ping this IP from ESX COS... if it does not work is still a VLAN problem (on switch configuration).

Andre

[fuldagap]

No, we don't assign and IP address to the VLAN specifically...we assign IP address to the individual devices and use the various VLANs to segment traffic. The ESX installation is not able to ping any other devices on the VLAN nor can any device ping the ESX address.

TCK

[szekelyk]

Hi, we have the same issue, but with the embedded ESXi 3.5 U4 everything is OK. We can ping the server.

Mybe it is worth a try.

Krisztian

[quesse]

Hi,

we have the same problem on ESX 4.0 U1, have you solved the problem?

[MauroBonder]

if you want i can validate the configuration of blade center.

you switch works with IP_Hash ?

*If you found this information useful, please consider awarding points for "Correct" or "Helpful"*

[quesse]

Hi Mauro,

thansk for your help.

Initially I trying to use bonding with source MAC address bonding, but to troublehoot the problem I have reset to default BNT eth switch configuration, and ESX 40U1 installation.

Which data do you need?

[MauroBonder]

1. if you dont use IP_Hash or MAC = Configure PORT ID

2. Look if your adapter physical at vmware receive a VLANs that you configured in switch

post here a configuration of internal ports of VMware and a external ports and of your switch core that make uplink with a Blade

post here too a output of this command line that you go run at each host.

esxcfg-info |grep -i -B 5 hint |more

*If you found this information useful, please consider awarding points for "Correct" or "Helpful"*

[quesse]

yes port ID is default and I done a new ESX install with all default value.

the BNT switch is reset to factory: no VLAN are configured.

this is ESX config:

esxcfg-vmknic esxcfg-volume esxcfg-vswif esxcfg-vswitch

# esxcfg-vswif -l

Name Port Group/DVPort IP Family IP Address Netmask Broadcast Enabled TYPE

vswif0 Service Console IPv4 10.192.45.106 255.255.255.0 10.192.45.255 true STATIC

# esxcfg-vswitch -l

Switch Name Num Ports Used Ports Configured Ports MTU Uplinks

vSwitch0 32 3 32 1500 vmnic1

PortGroup Name VLAN ID Used Ports Uplinks

VM Network 0 0 vmnic1

Service Console 0 1 vmnic1

# esxcfg-info |grep -i -B 5 hint

|----PCI Slot...........................................0

|----PCI function.......................................0

|----MAC Address........................................00:21:5e:96:d9:08

|----Virtual MAC Address................................00:50:56:56:d9:08

|----Driver.............................................bnx2

|----Network Hint.......................................0 10.192.45.0/255.255.255.0

--

|----PCI Slot...........................................0

|----PCI function.......................................1

|----MAC Address........................................00:21:5e:96:d9:0a

|----Virtual MAC Address................................00:50:56:56:d9:0a

|----Driver.............................................bnx2

|----Network Hint.......................................0 none

--

I have no config for BNT because I have reset to default.

Core switch config is default:

interface ethernet 1/12

description test_ESX

switchport allowed vlan add 1 untagged

switchport native vlan 1

switchport allowed vlan add 4093 tagged

[MauroBonder]

remove switchport native vlan 1.

dont can be vlan 1. set everyone but not 1.

test and post.

-

---

other thing, your range of ip "10.192.45.X" use vlan dafult or other VLan ID ?

*If you found this information useful, please consider awarding points for "Correct" or "Helpful"*

[quesse]

the problem isn't in the core switch because I'm not able to ping from BNT switch do HS22 and from HS22 to BNT switch ...

[MauroBonder]

try change switchport native vlan 1 -

choice a vlan that u dont use .

switchport native vlan X

dont can be 1.

try this test and post.

regards!

*If you found this information useful, please consider awarding points for "Correct" or "Helpful"*

[quesse]

the problem persist

[MauroBonder]

try remove a vswif and reconfigure.

esxcfg-vswif -d vswif0 (delete)

esxcfg-vswitch –A “Service Console” vSwitch0 (create)

esxcfg-vswitch –v 0–p “Service Console” vSwitch0 (attribute vlan id)

esxcfg-vswif –i xxx.xxx.xxx.xxx –n xxx.xxx.xxx.xxx vswif0 (set ip)

*If you found this information useful, please consider awarding points for "Correct" or "Helpful"*