esxi 5.0 not able to detect FCoE LUN from netapp32...

kongfupanda · ‎05-08-2013

Hi Team,I have a question regarding the esxi5.0 / FCoE/CNA with netapp3210,anybody can advise please ? I have a pair of filer 3210, installed FcoE license. NFS and iscsi tested ok. Now moving to FCOE.2 UTA connected to nexus 5548U, and I can see the connections.I have also brocade CNA card installed on ibm 3650 m4 servers with esxi 5.0 . But I cannot detect the storage from esxi host when I did a rescan. The LUN on filer has the initiator information of the CNA cards added and igroup as well. Nexus switch’s show flogi database and zoneset all looks ok. I feel something might be missing on the filer configuration, any advice please? Thanks

sh vsan 2001 membership

vsan 2001 interfaces:

fc1/31 fc1/32 vfc3 vfc4

vfc5 vfc6

sh fcoe

Global FCF details

FCF-MAC is 00:2a:6a:0f:fa:40

FC-MAP is 0e:fc:00

FCF Priority is 128

FKA Advertisement period for FCF is 8 seconds

VFC MAC details

vfc3 FCF-MAC is 00:2a:6a:0f:fa:6a

vfc4 FCF-MAC is 00:2a:6a:0f:fa:69

vfc5 FCF-MAC is 00:2a:6a:0f:fa:6b

vfc6 FCF-MAC is 00:2a:6a:0f:fa:6c

sh flogi data

--------------------------------------------------------------------------------

INTERFACE VSAN FCID PORT NAME NODE NAME

--------------------------------------------------------------------------------

vfc4 2001 0xd90060 50:0a:09:82:88:c9:92:0f 50:0a:09:80:88:c9:92:0f

vfc5 2001 0xd90000 10:00:8c:7c:ff:20:c0:99 20:00:8c:7c:ff:20:c0:99

vfc6 2001 0xd90020 10:00:8c:7c:ff:30:04:0d 20:00:8c:7c:ff:30:04:0d

Total number of flogi = 3.

Nexus5548-B# fcping pwwn 10:00:8c:7c:ff:20:c0:99 vsan 2001

28 bytes from 10:00:8c:7c:ff:20:c0:99 time = 236 usec

28 bytes from 10:00:8c:7c:ff:20:c0:99 time = 210 usec

28 bytes from 10:00:8c:7c:ff:20:c0:99 time = 209 usec

28 bytes from 10:00:8c:7c:ff:20:c0:99 time = 197 usec

igroup show iGroup_FCoE_01

iGroup_FCoE_01 (FCP) (ostype: vmware):

10:00:8c:7c:ff:20:10:fd (not logged in)

10:00:8c:7c:ff:20:84:3d (not logged in)

10:00:8c:7c:ff:30:04:0d (logged in on: vtic)

10:00:8c:7c:ff:20:c0:99 (not logged in)

10:00:8c:7c:ff:20:10:fc (not logged in)

10:00:8c:7c:ff:20:c0:98 (not logged in)

igroup show

iGroup_FCoE_01 (FCP) (ostype: vmware):

10:00:8c:7c:ff:20:c0:98 (not logged in)

10:00:8c:7c:ff:20:84:3c (not logged in)

10:00:8c:7c:ff:30:04:0c (not logged in)

10:00:8c:7c:ff:20:10:fc (not logged in)

10:00:8c:7c:ff:20:84:3d (logged in on: vtic, 1a)

10:00:8c:7c:ff:20:10:fd (logged in on: vtic, 1a)

10:00:8c:7c:ff:30:04:0d (logged in on: vtic, 1b)

10:00:8c:7c:ff:20:c0:99 (not logged in)

iGroup_iSCSI_SQL (iSCSI) (ostype: windows):

iqn.1991-05.com.microsoft:sql01 (not logged in)

iGroup_vmware_iscsi (iSCSI) (ostype: vmware):

iqn.1998-01.com.vmware (not logged in)

5548-B# fcping pwwn 50:0a:09:82:98:c9:92:0f vsan 2001

28 bytes from 50:0a:09:82:98:c9:92:0f time = 148 usec

28 bytes from 50:0a:09:82:98:c9:92:0f time = 185 usec

-Nexus5548-B# fcping pwwn 50:0a:09:82:88:c9:92:0f vsan 2001

28 bytes from 50:0a:09:82:88:c9:92:0f time = 148 usec

28 bytes from 50:0a:09:82:88:c9:92:0f time = 141 usec

28 bytes from 50:0a:09:82:88:c9:92:0f time = 228 usec

Nexus5548-B#

-3210b> ifconfig e1a

e1a: flags=0x8f48867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500

ether 02:a0:98:3d:9b:fc (auto-10g_twinax-fd-up) flowcontrol full

trunked VIF-b

s-3210b> ifconfig e1b

e1b: flags=0x8f48867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500

ether 02:a0:98:3d:9b:fc (auto-10g_twinax-fd-up) flowcontrol full

trunked VIF-b

3210b> ifconfig VIF-b

VIF-b: flags=0x24f48863<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM,NOWINS> mtu 1500

inet 192.168.10.132 netmask 0xffffff00 broadcast 192.168.10.255

partner vif-a (not in use)

ether 02:a0:98:3d:9b:fc (Enabled interface groups)

-3210b>

VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic5"

InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic5

IsLargeBuildNumber = true

VersionString = igb driver 2.1.11.1

IsEntity = false

ElementName = igb driver

VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic6"

InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic6

IsLargeBuildNumber = true

VersionString = igb driver 2.1.11.1

IsEntity = false

ElementName = igb driver

VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic7"

InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic7

IsLargeBuildNumber = true

VersionString = igb driver 2.1.11.1

IsEntity = false

ElementName = igb driver

VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic1"

InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic1

IsLargeBuildNumber = true

VersionString = igb driver 2.1.11.1

IsEntity = false

ElementName = igb driver

VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic2"

InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic2

IsLargeBuildNumber = true

VersionString = igb driver 2.1.11.1

IsEntity = false

ElementName = igb driver

VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic3"

InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic3

IsLargeBuildNumber = true

VersionString = igb driver 2.1.11.1

IsEntity = false

ElementName = igb driver

VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vusb0"

InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vusb0

IsLargeBuildNumber = true

VersionString = cdc_ether driver 22-Aug-2005

IsEntity = false

ElementName = cdc_ether driver

VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic0"

InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic0

IsLargeBuildNumber = true

VersionString = igb driver 2.1.11.1

IsEntity = false

ElementName = igb driver

VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic4"

InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic4

IsLargeBuildNumber = true

VersionString = igb driver 2.1.11.1

IsEntity = false

ElementName = igb driver

VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic11"

InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic11

IsLargeBuildNumber = true

VersionString = bna driver 3.2.0.0

IsEntity = false

ElementName = bna driver

VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic9"

InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic9

IsLargeBuildNumber = true

VersionString = bna driver 3.2.0.0

IsEntity = false

ElementName = bna driver

VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic10"

InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic10

IsLargeBuildNumber = true

VersionString = bna driver 3.2.0.0

IsEntity = false

ElementName = bna driver

VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic8"

InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic8

IsLargeBuildNumber = true

VersionString = bna driver 3.2.0.0

IsEntity = false

ElementName = bna driver

VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic5"

InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic5

IsLargeBuildNumber = true

VersionString = igb device firmware 3.19-0

IsEntity = false

ElementName = igb device firmware

VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic6"

InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic6

IsLargeBuildNumber = true

VersionString = igb device firmware 3.19-0

IsEntity = false

ElementName = igb device firmware

VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic7"

InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic7

IsLargeBuildNumber = true

VersionString = igb device firmware 3.19-0

IsEntity = false

ElementName = igb device firmware

VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic1"

InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic1

IsLargeBuildNumber = true

VersionString = igb device firmware 1.6-1

IsEntity = false

ElementName = igb device firmware

VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic2"

InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic2

IsLargeBuildNumber = true

VersionString = igb device firmware 1.6-1

IsEntity = false

ElementName = igb device firmware

VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic3"

InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic3

IsLargeBuildNumber = true

VersionString = igb device firmware 1.6-1

IsEntity = false

ElementName = igb device firmware

VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vusb0"

InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vusb0

IsLargeBuildNumber = true

VersionString = cdc_ether device firmware CDC Ethernet Device

IsEntity = false

ElementName = cdc_ether device firmware

VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic0"

InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic0

IsLargeBuildNumber = true

VersionString = igb device firmware 1.6-1

IsEntity = false

ElementName = igb device firmware

VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic4"

InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic4

IsLargeBuildNumber = true

VersionString = igb device firmware 3.19-0

IsEntity = false

ElementName = igb device firmware

VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic11"

InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic11

IsLargeBuildNumber = true

VersionString = bna device firmware 3.2.0.0

IsEntity = false

ElementName = bna device firmware

VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic9"

InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic9

IsLargeBuildNumber = true

VersionString = bna device firmware 3.2.0.0

IsEntity = false

ElementName = bna device firmware

VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic10"

InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic10

IsLargeBuildNumber = true

VersionString = bna device firmware 3.2.0.0

IsEntity = false

ElementName = bna device firmware

VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic8"

InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic8

IsLargeBuildNumber = true

VersionString = bna device firmware 3.2.0.0

IsEntity = false

ElementName = bna device firmware

Namespace: vmware/esxv2

error: enumInstances Class not found

Namespace: root/interop

error: enumInstances Class not found

Namespace: root/config

error: enumInstances Class not found

000:144:00.0 Fibre Channel Serial bus controller: Brocade Communications Systems, Inc. Brocade-1010/1020/1007/1741 [vmhba4]

Class 0c04: 1657:0014

000:144:00.1 Fibre Channel Serial bus controller: Brocade Communications Systems, Inc. Brocade-1010/1020/1007/1741 [vmhba5]

Class 0c04: 1657:0014

000:144:00.2 Ethernet controller Network controller: Brocade Communications Systems, Inc. Brocade-1010/1020/1007/1741 10G PCIe Ethernet Adapter [vmnic10]

Class 0200: 1657:0014

000:144:00.3 Ethernet controller Network controller: Brocade Communications Systems, Inc. Brocade-1010/1020/1007/1741 10G PCIe Ethernet Adapter [vmnic11]

Class 0200: 1657:0014

taylorb · ‎05-09-2013

This is probably a question that need Netapp/Cisco support engineers to be involved. Have you contacted support?

kongfupanda · ‎05-09-2013

Yes. Seems the Netapp lun id needs to be default.

Thanks and best regards

All

esxi 5.0 not able to detect FCoE LUN from netapp3210