ESXi 4.1 Broadcom iSCSI Adapter - how configure th...

Tomek24VMWARE · ‎07-15-2010

Hello All,

I testing Broadcom Adapter for iSCSI but adapter didn't work for me.

I did the same configuration as the iSCSI Software Adapter.

But Broadcom iSCSI adapter does not see the drives in the array.

Braodcom logs on to the matrix and session breaks.

What i'm doing wrong?

You met with something like that??

How configure Braodcom iSCSI adapter? Where is white paper for this?

Tom

binoche · ‎07-15-2010

maybe you can have a try the below steps,

1, find which vmnic located with vmhba34 in the same adapter?

esxcli swiscsi vmnic list --adapter vmhba34

2, port binding this vmnic to vmhba34

esxcli swiscsi nic add --nic --adapter vmhba34

binoche, VMware VCP, Cisco CCNA

Tomek24VMWARE · ‎07-15-2010

I did asyou write, the result you have in the first post, but it does not work.

binoche · ‎07-15-2010

could you please recheck lun masking correct or not since vmhba34 has already found the array?

binoche, VMware VCP, Cisco CCNA

binoche · ‎07-15-2010

please post vmkernel messages when the session is connected and disconnected?

binoche, VMware VCP, Cisco CCNA

Tomek24VMWARE · ‎07-15-2010

I habe 4 IP for My array

10.1.1.1-4

10.1.1.1 and 10.1.1.3 is connected to other switch for redundancy for other

10.1.1.2 and 10.1.1.4 is connected to this same switch with vmk1 on vmnic0

Logs from ESXi:

Jul 15 08:46:02 iscsid: discovery_sendtargets::Running discovery on

IFACE default(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)

Jul

15 08:46:02 iscsid: discovery_sendtargets::Filtered out IFACE

iscsi_vmk@vmk2(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)

Jul 15

08:46:02 iscsid: discovery_sendtargets::Filtered out IFACE

iscsi_vmk@vmk1(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)

Jul 15

08:46:02 iscsid: discovery_sendtargets::Running discovery on IFACE

bnx2i-0026b98aecbd@vmk1(bnx2i-0026b98aecbd)

(drec.transport=bnx2i-0026b98aecbd)

Jul 15 08:46:02 iscsid:

discovery_sendtargets::Running discovery on IFACE

default(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)

Jul

15 08:46:02 iscsid: discovery_sendtargets::Filtered out IFACE

iscsi_vmk@vmk2(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)

Jul 15

08:46:02 iscsid: discovery_sendtargets::Filtered out IFACE

iscsi_vmk@vmk1(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)

Jul 15

08:46:02 iscsid: discovery_sendtargets::Running discovery on IFACE

bnx2i-0026b98aecbd@vmk1(bnx2i-0026b98aecbd)

(drec.transport=bnx2i-0026b98aecbd)

Jul 15 08:46:02 iscsid: Login

Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:0 ISID:0x1)

Jul

15 08:46:02 iscsid: Notice: Assigned (H34 T0 C0 session=1, target=1/1)

Jul

15 08:46:02 iscsid: SessionResolve for 10.1.1.2 (via vmk1) started)

Jul

15 08:46:02 iscsid: Login Target:

iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.3:3260 (TPGT:0 ISID:0x2)

Jul

15 08:46:02 iscsid: Notice: Assigned (H34 T0 C1 session=2, target=1/2)

Jul

15 08:46:02 iscsid: SessionResolve for 10.1.1.3 (via vmk1) started)

Jul

15 08:46:02 iscsid: Login Target:

iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:0 ISID:0x3)

Jul

15 08:46:02 iscsid: Notice: Assigned (H34 T0 C2 session=3, target=1/3)

Jul

15 08:46:02 iscsid: SessionResolve for 10.1.1.4 (via vmk1) started)

Jul

15 08:46:02 iscsid: Login Target:

iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.1:3260 (TPGT:0 ISID:0x4)

Jul

15 08:46:02 iscsid: Notice: Assigned (H34 T0 C3 session=4, target=1/4)

Jul

15 08:46:02 iscsid: SessionResolve for 10.1.1.1 (via vmk1) started)

Jul

15 08:46:02 iscsid: Login Target:

iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:1 ISID:0x1)

Jul

15 08:46:02 iscsid: Notice: Assigned (H34 T1 C0 session=5, target=2/5)

Jul

15 08:46:02 iscsid: SessionResolve for 10.1.1.2 (via vmk1) started)

Jul

15 08:46:02 iscsid: Login Target:

iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.3:3260 (TPGT:1 ISID:0x2)

Jul

15 08:46:02 iscsid: Notice: Assigned (H34 T1 C1 session=6, target=2/6)

Jul

15 08:46:02 iscsid: SessionResolve for 10.1.1.3 (via vmk1) started)

Jul

15 08:46:02 iscsid: Login Target:

iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:1 ISID:0x3)

Jul

15 08:46:02 iscsid: Notice: Assigned (H34 T1 C2 session=7, target=2/7)

Jul

15 08:46:02 iscsid: SessionResolve for 10.1.1.4 (via vmk1) started)

Jul

15 08:46:02 iscsid: Login Target:

iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.1:3260 (TPGT:1 ISID:0x4)

Jul

15 08:46:02 iscsid: Notice: Assigned (H34 T1 C3 session=8, target=2/8)

Jul

15 08:46:02 iscsid: SessionResolve for 10.1.1.1 (via vmk1) started)

Jul

15 08:46:02 iscsid: DISCOVERY: Pending=8 Failed=0

Jul 15 08:46:03

iscsid: DISCOVERY: Pending=8 Failed=0

Jul 15 08:46:04 iscsid:

DISCOVERY: Pending=8 Failed=0

Jul 15 08:46:05 iscsid: DISCOVERY:

Pending=8 Failed=0

Jul 15 08:46:06 iscsid: sendto() failed (Host is

down)

Jul 15 08:46:06 iscsid: sendto() failed (Host is down)

Jul

15 08:46:06 iscsid: DISCOVERY: Pending=8 Failed=0

Jul 15 08:46:07

iscsid: The ARP lookup for 10.1.1.3 (via vmk1) failed, err_code=510

Jul

15 08:46:07 iscsid: The PMTU discovery for 10.1.1.3 (via vmk1) failed,

err_code=510

Jul 15 08:46:07 iscsid: The ARP lookup for 10.1.1.1 (via

vmk1) failed, err_code=510

Jul 15 08:46:07 iscsid: The PMTU

discovery for 10.1.1.1 (via vmk1) failed, err_code=510

Jul 15

08:46:07 iscsid: The ARP lookup for 10.1.1.3 (via vmk1) failed,

err_code=510

Jul 15 08:46:07 iscsid: The PMTU discovery for 10.1.1.3

(via vmk1) failed, err_code=112

Jul 15 08:46:07 iscsid: The ARP

lookup for 10.1.1.1 (via vmk1) failed, err_code=510

Jul 15 08:46:07

iscsid: The PMTU discovery for 10.1.1.1 (via vmk1) failed, err_code=112

Jul

15 08:46:07 iscsid: DISCOVERY: Pending=8 Failed=0

Jul 15 08:46:07

iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.3:3260 (TPGT:0 ISID:0x2) Reason:

00040000 (Initiator Connection Failure)

Jul 15 08:46:07 iscsid:

Notice: Reclaimed Channel (H34 T0 C1 oid=1)

Jul 15 08:46:07 iscsid:

Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.1:3260 (TPGT:0 ISID:0x4) Reason:

00040000 (Initiator Connection Failure)

Jul 15 08:46:07 iscsid:

Notice: Reclaimed Channel (H34 T0 C3 oid=1)

Jul 15 08:46:07 iscsid:

Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.3:3260 (TPGT:1 ISID:0x2) Reason:

00040000 (Initiator Connection Failure)

Jul 15 08:46:07 iscsid:

Notice: Reclaimed Channel (H34 T1 C1 oid=2)

Jul 15 08:46:07 vmkernel:

0:00:09:07.065 cpu15:4856)iscsi_linux: vmhba34: H:2 C:0 T:0 session

allocated

Jul 15 08:46:07 vmkernel: 0:00:09:07.065

cpu15:4856)iscsi_linux: vmhba34: H:2 C:2 T:1 session added

Jul 15

08:46:07 vmkernel: 0:00:09:07.065 cpu15:4856)iscsi_linux: [vmhba34: H:2

C:2 T:1] session created

Jul 15 08:46:07 iscsid: Login Failed:

iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.1:3260 (TPGT:1 ISID:0x4) Reason:

00040000 (Initiator Connection Failure)

Jul 15 08:46:07 iscsid:

Notice: Reclaimed Channel (H34 T1 C3 oid=2)

Jul 15 08:46:07 iscsid:

ep_poll failed rc-1

Jul 15 08:46:07 iscsid: Login Failed:

iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:1 ISID:0x1) Reason:

00040000 (Initiator Connection Failure)

Jul 15 08:46:07 iscsid:

Notice: Reclaimed Channel (H34 T1 C0 oid=2)

Jul 15 08:46:08 iscsid:

DISCOVERY: Pending=3 Failed=5

Jul 15 08:46:08 iscsid: ep_poll failed

rc-1

Jul 15 08:46:08 iscsid: Login Failed:

iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:0 ISID:0x1) Reason:

00040000 (Initiator Connection Failure)

Jul 15 08:46:08 iscsid:

Notice: Reclaimed Channel (H34 T0 C0 oid=1)

Jul 15 08:46:08 iscsid:

ep_poll failed rc-1

Jul 15 08:46:08 iscsid: Login Failed:

iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:0 ISID:0x3) Reason:

00040000 (Initiator Connection Failure)

Jul 15 08:46:08 iscsid:

Notice: Reclaimed Channel (H34 T0 C2 oid=1)

Jul 15 08:46:08 iscsid:

Notice: Reclaimed Target (H34 T0 oid=1)

Jul 15 08:46:09 iscsid:

DISCOVERY: Pending=1 Failed=7

Jul 15 08:46:10 iscsid: DISCOVERY:

Pending=1 Failed=7

Jul 15 08:46:11 iscsid: DISCOVERY: Pending=1

Failed=7

Jul 15 08:46:12 iscsid: DISCOVERY: Pending=1 Failed=7

Jul

15 08:46:13 iscsid: DISCOVERY: Pending=1 Failed=7

Jul 15 08:46:14

iscsid: DISCOVERY: Pending=1 Failed=7

Jul 15 08:46:15 iscsid:

DISCOVERY: Pending=1 Failed=7

Jul 15 08:46:16 iscsid: DISCOVERY:

Pending=1 Failed=7

Jul 15 08:46:17 iscsid: DISCOVERY: Pending=1

Failed=7

Jul 15 08:46:18 iscsid: DISCOVERY: Pending=1 Failed=7

Jul

15 08:46:19 iscsid: DISCOVERY: Pending=1 Failed=7

Jul 15 08:46:20

iscsid: DISCOVERY: Pending=1 Failed=7

Jul 15 08:46:21 iscsid:

DISCOVERY: Pending=1 Failed=7

Jul 15 08:46:22 iscsid: DISCOVERY:

Pending=1 Failed=7

Jul 15 08:46:23 iscsid: DISCOVERY: Pending=1

Failed=7

Jul 15 08:46:24 iscsid: DISCOVERY: Pending=1 Failed=7

Jul

15 08:46:25 iscsid: DISCOVERY: Pending=1 Failed=7

Jul 15 08:46:26

iscsid: DISCOVERY: Pending=1 Failed=7

Jul 15 08:46:27 iscsid:

DISCOVERY: Pending=1 Failed=7

Jul 15 08:46:27 vmkernel:

0:00:09:27.080 cpu12:4856)iscsi_linux: vmhba34: H:2 C:2 T:1 session

blocked

Jul 15 08:46:27 vmkernel: 0:00:09:27.080

cpu12:4856)iscsi_linux: vmhba34: H:2 C:2 T:1 session recovery timeout

Jul

15 08:46:27 iscsid: Shutdown Session:

iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:1 ISID:0x3) (T1 C2)

Reason=11

Jul 15 08:46:27 vmkernel: 0:00:09:27.080

cpu12:4856)iscsi_linux: vmhba34: H:2 C:2 T:1 session offlined

Jul

15 08:46:27 vmkernel: 0:00:09:27.080 cpu14:4856)iscsi_linux: [vmhba34:

H:2 C:2 T:1] session removed

Jul 15 08:46:27 vmkernel: 0:00:09:27.080

cpu14:4856)iscsi_linux: vmhba34: H:2 C:2 T:1 session freed

Jul 15

08:46:27 iscsid: Notice: Reclaimed Channel (H34 T1 C2 oid=2)

Jul 15

08:46:27 iscsid: Notice: Reclaimed Target (H34 T1 oid=2)

Jul 15

08:46:27 iscsid: Login Failed:

iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1

if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:1 ISID:0x3) Reason:

000b0000 (Initiator Connection Failure)

Jul 15 08:46:27 iscsid:

Notice: Delaying Release of (H34 T1 C2 session=7 target=2/7)

Jul 15

08:46:28 iscsid: DISCOVERY: Pending=0 Failed=8

Jul 15 08:47:58

shell[8936|http://communities.vmware.com/community-document-picker.jspa?communityID=&subject=8936]: cat /var/log/messages |grep iscsi

EDIT:

My last Log with correct IP and I have this same problem:

Jul 15 09:27:05 iscsid: discovery_sendtargets::Running discovery on IFACE default(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:27:05 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk2(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:27:05 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk1(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:27:05 iscsid: discovery_sendtargets::Running discovery on IFACE bnx2i-0026b98aecbd@vmk1(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:27:24 iscsid: discovery_sendtargets::Running discovery on IFACE default(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:27:24 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk2(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:27:24 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk1(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:27:24 iscsid: discovery_sendtargets::Running discovery on IFACE bnx2i-0026b98aecbd@vmk1(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:28:22 iscsid: discovery_sendtargets::Running discovery on IFACE default(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:28:22 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk2(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:28:22 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk1(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:28:22 iscsid: discovery_sendtargets::Running discovery on IFACE bnx2i-0026b98aecbd@vmk1(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:28:31 iscsid: discovery_sendtargets::Running discovery on IFACE default(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:28:31 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk2(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:28:31 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk1(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:28:31 iscsid: discovery_sendtargets::Running discovery on IFACE bnx2i-0026b98aecbd@vmk1(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:28:31 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:0 ISID:0x1)

Jul 15 09:28:31 iscsid: Notice: Assigned (H34 T0 C0 session=11, target=5/11)

Jul 15 09:28:31 iscsid: SessionResolve for 10.1.1.2 (via vmk1) started)

Jul 15 09:28:31 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:0 ISID:0x2)

Jul 15 09:28:31 iscsid: Notice: Assigned (H34 T0 C1 session=12, target=5/12)

Jul 15 09:28:31 iscsid: SessionResolve for 10.1.1.4 (via vmk1) started)

Jul 15 09:28:31 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:1 ISID:0x1)

Jul 15 09:28:31 iscsid: Notice: Assigned (H34 T1 C0 session=13, target=6/13)

Jul 15 09:28:31 iscsid: SessionResolve for 10.1.1.2 (via vmk1) started)

Jul 15 09:28:31 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:1 ISID:0x2)

Jul 15 09:28:31 iscsid: Notice: Assigned (H34 T1 C1 session=14, target=6/14)

Jul 15 09:28:31 iscsid: SessionResolve for 10.1.1.4 (via vmk1) started)

Jul 15 09:28:31 iscsid: DISCOVERY: Pending=4 Failed=0

Jul 15 09:28:32 iscsid: DISCOVERY: Pending=4 Failed=0

Jul 15 09:28:33 iscsid: DISCOVERY: Pending=4 Failed=0

Jul 15 09:28:34 iscsid: DISCOVERY: Pending=4 Failed=0

Jul 15 09:28:35 iscsid: DISCOVERY: Pending=4 Failed=0

Jul 15 09:28:36 iscsid: DISCOVERY: Pending=4 Failed=0

Jul 15 09:28:36 iscsid: ep_poll failed rc-1

Jul 15 09:28:36 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:1 ISID:0x1) Reason: 00040000 (Initiator Connection Failure)

Jul 15 09:28:36 iscsid: Notice: Reclaimed Channel (H34 T1 C0 oid=6)

Jul 15 09:28:36 iscsid: ep_poll failed rc-1

Jul 15 09:28:36 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:1 ISID:0x2) Reason: 00040000 (Inoitiator Connectin Failure)

Jul 15 09:28:36 iscsid: Notice: Reclaimed Channel (H34 T1 C1 oid=6)

Jul 15 09:28:36 iscsid: Notice: Reclaimed Target (H34 T1 oid=6)

Jul 15 09:28:37 iscsid: DISCOVERY: Pending=2 Failed=2

Jul 15 09:28:37 iscsid: ep_poll failed rc-1

Jul 15 09:28:37 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:0 ISID:0x1) Reason: 00040000 (Initiator Connection Failure)

Jul 15 09:28:37 iscsid: Notice: Reclaimed Channel (H34 T0 C0 oid=5)

Jul 15 09:28:37 iscsid: ep_poll failed rc-1

Jul 15 09:28:37 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:0 ISID:0x2) Reason: 00040000 (Initiator Connection Failure)

Jul 15 09:28:37 iscsid: Notice: Reclaimed Channel (H34 T0 C1 oid=5)

Jul 15 09:28:37 iscsid: Notice: Reclaimed Target (H34 T0 oid=5)

Jul 15 09:28:38 iscsid: DISCOVERY: Pending=0 Failed=4

Jul 15 09:29:15 shell[8936]: cat /var/log/messages |grep iscsi

array is on IP 10.1.1.2 and 10.1.1.4

In array log I see only like this message:

iSCSI logout from iqn.2010-07.com.vmware:esxi41-1 (10.1.1.10:50822) was received, reason .

binoche · ‎07-15-2010

iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.3:3260 (TPGT:0 ISID:0x2) Reason: 00040000 (Initiator Connection Failure)

usually initiator issue, could you please check this broadcom adapter configurations?

binoche, VMware VCP, Cisco CCNA

Tomek24VMWARE · ‎07-15-2010

Yes

I

checked the configuration.

vSwitch have MTU

1500 and MTU 1500 vmk have

Log:

Jul 15 09:54:52 vmkernel: <6>bnx2 vmnic0: CPU fw versions: TXP: 'txp5.0.0j13' TPAT: 'tpa5.0.0j13' RXP: 'rxp5.0.0j13' COM: 'com5.0.0j13' CP: 'cp5.0.0j13'

Jul 15 09:54:52 vmkernel: 0:01:17:52.062 cpu12:4108)<6>bnx2i::0x41000c804558: : ISCSI_INIT passed

Jul 15 09:54:55 Hostd: Task Created : haTask-ha-host-vim.host.StorageSystem.rescanHba-102

Jul 15 09:54:55 iscsid: discovery_sendtargets::Running discovery on IFACE default(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:54:55 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk2(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:54:55 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk1(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:54:55 iscsid: discovery_sendtargets::Running discovery on IFACE bnx2i-0026b98aecbd@vmk1(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)

Jul 15 09:54:55 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:0 ISID:0x1)

Jul 15 09:54:55 iscsid: Notice: Assigned (H34 T0 C0 session=21, target=5/11)

Jul 15 09:54:55 iscsid: SessionResolve for 10.1.1.2 (via vmk1) started)

Jul 15 09:54:55 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:0 ISID:0x2)

Jul 15 09:54:55 iscsid: Notice: Assigned (H34 T0 C1 session=22, target=5/12)

Jul 15 09:54:55 iscsid: SessionResolve for 10.1.1.4 (via vmk1) started)

Jul 15 09:54:55 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:1 ISID:0x1)

Jul 15 09:54:55 iscsid: Notice: Assigned (H34 T1 C0 session=23, target=6/13)

Jul 15 09:54:55 iscsid: SessionResolve for 10.1.1.2 (via vmk1) started)

Jul 15 09:54:55 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:1 ISID:0x2)

Jul 15 09:54:55 iscsid: Notice: Assigned (H34 T1 C1 session=24, target=6/14)

Jul 15 09:54:55 iscsid: SessionResolve for 10.1.1.4 (via vmk1) started)

Jul 15 09:54:55 iscsid: DISCOVERY: Pending=4 Failed=0

Jul 15 09:54:56 iscsid: DISCOVERY: Pending=4 Failed=0

Jul 15 09:54:57 iscsid: DISCOVERY: Pending=4 Failed=0

Jul 15 09:54:58 iscsid: DISCOVERY: Pending=4 Failed=0

Jul 15 09:54:59 iscsid: DISCOVERY: Pending=4 Failed=0

Jul 15 09:55:00 vmkernel: 0:01:17:59.610 cpu12:4108)<3>bnx2i::0x41000c804558: bnx2i_cm_connect_cmpl: cid 16 failed to connect 10000000

Jul 15 09:55:00 vmkernel: 0:01:17:59.610 cpu12:4108)<3>bnx2i::0x41000c804558: bnx2i_cm_connect_cmpl: cid 17 failed to connect 10000000

Jul 15 09:55:00 vmkernel: 0:01:17:59.610 cpu12:4108)<3>bnx2i::0x41000c804558: bnx2i_cm_connect_cmpl: cid 18 failed to connect 10000000

Jul 15 09:55:00 vmkernel: 0:01:17:59.610 cpu12:4108)<3>bnx2i::0x41000c804558: bnx2i_cm_connect_cmpl: cid 19 failed to connect 10000000

Jul 15 09:55:00 iscsid: ep_poll failed rc-1

Jul 15 09:55:00 vmkernel: 0:01:17:59.620 cpu14:4856)bnx2i::0x41000c804558: bnx2i_ep_disconnect: vmnic0: disconnecting ep 0x4100b00240e0 {16, 108000}, conn 0x0, sess 0x0, hba-state 1, num active conns 4

Jul 15 09:55:00 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:0 ISID:0x1) Reason: 00040000 (Initiator Connection Failure)

Jul 15 09:55:00 iscsid: Notice: Reclaimed Channel (H34 T0 C0 oid=5)

Jul 15 09:55:00 iscsid: ep_poll failed rc-1

Jul 15 09:55:00 vmkernel: 0:01:17:59.621 cpu14:4856)bnx2i::0x41000c804558: bnx2i_ep_disconnect: vmnic0: disconnecting ep 0x4100b00242d0 {17, 10a400}, conn 0x0, sess 0x0, hba-state 1, num active conns 3

Jul 15 09:55:00 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:0 ISID:0x2) Reason: 00040000 (Initiator Connection Failure)

Jul 15 09:55:00 iscsid: Notice: Reclaimed Channel (H34 T0 C1 oid=5)

Jul 15 09:55:00 iscsid: Notice: Reclaimed Target (H34 T0 oid=5)

Jul 15 09:55:00 iscsid: ep_poll failed rc-1

Jul 15 09:55:00 vmkernel: 0:01:17:59.623 cpu14:4856)bnx2i::0x41000c804558: bnx2i_ep_disconnect: vmnic0: disconnecting ep 0x4100b00244c0 {18, 10c800}, conn 0x0, sess 0x0, hba-state 1, num active conns 2

Jul 15 09:55:00 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:1 ISID:0x1) Reason: 00040000 (Initiator Connection Failure)

Jul 15 09:55:00 iscsid: Notice: Reclaimed Channel (H34 T1 C0 oid=6)

Jul 15 09:55:00 vmkernel: 0:01:17:59.625 cpu14:4856)bnx2i::0x41000c804558: bnx2i_ep_disconnect: vmnic0: disconnecting ep 0x4100b00246b0 {19, 10ec00}, conn 0x0, sess 0x0, hba-state 1, num active conns 1

Jul 15 09:55:00 iscsid: ep_poll failed rc-1

Jul 15 09:55:00 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:1 ISID:0x2) Reason: 00040000 (Initiator Connection Failure)

Jul 15 09:55:00 iscsid: Notice: Reclaimed Channel (H34 T1 C1 oid=6)

Jul 15 09:55:00 iscsid: Notice: Reclaimed Target (H34 T1 oid=6)

Jul 15 09:55:00 iscsid: DISCOVERY: Pending=0 Failed=4

binoche · ‎07-15-2010

so far I have no more ideas;

maybe you can have a check vmhba34 MTU, as your attached screenshot shows, MTU is 9000?

or check what are the differences vmhba34 from software iscsi adapter? vmkiscsi-tool --Parameter vmhba34

binoche, VMware VCP, Cisco CCNA

Tomek24VMWARE · ‎07-15-2010

vmhba didn't have MTU

Mtu have only vSwitch is set 1500

and vmk1 1500

~ # vmkiscsi-tool --Parameter vmhba34

iSCSI Parameters Setting:

-

Parameter Min/List Max Current Settable

-

error_recovery_level 0 2 0 No

init_login_retry_max 0 64 4 No

init_r2t OFF N/A OFF No

ON

max_outstanding_r2t 1 1 1 Yes

first_burst_len 8192 16777215 262144 Yes

max_burst_len 8192 16777215 262144 Yes

max_rev_data_seg_len 8192 16777215 131072 Yes

cmds_max 2 2048 128 No

immediate_data OFF N/A ON No

ON

default_time2wait 0 60 2 No

default_time2retain 0 60 0 No

login_timeout 0 60 15 No

logout_timeout 0 60 15 No

noop_out_interval 1 60 15 Yes

noop_out_timeout 10 30 10 Yes

recovery_timeout 1 120 10 Yes

header_digest NONE N/A NONE Yes

NONE,CRC32C

CRC32C,NONE

CRC32C

data_digest NONE N/A NONE Yes

NONE,CRC32C

CRC32C,NONE

CRC32C

delayed_ack OFF N/A ON Yes

ON

- inheritance[:smileyshocked:]: 0x0

- inheritted parameters:

For Software ISCSI Adapter on vmhba39

~ # vmkiscsi-tool --Parameter vmhba39

iSCSI Parameters Setting:

-

Parameter Min/List Max Current Settable

-

error_recovery_level 0 2 0 No

init_login_retry_max 0 64 4 No

init_r2t OFF N/A OFF No

ON

max_outstanding_r2t 1 8 1 Yes

first_burst_len 512 16777215 262144 Yes

max_burst_len 512 16777215 262144 Yes

max_rev_data_seg_len 512 16777215 131072 Yes

cmds_max 2 2048 128 No

immediate_data OFF N/A ON No

ON

default_time2wait 0 60 2 No

default_time2retain 0 60 0 No

login_timeout 0 60 15 No

logout_timeout 0 60 15 No

noop_out_interval 1 60 15 Yes

noop_out_timeout 10 30 10 Yes

recovery_timeout 1 120 10 Yes

header_digest NONE N/A NONE Yes

NONE,CRC32C

CRC32C,NONE

CRC32C

data_digest NONE N/A NONE Yes

NONE,CRC32C

CRC32C,NONE

CRC32C

delayed_ack OFF N/A ON Yes

ON

- inheritance[:smileyshocked:]: 0x0

- inheritted parameters:

All settings is default

binoche · ‎07-15-2010

I also have similar broadcom hba, its mtu different from your vmhba34

~ # esxcli swiscsi vmnic list -d vmhba37

vmnic4

Vmnic Name: vmnic4

Mac Address: 00:10:18:3d:a3:c8

Mac Address Settable: NO

Maximum Transfer Rate: 1000

Current Transfer Rate: 1000

Maximum Frame Size: 1500

~ # esxcli swiscsi nic list -d vmhba37

vmk1

Pnic Name: vmnic4

Ipv4 Address: 10.23.1.169

Ipv4 NetMask: 255.255.255.0

Ipv6 Addresses: fe80::250:56ff:fe7b:93af/64

Mac Address: 00:10:18:3d:a3:c8

Mtu: 1500 <--- 1500 instead of 9000

Toe: false

Tso: true

Tcp Checksum: false

Vlan: true

VlanId: 0

Ports Reserved: 63488~65536

Link Connected: true

Ethernet Speed: 1000

Packets Received: 181881

Packets Sent: 124479

Nic Driver: bnx2

Driver Version: 1.9.36b.v45.5-3vmw

Firmware Version: 4.4.14

~ #

binoche, VMware VCP, Cisco CCNA

Tomek24VMWARE · ‎07-16-2010

~

# esxcfg-nics -l

Name PCI Driver Link Speed Duplex MAC Address

MTU Description

vmnic0 0000:01:00.00 bnx2 Up 1000Mbps Full

00:26:b9:8a:ec:bd 1500 Broadcom Corporation PowerEdge R710 BCM5709

Gigabit Ethernet

vmnic1 0000:01:00.01 bnx2 Up 1000Mbps Full

00:26:b9:8a:ec:bf 1500 Broadcom Corporation PowerEdge R710 BCM5709

Gigabit Ethernet

vmnic2 0000:02:00.00 bnx2 Up 1000Mbps Full

00:26:b9:8a:ec:c1 1500 Broadcom Corporation PowerEdge R710 BCM5709

Gigabit Ethernet

vmnic3 0000:02:00.01 bnx2 Up 1000Mbps Full

00:26:b9:8a:ec:c3 1500 Broadcom Corporation PowerEdge R710 BCM5709

Gigabit Ethernet

vmnic4 0000:07:00.00 igb Up 1000Mbps Full

00:1b:21:63:c9:90 1500 Intel Corporation 82576 Gigabit Network

Connection

vmnic5 0000:07:00.01 igb Up 1000Mbps Full

00:1b:21:63:c9:91 1500 Intel Corporation 82576 Gigabit Network

Connection

vmnic6 0000:08:00.00 igb Up 1000Mbps Full

00:1b:21:63:c9:94 1500 Intel Corporation 82576 Gigabit Network

Connection

vmnic7 0000:08:00.01 igb Up 1000Mbps Full

00:1b:21:63:c9:95 1500 Intel Corporation 82576 Gigabit Network

Connection

~ # esxcli swiscsi nic list -d vmhba35

vmk4

pNic name: vmnic1

ipv4 address: 10.1.1.9

ipv4 net mask: 255.255.255.0

ipv6 addresses:

mac address: 00:26:b9:8a:ec:bf

mtu: 1500

toe: false

tso: true

tcp checksum: false

vlan: true

vlanId: 0

ports reserved: 63488~65536

link connected: true

ethernet speed: 1000

packets received: 48223

packets sent: 182

NIC driver: bnx2

driver version: 2.0.7d-2vmw

firmware version: 5.0.11 NCSI 2.0.5

~ # esxcli swiscsi nic list -d vmhba36

vmk3

pNic name: vmnic2

ipv4 address: 10.1.1.11

ipv4 net mask: 255.255.255.0

ipv6 addresses:

mac address: 00:26:b9:8a:ec:c1

mtu: 1500

toe: false

tso: true

tcp checksum: false

vlan: true

vlanId: 0

ports reserved: 63488~65536

link connected: true

ethernet speed: 1000

packets received: 60655

packets sent: 97

NIC driver: bnx2

driver version: 2.0.7d-2vmw

firmware version: 5.0.11 NCSI 2.0.5

~ # esxcli swiscsi nic list -d vmhba34

vmk1

pNic name: vmnic0

ipv4 address: 10.1.1.10

ipv4 net mask: 255.255.255.0

ipv6 addresses:

mac address: 00:26:b9:8a:ec:bd

mtu: 1500

toe: false

tso: true

tcp checksum: false

vlan: true

vlanId: 0

ports reserved: 63488~65536

link connected: true

ethernet speed: 1000

packets received: 282816

packets sent: 556

NIC driver: bnx2

driver version: 2.0.7d-2vmw

firmware version: 5.0.11 NCSI 2.0.5

~ # esxcfg-scsidevs -a

vmhba38 ata_piix link-n/a sata.vmhba38

(0:0:31.2) Intel Corporation PowerEdge R710 SATA IDE Controller

vmhba39 iscsi_vmk online iscsi.vmhba39

iSCSI Software Adapter

vmhba0 ata_piix link-n/a sata.vmhba0

(0:0:31.2) Intel Corporation PowerEdge R710 SATA IDE Controller

vmhba1 megaraid_sas link-n/a unknown.vmhba1

(0:3:0.0) LSI Logic / Symbios Logic Dell PERC H700 Integrated

vmhba33 usb-storage link-n/a usb.vmhba33

() USB

vmhba34 bnx2i online iscsi.vmhba34

Broadcom iSCSI Adapter

vmhba35 bnx2i online iscsi.vmhba35

Broadcom iSCSI Adapter

vmhba36 bnx2i online iscsi.vmhba36

Broadcom iSCSI Adapter

vmhba37 bnx2i unbound iscsi.vmhba37

Broadcom iSCSI Adapter

~ # esxcli swiscsi vmknic list -d vmhba36

vmk3

vmknic name: vmk3

mac address: 00:50:56:77:01:d6

mac address settable: NO

~ # esxcli swiscsi vmknic list -d vmhba34

vmk1

vmknic name: vmk1

mac address: 00:50:56:7e:c7:b2

mac address settable: NO

~ # esxcli swiscsi vmknic list -d vmhba35

vmk4

vmknic name: vmk4

mac address: 00:50:56:7d:90:a2

mac address settable: NO

vmhba34,35,36,37 is a BroadCom Iscsi Adapter

When I connect vmknic0 or 1 or 2 or 3 to vmhba39 (Software ISCSI Adapter

) all is OK iscsi see LUN.

On Broadcom adapter not see LUN, but trying connect to matrix and

closing session

See this post:

Andy_Banta · ‎07-16-2010

This all appears to be set up properly, and the esxcli swiscsi nic list command would nott be showing the correct NIC if some step was missing.

What target are you using?

What is the address of the target you are using? Note that Broadcom adapters won't use next hops.

Andy

Tomek24VMWARE · ‎07-16-2010

My target is

10.1.1.1

10.1.1.2

10.1.1.3

10.1.1.4

I have matrix with 4 portal.

Im not use next hope Ip is in this same subnets.

shame

that VMware employees do not want to say, what is wrong?

Andy_Banta · ‎07-16-2010

Again, this all looks OK.

Is the Matrix on the HCL? I'm not familiar with it. Does it have any sort of access control that might be getting in the way?

Can you grep the iscsid log entries out of the /var/log/messages file? This might give some indication of why the connections are not being established. Does the array side provide any log of events? Based on what you've described so far, nothing seems to be out of whack, so it's going to take a little more digging.

Thanks,

Andy

Tomek24VMWARE · ‎07-24-2010

Matrix is P300Q-D424 this matrix is in VMware HCL list.

Arun_kumar · ‎08-10-2010

HI,

i have insalled ESX4.1 after the fresh installation i not able to see WWN number of my FC-HBA(Brocade)..

Am i missing some wherer

Andy_Banta · ‎08-10-2010

Arun,

You might want to start this as a new message thread. Broadcom iSCSI HBAs and Brocade FC HBAs are as similar as Coq Au Vin and Foghorn Leghorn.

Andy

All

ESXi 4.1 Broadcom iSCSI Adapter - how configure this hba?