Hello All,
I testing Broadcom Adapter for iSCSI but adapter didn't work for me.
I did the same configuration as the iSCSI Software Adapter.
But Broadcom iSCSI adapter does not see the drives in the array.
Braodcom logs on to the matrix and session breaks.
What i'm doing wrong?
You met with something like that??
How configure Braodcom iSCSI adapter? Where is white paper for this?
Tom
maybe you can have a try the below steps,
1, find which vmnic located with vmhba34 in the same adapter?
esxcli swiscsi vmnic list --adapter vmhba34
2, port binding this vmnic to vmhba34
esxcli swiscsi nic add --nic --adapter vmhba34
binoche, VMware VCP, Cisco CCNA
I did asyou write, the result you have in the first post, but it does not work.
could you please recheck lun masking correct or not since vmhba34 has already found the array?
binoche, VMware VCP, Cisco CCNA
please post vmkernel messages when the session is connected and disconnected?
binoche, VMware VCP, Cisco CCNA
I habe 4 IP for My array
10.1.1.1-4
10.1.1.1 and 10.1.1.3 is connected to other switch for redundancy for other
10.1.1.2 and 10.1.1.4 is connected to this same switch with vmk1 on vmnic0
Logs from ESXi:
Jul 15 08:46:02 iscsid: discovery_sendtargets::Running discovery on
IFACE default(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)
Jul
15 08:46:02 iscsid: discovery_sendtargets::Filtered out IFACE
iscsi_vmk@vmk2(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)
Jul 15
08:46:02 iscsid: discovery_sendtargets::Filtered out IFACE
iscsi_vmk@vmk1(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)
Jul 15
08:46:02 iscsid: discovery_sendtargets::Running discovery on IFACE
bnx2i-0026b98aecbd@vmk1(bnx2i-0026b98aecbd)
(drec.transport=bnx2i-0026b98aecbd)
Jul 15 08:46:02 iscsid:
discovery_sendtargets::Running discovery on IFACE
default(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)
Jul
15 08:46:02 iscsid: discovery_sendtargets::Filtered out IFACE
iscsi_vmk@vmk2(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)
Jul 15
08:46:02 iscsid: discovery_sendtargets::Filtered out IFACE
iscsi_vmk@vmk1(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)
Jul 15
08:46:02 iscsid: discovery_sendtargets::Running discovery on IFACE
bnx2i-0026b98aecbd@vmk1(bnx2i-0026b98aecbd)
(drec.transport=bnx2i-0026b98aecbd)
Jul 15 08:46:02 iscsid: Login
Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:0 ISID:0x1)
Jul
15 08:46:02 iscsid: Notice: Assigned (H34 T0 C0 session=1, target=1/1)
Jul
15 08:46:02 iscsid: SessionResolve for 10.1.1.2 (via vmk1) started)
Jul
15 08:46:02 iscsid: Login Target:
iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.3:3260 (TPGT:0 ISID:0x2)
Jul
15 08:46:02 iscsid: Notice: Assigned (H34 T0 C1 session=2, target=1/2)
Jul
15 08:46:02 iscsid: SessionResolve for 10.1.1.3 (via vmk1) started)
Jul
15 08:46:02 iscsid: Login Target:
iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:0 ISID:0x3)
Jul
15 08:46:02 iscsid: Notice: Assigned (H34 T0 C2 session=3, target=1/3)
Jul
15 08:46:02 iscsid: SessionResolve for 10.1.1.4 (via vmk1) started)
Jul
15 08:46:02 iscsid: Login Target:
iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.1:3260 (TPGT:0 ISID:0x4)
Jul
15 08:46:02 iscsid: Notice: Assigned (H34 T0 C3 session=4, target=1/4)
Jul
15 08:46:02 iscsid: SessionResolve for 10.1.1.1 (via vmk1) started)
Jul
15 08:46:02 iscsid: Login Target:
iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:1 ISID:0x1)
Jul
15 08:46:02 iscsid: Notice: Assigned (H34 T1 C0 session=5, target=2/5)
Jul
15 08:46:02 iscsid: SessionResolve for 10.1.1.2 (via vmk1) started)
Jul
15 08:46:02 iscsid: Login Target:
iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.3:3260 (TPGT:1 ISID:0x2)
Jul
15 08:46:02 iscsid: Notice: Assigned (H34 T1 C1 session=6, target=2/6)
Jul
15 08:46:02 iscsid: SessionResolve for 10.1.1.3 (via vmk1) started)
Jul
15 08:46:02 iscsid: Login Target:
iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:1 ISID:0x3)
Jul
15 08:46:02 iscsid: Notice: Assigned (H34 T1 C2 session=7, target=2/7)
Jul
15 08:46:02 iscsid: SessionResolve for 10.1.1.4 (via vmk1) started)
Jul
15 08:46:02 iscsid: Login Target:
iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.1:3260 (TPGT:1 ISID:0x4)
Jul
15 08:46:02 iscsid: Notice: Assigned (H34 T1 C3 session=8, target=2/8)
Jul
15 08:46:02 iscsid: SessionResolve for 10.1.1.1 (via vmk1) started)
Jul
15 08:46:02 iscsid: DISCOVERY: Pending=8 Failed=0
Jul 15 08:46:03
iscsid: DISCOVERY: Pending=8 Failed=0
Jul 15 08:46:04 iscsid:
DISCOVERY: Pending=8 Failed=0
Jul 15 08:46:05 iscsid: DISCOVERY:
Pending=8 Failed=0
Jul 15 08:46:06 iscsid: sendto() failed (Host is
down)
Jul 15 08:46:06 iscsid: sendto() failed (Host is down)
Jul
15 08:46:06 iscsid: DISCOVERY: Pending=8 Failed=0
Jul 15 08:46:07
iscsid: The ARP lookup for 10.1.1.3 (via vmk1) failed, err_code=510
Jul
15 08:46:07 iscsid: The PMTU discovery for 10.1.1.3 (via vmk1) failed,
err_code=510
Jul 15 08:46:07 iscsid: The ARP lookup for 10.1.1.1 (via
vmk1) failed, err_code=510
Jul 15 08:46:07 iscsid: The PMTU
discovery for 10.1.1.1 (via vmk1) failed, err_code=510
Jul 15
08:46:07 iscsid: The ARP lookup for 10.1.1.3 (via vmk1) failed,
err_code=510
Jul 15 08:46:07 iscsid: The PMTU discovery for 10.1.1.3
(via vmk1) failed, err_code=112
Jul 15 08:46:07 iscsid: The ARP
lookup for 10.1.1.1 (via vmk1) failed, err_code=510
Jul 15 08:46:07
iscsid: The PMTU discovery for 10.1.1.1 (via vmk1) failed, err_code=112
Jul
15 08:46:07 iscsid: DISCOVERY: Pending=8 Failed=0
Jul 15 08:46:07
iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.3:3260 (TPGT:0 ISID:0x2) Reason:
00040000 (Initiator Connection Failure)
Jul 15 08:46:07 iscsid:
Notice: Reclaimed Channel (H34 T0 C1 oid=1)
Jul 15 08:46:07 iscsid:
Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.1:3260 (TPGT:0 ISID:0x4) Reason:
00040000 (Initiator Connection Failure)
Jul 15 08:46:07 iscsid:
Notice: Reclaimed Channel (H34 T0 C3 oid=1)
Jul 15 08:46:07 iscsid:
Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.3:3260 (TPGT:1 ISID:0x2) Reason:
00040000 (Initiator Connection Failure)
Jul 15 08:46:07 iscsid:
Notice: Reclaimed Channel (H34 T1 C1 oid=2)
Jul 15 08:46:07 vmkernel:
0:00:09:07.065 cpu15:4856)iscsi_linux: vmhba34: H:2 C:0 T:0 session
allocated
Jul 15 08:46:07 vmkernel: 0:00:09:07.065
cpu15:4856)iscsi_linux: vmhba34: H:2 C:2 T:1 session added
Jul 15
08:46:07 vmkernel: 0:00:09:07.065 cpu15:4856)iscsi_linux: [vmhba34: H:2
C:2 T:1] session created
Jul 15 08:46:07 iscsid: Login Failed:
iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.1:3260 (TPGT:1 ISID:0x4) Reason:
00040000 (Initiator Connection Failure)
Jul 15 08:46:07 iscsid:
Notice: Reclaimed Channel (H34 T1 C3 oid=2)
Jul 15 08:46:07 iscsid:
ep_poll failed rc-1
Jul 15 08:46:07 iscsid: Login Failed:
iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:1 ISID:0x1) Reason:
00040000 (Initiator Connection Failure)
Jul 15 08:46:07 iscsid:
Notice: Reclaimed Channel (H34 T1 C0 oid=2)
Jul 15 08:46:08 iscsid:
DISCOVERY: Pending=3 Failed=5
Jul 15 08:46:08 iscsid: ep_poll failed
rc-1
Jul 15 08:46:08 iscsid: Login Failed:
iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:0 ISID:0x1) Reason:
00040000 (Initiator Connection Failure)
Jul 15 08:46:08 iscsid:
Notice: Reclaimed Channel (H34 T0 C0 oid=1)
Jul 15 08:46:08 iscsid:
ep_poll failed rc-1
Jul 15 08:46:08 iscsid: Login Failed:
iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:0 ISID:0x3) Reason:
00040000 (Initiator Connection Failure)
Jul 15 08:46:08 iscsid:
Notice: Reclaimed Channel (H34 T0 C2 oid=1)
Jul 15 08:46:08 iscsid:
Notice: Reclaimed Target (H34 T0 oid=1)
Jul 15 08:46:09 iscsid:
DISCOVERY: Pending=1 Failed=7
Jul 15 08:46:10 iscsid: DISCOVERY:
Pending=1 Failed=7
Jul 15 08:46:11 iscsid: DISCOVERY: Pending=1
Failed=7
Jul 15 08:46:12 iscsid: DISCOVERY: Pending=1 Failed=7
Jul
15 08:46:13 iscsid: DISCOVERY: Pending=1 Failed=7
Jul 15 08:46:14
iscsid: DISCOVERY: Pending=1 Failed=7
Jul 15 08:46:15 iscsid:
DISCOVERY: Pending=1 Failed=7
Jul 15 08:46:16 iscsid: DISCOVERY:
Pending=1 Failed=7
Jul 15 08:46:17 iscsid: DISCOVERY: Pending=1
Failed=7
Jul 15 08:46:18 iscsid: DISCOVERY: Pending=1 Failed=7
Jul
15 08:46:19 iscsid: DISCOVERY: Pending=1 Failed=7
Jul 15 08:46:20
iscsid: DISCOVERY: Pending=1 Failed=7
Jul 15 08:46:21 iscsid:
DISCOVERY: Pending=1 Failed=7
Jul 15 08:46:22 iscsid: DISCOVERY:
Pending=1 Failed=7
Jul 15 08:46:23 iscsid: DISCOVERY: Pending=1
Failed=7
Jul 15 08:46:24 iscsid: DISCOVERY: Pending=1 Failed=7
Jul
15 08:46:25 iscsid: DISCOVERY: Pending=1 Failed=7
Jul 15 08:46:26
iscsid: DISCOVERY: Pending=1 Failed=7
Jul 15 08:46:27 iscsid:
DISCOVERY: Pending=1 Failed=7
Jul 15 08:46:27 vmkernel:
0:00:09:27.080 cpu12:4856)iscsi_linux: vmhba34: H:2 C:2 T:1 session
blocked
Jul 15 08:46:27 vmkernel: 0:00:09:27.080
cpu12:4856)iscsi_linux: vmhba34: H:2 C:2 T:1 session recovery timeout
Jul
15 08:46:27 iscsid: Shutdown Session:
iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:1 ISID:0x3) (T1 C2)
Reason=11
Jul 15 08:46:27 vmkernel: 0:00:09:27.080
cpu12:4856)iscsi_linux: vmhba34: H:2 C:2 T:1 session offlined
Jul
15 08:46:27 vmkernel: 0:00:09:27.080 cpu14:4856)iscsi_linux: [vmhba34:
H:2 C:2 T:1] session removed
Jul 15 08:46:27 vmkernel: 0:00:09:27.080
cpu14:4856)iscsi_linux: vmhba34: H:2 C:2 T:1 session freed
Jul 15
08:46:27 iscsid: Notice: Reclaimed Channel (H34 T1 C2 oid=2)
Jul 15
08:46:27 iscsid: Notice: Reclaimed Target (H34 T1 oid=2)
Jul 15
08:46:27 iscsid: Login Failed:
iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1
if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:1 ISID:0x3) Reason:
000b0000 (Initiator Connection Failure)
Jul 15 08:46:27 iscsid:
Notice: Delaying Release of (H34 T1 C2 session=7 target=2/7)
Jul 15
08:46:28 iscsid: DISCOVERY: Pending=0 Failed=8
Jul 15 08:47:58
shell[8936|http://communities.vmware.com/community-document-picker.jspa?communityID=&subject=8936]: cat /var/log/messages |grep iscsi
EDIT:
My last Log with correct IP and I have this same problem:
Jul 15 09:27:05 iscsid: discovery_sendtargets::Running discovery on IFACE default(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:27:05 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk2(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:27:05 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk1(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:27:05 iscsid: discovery_sendtargets::Running discovery on IFACE bnx2i-0026b98aecbd@vmk1(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:27:24 iscsid: discovery_sendtargets::Running discovery on IFACE default(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:27:24 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk2(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:27:24 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk1(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:27:24 iscsid: discovery_sendtargets::Running discovery on IFACE bnx2i-0026b98aecbd@vmk1(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:28:22 iscsid: discovery_sendtargets::Running discovery on IFACE default(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:28:22 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk2(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:28:22 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk1(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:28:22 iscsid: discovery_sendtargets::Running discovery on IFACE bnx2i-0026b98aecbd@vmk1(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:28:31 iscsid: discovery_sendtargets::Running discovery on IFACE default(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:28:31 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk2(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:28:31 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk1(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:28:31 iscsid: discovery_sendtargets::Running discovery on IFACE bnx2i-0026b98aecbd@vmk1(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:28:31 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:0 ISID:0x1)
Jul 15 09:28:31 iscsid: Notice: Assigned (H34 T0 C0 session=11, target=5/11)
Jul 15 09:28:31 iscsid: SessionResolve for 10.1.1.2 (via vmk1) started)
Jul 15 09:28:31 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:0 ISID:0x2)
Jul 15 09:28:31 iscsid: Notice: Assigned (H34 T0 C1 session=12, target=5/12)
Jul 15 09:28:31 iscsid: SessionResolve for 10.1.1.4 (via vmk1) started)
Jul 15 09:28:31 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:1 ISID:0x1)
Jul 15 09:28:31 iscsid: Notice: Assigned (H34 T1 C0 session=13, target=6/13)
Jul 15 09:28:31 iscsid: SessionResolve for 10.1.1.2 (via vmk1) started)
Jul 15 09:28:31 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:1 ISID:0x2)
Jul 15 09:28:31 iscsid: Notice: Assigned (H34 T1 C1 session=14, target=6/14)
Jul 15 09:28:31 iscsid: SessionResolve for 10.1.1.4 (via vmk1) started)
Jul 15 09:28:31 iscsid: DISCOVERY: Pending=4 Failed=0
Jul 15 09:28:32 iscsid: DISCOVERY: Pending=4 Failed=0
Jul 15 09:28:33 iscsid: DISCOVERY: Pending=4 Failed=0
Jul 15 09:28:34 iscsid: DISCOVERY: Pending=4 Failed=0
Jul 15 09:28:35 iscsid: DISCOVERY: Pending=4 Failed=0
Jul 15 09:28:36 iscsid: DISCOVERY: Pending=4 Failed=0
Jul 15 09:28:36 iscsid: ep_poll failed rc-1
Jul 15 09:28:36 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:1 ISID:0x1) Reason: 00040000 (Initiator Connection Failure)
Jul 15 09:28:36 iscsid: Notice: Reclaimed Channel (H34 T1 C0 oid=6)
Jul 15 09:28:36 iscsid: ep_poll failed rc-1
Jul 15 09:28:36 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:1 ISID:0x2) Reason: 00040000 (Inoitiator Connectin Failure)
Jul 15 09:28:36 iscsid: Notice: Reclaimed Channel (H34 T1 C1 oid=6)
Jul 15 09:28:36 iscsid: Notice: Reclaimed Target (H34 T1 oid=6)
Jul 15 09:28:37 iscsid: DISCOVERY: Pending=2 Failed=2
Jul 15 09:28:37 iscsid: ep_poll failed rc-1
Jul 15 09:28:37 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:0 ISID:0x1) Reason: 00040000 (Initiator Connection Failure)
Jul 15 09:28:37 iscsid: Notice: Reclaimed Channel (H34 T0 C0 oid=5)
Jul 15 09:28:37 iscsid: ep_poll failed rc-1
Jul 15 09:28:37 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:0 ISID:0x2) Reason: 00040000 (Initiator Connection Failure)
Jul 15 09:28:37 iscsid: Notice: Reclaimed Channel (H34 T0 C1 oid=5)
Jul 15 09:28:37 iscsid: Notice: Reclaimed Target (H34 T0 oid=5)
Jul 15 09:28:38 iscsid: DISCOVERY: Pending=0 Failed=4
Jul 15 09:29:15 shell[8936]: cat /var/log/messages |grep iscsi
array is on IP 10.1.1.2 and 10.1.1.4
In array log I see only like this message:
iSCSI logout from iqn.2010-07.com.vmware:esxi41-1 (10.1.1.10:50822) was received, reason .
iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.3:3260 (TPGT:0 ISID:0x2) Reason: 00040000 (Initiator Connection Failure)
usually initiator issue, could you please check this broadcom adapter configurations?
binoche, VMware VCP, Cisco CCNA
Yes
I
checked the configuration.
vSwitch have MTU
1500 and MTU 1500 vmk have
Log:
Jul 15 09:54:52 vmkernel: <6>bnx2 vmnic0: CPU fw versions: TXP: 'txp5.0.0j13' TPAT: 'tpa5.0.0j13' RXP: 'rxp5.0.0j13' COM: 'com5.0.0j13' CP: 'cp5.0.0j13'
Jul 15 09:54:52 vmkernel: 0:01:17:52.062 cpu12:4108)<6>bnx2i::0x41000c804558: : ISCSI_INIT passed
Jul 15 09:54:55 Hostd: Task Created : haTask-ha-host-vim.host.StorageSystem.rescanHba-102
Jul 15 09:54:55 iscsid: discovery_sendtargets::Running discovery on IFACE default(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:54:55 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk2(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:54:55 iscsid: discovery_sendtargets::Filtered out IFACE iscsi_vmk@vmk1(iscsi_vmk) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:54:55 iscsid: discovery_sendtargets::Running discovery on IFACE bnx2i-0026b98aecbd@vmk1(bnx2i-0026b98aecbd) (drec.transport=bnx2i-0026b98aecbd)
Jul 15 09:54:55 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:0 ISID:0x1)
Jul 15 09:54:55 iscsid: Notice: Assigned (H34 T0 C0 session=21, target=5/11)
Jul 15 09:54:55 iscsid: SessionResolve for 10.1.1.2 (via vmk1) started)
Jul 15 09:54:55 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:0 ISID:0x2)
Jul 15 09:54:55 iscsid: Notice: Assigned (H34 T0 C1 session=22, target=5/12)
Jul 15 09:54:55 iscsid: SessionResolve for 10.1.1.4 (via vmk1) started)
Jul 15 09:54:55 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:1 ISID:0x1)
Jul 15 09:54:55 iscsid: Notice: Assigned (H34 T1 C0 session=23, target=6/13)
Jul 15 09:54:55 iscsid: SessionResolve for 10.1.1.2 (via vmk1) started)
Jul 15 09:54:55 iscsid: Login Target: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:1 ISID:0x2)
Jul 15 09:54:55 iscsid: Notice: Assigned (H34 T1 C1 session=24, target=6/14)
Jul 15 09:54:55 iscsid: SessionResolve for 10.1.1.4 (via vmk1) started)
Jul 15 09:54:55 iscsid: DISCOVERY: Pending=4 Failed=0
Jul 15 09:54:56 iscsid: DISCOVERY: Pending=4 Failed=0
Jul 15 09:54:57 iscsid: DISCOVERY: Pending=4 Failed=0
Jul 15 09:54:58 iscsid: DISCOVERY: Pending=4 Failed=0
Jul 15 09:54:59 iscsid: DISCOVERY: Pending=4 Failed=0
Jul 15 09:55:00 vmkernel: 0:01:17:59.610 cpu12:4108)<3>bnx2i::0x41000c804558: bnx2i_cm_connect_cmpl: cid 16 failed to connect 10000000
Jul 15 09:55:00 vmkernel: 0:01:17:59.610 cpu12:4108)<3>bnx2i::0x41000c804558: bnx2i_cm_connect_cmpl: cid 17 failed to connect 10000000
Jul 15 09:55:00 vmkernel: 0:01:17:59.610 cpu12:4108)<3>bnx2i::0x41000c804558: bnx2i_cm_connect_cmpl: cid 18 failed to connect 10000000
Jul 15 09:55:00 vmkernel: 0:01:17:59.610 cpu12:4108)<3>bnx2i::0x41000c804558: bnx2i_cm_connect_cmpl: cid 19 failed to connect 10000000
Jul 15 09:55:00 iscsid: ep_poll failed rc-1
Jul 15 09:55:00 vmkernel: 0:01:17:59.620 cpu14:4856)bnx2i::0x41000c804558: bnx2i_ep_disconnect: vmnic0: disconnecting ep 0x4100b00240e0 {16, 108000}, conn 0x0, sess 0x0, hba-state 1, num active conns 4
Jul 15 09:55:00 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:0 ISID:0x1) Reason: 00040000 (Initiator Connection Failure)
Jul 15 09:55:00 iscsid: Notice: Reclaimed Channel (H34 T0 C0 oid=5)
Jul 15 09:55:00 iscsid: ep_poll failed rc-1
Jul 15 09:55:00 vmkernel: 0:01:17:59.621 cpu14:4856)bnx2i::0x41000c804558: bnx2i_ep_disconnect: vmnic0: disconnecting ep 0x4100b00242d0 {17, 10a400}, conn 0x0, sess 0x0, hba-state 1, num active conns 3
Jul 15 09:55:00 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev0.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:0 ISID:0x2) Reason: 00040000 (Initiator Connection Failure)
Jul 15 09:55:00 iscsid: Notice: Reclaimed Channel (H34 T0 C1 oid=5)
Jul 15 09:55:00 iscsid: Notice: Reclaimed Target (H34 T0 oid=5)
Jul 15 09:55:00 iscsid: ep_poll failed rc-1
Jul 15 09:55:00 vmkernel: 0:01:17:59.623 cpu14:4856)bnx2i::0x41000c804558: bnx2i_ep_disconnect: vmnic0: disconnecting ep 0x4100b00244c0 {18, 10c800}, conn 0x0, sess 0x0, hba-state 1, num active conns 2
Jul 15 09:55:00 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.2:3260 (TPGT:1 ISID:0x1) Reason: 00040000 (Initiator Connection Failure)
Jul 15 09:55:00 iscsid: Notice: Reclaimed Channel (H34 T1 C0 oid=6)
Jul 15 09:55:00 vmkernel: 0:01:17:59.625 cpu14:4856)bnx2i::0x41000c804558: bnx2i_ep_disconnect: vmnic0: disconnecting ep 0x4100b00246b0 {19, 10ec00}, conn 0x0, sess 0x0, hba-state 1, num active conns 1
Jul 15 09:55:00 iscsid: ep_poll failed rc-1
Jul 15 09:55:00 iscsid: Login Failed: iqn.2010-05.pl.iri:p300q-d424-fff9055d8:dev1.ctr1 if=bnx2i-0026b98aecbd@vmk1 addr=10.1.1.4:3260 (TPGT:1 ISID:0x2) Reason: 00040000 (Initiator Connection Failure)
Jul 15 09:55:00 iscsid: Notice: Reclaimed Channel (H34 T1 C1 oid=6)
Jul 15 09:55:00 iscsid: Notice: Reclaimed Target (H34 T1 oid=6)
Jul 15 09:55:00 iscsid: DISCOVERY: Pending=0 Failed=4
so far I have no more ideas;
maybe you can have a check vmhba34 MTU, as your attached screenshot shows, MTU is 9000?
or check what are the differences vmhba34 from software iscsi adapter? vmkiscsi-tool --Parameter vmhba34
binoche, VMware VCP, Cisco CCNA
vmhba didn't have MTU
Mtu have only vSwitch is set 1500
and vmk1 1500
~ # vmkiscsi-tool --Parameter vmhba34
iSCSI Parameters Setting:
-
Parameter Min/List Max Current Settable
-
error_recovery_level 0 2 0 No
init_login_retry_max 0 64 4 No
init_r2t OFF N/A OFF No
ON
max_outstanding_r2t 1 1 1 Yes
first_burst_len 8192 16777215 262144 Yes
max_burst_len 8192 16777215 262144 Yes
max_rev_data_seg_len 8192 16777215 131072 Yes
cmds_max 2 2048 128 No
immediate_data OFF N/A ON No
ON
default_time2wait 0 60 2 No
default_time2retain 0 60 0 No
login_timeout 0 60 15 No
logout_timeout 0 60 15 No
noop_out_interval 1 60 15 Yes
noop_out_timeout 10 30 10 Yes
recovery_timeout 1 120 10 Yes
header_digest NONE N/A NONE Yes
NONE,CRC32C
CRC32C,NONE
CRC32C
data_digest NONE N/A NONE Yes
NONE,CRC32C
CRC32C,NONE
CRC32C
delayed_ack OFF N/A ON Yes
ON
- inheritance[:smileyshocked:]: 0x0
- inheritted parameters:
For Software ISCSI Adapter on vmhba39
~ # vmkiscsi-tool --Parameter vmhba39
iSCSI Parameters Setting:
-
Parameter Min/List Max Current Settable
-
error_recovery_level 0 2 0 No
init_login_retry_max 0 64 4 No
init_r2t OFF N/A OFF No
ON
max_outstanding_r2t 1 8 1 Yes
first_burst_len 512 16777215 262144 Yes
max_burst_len 512 16777215 262144 Yes
max_rev_data_seg_len 512 16777215 131072 Yes
cmds_max 2 2048 128 No
immediate_data OFF N/A ON No
ON
default_time2wait 0 60 2 No
default_time2retain 0 60 0 No
login_timeout 0 60 15 No
logout_timeout 0 60 15 No
noop_out_interval 1 60 15 Yes
noop_out_timeout 10 30 10 Yes
recovery_timeout 1 120 10 Yes
header_digest NONE N/A NONE Yes
NONE,CRC32C
CRC32C,NONE
CRC32C
data_digest NONE N/A NONE Yes
NONE,CRC32C
CRC32C,NONE
CRC32C
delayed_ack OFF N/A ON Yes
ON
- inheritance[:smileyshocked:]: 0x0
- inheritted parameters:
All settings is default
I also have similar broadcom hba, its mtu different from your vmhba34
~ # esxcli swiscsi vmnic list -d vmhba37
vmnic4
Vmnic Name: vmnic4
Mac Address: 00:10:18:3d:a3:c8
Mac Address Settable: NO
Maximum Transfer Rate: 1000
Current Transfer Rate: 1000
Maximum Frame Size: 1500
~ # esxcli swiscsi nic list -d vmhba37
vmk1
Pnic Name: vmnic4
Ipv4 Address: 10.23.1.169
Ipv4 NetMask: 255.255.255.0
Ipv6 Addresses: fe80::250:56ff:fe7b:93af/64
Mac Address: 00:10:18:3d:a3:c8
Mtu: 1500 <--- 1500 instead of 9000
Toe: false
Tso: true
Tcp Checksum: false
Vlan: true
VlanId: 0
Ports Reserved: 63488~65536
Link Connected: true
Ethernet Speed: 1000
Packets Received: 181881
Packets Sent: 124479
Nic Driver: bnx2
Driver Version: 1.9.36b.v45.5-3vmw
Firmware Version: 4.4.14
~ #
binoche, VMware VCP, Cisco CCNA
~
# esxcfg-nics -l
Name PCI Driver Link Speed Duplex MAC Address
MTU Description
vmnic0 0000:01:00.00 bnx2 Up 1000Mbps Full
00:26:b9:8a:ec:bd 1500 Broadcom Corporation PowerEdge R710 BCM5709
Gigabit Ethernet
vmnic1 0000:01:00.01 bnx2 Up 1000Mbps Full
00:26:b9:8a:ec:bf 1500 Broadcom Corporation PowerEdge R710 BCM5709
Gigabit Ethernet
vmnic2 0000:02:00.00 bnx2 Up 1000Mbps Full
00:26:b9:8a:ec:c1 1500 Broadcom Corporation PowerEdge R710 BCM5709
Gigabit Ethernet
vmnic3 0000:02:00.01 bnx2 Up 1000Mbps Full
00:26:b9:8a:ec:c3 1500 Broadcom Corporation PowerEdge R710 BCM5709
Gigabit Ethernet
vmnic4 0000:07:00.00 igb Up 1000Mbps Full
00:1b:21:63:c9:90 1500 Intel Corporation 82576 Gigabit Network
Connection
vmnic5 0000:07:00.01 igb Up 1000Mbps Full
00:1b:21:63:c9:91 1500 Intel Corporation 82576 Gigabit Network
Connection
vmnic6 0000:08:00.00 igb Up 1000Mbps Full
00:1b:21:63:c9:94 1500 Intel Corporation 82576 Gigabit Network
Connection
vmnic7 0000:08:00.01 igb Up 1000Mbps Full
00:1b:21:63:c9:95 1500 Intel Corporation 82576 Gigabit Network
Connection
~ # esxcli swiscsi nic list -d vmhba35
vmk4
pNic name: vmnic1
ipv4 address: 10.1.1.9
ipv4 net mask: 255.255.255.0
ipv6 addresses:
mac address: 00:26:b9:8a:ec:bf
mtu: 1500
toe: false
tso: true
tcp checksum: false
vlan: true
vlanId: 0
ports reserved: 63488~65536
link connected: true
ethernet speed: 1000
packets received: 48223
packets sent: 182
NIC driver: bnx2
driver version: 2.0.7d-2vmw
firmware version: 5.0.11 NCSI 2.0.5
~ # esxcli swiscsi nic list -d vmhba36
vmk3
pNic name: vmnic2
ipv4 address: 10.1.1.11
ipv4 net mask: 255.255.255.0
ipv6 addresses:
mac address: 00:26:b9:8a:ec:c1
mtu: 1500
toe: false
tso: true
tcp checksum: false
vlan: true
vlanId: 0
ports reserved: 63488~65536
link connected: true
ethernet speed: 1000
packets received: 60655
packets sent: 97
NIC driver: bnx2
driver version: 2.0.7d-2vmw
firmware version: 5.0.11 NCSI 2.0.5
~ # esxcli swiscsi nic list -d vmhba34
vmk1
pNic name: vmnic0
ipv4 address: 10.1.1.10
ipv4 net mask: 255.255.255.0
ipv6 addresses:
mac address: 00:26:b9:8a:ec:bd
mtu: 1500
toe: false
tso: true
tcp checksum: false
vlan: true
vlanId: 0
ports reserved: 63488~65536
link connected: true
ethernet speed: 1000
packets received: 282816
packets sent: 556
NIC driver: bnx2
driver version: 2.0.7d-2vmw
firmware version: 5.0.11 NCSI 2.0.5
~ # esxcfg-scsidevs -a
vmhba38 ata_piix link-n/a sata.vmhba38
(0:0:31.2) Intel Corporation PowerEdge R710 SATA IDE Controller
vmhba39 iscsi_vmk online iscsi.vmhba39
iSCSI Software Adapter
vmhba0 ata_piix link-n/a sata.vmhba0
(0:0:31.2) Intel Corporation PowerEdge R710 SATA IDE Controller
vmhba1 megaraid_sas link-n/a unknown.vmhba1
(0:3:0.0) LSI Logic / Symbios Logic Dell PERC H700 Integrated
vmhba33 usb-storage link-n/a usb.vmhba33
() USB
vmhba34 bnx2i online iscsi.vmhba34
Broadcom iSCSI Adapter
vmhba35 bnx2i online iscsi.vmhba35
Broadcom iSCSI Adapter
vmhba36 bnx2i online iscsi.vmhba36
Broadcom iSCSI Adapter
vmhba37 bnx2i unbound iscsi.vmhba37
Broadcom iSCSI Adapter
~ # esxcli swiscsi vmknic list -d vmhba36
vmk3
vmknic name: vmk3
mac address: 00:50:56:77:01:d6
mac address settable: NO
~ # esxcli swiscsi vmknic list -d vmhba34
vmk1
vmknic name: vmk1
mac address: 00:50:56:7e:c7:b2
mac address settable: NO
~ # esxcli swiscsi vmknic list -d vmhba35
vmk4
vmknic name: vmk4
mac address: 00:50:56:7d:90:a2
mac address settable: NO
vmhba34,35,36,37 is a BroadCom Iscsi Adapter
When I connect vmknic0 or 1 or 2 or 3 to vmhba39 (Software ISCSI Adapter
) all is OK iscsi see LUN.
On Broadcom adapter not see LUN, but trying connect to matrix and
closing session
This all appears to be set up properly, and the esxcli swiscsi nic list command would nott be showing the correct NIC if some step was missing.
What target are you using?
What is the address of the target you are using? Note that Broadcom adapters won't use next hops.
Andy
My target is
10.1.1.1
10.1.1.2
10.1.1.3
10.1.1.4
I have matrix with 4 portal.
Im not use next hope Ip is in this same subnets.
shame
that VMware employees do not want to say, what is wrong?
Again, this all looks OK.
Is the Matrix on the HCL? I'm not familiar with it. Does it have any sort of access control that might be getting in the way?
Can you grep the iscsid log entries out of the /var/log/messages file? This might give some indication of why the connections are not being established. Does the array side provide any log of events? Based on what you've described so far, nothing seems to be out of whack, so it's going to take a little more digging.
Thanks,
Andy
Matrix is P300Q-D424 this matrix is in VMware HCL list.
HI,
i have insalled ESX4.1 after the fresh installation i not able to see WWN number of my FC-HBA(Brocade)..
Am i missing some wherer
Arun,
You might want to start this as a new message thread. Broadcom iSCSI HBAs and Brocade FC HBAs are as similar as Coq Au Vin and Foghorn Leghorn.
Andy