I'm trying to get the dependent hardware iSCSI (with Broadcom 5709c adapters) working. I'm going to use vmhba32, 34 and 36 (they are associated with vmnic0, vmnic2 and vmnic4, respectively).
I've created a vSwitch with three VMkernel interfaces (vmk2, vmk3, vmk4) and used 'esxcli swiscsi nic add -n port_name -d vmhba##' to attach the vmk# interface to a vmhba## interface.
I've editted the iqn/wwn of the three vmhba adapters, and added an iSCSI Target to the Dynamic Discovery/SendTarget method.
After a rescan on all three adapters, I see mixed results. On one out of three, I see that the 'Static Discovery' tab has been automatically filled with targets/LUNs, and I actually do see a device/LUN available. On the other two vmhba adapters, the 'Static Discovery' tab is not filled and I do not see any devices/volumes to attach to.
Logging from /var/log/messages when performing a manual rescan on one of the adapters that doesn't show any LUNs:
Aug 22 11:42:46 Hostd: [2010-08-22 11:42:46.626 46B46B90 verbose 'App'] Timed out reading between HTTP requests. : Read timeout after approximately 50000ms. Closing stream TCP(local=127.0.0.1:57230, peer=127.0.0.1:8309) Aug 22 11:42:47 Hostd: [2010-08-22 11:42:47.466 46A2EB90 verbose 'Locale'] Default resource used for 'host.SystemIdentificationInfo.IdentifierType.AssetTag.label' expected in module 'enum'. Aug 22 11:42:47 Hostd: [2010-08-22 11:42:47.466 46A2EB90 verbose 'Locale'] Default resource used for 'host.SystemIdentificationInfo.IdentifierType.AssetTag.summary' expected in module 'enum'. Aug 22 11:42:47 Hostd: [2010-08-22 11:42:47.467 46B05B90 verbose 'Locale'] Default resource used for 'host.SystemIdentificationInfo.IdentifierType.AssetTag.label' expected in module 'enum'. Aug 22 11:42:47 Hostd: [2010-08-22 11:42:47.467 46B05B90 verbose 'Locale'] Default resource used for 'host.SystemIdentificationInfo.IdentifierType.AssetTag.summary' expected in module 'enum'. Aug 22 11:42:55 Hostd: [2010-08-22 11:42:55.553 46B46B90 info 'TaskManager' opID=8AD7B284-00000059] Task Created : haTask-ha-host-vim.host.StorageSystem.rescanHba-15 Aug 22 11:42:55 iscsid: discovery_sendtargets::Running discovery on IFACE default(bnx2i-1cc1dee46bfc) (drec.transport=bnx2i-1cc1dee46bfc) Aug 22 11:43:00 iscsid: connection failed for discovery (err = Interrupted system call)! Aug 22 11:43:00 vmkernel: 0:00:04:22.065 cpu12:4848)Tcpip: 2229: msleep returned 4 Aug 22 11:43:00 iscsid: connection to discovery address 172.20.161.100 failed Aug 22 11:43:00 iscsid: connection login retries (reopen_max) 5 exceeded Aug 22 11:43:00 iscsid: discovery_sendtargets::Running discovery on IFACE bnx2i-1cc1dee46bfc@vmk2(bnx2i-1cc1dee46bfc) (drec.transport=bnx2i-1cc1dee46bfc) Aug 22 11:43:05 vmkernel: 0:00:04:27.068 cpu14:4848)Tcpip: 2229: msleep returned 4 Aug 22 11:43:05 iscsid: connection failed for discovery (err = Interrupted system call)! Aug 22 11:43:05 iscsid: connection to discovery address 172.20.161.100 failed Aug 22 11:43:05 iscsid: connection login retries (reopen_max) 5 exceeded Aug 22 11:43:05 iscsid: discovery_sendtargets::Filtered out IFACE bnx2i-1cc1dee47b10@vmk3(bnx2i-1cc1dee47b10) (drec.transport=bnx2i-1cc1dee46bfc) Aug 22 11:43:05 iscsid: discovery_sendtargets::Filtered out IFACE bnx2i-78e7d1577bcc@vmk4(bnx2i-78e7d1577bcc) (drec.transport=bnx2i-1cc1dee46bfc) Aug 22 11:43:05 iscsid: DISCOVERY: Pending=0 Failed=0 Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.598 46AC4B90 verbose 'StorageSystem' opID=8AD7B284-00000059] SendStorageInfoEvent() called Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.598 46AC4B90 verbose 'Hostsvc::DatastoreSystem' opID=8AD7B284-00000059] ReconcileVMFSDatastores called: refresh = true, rescan = false Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.598 46AC4B90 verbose 'FSVolumeProvider' opID=8AD7B284-00000059] RefreshVMFSVolumes called Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.609 465D2B90 info 'App'] CreateISCSIHBA Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.648 46AC4B90 verbose 'FSVolumeProvider' opID=8AD7B284-00000059] RefreshVMFSVolumes: refreshed volume, id 4c6ebaaf-77fb76d7-72a9-78e7d1f7b584, name TV1 Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.688 465D2B90 info 'App'] CreateISCSIHBA Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.690 46AC4B90 verbose 'FSVolumeProvider' opID=8AD7B284-00000059] RefreshVMFSVolumes: refreshed volume, id 4c6bec8f-4b31d6ef-68d6-1cc1dee46bfe, name esx01 Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.690 46AC4B90 verbose 'Hostsvc::Datastore' opID=8AD7B284-00000059] SetVolume: Datastore 4c6ebaaf-77fb76d7-72a9-78e7d1f7b584 has changed provider volume pointer Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.690 46AC4B90 verbose 'Hostsvc::Datastore' opID=8AD7B284-00000059] SetVolume: Datastore 4c6bec8f-4b31d6ef-68d6-1cc1dee46bfe has changed provider volume pointer Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.690 46AC4B90 verbose 'Hostsvc::DatastoreSystem' opID=8AD7B284-00000059] ReconcileVMFSDatastores: Done discovering new filesystem volumes. Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.690 46AC4B90 info 'TaskManager' opID=8AD7B284-00000059] Task Completed : haTask-ha-host-vim.host.StorageSystem.rescanHba-15 Status success Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.702 469D2B90 info 'TaskManager' opID=8AD7B284-0000005E] Task Created : haTask-ha-host-vim.host.StorageSystem.rescanVmfs-16 Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.703 46AC4B90 verbose 'Hostsvc::DatastoreSystem' opID=8AD7B284-0000005E] ReconcileVMFSDatastores called: refresh = true, rescan = true Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.703 46AC4B90 verbose 'FSVolumeProvider' opID=8AD7B284-0000005E] RefreshVMFSVolumes called Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.703 46AC4B90 verbose 'FSVolumeProvider' opID=8AD7B284-0000005E] RescanVmfs called Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.736 465D2B90 info 'App'] CreateISCSIHBA Aug 22 11:43:05 vmkernel: 0:00:04:27.231 cpu21:8827)Vol3: 1604: Could not open device 'naa.600508b1001030393943304132300400:6' for probing: Permission denied Aug 22 11:43:05 vmkernel: 0:00:04:27.232 cpu21:8827)Vol3: 644: Could not open device 'naa.600508b1001030393943304132300400:6' for volume open: Permission denied Aug 22 11:43:05 vmkernel: 0:00:04:27.233 cpu21:8827)Vol3: 1604: Could not open device 'naa.600508b1001030393943304132300400:5' for probing: Permission denied Aug 22 11:43:05 vmkernel: 0:00:04:27.233 cpu21:8827)Vol3: 644: Could not open device 'naa.600508b1001030393943304132300400:5' for volume open: Permission denied Aug 22 11:43:05 vmkernel: 0:00:04:27.234 cpu21:8827)Vol3: 1604: Could not open device 'naa.600508b1001030393943304132300400:8' for probing: Permission denied Aug 22 11:43:05 vmkernel: 0:00:04:27.235 cpu21:8827)Vol3: 644: Could not open device 'naa.600508b1001030393943304132300400:8' for volume open: Permission denied Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.744 46740B90 verbose 'Hostsvc::DatastoreSystem'] VmfsUpdate: got VMFS message [N11HostdCommon18VmkernelUpdateVmfsE:0x46828208] timestamp=267237658 specific=0 name= label= Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.788 46AC4B90 verbose 'FSVolumeProvider' opID=8AD7B284-0000005E] RefreshVMFSVolumes: refreshed volume, id 4c6ebaaf-77fb76d7-72a9-78e7d1f7b584, name TV1 Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.812 46AC4B90 verbose 'FSVolumeProvider' opID=8AD7B284-0000005E] RefreshVMFSVolumes: refreshed volume, id 4c6bec8f-4b31d6ef-68d6-1cc1dee46bfe, name esx01 Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.812 46AC4B90 verbose 'Hostsvc::Datastore' opID=8AD7B284-0000005E] SetVolume: Datastore 4c6ebaaf-77fb76d7-72a9-78e7d1f7b584 has changed provider volume pointer Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.812 46AC4B90 verbose 'Hostsvc::Datastore' opID=8AD7B284-0000005E] SetVolume: Datastore 4c6bec8f-4b31d6ef-68d6-1cc1dee46bfe has changed provider volume pointer Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.812 46AC4B90 verbose 'Hostsvc::DatastoreSystem' opID=8AD7B284-0000005E] ReconcileVMFSDatastores: Done discovering new filesystem volumes. Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.812 46AC4B90 info 'TaskManager' opID=8AD7B284-0000005E] Task Completed : haTask-ha-host-vim.host.StorageSystem.rescanVmfs-16 Status success Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.873 465D2B90 info 'App'] CreateISCSIHBA Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.919 465D2B90 info 'App'] CreateISCSIHBA Aug 22 11:43:05 Hostd: [2010-08-22 11:43:05.997 465D2B90 info 'App'] CreateISCSIHBA
On line 36, volume probing and volume open commands fail with 'Permission denied', which would lead me to believe something is wrong on the array (like access control), but all three iqn identifiers are able to access the volume. On other hosts with identical configuration, not one but two vmhba adapters are able to see the device, which excludes any problem with 'only one connection between host and array when using dependent hw iscsi'.
So, the big question is, where do I look to solve this problem? How do I get all three vmhba adapters to see the LUN?
Cheers,
Joep Piscaer
VMware vExpert 2009
Virtual Lifestyle: http://www.virtuallifestyle.nl
Twitter: http://www.twitter.com/jpiscaer
LinkedIn: http://www.linkedin.com/in/jpiscaer
*If you found this information useful, please consider awarding points*
Haven't been able to update firmware, HP site has been down all day.
Did find out something else though: adapter that doesn't show volumes actually does see the targets in the 'Static Discovery' tab:
See, there are discovered iSCSI Targets!
But wait, even though they're listed under Static Discovery, they don't show as devices...
Does anyone have an explanation for that?
Cheers,
Joep Piscaer
VMware vExpert 2009
Virtual Lifestyle: http://www.virtuallifestyle.nl
Twitter: http://www.twitter.com/jpiscaer
LinkedIn: http://www.linkedin.com/in/jpiscaer
*If you found this information useful, please consider awarding points*