VMware Cloud Community
tbrown
Contributor
Contributor

Accessing iSCSI targets on Open Solaris

This post will be mostly a statement and little bit a question:

For those of you that didn't know the latest Nevada build or open Solaris supports iSCSI targets. It looks like it maybe a bit more complete than the IETD project this implementation. This implementation supports RESERVE/RELEASE which I'm told is very important when using vmotion to prevent data corruption.

I must say setting up the Solaris side is very easy.

iscsitadm create target -z 10g -b /export/home/test test

That creates a 10gb target and dump the container of the block device in /export/home/test and test is mearely a friendly name it creates the rest of the iqn number. I tested it using my M$ iSCSI initiator all is good I can see my LUNs.

Then I goto setup the ESX side. I enable the initiator. I disable the firewall rule to allow iSCSI out of the server (doh I forgot that one originally). I add my iSCSI server to the config. I rescan the initiator for LUNs which then causes iscsitgtd to die and all my LUNs go away Smiley Sad

Its easy to fix:

iscsitadm create target -b /export/home/test test

Then my LUNs are back. Has anyone been successful in getting ESX to attach to an iSCSI target on Open Solaris? I'm not doing anything fancy at all no encryption, no authenication.

I have also posted over at the iscsitgtd porject on opensolaris.org seeing if I get any hits.

tb

0 Kudos
6 Replies
Paul_Lalonde
Commander
Commander

I've done tests with ESX and numerous iSCSI targets, and I was not successful in establishing connectivity between ESX and Open Solaris.

I can't recall off the top of my head what the build # was at the time (38? 40?) but I encountered the same issue: Windows iSCSI initiator worked fine, but the ESX one did not.

As a test, could you try running the Windows MSCS (cluster server) validation test against it? This would be similar to the checks and balances that ESX performs against an iSCSI target to validate it will support the VMFS filesystem properly.

Paul

0 Kudos
tbrown
Contributor
Contributor

I got a response from the maintainers of the project. They said some of the changes that prevent ESX from working will be addressed in build 60 of Nevada. Still having issues different issues which I'll address with the maintainers of the iscsitgtd. But there is hope on the horizon.

0 Kudos
jingi
Contributor
Contributor

I think this is the best thread to post my workings and the problem am facing.

i have installed openfiler on vmware gsx 3.2.1 and two solaris nodes (solaris 10 11/06). I have created volumes and configured everything on openfiler using the admin console and ran the following commands on two solaris nodes.

#iscsiadm modify discovery --sendtargets enable

#iscsiadm add discovery-address 14.0.0.5:3260

#devfsadm

#iscsiadm list target -S

now after running the above "list target" on both the nodes, i am able to see the output as follows.

#################

FIRST SOLARIS NODE

##################

Target: iqn.2001-05.com.abcstorage:6-8a0900-37ad70401-bcfff02df8a421df-zzr1200-01

TPGT: default

ISID: 4000002a0000

Connections: 1

LUN: 0

Vendor: ABCSTOR

Product: 0010

OS Device Name: /dev/rdsk/c3t34d0s2

#################

SECOND SOLARIS NODE

##################

Target: iqn.2001-05.com.abcstorage:6-8a0900-37ad70401-bcfff02df8a421df-zzr1200-01

TPGT: default

ISID: 4000002a0000

Connections: 1

LUN: 0

Vendor: ABCSTOR

Product: 0010

OS Device Name: /dev/rdsk/c3t54d0s2

why are the OS DEVICE NAMES DIFFERENT ON BOTH THE NODES. BECAUSE OF THIS AM NOT ABLE TO INSTALL SOME SOFTWARE ON THE SHARED DEVICE.

somebody pl help. am stuck here

0 Kudos
Roman_Romano
Enthusiast
Enthusiast

For what is worth, I’ve got the OpenSolaris iSCSI Target to work and this is what fired my imagination: http://blogs.sun.com/simonredmill/entry/nevada_b54_iscsi_target_vmware

I'm currently using build 57 and ESX 3.0.1 and I can’t remember doing any fancy tricks to get it working.

I set up a standard install of OpenSolaris (build 57) and created a ZFS pool from which I created a zvol which I made an iSCSI target (build 57 comes with the shareiscsi=on switch in zfs, most handy!). Admittedly, I haven't done anything fancy like target portal group settings etc. But I was able to point my ESX servers (yes plural!) at the OpenSolaris box. As you did, I enabled the opening of the firewall for the iSCSI initiator, enabled the iSCSI software initiator, pointed it to my OpenSolaris box, connected to the target and formatted it as a VMFS datastore.

Even better, I am able to do the same with my second ESX server and have the OpenSolaris box as a shared storage device (can you tell where this is going...) Creating a virtual server on the first ESX box and storing it on the VMFS datastore held by the OpenSolaris box, I was then (through my VirtualCenter server) able to Successfully Vmotion the virtual server to the second ESX box, a process taking less than 20 seconds and suffering no dropped/lost packets along the way. The virtual server continues to function merrily on either server and is this poor mans answer to a SAN based shared storage Smiley Wink

The only problems I've had have been when I tried to deploy a virtual server from a template held elsewhere to the OpenSolaris datastore. This would indeed crash my iscsitgtd and I would have to go through the laborious process of restarting the service on the OpenSolaris box and 'messing about' with the iSCSI initiator on the ESX boxes (e.g. rediscovering the OpenSolaris iSCSI target, rescanning etc. etc.) But I can usually get things back.

I'm holding out for build 60 of Solaris Express Community Edition to deploy on my current build 57 box to see if it’s any more stable. From a production point of view, it still seems a bit 'flaky' but I am totally impressed and in awe of what can be accomplished with a dollop of perseverance and a bit of redundant kit.

My vision of an HP based OpenSolaris iSCSI Target, 'floating' on ZFS (and all the wonderful features that offers) and accessed by my Virtual Infrastructure setup may indeed be through rose tinted glasses. But surely the cleaver guys out there can get it working, and guys like me can set it up and to do the cool Virtual Infrastructure things. The thought of ZFS, iSCSI target and Virtual Infrastructure, well, isn't it the best thing ever??

0 Kudos
Paul_Lalonde
Commander
Commander

Roman,

I admire the work that Richard McNeal has done on the Solaris iSCSI target. I've been following it off and on since the project started.

I'm anxious to see the target working with ESX 3.0. When it's finished, SUN code is pretty darned solid so I'm sure we'll see good things with this project.

Paul

0 Kudos
Roman_Romano
Enthusiast
Enthusiast

Paul,

Glad there are fellow enthusiasts of the system out there.

The question is, do you ever think VMware would 'officially' sanction such an opensource system?

Regards

Roman

0 Kudos