OpenSolaris

Discussions Communities Projects Download Source Browser

Home » OpenSolaris Forums » ha-clusters » discuss

Thread: Possible to have a HA iSCSI cluster (using ZFS) ?

Welcome, Guest Help
Login Login
Guest Settings Guest Settings
Reply to this Thread Reply to this Thread Search Forum Search Forum Back to Thread List Back to Thread List

Permlink Replies: 10 - Last Post: Nov 23, 2009 1:35 PM by: deonc Threads: [ Previous | Next ]
andy.c

Posts: 4
From: GB

Registered: 11/5/09
Possible to have a HA iSCSI cluster (using ZFS) ?
Posted: Nov 5, 2009 6:57 AM
To: Communities » ha-clusters » discuss
  Click to reply to this thread Reply

Hey,

I've been digging around for ages now trying to find the answer, but keep hitting old resources saying iSCSI targets not tested yet etc.

Basically is it possible yet to build a HA iSCSI cluster? There seems to be so many different projects that cover part of the process (e.g. COMSTAR) but I can't seem to find a way of combining it all to provide a fully redundant, seamless failover storage system.

The fact that products like Nexentastor exist seems to hint that its not possible with current open projects?

Thanks in advance,
Andy.

roush

Posts: 43
From: California

Registered: 5/14/06
Re: [ha-clusters-discuss] Possible to have a HA iSCSI cluster (using ZFS) ?
Posted: Nov 5, 2009 12:45 PM   in response to: andy.c

  Click to reply to this thread Reply

Hi Andy,

iSCSI can be used with Sun Cluster in a variety of ways.

What do you mean by an HA iSCSI cluster ?

Regards,
Ellard

Andy Coates wrote:
> Hey,
>
> I've been digging around for ages now trying to find the answer, but keep hitting old resources saying iSCSI targets not tested yet etc.
>
> Basically is it possible yet to build a HA iSCSI cluster? There seems to be so many different projects that cover part of the process (e.g. COMSTAR) but I can't seem to find a way of combining it all to provide a fully redundant, seamless failover storage system.
>
> The fact that products like Nexentastor exist seems to hint that its not possible with current open projects?
>
> Thanks in advance,
> Andy.

_______________________________________________
ha-clusters-discuss mailing list
ha-clusters-discuss at opensolaris dot org
http://mail.opensolaris.org/mailman/listinfo/ha-clusters-discuss


andy.c

Posts: 4
From: GB

Registered: 11/5/09
Re: [ha-clusters-discuss] Possible to have a HA iSCSI cluster (using ZFS) ?
Posted: Nov 5, 2009 3:23 PM   in response to: roush
To: Communities » ha-clusters » discuss
  Click to reply to this thread Reply

Hi Ellard,

A 'HA iSCSI cluster' to me is essentially a group of servers (n+1) that provide iSCSI target services in a redundant environment, so basically a highly available iSCSI SAN. It would ideally offer features like the ability to do snapshots, automatic failover, multipath etc.

That make sense?

Thanks,
Andy.

jonloran

Posts: 68
From:

Registered: 1/10/08
[ha-clusters-discuss] Recommendation Request: Building Solaris 10 HA Containers with Open HA
Posted: Nov 19, 2009 3:41 PM   in response to: roush

  Click to reply to this thread Reply


Hi List,

I am seeking advice as to the feasibility of a project I'm working on:

Background:  
My sysadmin group supports a satellite missions ops center that relies on software which only works on Solaris SPARC systems.  The ops center currently has 22 Sunblade 1500's, one for each satellite used for data acquisition and commanding.  The overall system is networked such that we have central name service, and storage, yet the actual workstations are used to control missions and acquire data.  My plan is to replace each of these workstations with Solaris 10 branded containers, running on two T5120's setup in an HA configuration.  Each container would use a Sunray as it's head for the satellite operators.  There are many advantages to this setup, but it is critical that the containers reside in an HA environment.

What I would love to do is use Open HA to build the cluster, using the hardware minimized setup, so we don't need separate quorum hardware.  We have limited funds. We already own the T5120's and some Sunrays, but don't have the cash for expensive shared storage and controllers.   As it stands right now, we can't really build out a test environment, because the Solaris 10 branded zones don't work on snv_111b, and as I understand it, the current Open HA release won't work on the newer builds.  So my hope is that there will be an Open HA release coincident with Opensolaris 2010.02.  I also hope there will be a Solaris 10 branded zone that is compatible in 2010.02.  Is this a reasonable expectation?

Of course, there are other problems with this setup:

System recovery scenarios:   Since there's no boot CD for SPARC, recovering a system could be tricky.  We will need a boot server within our operations center to recover these systems of they completely die.  OTOH, hopefully there will be a SPARC boot CD for 2010.02.

System updates:  These will need to be applied with extreme care, since we don't want to break the cluster.  Unlike the current setup, all of our eggs will be in one basket on the Sunray/zone servers.

What am I not thinking about?

Thanks in advance for any thoughts/recommendations on this.

Jon


-     _____/     _____/      /           - Jonathan Loran -           -
-    /          /           /                IT Manager               -
-  _____  /   _____  /     /     Space Sciences Laboratory, UC Berkeley
-        /          /     /      (510) 643-5146 jloran at ssl dot berkeley dot edu
- ______/    ______/    ______/           AST:7731^29u18e3
                                 



_______________________________________________ ha-clusters-discuss mailing list ha-clusters-discuss at opensolaris dot org http://mail.opensolaris.org/mailman/listinfo/ha-clusters-discuss


javen

Posts: 52
From: CN

Registered: 5/29/06
Re: [ha-clusters-discuss] Possible to have a HA iSCSI cluster (using ZFS) ?
Posted: Nov 5, 2009 5:22 PM   in response to: andy.c

  Click to reply to this thread Reply

You might need to send email to storage-discuss to query how well Solaris iSCSI target and COMSTAR support SCSI reservation and SCSI 3 PGR. I think if SCSI 2 reservation and SCSI3 PGR are supported well, you are suppose to setup a iSCSI HA cluster successfully.

Javen

2009/11/5 Andy Coates <andy dot coates at corealtitude dot com>
Hey,

I've been digging around for ages now trying to find the answer, but keep hitting old resources saying iSCSI targets not tested yet etc.

Basically is it possible yet to build a HA iSCSI cluster?  There seems to be so many different projects that cover part of the process (e.g. COMSTAR) but I can't seem to find a way of combining it all to provide a fully redundant, seamless failover storage system.

The fact that products like Nexentastor exist seems to hint that its not possible with current open projects?

Thanks in advance,
Andy.
--
This message posted from opensolaris.org
_______________________________________________
ha-clusters-discuss mailing list
ha-clusters-discuss at opensolaris dot org
http://mail.opensolaris.org/mailman/listinfo/ha-clusters-discuss



--
Javen Wu
_______________________________________________ ha-clusters-discuss mailing list ha-clusters-discuss at opensolaris dot org http://mail.opensolaris.org/mailman/listinfo/ha-clusters-discuss


jdunham

Posts: 305
From: US

Registered: 3/9/05
Re: [ha-clusters-discuss] [storage-discuss] Possible to have a HA iSCSI cluster (using ZFS) ?
Posted: Nov 6, 2009 8:00 AM   in response to: javen

  Click to reply to this thread Reply

 Javen Wu wrote:

You might need to send email to storage-discuss to query how well Solaris iSCSI target and COMSTAR support SCSI reservation and SCSI 3 PGR. I think if SCSI 2 reservation and SCSI3 PGR are supported well, you are suppose to setup a iSCSI HA cluster successfully.

Yes, COMSTAR's LU provider supports SCSI 3 PGR, but this is a SCSI Target property.

HA iSCSI Clusters is an iSCSI Initiator side problem set, where not only is there a requirement for SCSI-3 PGR, but also HA support for the TCP/IP path between the iSCSI Initiator and iSCSI Target. 


Javen

2009/11/5 Andy Coates <andy dot coates at corealtitude dot com>
Hey,

I've been digging around for ages now trying to find the answer, but keep hitting old resources saying iSCSI targets not tested yet etc.

Basically is it possible yet to build a HA iSCSI cluster?  There seems to be so many different projects that cover part of the process (e.g. COMSTAR) but I can't seem to find a way of combining it all to provide a fully redundant, seamless failover storage system.

The fact that products like Nexentastor exist seems to hint that its not possible with current open projects?

Thanks in advance,
Andy.
--
This message posted from opensolaris.org
_______________________________________________
ha-clusters-discuss mailing list
ha-clusters-discuss at opensolaris dot org
http://mail.opensolaris.org/mailman/listinfo/ha-clusters-discuss



--
Javen Wu
_______________________________________________
storage-discuss mailing list
storage-discuss at opensolaris dot org
http://mail.opensolaris.org/mailman/listinfo/storage-discuss

Jim Dunham 
Engineering Manager
Core I/O - COMSTAR
Open Storage Systems Group

Sun Microsystems, Inc.
45 Network Drive
Burlington, MA 01803 USA
Phone x53360 / +1 (781) 730-4006
Email: James dot Dunham at Sun dot COM


_______________________________________________ ha-clusters-discuss mailing list ha-clusters-discuss at opensolaris dot org http://mail.opensolaris.org/mailman/listinfo/ha-clusters-discuss


andy.c

Posts: 4
From: GB

Registered: 11/5/09
Re: Possible to have a HA iSCSI cluster (using ZFS) ?
Posted: Nov 9, 2009 1:42 AM   in response to: andy.c
To: Communities » ha-clusters » discuss
  Click to reply to this thread Reply

After a *lot* of digging around trying to tie up COMSTAR and clustering I came across this:

http://docs.sun.com/app/docs/doc/820-7821/girgb?a=view

Is that not exactly what I'm after? I haven't got the hardware available right now to test it, but it *seems* to have most of the requirements?

Andy.

ulherr

Posts: 122
From: DE

Registered: 5/30/07
Re: [ha-clusters-discuss] Possible to have a HA iSCSI cluster (using ZFS) ?
Posted: Nov 9, 2009 1:50 AM   in response to: andy.c

  Click to reply to this thread Reply

But you need Open Solaris and open HA Cluster right now, COMSTAR is not
available in Solaris 10 AFAIK.

Detlef

Andy Coates wrote:
> After a *lot* of digging around trying to tie up COMSTAR and clustering I came across this:
>
> http://docs.sun.com/app/docs/doc/820-7821/girgb?a=view
>
> Is that not exactly what I'm after? I haven't got the hardware available right now to test it, but it *seems* to have most of the requirements?
>
> Andy.
>

--

*****************************************************************************
Detlef Ulherr
Staff Engineer Tel: (++49 6103) 752-248
Availability Engineering Fax: (++49 6103) 752-167
Sun Microsystems GmbH
Amperestr. 6 mailto:detlef dot ulherr at sun dot com
63225 Langen http://www.sun.de/
*****************************************************************************

Sitz der Gesellschaft:
Sun Microsystems GmbH, Sonnenallee 1, D-85551 Kirchheim-Heimstetten
Amtsgericht München: HRB 161028
Geschäftsführer: Thomas Schröder, Wolfgang Engels, Wolf Frenkel
Vorsitzender des Aufsichtsrates: Martin Häring

*****************************************************************************


_______________________________________________
ha-clusters-discuss mailing list
ha-clusters-discuss at opensolaris dot org
http://mail.opensolaris.org/mailman/listinfo/ha-clusters-discuss


hs86490

Posts: 24
From: DE

Registered: 10/29/07
Re: [ha-clusters-discuss] Possible to have a HA iSCSI cluster (using ZFS) ?
Posted: Nov 9, 2009 1:54 AM   in response to: andy.c

  Click to reply to this thread Reply

Hi Andy,
the problem is, that the term "HA iSCSI" leaves lots of room for
interpretation.

I assume what you want to have is that you have a cluster that provides
HA services (but not necessarily HA iSCSI targets, which is a different
issue), using - probably - local disks within the cluster nodes via iSCSI.

This is indeed described in the doc that you mention below.

A much better description can be found in Thorsten's blog at:
http://blogs.sun.com/TF/entry/hochverf%C3%BCgbarkeit_mit_minimalem_cluster.
This is a blog entry in German but has a link to an English whitepaper
that has it all. It is a setup that uses local disks only.

Now HA iSCSI targets would be a different setup, namely configuring an
iSCSI target and making that HA. It seems to me that the iSCSI target
implementation uses some local(!) configuration files that would need to
be put on shared storage or put into the CCR to make it failover
succesfully.

I am not sure if anybody is working on this one.

Regards
Hartmut


On 11/09/09 10:42, Andy Coates wrote:
> After a *lot* of digging around trying to tie up COMSTAR and clustering I came across this:
>
> http://docs.sun.com/app/docs/doc/820-7821/girgb?a=view
>
> Is that not exactly what I'm after? I haven't got the hardware available right now to test it, but it *seems* to have most of the requirements?
>
> Andy.
>

--
Sun Microsystems GmbH Hartmut Streppel
Sonnenallee 1 Systems Practice
D-85551 Kirchheim-Heimstetten Phone: +49 (0)89 46008 2563
Germany Mobile: +49 (0)172 8919711
http://www.sun.de FAX: +49 (0)89 46008 2572
mailto: hartmut dot streppel at sun dot com
My BLOG: http://blogs.sun.com/Hartmut
SAP Infos: http://wikis.sun.com/display/SAPonSun/SAP+on+Sun
Sitz der Gesellschaft
Sun Microsystems GmbH, Sonnenallee 1, D-85551 Kirchheim-Heimstetten
Amtsgericht München: HRB 161028
Geschäftsführer: Thomas Schröder, Wolfgang Engels, Wolf Frenkel
Vorsitzender des Aufsichtsrates: Martin Häring



_______________________________________________
ha-clusters-discuss mailing list
ha-clusters-discuss at opensolaris dot org
http://mail.opensolaris.org/mailman/listinfo/ha-clusters-discuss


andy.c

Posts: 4
From: GB

Registered: 11/5/09
Re: [ha-clusters-discuss] Possible to have a HA iSCSI cluster (using ZFS) ?
Posted: Nov 9, 2009 8:05 AM   in response to: hs86490
To: Communities » ha-clusters » discuss
  Click to reply to this thread Reply

> Hi Andy,
> the problem is, that the term "HA iSCSI" leaves lots
> of room for interpretation.

So I see! :)

[snip]

> Now HA iSCSI targets would be a different setup,
> namely configuring an
> iSCSI target and making that HA. It seems to me that
> the iSCSI target
> implementation uses some local(!) configuration files
> that would need to
> be put on shared storage or put into the CCR to make
> it failover succesfully.
>
> I am not sure if anybody is working on this one.

Yeah that's what I'm after. Basically providing what hardware vendors like Dell (MD3000i/Equalogic etc) do, expect with the tools available with Open Solaris. Basically a high available iSCSI SAN.

Andy.

deonc

Posts: 1
From:

Registered: 11/23/09
Re: [ha-clusters-discuss] Possible to have a HA iSCSI cluster (using ZFS) ?
Posted: Nov 23, 2009 1:35 PM   in response to: andy.c
To: Communities » ha-clusters » discuss
  Click to reply to this thread Reply

I'm also trying to figure out how to provide Highly Available iSCSI services using opensolaris for an ESX cluster.

I am currently running a nexentaOS box providing NFS services to my ESX cluster.

I want to add in another box, change the setup to iSCSI and provide failover AND dynamic load balancing.

The openHA whitepaper seems to provide 80% of the setup required.
The part which is still missing is how do I configure the two boxes providing iSCSI to have the same iSCSI target IQN and how do I configured ESX's software initiator to round robin between the multipaths to the IQN's.




Terms of Use | Privacy | Trademarks | Copyright Policy | Site Guidelines
Your use of this web site or any of its content or software indicates your agreement to be bound by these Terms of Use.
Copyright © 1995-2005 Sun Microsystems, Inc.