High available ZFS storage

[mir]

Hi all,

If somebody wants to try making a high available ZFS storage for Proxmox I was just referred to these two blog posts by Saso Kiselkov:
http://zfs-create.blogspot.dk/2013/06/building-zfs-storage-appliance-part-1.html
http://zfs-create.blogspot.dk/2014/05/building-zfs-storage-appliance-part-2.html

 

[dietmar]

How is data mirrored between both storage nodes?

 

[dswartz]

Mir, did you read the blog articles at all? The whole thing is for an omnios (or openindiana) based solution, not linux. If you want something linux based (for proxmox), you need to go with Zfs on Linux. Dietmar, the blog mir posted to uses pacemaker+heartbeat. I tried to use it but it did not work for me (or for some others either - virtual IP not working, packages not built properly, etc...) Saso never responded to posts asking about this and has not posted much of anything to that blog for a long time now... I am working on a solution using ZoL with CentOS7 as the storage appliance, with pacemaker+corosync. It works fine, but the sync write performance via NFS sucks due to lack of AIO support. There is a proposed patch by ryao which I tested that greatly improves this, so I am waiting on that to be committed to the tree...

 

[mir]

Mir, did you read the blog articles at all? The whole thing is for an omnios (or openindiana) based solution, not linux.

So because it is not GNU/Linux based I cannot post the links in this forum?

 

[mir]

How is data mirrored between both storage nodes?

I haven't tested but I think the mirroring is done by the use of ZFS receive/send between the two storage servers - this is also the way Nexenta does clustering.

 

[dswartz]

Are you serious? You post links with this tag "If somebody wants to try making a high available ZFS storage for Proxmox..." The blog articles refer specifically to Open Solaris architecture. They will be pretty close to 100% useless to someone who wants to do HA ZFS on a debian platform. There are many, many articles easily findable with google that describe pacemaker+corosync (or heartbeat, although that is deprecated) on Linux (if you go clusterlabs.org that will be a decent starting place for most people...)

 

[dswartz]

No, he was using dual-head SAS JBOD enclosures.

 

[mo_]

They will be pretty close to 100% useless to someone who wants to do HA ZFS on a debian platform.

Im not exactly sure what your problem is, but nobody said anything about a debian platform. You do realize, that storage FOR Proxmox is generally hosted on OTHER physical machines, right?