ZFS over iSCSI for HA

Blaise Saunders

New Member
Oct 30, 2018
4
0
1
25
Hi there!

I have 5*ProxMox servers running 5.2-9, one of which has a number of hard drives in them, I would like to share those disks to the other 4 servers in the cluster so that I can run HA. (to clarify, the other 4 servers contain minimal storage that I do not wish to store VMs on)

My understanding is that I need to create a ZFS pool and share it over iSCSI, but I'm a little unsure about how to proceed, is it a pool or volume I need to share? And I am confused as to the use of the SSH commands on the Wiki page... Could somebody please point me in the direction or clarify?

Thanks in advance!!

- Blaise
 
Think of it: The server with the disks is the single point of failure
Fair point! We are poor for hardware at the moment, the SAN is quite reliable but the compute nodes are not, as the business takes off we plan to add disk redundancy...
Would our design choice limit our abilities to duplicate the SAN?
 
can you spread out the disks equally to the nodes? Then CEPH would be an option.

The nodes vary greatly in speed and in networking, and we have invested in some Mellanox ConnectX cards to connect the main server to the SAN in hopes of using RDMA with iSCSI, so that is the preferred technology for now... Also the nodes are connected with teamed 4 port ethernet cards.
For some background, we are hoping to run some data backups for small businesses, we have some redundant NASs to store the data on, but we need some servers for ingress, verification, and hopefully virtual booting at a later date (probably to a separate ESXi server).
 
we figure a beefier pair of SANs would work better

I'd first go with a dual-headed single box 2 HE SAN, e.g. Fujitsu Eternus DX100 which is a dumb block storage that is therefore very cheap, but in itself totally redundant if you have redundant power lines. To have a ZFS-based redundant system, you have to have external software, because ZFS itself is not clusterable.

My understanding is that I need to create a ZFS pool and share it over iSCSI, but I'm a little unsure about how to proceed,

ZFS-over-iSCSI that is currently implemented is for special backend storage devices that will be controlled by PVE. There is ongoing development for Linux based backends and a FreeNAS backend. For more information, please refer to the article on the wiki:

https://pve.proxmox.com/wiki/Storage:_ZFS_over_iSCSI
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!