Shared storage recommendations.

E

Esben Viborg

Member
Oct 12, 2017
22
0
6
40
Hi

Atm. i am running a Proxmox cluster with 6 nodes. They are all configured to run the vms on each nodes own LVM-thin storage.
However i would like to move to a shared storage solution.
I have looked at ceph, however due to storage port limits in my current nodes, im not able to install extra disks in each node to run Ceph.

Performance is key. The solution has to run fairly fast.

Any recommendations?

/Glacier
 
mir said:
A storage solution based on Omnios using ZFS over iSCSI is rock stable
Click to expand...

Is there a way to have a HA configuration similar to that what some people built around FreeBSD with dual controllers on two boxes with a kind of failover ZFS?
 
LnxBil said:
Is there a way to have a HA configuration similar to that what some people built around FreeBSD with dual controllers on two boxes with a kind of failover ZFS?
Click to expand...
If you have cash to spend (RSF-1): https://www.youtube.com/watch?v=JZ2PK-AXZ0A

Otherwise use UPS to guard your storage server and
Cheap: multiple nics using LACP
Less cheap: Configure multipath on proxmox to storage server preferable using LACP on each path
 
RSF-1 is what is used by Nextena for their ZFS storage offerings.

Currently investigating it's use.
So basically you can achieve hyperconvergence for two nodes, where your storage resides on both nodes at the same time.
RPO is typically 15min (it's snapshot based), but can be configured lower depending on bandwidth I guess.
Shares are done via nfs, smb or iscsi.
HA is achieved via a VRRP, which will failover to the other node.

It's near realtime HA.

Prices are really good compared to concurrence (take linbit prices and divide them by 10, also no subscription fees. Licences are perpetual).

All in all, if your RPO can be 15 minutes instead of instant, it's a cheap and good solution.
 
jt_telrite said:
Any storage solution that aims to help Proxmox compete with ESXI \ VMWare has to feature "snapshots".
Click to expand...
Did you mean is: use any commercial storage that support snapshot and replication function can helps Proxmox VE to compete with VMware?
 
jt_telrite said:
i'm gambling on the plugin to mount a truenas iscsi export as a zfs over iscsi storage. it works well but i'm still concerned with moving it to production.
Click to expand...
Will work, as long as:
- You don't use TrueNAS core with LAGG (is hellish in terms of network stability)
- iSCSI timeouts are up to 30 seconds, your VMs must tolerate this in case of failure
 
orsiris said:
Will work, as long as:
- You don't use TrueNAS core with LAGG (is hellish in terms of network stability)
- iSCSI timeouts are up to 30 seconds, your VMs must tolerate this in case of failure
Click to expand...
I did some reading on that "RSF-1 ... ZFS storage offerings." if there isn't a witness to contend with... I'm very interested!
 
jt_telrite said:
I did some reading on that "RSF-1 ... ZFS storage offerings." if there isn't a witness to contend with... I'm very interested!
Click to expand...
AFAIK there is no witness, since it's a active/passive setup, where active/active is achieved by doing 2 active/passive inverted setups.
I'm currently testing RSF-1, but I must admit that of all the solutions I checked, it looks the most promising as for now.
There are still some caveats (replication is done via ssh, so it's cpu bound and not fast, but they're currently implementing mbuffer replication for next v2.4.0), but it still looks great.
 
You must log in or register to reply here.
Top Bottom