See other post: https://forum.proxmox.com/threads/c...c-software-defined-storage.142472/post-639567
Storage based snaps are not supported at this time. (see screenshot image that shows this).
Attachments
Last edited:
[TUTORIAL] Creating 2 node Proxmox VE cluster with StorMagic software defined storage
- Thread starter brucekornfeld
- Start date
Storage based snaps are not supported at this time. (see screenshot image that shows this).
Thanks @RolandK for helping me explain. I am just sharing an alternative approach to ceph. Perhaps the disconnect here is that SvSAN was designed for small environments (edge/smb/robo) with limited budget and small hardware requirements (1vCPU, 1GB memory, 1 disk drive of any type). ceph requires a lot more than that. And yes - we do require 3 nodes (for proper quorum management), but our 3rd node doesn't have to be a full server - it is a small service that can run on anything (even raspberry pi if you want) and a single witness supports up to 1,000 clusters, only requires 9Kb/sec network connection and can withstand up to 3000ms latency. It was designed for edge use cases.
Last edited:
The difference is that the SvSAN witness is not a full node, each witness supports up to 1,000 clusters with minimal networking requirements (9Kb/sec). To answer your question on why you'd want to run 2 nodes is cost or space. The environments that are using SvSAN are typically edge and smb where a 2 server solution is preferable to 3 (airports, retail stores, oil rigs, manufacturing plants, wind farms, schools). If you need 3 nodes for processing power and storage - that is great and ceph is probably a perfect solution. And you wouldn't be running a cluster in a cluster. Glad to expand on that if desired.
Plans for supporting Proxmox: this is our first step. We published documents to help users that want to install SvSAN as the storage layer with Proxmox: https://support.stormagic.com/hc/en-gb/sections/14959498948381-SvSAN-Proxmox-7 We (StorMagic) will support users that wish to deploy SvSAN and to use it in production in a proxmox environment. Next up for us is to leverage the proxmox published APIs and plug-ins to make the deployment process easier.
Thanks for reply @pveuser113 I commented on other posts so this may be repetitive. I think the disconnect is that for some environments keeping the hardware costs to the absolute minimum is paramount. And our witness is a 1:1,000 design so that users with a large # of sites can deploy one witness for 1,000 sites with very small networking requirements (9Kb/sec, 3000 ms latency). Yes - the witness is a third node - not arguing that at all. Our largest customers has over 6,000 sites running 2 nodes each and they run 7 witnesses in their corporate datacenters (a single VM each with very little hardware allocated to it). The wtiness is only monitoring heartbeat and its not in the data path like most other witness / 3 node solutions out there.
correct. the witness can run anywhere - corp datacenter, cloud, windows laptop, raspberry pi, etc...etc...), 9Kb/sec network connection
@brucekornfeld , did stormagic ever think on providing some free svsan license small virtual storage amount (i guess <<500gb and usage limitation for non prod is ok) for hobbyists and tech enthusiasts ? ( like leftand did for example https://community.hpe.com/t5/around...toreonce-vsa-1tb-data-protection/ba-p/6944232 )
furthermore, i have to admit that 15 days of eval period is a rather short timeframe ( i rally think it's awful short) . that scares me away personally.
if stormagic wants to delight and inspire people for your product and want to especially place it in proxmox orbit/territory, i guess some free but limited license would be helpful to get people on the boat , by attracting them via getting experience with it and using it.
i know at least 4 persons in my private orbit who run a proxmox cluster privately and non production , and i am running two. i search for quite a while for a ceph alternative to provide ha storage to such clusters, to get some experience with that and later on recommend for work.
furthermore, i know a lot who currently leave the sinking vmware boat , not least because of esxi free being revoked.
so, when vmware doing completely wrong (and they do, i have rarely seen such stupid and arrogant action) - stormagic could do something better/right. and get profit from that.
furthermore, i have to admit that 15 days of eval period is a rather short timeframe ( i rally think it's awful short) . that scares me away personally.
if stormagic wants to delight and inspire people for your product and want to especially place it in proxmox orbit/territory, i guess some free but limited license would be helpful to get people on the boat , by attracting them via getting experience with it and using it.
i know at least 4 persons in my private orbit who run a proxmox cluster privately and non production , and i am running two. i search for quite a while for a ceph alternative to provide ha storage to such clusters, to get some experience with that and later on recommend for work.
furthermore, i know a lot who currently leave the sinking vmware boat , not least because of esxi free being revoked.
so, when vmware doing completely wrong (and they do, i have rarely seen such stupid and arrogant action) - stormagic could do something better/right. and get profit from that.
Great idea! Thanks for the feedback. I've already starting pursuing this internally. Stay tuned - I'll update this thread once I have a firm answer.
Actually you can. Healthy amount of cores, ram, and diskIO on the current generation PI/ARM/etc boxes.
you "can" isnt a particularly useful standard.
without proper networking or OSD bandwidth its not really useful for anything except for the lulz...
I got a demo a few months ago, did you try the final release? Had some big flaws and things that were missing a few months ago. Will check my notes tomorrow to see what flaws I noticed the last time.
so we went from head of marketing posting in every ceph thread "dont use ceph use our in-vm solution", to "dont use proxmox use another hypervisor".
The pricing is $2049 for non-HA 2TB in 12 months. Thats $85/TB per month of non-encrypted (extra) and not-protected (?) data.
Cant they start their own forum and have "friends" advertise there?
The pricing is $2049 for non-HA 2TB in 12 months. Thats $85/TB per month of non-encrypted (extra) and not-protected (?) data.
Cant they start their own forum and have "friends" advertise there?
Last edited:
Checked a few of those solutions and even if the concept is nice and sure they work perfectly, for me they fall into the niche solutions when you can't use Ceph for performance reasons, mostly disk latency. None beats Ceph in data resiliency and for their prices you can almost get a third node for your cluster and use Ceph.
It's good to see that those solutions support Proxmox VE because someone may be using them already with other hypervisor and are used to work with them, so they can trust them on PVE too.
It's good to see that those solutions support Proxmox VE because someone may be using them already with other hypervisor and are used to work with them, so they can trust them on PVE too.