Seeking advice: Shared storage solution for PVE VM backups across multiple nodes

[nico2f]

Hey everyone,

I recently set up an LVM storage for my backups, following the guidance provided in this forum post. However, I've encountered an issue where the nodes aren't synchronizing their activities. Essentially, the backups stored on one node aren't visible from the others, and vice versa.

After some research, I suspect this could be due to the filesystem I'm using. It seems that ext4 doesn't support clusterization, which may explain the syncing problem. I considered switching to GFS2, but I came across discouraging feedback on its usage in this context.

Next, I explored using ZFS via iSCSI, but unfortunately, my QNAP NAS doesn't support this setup.

To summarize, I'm looking for a solution to store my PVE VMs' backups in a directory that can be shared among all three nodes. I'd greatly appreciate any insights or recommendations on what filesystem or approach I should consider.

Thanks in advance for your help!

 

[bbgeek17]

To summarize, I'm looking for a solution to store my PVE VMs' backups in a directory that can be shared among all three nodes. I'd greatly appreciate any insights or recommendations on what filesystem or approach I should consider.

You should be using NFS from your Qnap

good luck

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[nico2f]

Thanks for the quick response. I would actually prefer using iSCSI due to its superior performance, scalability, and security. However, if there are no better alternatives, I'll go for NFS.

 

[bbgeek17]

I recently set up an LVM storage for my backups, following the guidance provided in this forum post. However, I've encountered an issue where the nodes aren't synchronizing their activities. Essentially, the backups stored on one node aren't visible from the others, and vice versa.

This ^ implies concurrent access to LVM/EXT4 placed on iSCSI. As you discovered, it can't/mustn't be done, as two out of 3 technologies are not cluster-friendly.
NOTE: in the post you referenced as a starting point, you made NO mention of clustering. If you did, I would have told you that it would not work.

Unless you implement a Cluster Aware Filesystem (GFS2 or OCFS), you will not achieve your goal.
Use NFS.

Good luck

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[LnxBil]

Have you considered using Proxmox Backup Server (PBS) as a VM that stores its data on the shared storage? Or maybe run PBS on your NAS filer directly?

 

[bbgeek17]

One other thought. Most people want the easiest and fastest way to access their backups. In the case of NFS - you can access them from any host.
If you put it behind iSCSI/CFS, before being able to access backups (in the worst-case scenario) you will need to get iSCSI and CFS up and running.

Running PBS on the filer, as @LnxBil suggested, may make recovery even simpler.

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[nico2f]

Great. I'm using NFS now. Thank you very much.