Seeking advice: Shared storage solution for PVE VM backups across multiple nodes

N

nico2f

New Member
May 15, 2024
10
1
3
Hey everyone,

I recently set up an LVM storage for my backups, following the guidance provided in this forum post. However, I've encountered an issue where the nodes aren't synchronizing their activities. Essentially, the backups stored on one node aren't visible from the others, and vice versa.

After some research, I suspect this could be due to the filesystem I'm using. It seems that ext4 doesn't support clusterization, which may explain the syncing problem. I considered switching to GFS2, but I came across discouraging feedback on its usage in this context.

Next, I explored using ZFS via iSCSI, but unfortunately, my QNAP NAS doesn't support this setup.

To summarize, I'm looking for a solution to store my PVE VMs' backups in a directory that can be shared among all three nodes. I'd greatly appreciate any insights or recommendations on what filesystem or approach I should consider.

Thanks in advance for your help!
 
nico2f said:
To summarize, I'm looking for a solution to store my PVE VMs' backups in a directory that can be shared among all three nodes. I'd greatly appreciate any insights or recommendations on what filesystem or approach I should consider.
Click to expand...
You should be using NFS from your Qnap

good luck

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
Thanks for the quick response. I would actually prefer using iSCSI due to its superior performance, scalability, and security. However, if there are no better alternatives, I'll go for NFS.
 
nico2f said:
I recently set up an LVM storage for my backups, following the guidance provided in this forum post. However, I've encountered an issue where the nodes aren't synchronizing their activities. Essentially, the backups stored on one node aren't visible from the others, and vice versa.
Click to expand...
This ^ implies concurrent access to LVM/EXT4 placed on iSCSI. As you discovered, it can't/mustn't be done, as two out of 3 technologies are not cluster-friendly.
NOTE: in the post you referenced as a starting point, you made NO mention of clustering. If you did, I would have told you that it would not work.

Unless you implement a Cluster Aware Filesystem (GFS2 or OCFS), you will not achieve your goal.
Use NFS.

Good luck

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
Have you considered using Proxmox Backup Server (PBS) as a VM that stores its data on the shared storage? Or maybe run PBS on your NAS filer directly?
 
One other thought. Most people want the easiest and fastest way to access their backups. In the case of NFS - you can access them from any host.
If you put it behind iSCSI/CFS, before being able to access backups (in the worst-case scenario) you will need to get iSCSI and CFS up and running.

Running PBS on the filer, as @LnxBil suggested, may make recovery even simpler.

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
You must log in or register to reply here.
Top Bottom