Local Storage storage as shared storage for cluster

S

shirocko

New Member
Dec 31, 2024
11
3
3
Hi,

since a few days I got a second mini pc beside my existing dell wyse mini pc. Both have a 1 TB SSD inside.
Currently one is running lvm and the other zfs. But I am about to reinstall the lvm one to a zfs storage.
After that I would like to build a proxmox Cluster with these two nodes and a raspi as the quorum.

My main problem is the shared storage so that I can move VMs and Container from one node to another.
I would like to use the internal SSD as shared storage. Best would be that both drive sync in both ways or they build a shared storage somehow.
I have an OMV VM currently running as an NFS share for the Docker VM and its containers.
Is it somehow possible to use some ZFS feature or a NAS VM to promote the shared storage and use it as the main storage for containers and VMs in Proxmox and use the benefits of a cluster?

p.s. both systems are running the current pve version 8.4-1.

Thanks in advance
shirocko
 
Ok thanks. I will have a look at the zfs replication.

The problem with the current NFS for docker is, that it is a VM on proxmox itself. So if the first host or the VM crashes also the NFS for proxmox itself is gone.
 
Hi UdoB
I just finished reinstalling my second pve node and I established the two node cluster today with a raspi as quorum.
UdoB said:
Usually you replicate ZFS storage in a small cluster
Click to expand...
The replication is working fine and I can migrate VMs and Containers in Reboot mode.

UdoB said:
Virtual disks living on NFS are "shared" by definition. Migration between nodes should work as intended...
Click to expand...
But I would like to use Live Migration, if possible, with the local SSD ZFS Storage.
Is there a way to establish a constant replication of the local ZFS storage, so that a live migration would be possible?
Or is it really only possible with shared storage somewhere in the network?
 
shirocko said:
But I would like to use Live Migration, if possible, with the local SSD ZFS Storage.
Is there a way to establish a constant replication of the local ZFS storage, so that a live migration would be possible?
Click to expand...
Well, I use ZFS replication exclusively. And I can live-migrate; that did work from the beginning without special tweaking.

Just have a running VM, right-click it and select "Migrate". In the now opened dialog in the top left are you should see "Mode: Online". Don't you?

Note that this does NOT work for Containers, only VMs.

shirocko said:
Or is it really only possible with shared storage somewhere in the network?
Click to expand...
For PVE "ZFS replicated" counts as shared. With some well-known drawbacks.
 
  • Like
Reactions: shirocko, MarkusKo and Johannes S
You must log in or register to reply here.
Top Bottom