You should remove these IP addresses from the ethernet interface.
Add a bridge (vmbr0) with the ethernet interface as a port and add the IPv6 address to the bridge interface.
Atttach the VM to the bridge and configure the IPv4 address inside...
No need to remove the packages, you can downgrade them with:
apt install ceph-common=18.2.4-pve3 libsqlite3-mod-ceph=18.2.4-pve3 librados2=18.2.4-pve3
and possible any other package that is newer than reef.
You need to stop the MON and replace its store.db. Make sure that the MON runs on the same IP as in the old cluster. It's all in the Ceph documentation.
As you have created a new cluster (id 9c9daac0-736e-4dc1-8380-e6a3fa7d2c23) and the OSDs on disk belong to the old cluster (id c3c25528-cbda-4f9b-a805-583d16b93e8f) you cannot just add them.
Have you read through the procedure to recover the MON...
Ich möchte an der Stelle nochmal kurz ein Feedback in die Runde geben, vielleicht auch falls mal jemand über die Frage stolpert beim Suchen.
In Ermangelung an Budget habe ich jetzt erstmal nur den QNAP Switch gegen einen MikroTik CRS312-4c+8XG...
With just 3 nodes, if one fails no rebalancing will happen. There will be some rebalancing if one OSD fails, though. Check this thread with some detailed expanations about this [1].
Add it to the cluster then with OSD's and let Ceph deal with...
Why doesn't it make sense???
Four nodes are better than three ;-)
Beside the capacity aspect think: with three Ceph-Nodes and one failing there is NO CHANCE for self-healing as the "failure domain" is "node".
But with four Ceph-Nodes, still...
Thank you!
I created a vlan zone simply called "Networks"
Then while creating a VNet when I hook it into this "Networks" zone it asks for the vlan tag.
I did not create a subnet in any of them because I want Unifi to be in the lead there.
Then...
So, we're talking about a VM, not a LXC, right? The IP address config is done within the OS of the VM. You can't manage this in Proxmox. So, stop the origin VM, start the cloned VM and change IP config in the VM OS.