Recent content by Nemesiz

I`m tracking Ceph mailing list and from it I assume developers leaves testing stage to customers. Safe upgrade should be done to X.Y.2+ version only.

Try to turn off write cache.

I recommend SoftEther VPN

If I wanted to trick VPS provider I would look does he use ARP. In that case I would use L2 VPN (wireguard is only L3): Cloudzy VPS eth0 -> bridge with VPN -> VPN L2 -> Proxmox -> bridge with VPS -> VPS

Did it worked for short ?

VM OS ignored shutdown or you haven't installed qemu agent. If you really need to stop VM you can use "qm stop" to kill it.

ZFS is not Ceph. You can use up to 100%

VNet. Personally I`m not sure but lets try.

Try to enable "VLAN Aware"

Can you show VM network configuration ?

5 MON - A.I suggest to use this number only on really huge setup. 1 MON - on single ceph machine. 2 MON - no quorum 3 MON - regular setup 4 MON - no quorum? Try to lower MON setup to 3.

I suggest you take a look at these links https://www.osris.org/article/2019/03/01/ceph-osd-site-affinity https://ceph.io/en/news/blog/2015/crushmap-example-of-a-hierarchical-cluster-map/

How OSD lose PG objects ? Who cause it ?

In maintenance time I set noout norebalance norecover flags before OSD/server shutdown. It stops from moving data around others OSD. In some Ceph talks was mentioned that single HDD can impact all cluster event HDD SMART will not show any evidence of coming HDD death. So you must track of disk...

Proxmox installation is not so rich with option. Try to install debian as you wish and then convert to Proxmox.