With replication size 3 you have a max usable capacity of 5.2 TB as this is the capacity of your smallest host.
Your OSDs are very unbalanced across the hosts which is not good for such a small cluster.
This is why the OSDs in pve10 reach the nearfull ratio and refuse to take any more data.
You...
Do you run Crph along with the VMs on the same hardware? The load may be too high:
osd_scrub_load_threshold
Description: The maximum load. Ceph will not scrub when the system load (as defined by the getloadavg() function) is higher than this number. Default is 0.5.
Type: Float...
There is now a kernel patch available: https://lore.kernel.org/io-uring/8b7a8200-f616-46a8-bc44-5af7ce9b081a@kernel.dk/T/#u
OCFS2 seems to be unmaintained.
Wenn Du nur einen einzelnen Proxmox-Host hast, brauchst Du das Thema SDN nicht.
Erzeuge einfach ein eeiteres Bridge-Interface ohne physischen Port und ohne Adresse und nutze es als internes Netz für die VMs.
AFAIK Ceph cannot run dual stack.
And the MON addresses are recorded as IPv4 in the cluster map. The same goes for the public_network and cluster_network settings.
You would have to manually change the MON map and these settings and then adjust the ceph.conf.
If you directly link both Proxmox nodes with two cables without the hub you can configure normal bonding interfaces between them.
There is no "server side" with LACP, just two Ethernet partners talking to each other.
You cannot use a hub to do bonding / link aggregation. The link partner has to support LACP.
The only option is to use the active/backup mode (not 802.3ad) and then only utilize one of the two NICs at a time.