Ceph cluster broke after updating proxmox to the latest 6.4, please help

ok - I was able to recover - turned off proxmox firewall and it all started communicating again and rebalancing and now it is live. Something with upgrade and firewall broke my ceph.
 
Last edited: