[SOLVED] HELP - problem with ceph Cluster

[starnetwork]

Hi,
I have ceph Cluster working on multiple nodes with 10.10.10.0/24 network
now, I added new nodes to the Proxmox cluster but this nodes was no access to the 10.10.10.0/24
and I did pveceph init --network 10.10.10.0/24
on this nodes, now after I see that no connection I added the network settings to this subnet and the network is working
the problem is that since this case, all my nodes show timeout via gui and via cli for
root@server1:~# pvesm status
got timeout
got timeout
Name Type Status Total Used Available %
CephPool1_ct rbd inactive 0 0 0 0.00%
CephPool1_vm rbd inactive 0 0 0 0.00%

but
root@server1:~# ceph status
cluster:
id: 411df041-bcd3-029b-aa09-5b91de414bac
health: HEALTH_OK

show HEALTH_OK and all nodes inside this cluster are working
but if I will try to restart on of the nodes, it's will not boot up, I also can't create backups for nodes, the error:
ERROR: Backup of VM 100 failed - rbd error: rbd: couldn't connect to the cluster!

any suggestions and what should I do to restore back the normal operational?

Regards,

 

[starnetwork]

Solved
by editing /etc/pve/storage.cfg
and removing the cephmon lines in rbd storage

 

[Abergr]

Thank you!
I tried to remove it via UI but it mark it as red, so only way is to remove it via cli. Bug thumbs up!