[SOLVED] ceph - how do i remove all config and start over?

[RobFantini]

Hello
I've a ceph cluster which I had tried to change the ceph network and failed.

besides running 'pveceph purge' what else needs to be done from cli to remove all traces of former osd and mons?

 

[RobFantini]

starting over was not hard.

I started out with the network and configuration options the way we wanted from the start.

And got more certainty on how to install and configure ceph.

 

[RobFantini]

so the cause of my ceph issue was this error:

when preparing the 8-th node i mistakenly set up ceph before adding node to cluster.

that caused ceph issues . slow and crashing vm's.

solution is to reinstall the node and add to cluster before installing ceph software and running 'pveceph init '

AND there were a couple of loose infiniband cards / connections. the cards had been converted from 4U size to 2U then back to 4U . some of the clips got damaged in the conversion. I've replacements on order.