Hi FT,
are you sure your not over thinking it.
I have run CEPH for a year and lost OSD's and lost NODE's, somehow it works it out.
Give it a try. build your system and then pull the plug, drop a drive and replace it.
I'm reasonably confident that brighter minds than mine will ensure it fixes...