Hello,
I had OSD 23 on one of my hosts but the drive failed so we stopped the services and removed it. We did not need to replace it immediately (lots of OSDs in the cluster so not a lot of capacity lost) so I didn't pay much attention to it.
Sometime in the last couple of months another disk failed on a different host and we replaced that, now that other host has gotten the osd.23 id for its replaced OSD.
Fast forward a couple of months, I notice that on the "original" osd.23 host there is still the service ceph-osd@23.service and ceph-volume@simple-23-ae6103e9-0329-44fe-9121-ac28493f6a49.service running but failing to start up (obviously). Under /etc/ceph/osd/ there is also still the 23-ae6103e9-0329-44fe-9121-ac28493f6a49.json.
I don't think I can trace back from the logs to what went wrong and why those services didn't get removed as that is too far in the past now.
The systemd services are templated so I can't just remove the service file from /lib/systemd/system/. How can I do a proper manual cleanup on that host?
I had OSD 23 on one of my hosts but the drive failed so we stopped the services and removed it. We did not need to replace it immediately (lots of OSDs in the cluster so not a lot of capacity lost) so I didn't pay much attention to it.
Sometime in the last couple of months another disk failed on a different host and we replaced that, now that other host has gotten the osd.23 id for its replaced OSD.
Fast forward a couple of months, I notice that on the "original" osd.23 host there is still the service ceph-osd@23.service and ceph-volume@simple-23-ae6103e9-0329-44fe-9121-ac28493f6a49.service running but failing to start up (obviously). Under /etc/ceph/osd/ there is also still the 23-ae6103e9-0329-44fe-9121-ac28493f6a49.json.
I don't think I can trace back from the logs to what went wrong and why those services didn't get removed as that is too far in the past now.
The systemd services are templated so I can't just remove the service file from /lib/systemd/system/. How can I do a proper manual cleanup on that host?