This was actually a pretty weird issue that required multiple node restarts after moving the OSD. Both the old node and new node had to be down, and IIRC if the old node was still running when restarting the new node it still wouldn't detect the osd correctly.
So likely an issue with quarium or...