Sounds like you are on the right path. Remove the PVE storage entry, unmount the disk, find and remove the automatic mount (fstab?).
This should unstuck the PVE. You can then try to mount the disk and save the data prior to throwing the disk into a bin.
Cheers
PS It could, theoretically, be...