I solved this issue by doing lvconvert --repair pve/data (Remember to backup your volumes first).
After node reboot, the problem doesn't return anymore.
# Disable the storage pools which is using the volumes
pvesm set local-lvm --disable 1
# Deactivate the volumes which we want to repair...
