I've tried inserting another disk and installing grub there, but it behaves exactly the same (so at least the grub installation is working, it's just installing a broken config). Copying over the images in /boot from a fresh proxmox install also didn't change anything.
As a workaround, I've...