Yeah so my workaround for now was to install debian first, then install proxmox using these steps.
Post-pve-install and before-reboot open /etc/default/grub, add the nomodeset boot parameter, run update-grub, and reboot.
PVE6.3-1 will then run without the AMD gpu driver which seems to be...