I followed this guide on Reddit: https://www.reddit.com/r/homelab/comments/b5xpua/the_ultimate_beginners_guide_to_gpu_passthrough/
Everything was successful, no errors. But then when I went to start the VM, Proxmox stops responding. Website goes down, VMs, can't SSH, it was just a hard crash...