figure out the ACTUAL APPLICATIONS and check their compatibility matrixes. Many application require specific nvidia driver versions, which in turn would be dependent on specific kernel version ranges. That will determine whether you can/want to run the driver on the host kernel (proxmox) or in guest which you can pick based on kernel version necessity.