While this affects proxmox, it is not just a proxmox issue, it is a general Linux kernel driver issue, that affects every distribution using Linux kernel 6.* and above, so Ubuntu, debian, suse, etc ....
you can pin the last proxmox 6.5 kernel and build/install the 5.20.3 driver there to regain...