Thank you @DevilhandX, I found this topic while investigating this problem and your solution has worked for me as well.
Just wanted to add: if you also include x-vga=on in the arguments for the passthrough device, you can set the VM's GPU type to "none" and the VM will boot fine.