Yeah, so if I remove the IOMMU after booting into a Ubuntu 20.04 live USB and editing it (import zfs, mount partitions etc), it boots back up again. But even if I just add rootdelay=10 to the cmdline file it still hangs at that point.
So I had to use 21.04 Ubuntu to be able to import the rpool...