PCIe Passtrough on ZFS not working

Murphi

New Member
Dec 14, 2019
19
1
3
24
Hello,

I am having troubles with PCIe Passtrough. I followed your guides on this Topic without any luck.
https://pve.proxmox.com/wiki/PCI(e)_Passthrough
https://pve.proxmox.com/wiki/Pci_passthrough
https://pve.proxmox.com/wiki/Host_Bootloader

My Setup:
2x Xeon E5-2680
ASRock EP2C602-4L/D16
Proxmox VE 6.x in UEFI Mode on an ZFS.
VT-d is enabled

According to your guide, I am supposed to add "Intel_iommu=on" in '/etc/kernel/cmdline' like so "root=ZFS=rpool/ROOT/pve-1 boot=zfs intel_iommu=on ". And run 'pve-efiboot-tool refresh' after that. After editing '/etc/modules' and runing update-initramfs -u -k all" I reboot my system.
However, If I do that my Server will only boot into 'initramfs' and "zpool list" tells me "no pools available".


I tried it with grub too, but that didn't work either.

"cat /proc/cmdline" shows:(without any editing from me, or when using grub)
initrd=\EFI\proxmox\5.3.10-1-pve\initrd.img-5.3.10-1-pve root=ZFS=rpool/ROOT/pve-1 boot=zfs


'dmesg' pastebin: https://pastebin.com/zeaVHf4x

'ls -l /sys/kernel/iommu_groups' returns nothing


'zfs list | grep pve-1' returns:
rpool/ROOT/pve-1 1013M 107G 1013M /



I just tried it without ZFS. But I am also having the same boot Problem when using grub. I only get into initramfs.

I would appreciate some help, I am out of ideas. Thank you in advance.
 
Last edited:
Maybe try add BOOT_IMAGE
Code:
BOOT_IMAGE=/ROOT/pve-1/@//boot/pve/vmlinuz ro ramdisk_size=16777216 root=ZFS=rpool/ROOT/pve-1 boot=zfs nmi_watchdog=0 amd_iommu=on iommu=pt
 
Can I paste this or do I have to change something?
Code:
BOOT_IMAGE=/ROOT/pve-1/@//boot/pve/vmlinuz ro ramdisk_size=16777216 root=ZFS=rpool/ROOT/pve-1 boot=zfs nmi_watchdog=0 amd_iommu=on iommu=pt
 
Can I paste this or do I have to change something?
Code:
BOOT_IMAGE=/ROOT/pve-1/@//boot/pve/vmlinuz ro ramdisk_size=16777216 root=ZFS=rpool/ROOT/pve-1 boot=zfs nmi_watchdog=0 amd_iommu=on iommu=pt
This is my config, at least you need to use intel_iommu instead of amd_iommu :)
 
I had a X9SRL-F (also C602) and I haven't any issues... Have you done anything else in the guide, for example blacklist anything ?