r730xd H330 passthrough fail

[freesilent]

Hi, i‘m here again. A short time ago, i use LSI 9207-8i passthrough. It was successful.

Now, i use SAS3008

lspci -nnk -s 03:00

03:00.0 RAID bus controller [0104]: Broadcom / LSI MegaRAID SAS-3 3008 [Fury] [1000:005f] (rev 02)

i have completed all setup. But the VM cann't boot.

cat /etc/modprobe.d/pve-blacklist.conf

# This file contains a list of modules which are not supported by Proxmox VE 
# nidiafb see bugreport https://bugzilla.proxmox.com/show_bug.cgi?id=701
blacklist nvidiafb
# blacklist  SAS3008
softdep megaraid_sas pre: vfio-pci
blacklist megaraid_sas

cat /etc/modprobe.d/vfio.conf

# passthrough SAS3008
options vfio-pci ids=1000:005f
softdep megaraid_sas pre: vfio-pci

After completing the setup，this is the message.

lspci -v -s 03:00

03:00.0 RAID bus controller: Broadcom / LSI MegaRAID SAS-3 3008 [Fury] (rev 02)
        DeviceName: Integrated RAID
        Subsystem: Dell PERC H330 Mini
        Flags: bus master, fast devsel, latency 0, IRQ 255, NUMA node 0, IOMMU group 29
        I/O ports at 2000 [size=256]
        Memory at 97700000 (64-bit, non-prefetchable) [size=64K]
        Memory at 97600000 (64-bit, non-prefetchable) [size=1M]
        Expansion ROM at <ignored> [disabled]
        Capabilities: [50] Power Management version 3
        Capabilities: [68] Express Endpoint, MSI 00
        Capabilities: [a8] MSI: Enable- Count=1/1 Maskable+ 64bit+
        Capabilities: [c0] MSI-X: Enable- Count=97 Masked-
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [1e0] Secondary PCI Express
        Capabilities: [1c0] Power Budgeting <?>
        Capabilities: [148] Alternative Routing-ID Interpretation (ARI)
        Kernel driver in use: vfio-pci
        Kernel modules: megaraid_sas

the VM error message is as follows：

kvm: -device vfio-pci,host=0000:03:00.0,id=hostpci0,bus=ich9-pcie-port-1,addr=0x0,rombar=0: vfio 0000:03:00.0: failed to setup container for group 29: Failed to set iommu for container: Operation not permitted
TASK ERROR: start failed: QEMU exited with code 1

 

[jdancer]

I use H330s in a R630 Ceph cluster.

Flashed with latest firmware version?

Did you delete any virtual disks before switching the H330 to HBA mode? If you don't do this step, you won't see the physical drives.

 

[freesilent]

I had flashed with latest firmware from Dell.com.
The H330 is normal in Esxi.

 

[leesteken]

the VM error message is as follows：

kvm: -device vfio-pci,host=0000:03:00.0,id=hostpci0,bus=ich9-pcie-port-1,addr=0x0,rombar=0: vfio 0000:03:00.0: failed to setup container for group 29: Failed to set iommu for container: Operation not permitted
TASK ERROR: start failed: QEMU exited with code 1

Do you have messages like Device is ineligible for IOMMU domain attach due to platform RMRR requirement. Contact your platform vendor. in your journalctl (you'll have to scroll or search)? Then you might first look into getting around the RMRR issue.

 

[freesilent]

Do you have messages like Device is ineligible for IOMMU domain attach due to platform RMRR requirement. Contact your platform vendor. in your journalctl (you'll have to scroll or search)? Then you might first look into getting around the RMRR issue.

Hi, thank you very much. I found the problem.
I patch 'relax-intel-rmrr', and it's useful.