r730xd H330 passthrough fail

F

freesilent

Member
Apr 29, 2023
12
2
8
Hi, i‘m here again. A short time ago, i use LSI 9207-8i passthrough. It was successful.

Now, i use SAS3008

Code: 
lspci -nnk -s 03:00

03:00.0 RAID bus controller [0104]: Broadcom / LSI MegaRAID SAS-3 3008 [Fury] [1000:005f] (rev 02)

i have completed all setup. But the VM cann't boot.

Code: 
cat /etc/modprobe.d/pve-blacklist.conf

# This file contains a list of modules which are not supported by Proxmox VE 
# nidiafb see bugreport https://bugzilla.proxmox.com/show_bug.cgi?id=701
blacklist nvidiafb
# blacklist  SAS3008
softdep megaraid_sas pre: vfio-pci
blacklist megaraid_sas

Code: 
cat /etc/modprobe.d/vfio.conf

# passthrough SAS3008
options vfio-pci ids=1000:005f
softdep megaraid_sas pre: vfio-pci


After completing the setup，this is the message.

Code: 
lspci -v -s 03:00

03:00.0 RAID bus controller: Broadcom / LSI MegaRAID SAS-3 3008 [Fury] (rev 02)
        DeviceName: Integrated RAID
        Subsystem: Dell PERC H330 Mini
        Flags: bus master, fast devsel, latency 0, IRQ 255, NUMA node 0, IOMMU group 29
        I/O ports at 2000 [size=256]
        Memory at 97700000 (64-bit, non-prefetchable) [size=64K]
        Memory at 97600000 (64-bit, non-prefetchable) [size=1M]
        Expansion ROM at <ignored> [disabled]
        Capabilities: [50] Power Management version 3
        Capabilities: [68] Express Endpoint, MSI 00
        Capabilities: [a8] MSI: Enable- Count=1/1 Maskable+ 64bit+
        Capabilities: [c0] MSI-X: Enable- Count=97 Masked-
        Capabilities: [100] Advanced Error Reporting
        Capabilities: [1e0] Secondary PCI Express
        Capabilities: [1c0] Power Budgeting <?>
        Capabilities: [148] Alternative Routing-ID Interpretation (ARI)
        Kernel driver in use: vfio-pci
        Kernel modules: megaraid_sas

the VM error message is as follows：

Code: 
kvm: -device vfio-pci,host=0000:03:00.0,id=hostpci0,bus=ich9-pcie-port-1,addr=0x0,rombar=0: vfio 0000:03:00.0: failed to setup container for group 29: Failed to set iommu for container: Operation not permitted
TASK ERROR: start failed: QEMU exited with code 1
 
I use H330s in a R630 Ceph cluster.

Flashed with latest firmware version?

Did you delete any virtual disks before switching the H330 to HBA mode? If you don't do this step, you won't see the physical drives.
 
freesilent said:
the VM error message is as follows：

Code: 
kvm: -device vfio-pci,host=0000:03:00.0,id=hostpci0,bus=ich9-pcie-port-1,addr=0x0,rombar=0: vfio 0000:03:00.0: failed to setup container for group 29: Failed to set iommu for container: Operation not permitted
TASK ERROR: start failed: QEMU exited with code 1
Click to expand...
Do you have messages like Device is ineligible for IOMMU domain attach due to platform RMRR requirement. Contact your platform vendor. in your journalctl (you'll have to scroll or search)? Then you might first look into getting around the RMRR issue.
 
leesteken said:
Do you have messages like Device is ineligible for IOMMU domain attach due to platform RMRR requirement. Contact your platform vendor. in your journalctl (you'll have to scroll or search)? Then you might first look into getting around the RMRR issue.
Click to expand...
Hi, thank you very much. I found the problem.
I patch 'relax-intel-rmrr', and it's useful.
 
  • Like
Reactions: leesteken
freesilent said:
Hi, thank you very much. I found the problem.
I patch 'relax-intel-rmrr', and it's useful.
Click to expand...
Hi freesilent,
I am stuck in the same point as you were, I use the same raid controller SAS3008 on dell r730xd server.
I have tried all possible configs to passthrough my controller with no luck.
I don't know how to patch 'relax-intel-rmrr', my skills in linux is poor.
I would appriciate your help if you could provide me with that solution steps.
 
You must log in or register to reply here.
Top Bottom