Pci passthrough problems

Does this say what I am using?

efibootmgr -v
BootCurrent: 000E
Timeout: 0 seconds
BootOrder: 000E,0010,0008,0000,0002,0001,0003,0004,0005,0006,0007,000A,0009,000C,000D
Boot0000 Embedded UEFI Shell FvVol(cdbb7b35-6833-4ed6-9ab2-57d2acddf6f0)/FvFile(c57ad6b7-0515-40a8-9d21-551652854e37)
Boot0001 Diagnose Error FvVol(cdbb7b35-6833-4ed6-9ab2-57d2acddf6f0)/FvFile(0849279d-40d5-53ea-e764-2496766f9844)
Boot0002 System Utilities FvVol(cdbb7b35-6833-4ed6-9ab2-57d2acddf6f0)/FvFile(1fd631e5-44e0-2f91-10ab-f88f3568ef30)
Boot0003 Intelligent Provisioning FvVol(cdbb7b35-6833-4ed6-9ab2-57d2acddf6f0)/FvFile(4a433501-ddaa-490b-96b2-04f42d8669b8)
Boot0004 Boot Menu FvVol(cdbb7b35-6833-4ed6-9ab2-57d2acddf6f0)/FvFile(d3fd6286-43c5-bb8d-0793-07b70aa9de36)
Boot0005 Network Boot FvVol(cdbb7b35-6833-4ed6-9ab2-57d2acddf6f0)/FvFile(ee8b26b0-37e9-11e1-b86c-0800200c9a66)
Boot0006 Embedded Diagnostics FvVol(cdbb7b35-6833-4ed6-9ab2-57d2acddf6f0)/FvFile(b57fe6f1-4f49-d46e-4bba-0a8add34d2f3)
Boot0007 View Integrated Management Log FvVol(cdbb7b35-6833-4ed6-9ab2-57d2acddf6f0)/FvFile(93c92423-d1c6-4286-be67-b76b6671047e)
Boot0008* Generic USB Boot UsbClass(ffff,ffff,255,255)
Boot0009* Embedded LOM 1 Port 1 : HPE Ethernet 1Gb 4-port 331i Adapter - NIC (PXE IPv6) PciRoot(0x0)/Pci(0x1c,0x4)/Pci(0x0,0x0)/MAC(f4034354d8d4,1)/IPv6([::]:<->[::]:,0,0)N.....YM....R,Y.
Boot000A* Embedded LOM 1 Port 1 : HPE Ethernet 1Gb 4-port 331i Adapter - NIC (PXE IPv4) PciRoot(0x0)/Pci(0x1c,0x4)/Pci(0x0,0x0)/MAC(f4034354d8d4,1)/IPv4(0.0.0.00.0.0.0,0,0)N.....YM....R,Y.
Boot000B* Front USB 2 : PNY USB 3.1 FD PciRoot(0x0)/Pci(0x1d,0x0)/USB(0,0)/USB(5,0)N.....YM....R,Y.
Boot000C* Embedded RAID 1 : Smart Array P440ar Controller - 223.54 GiB, RAID 1 Logical Drive(Target:0, Lun:0) PciRoot(0x0)/Pci(0x1,0x0)/Pci(0x0,0x0)/SCSI(0,0)N.....YM....R,Y.
Boot000D* Embedded RAID 1 : Smart Array P440ar Controller - 1788.40 GiB, RAID 50 Logical Drive(Target:0, Lun:1) PciRoot(0x0)/Pci(0x1,0x0)/Pci(0x0,0x0)/SCSI(0,1)N.....YM....R,Y.
Boot000E* proxmox HD(2,GPT,9ea2e53d-e454-4a5c-84a7-23c9cef9e0fa,0x800,0x200000)/File(\EFI\proxmox\grubx64.efi)
Boot0010* VMware ESXi HD(1,GPT,b401d28c-ba4d-4a53-b9cb-e63ce38edc8d,0x40,0x32000)/File(\EFI\VMware\safeboot64.efi)
 
That is what is throwing me off... When I edit the /etc/kernel/cmdline, it is empty! I do not even know where cat /proc/cmdline gets it's information.
Yes, I did copy/paste the line in the /etc/default/grub.
/proc/cmdline appears to come from your /etc/default/grub. I don't think you have to worry about /etc/kernel/cmdline as you system does not appear to use systemd-boot.
/proc/cmdline looks strange because of the wrong character that is not recognized as a double-quote and therefore the value in /etc/default/grub is being cut off at the first space.
I mean, crap, I am pretty sure it is using grub!! When I installed, I did not specify anything, unless it does not use grub by default... Maybe I am not.
Just change GRUB_CMDLINE_LINUX_DEFAULT=”quiet mitigations=off intel_iommu=on iommu=pt initcall_blacklist=sysfb_init pcie_acs_override=downstream,multifunction pci=nommconf” to GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on" (notice the different characters for double-quotes) and run update-grub (check for any warnings or error messages) and reboot before checking again with cat /proc/cmdline.
 
Holy F! That did it! Thank you, and yes I do indeed see your meaning of the quotes I had wrong. I thank you my friend.
 
Hey Guys! i have an very simliar problem :D

IOMMU is enabled but a get an error when i try to start a VM with a GPU :D Also on a DL380p G8 :)

1698664850298.png

Im using the newest Bios that exists for that Server :D
 
nano /etc/default/grub

put

GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on,relax_rmrr iommu=pt intremap=no_x2apic_optout"

update-grub
 
Hello everyone

Just started setting up what santa bought me a nice DL360 G9 and what fixed it for me was
nano /etc/default/grub and update the line GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on"
Then do a grub-update && systemctl reboot and thadam! 132 IOMMU groups appeared ;)

Then whenever i passtrough the P440AR Smart Array Raid Controller it didn't let me do that with vfio-pci 0000:03:00.0: DMAR: Device is ineligible for IOMMU domain attach due to platform RMRR requirement. Contact your platform vendor. to fix this i had to go in to BIOS and go to the P440ar board configuration from BIOS and disable Smart Memory something option then go ahead in the BIOS and there was one other thing i disabled, can't remember, i just looked for a similar option in the bios

HP Support thread on that helped me find the remaining information to make it work
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!