Prox 7.2 passtrough igpu fail -nvidia no issues - Change of detection ?

[Docop2]

Hi
Installing fresh prox 7.2 iso with the same method/setting/config as doing for the 7.1 iso and 7.0 .. On 7/7.1 the onboard igpu intel was always working fine. While having an nvidia card that give no issues at all on 7.2, i try the onboard igpu, but this one fully failed. Just booting a liveiso or restoring a prox7.1 vm fully working passtrough, as usual with vfio set, it get hit by the detection of 'simplefb'.
But: with booting and releasing with : the pci remove release/ rescan method.. the iomem do show as the igpu being alone, but it still fail at vm boot with :

-device vfio-pci,host=0000:00:02.0,id=hostpci0,bus=ich9-pcie-port-1,addr=0x0,x-vga=on: vfio 0000:00:02.0: failed to setup container for group 1: Failed to set iommu for container: Device or resource busy

Also, from the usual grub setting inteliommu and efif.., adding the extra 2 items don't help :
video=vesafbff video=simplefbff


from dmesg: when the command to remove the pci and do the rescan : iomem

fefff : System RAM
7b2ff000-7b2fffff : RAM buffer
7b300000-7b3fffff : Reserved
7b400000-7bffffff : RAM buffer
7c000000-7fffffff : Reserved
80000000-dfffffff : PCI Bus 0000:00
  80000000-801fffff : PCI Bus 0000:01
  80200000-803fffff : PCI Bus 0000:01
  81000000-81ffffff : 0000:00:02.0
  90000000-9fffffff : 0000:00:02.0
  a0000000-c1ffffff : PCI Bus 0000:04
    a0000000-c1ffffff : PCI Bus 0000:05
      a0000000-c1ffffff : PCI Bus 0000:07
        a0000000-c1ffffff : PCI Bus 0000:08
          a0000000-b1ffffff : PCI Bus 0000:09
          a0000000-afffffff : 0000:09:00.0
          b0000000-b1ffffff : 0000:09:00.0
          b2000000-c1ffffff : PCI Bus 0000:0a

-At adress 02.0, no more: bootfb, simplefb.

vfio-pci 0000:00:02.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=io+mem
[  219.519145] DMAR: DRHD: handling fault status reg 2
[  219.519148] pci 0000:00:02.0: Removing from iommu group 1
[  219.519282] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x0 [fault reason 0x02] Present bit in context entry is clear
[  219.520295] DMAR: DRHD: handling fault status reg 3
[  219.520450] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c180000 [fault reason 0x02] Present bit in context entry is clear
[  219.521929] DMAR: DRHD: handling fault status reg 3
[  219.522089] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c1c0000 [fault reason 0x02] Present bit in context entry is clear
[  219.522757] DMAR: DRHD: handling fault status reg 3
[  224.523204] dmar_fault: 14714 callbacks suppressed
[  224.523207] DMAR: DRHD: handling fault status reg 3
[  224.523365] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c280000 [fault reason 0x02] Present bit in context entry is clear
[  224.524835] DMAR: DRHD: handling fault status reg 3
[  224.524995] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c2c0000 [fault reason 0x02] Present bit in context entry is clear
[  224.525674] DMAR: DRHD: handling fault status reg 3
[  224.525834] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c300000 [fault reason 0x02] Present bit in context entry is clear
[  224.526502] DMAR: DRHD: handling fault status reg 3
[  229.426384] pci 0000:00:02.0: [8086:193b] type 00 class 0x030000
[  229.426393] pci 0000:00:02.0: reg 0x10: [mem 0xdb000000-0xdbffffff 64bit]
[  229.426398] pci 0000:00:02.0: reg 0x18: [mem 0x90000000-0x9fffffff 64bit pref]
[  229.426402] pci 0000:00:02.0: reg 0x20: [io  0xf000-0xf03f]
[  229.426422] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[  229.426601] pci 0000:00:02.0: vgaarb: setting as boot VGA device
[  229.426604] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[  229.426638] pci 0000:00:02.0: Adding to iommu group 1
[  229.447018] pci 0000:00:02.0: BAR 2: assigned [mem 0x90000000-0x9fffffff 64bit pref]
[  229.447025] pci 0000:00:02.0: BAR 0: assigned [mem 0x81000000-0x81ffffff 64bit]
[  229.447030] pci 0000:00:02.0: BAR 4: assigned [io  0x1000-0x103f]
[  229.447062] vfio-pci 0000:00:02.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=io+mem
[  229.526906] dmar_fault: 14882 callbacks suppressed
[  229.526908] DMAR: DRHD: handling fault status reg 3
[  229.526967] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c3c0000 [fault reason 0x02] Present bit in context entry is clear
[  229.528535] DMAR: DRHD: handling fault status reg 3
[  229.528594] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c400000 [fault reason 0x02] Present bit in context entry is clear
[  229.529780] DMAR: DRHD: handling fault status reg 3
[  229.529838] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c000000 [fault reason 0x02] Present bit in context entry is clear
[  229.531138] DMAR: DRHD: handling fault status reg 3
[  234.530702] dmar_fault: 14678 callbacks suppressed
[  234.530705] DMAR: DRHD: handling fault status reg 3
[  234.530766] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c0c0000 [fault reason 0x02] Present bit in context entry is clear
[  234.531531] DMAR: DRHD: handling fault status reg 3
[  234.531589] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c100000 [fault reason 0x02] Present bit in context entry is clear
[  234.532368] DMAR: DRHD: handling fault status reg 3
[  234.532424] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c140000 [fault reason 0x02] Present bit in context entry is clear
[  234.533202] DMAR: DRHD: handling fault status reg 3
[  239.535246] dmar_fault: 15320 callbacks suppressed
[  239.535249] DMAR: DRHD: handling fault status reg 3
[  239.535309] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c240000 [fault reason 0x02] Present bit in context entry is clear
[  239.536082] DMAR: DRHD: handling fault status reg 3
[  239.536140] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c280000 [fault reason 0x02] Present bit in context entry is clear
[  239.537716] DMAR: DRHD: handling fault status reg 3
[  239.537774] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c2c0000 [fault reason 0x02] Present bit in context entry is clear
[  239.538580] DMAR: DRHD: handling fault status reg 3
[  244.538951] dmar_fault: 14675 callbacks suppressed
[  244.538954] DMAR: DRHD: handling fault status reg 3
[  244.539012] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c380000 [fault reason 0x02] Present bit in context entry is clear
[  244.542643] DMAR: DRHD: handling fault status reg 3
[  244.545754] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c000000 [fault reason 0x02] Present bit in context entry is clear
[  244.549806] DMAR: DRHD: handling fault status reg 3
[  244.553066] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c200000 [fault reason 0x02] Present bit in context entry is clear
[  244.556471] DMAR: DRHD: handling fault status reg 3
[  249.542732] dmar_fault: 15212 callbacks suppressed
[  249.542735] DMAR: DRHD: handling fault status reg 3
[  249.545963] DMAR: [DMA Write NO_PASID] Request device [00:02.0] fault addr 0x7c080000 [fault reason 0x02] Present bit in context entry is clear
[  249.549402] DMAR: DRHD: handling fault status reg 3

tail /var/log/kern.log

roxnuc6 kernel: [ 1530.694967] dmar_fault: 5252 callbacks suppressed
May 31 00:33:39 proxnuc6 kernel: [ 1530.694969] DMAR: DRHD: handling fault status reg 3
May 31 00:33:39 proxnuc6 kernel: [ 1530.708997] DMAR: [DMA Read NO_PASID] Request device [00:02.0] fault addr 0x7c3f0000 [fault reason 0x02] Present bit in context entry is clear
May 31 00:33:39 proxnuc6 kernel: [ 1530.898863] DMAR: DRHD: handling fault status reg 3
May 31 00:33:39 proxnuc6 kernel: [ 1530.913148] DMAR: [DMA Read NO_PASID] Request device [00:02.0] fault addr 0x7c3f4000 [fault reason 0x02] Present bit in context entry is clear
May 31 00:33:39 proxnuc6 kernel: [ 1531.102860] DMAR: DRHD: handling fault status reg 3
May 31 00:33:39 proxnuc6 kernel: [ 1531.116966] DMAR: [DMA Read NO_PASID] Request device [00:02.0] fault addr 0x7c3e6000 [fault reason 0x02] Present bit in context entry is clear
May 31 00:33:40 proxnuc6 kernel: [ 1531.306856] DMAR: DRHD: handling fault status reg 3

As all time, the pve official is install, no internet, no update. But this 7.2 version don't work for the igpu.
lspci -nnk
00:02.0 VGA compatible controller [0300]: Intel Corporation Iris Pro Graphics 580 [8086:193b] (rev 09)
DeviceName: CPU
Subsystem: Intel Corporation Iris Pro Graphics 580 [8086:2064]
Kernel driver in use: vfio-pci
Kernel modules: i915

*yes as all previous version... i915 is in the blacklist file. active also for the iommu_unsafe_interrupts / the 4 item in /etc/modules.
Quite odd that the onboard igpu fail while nvidia is ok.

Thanks for hints .. or as seen by many mostly the kernel look way too new and not yet fix..

 

[shrdlicka]

Hi,
what worked for some people was pining the kernel to an older version (and reboot ):

proxmox-boot-tool kernel list

proxmox-boot-tool kernel pin 5.13.19-6-pve

 

[Docop2]

Yes i did try that.., was hard to find. While this give the igpu back, i did an update from the gui and after a bit, on another reboot, i wasn't able to get back the nic as no connectivity was possible. All in all, nvidia work, but not igpu with prox 7.2, all is good on 7.1 and many issues on 7.0. I guess i will wait 7.3 to try .. quite same as esxi on 7.0.1d was fine, then they push too much stuff not tested and even remove update and delay other.. But i haven't seen a grub corruption failure in a week on 7.2.