SAS PCI passthrough issue

S

sergiu

New Member
May 2, 2019
6
0
1
46
Hi all,

I'm trying to pass through a SAS card to a Windows srv2012 VM. I'm able to see the PCI card in the hardware config of the VM but the OS doesn't detect it. Can anyone give me an advice please?

Here is what I did so far:

vi /etc/default/grub
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on"
update-grub

dmesg | grep -e DMAR -e IOMMU
=>0.042761] DMAR-IR: This system BIOS has enabled interrupt remapping

cat /etc/modules:
vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd

dmesg | grep ecap
=>***ecap f020fe

find /sys/kernel/iommu_groups/ -type l
=> NO OUTPUT

cat /etc/pve/qemu-server/<vmid>.conf
machine: q35
hostpci0: 03:00.0,pcie=1

Thanks
 
sergiu said:
find /sys/kernel/iommu_groups/ -type l
=> NO OUTPUT
Click to expand...

indicates that iommu is not active

did you enable vt-d in the bios?

what does the vm start task log say? (did you start the vm after editing the config?)
 
dcsapak said:
indicates that iommu is not active

did you enable vt-d in the bios?

what does the vm start task log say? (did you start the vm after editing the config?)
Click to expand...

First of all thank you for taking the time to help me.
1) vt-d is enabled
2) I restart the vm after changing the config.
3) I get no logs, the machine boots normally, I can see the pci in the hardware config of the vm. The OS running on the vm doesn't see the pci card.

Anything else I should try?

Thanks
 
can you do the following on the commandline and post the output:
Code: 
qm config ID
qm showcmd ID --pretty
qm start ID
 
dcsapak said:
can you do the following on the commandline and post the output:
Code: 
qm config ID
-----------------
balloon: 512
bootdisk: sata0
cores: 2
cpu: host
description: Windows Server 2012%0A%0ATo do%3A%0A- Shoretel Control (Pas assez puissant)%0A- Audio Architect%0A- Room Alert%0A- Sage 50%0Ahostpci1 04%3A00.0,pcie=1
hostpci0: 03:00.0,pcie=1
ide2: cdrom,media=cdrom
machine: q35
memory: 4096
name: win01*****
net0: e1000=EE:39:82:3B:43:C3,bridge=vmbr0
numa: 0
ostype: win8
sata0: local-lvm:vm-106-disk-1,size=32G
scsihw: virtio-scsi-pci
smbios1: uuid=994050a0-f1d3-44d4-b0fa-6b8dec07933a
sockets: 1
******************************************************************************************************************
qm showcmd ID --pretty
-----------------------------------
/usr/bin/kvm -id 106 -chardev 'socket,id=qmp,path=/var/run/qemu-server/106.qmp,server,nowait' -mon 'chardev=qmp,mode=control' -pidfile /var/run/qemu-server/106.pid -daemonize -smbios 'type=1,uuid=994050a0-f1d3-44d4-b0fa-6b8dec07933a' -name win01.blvd-mtl.com -smp '2,sockets=1,cores=2,maxcpus=2' -nodefaults -boot 'menu=on,strict=on,reboot-timeout=1000,splash=/usr/share/qemu-server/bootsplash.jpg' -vga std -vnc unix:/var/run/qemu-server/106.vnc,x509,password -no-hpet -cpu 'host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_spinlocks=0x1fff,hv_vapic,hv_time,hv_reset,hv_vpindex,hv_runtime,hv_relaxed' -m 4096 -k en-us -readconfig /usr/share/qemu-server/pve-q35.cfg -device 'usb-tablet,id=tablet,bus=ehci.0,port=1' -device 'vfio-pci,host=03:00.0,id=hostpci0,bus=ich9-pcie-port-1,addr=0x0' -device 'virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3' -iscsi 'initiator-name=iqn.1993-08.org.debian:01:da86807b16b9' -drive 'file=/dev/cdrom,if=none,id=drive-ide2,media=cdrom,aio=threads' -device 'ide-cd,bus=ide.1,unit=0,drive=drive-ide2,id=ide2,bootindex=200' -device 'ahci,id=ahci0,multifunction=on,bus=pci.0,addr=0x7' -drive 'file=/dev/pve/vm-106-disk-1,if=none,id=drive-sata0,format=raw,cache=none,aio=native,detect-zeroes=on' -device 'ide-drive,bus=ahci0.0,drive=drive-sata0,id=sata0,bootindex=100' -netdev 'type=tap,id=net0,ifname=tap106i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown' -device 'e1000,mac=EE:39:82:3B:43:C3,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300' -rtc 'driftfix=slew,base=localtime' -machine 'type=q35' -global 'kvm-pit.lost_tick_policy=discard'
******************************************************************************************************************
qm start ID
------------------
Click to expand...
VM 106 already running
 
root@pve:~# qm config 106

balloon: 512
bootdisk: sata0
cores: 2
cpu: host
description: Windows Server 2012%0A%0ATo do%3A%0A- Shoretel Control (Pas assez puissant)%0A- Audio Architect%0A- Room Alert%0A- Sage 50%0Ahostpci1 04%3A00.0,pcie=1
hostpci0: 03:00.0,pcie=1
ide2: cdrom,media=cdrom
machine: q35
memory: 4096
name: win01.blvd-mtl.com
net0: e1000=EE:39:82:3B:43:C3,bridge=vmbr0
numa: 0
ostype: win8
sata0: local-lvm:vm-106-disk-1,size=32G
scsihw: virtio-scsi-pci
smbios1: uuid=994050a0-f1d3-44d4-b0fa-6b8dec07933a
sockets: 1
========================================================================

root@pve:~# qm showcmd 106

/usr/bin/kvm -id 106 -chardev 'socket,id=qmp,path=/var/run/qemu-server/106.qmp,server,nowait' -mon 'chardev=qmp,mode=control' -pidfile /var/run/qemu-server/106.pid -daemonize -smbios 'type=1,uuid=994050a0-f1d3-44d4-b0fa-6b8dec07933a' -name win01.blvd-mtl.com -smp '2,sockets=1,cores=2,maxcpus=2' -nodefaults -boot 'menu=on,strict=on,reboot-timeout=1000,splash=/usr/share/qemu-server/bootsplash.jpg' -vga std -vnc unix:/var/run/qemu-server/106.vnc,x509,password -no-hpet -cpu 'host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_spinlocks=0x1fff,hv_vapic,hv_time,hv_reset,hv_vpindex,hv_runtime,hv_relaxed' -m 4096 -k en-us -readconfig /usr/share/qemu-server/pve-q35.cfg -device 'usb-tablet,id=tablet,bus=ehci.0,port=1' -device 'vfio-pci,host=03:00.0,id=hostpci0,bus=ich9-pcie-port-1,addr=0x0' -device 'virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x3' -iscsi 'initiator-name=iqn.1993-08.org.debian:01:da86807b16b9' -drive 'file=/dev/cdrom,if=none,id=drive-ide2,media=cdrom,aio=threads' -device 'ide-cd,bus=ide.1,unit=0,drive=drive-ide2,id=ide2,bootindex=200' -device 'ahci,id=ahci0,multifunction=on,bus=pci.0,addr=0x7' -drive 'file=/dev/pve/vm-106-disk-1,if=none,id=drive-sata0,format=raw,cache=none,aio=native,detect-zeroes=on' -device 'ide-drive,bus=ahci0.0,drive=drive-sata0,id=sata0,bootindex=100' -netdev 'type=tap,id=net0,ifname=tap106i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown' -device 'e1000,mac=EE:39:82:3B:43:C3,netdev=net0,bus=pci.0,addr=0x12,id=net0,bootindex=300' -rtc 'driftfix=slew,base=localtime' -machine 'type=q35' -global 'kvm-pit.lost_tick_policy=discard'
==========================================================================

root@pve:~# qm start 106

Cannot open iommu_group: No such file or directory
============================================================================

I had to comment out machine: q35 and hostpci0: 03:00.0,pcie=1 in order to boot the machine

Thanks
 
sergiu said:
Cannot open iommu_group: No such file or directory
============================================================================

I had to comment out machine: q35 and hostpci0: 03:00.0,pcie=1 in order to boot the machine
Click to expand...
no wonder it does not work then

to get a working passthrough, you have to start the vm with those configs enabled
if you simply edit the config after the vm ist started, nothing is changed in the vm...
(which would be obvious if you edited it via gui, since then the changes would be 'pending')

the error:
sergiu said:
Cannot open iommu_group: No such file or directory
Click to expand...
leads me to think that iommu is not working at all, can you post the complete dmesg output ?
 
dcsapak said:
no wonder it does not work then

to get a working passthrough, you have to start the vm with those configs enabled
if you simply edit the config after the vm ist started, nothing is changed in the vm...
(which would be obvious if you edited it via gui, since then the changes would be 'pending')

the error:

leads me to think that iommu is not working at all, can you post the complete dmesg output ?
Click to expand...


root@pve:~# dmesg
[ 0.000000] Linux version 4.10.15-1-pve (root@stretchbuild) (gcc version 6.3.0 20170516 (Debian 6.3.0-18) ) #1 SMP PVE 4.10.15-15 (Fri, 23 Jun 2017 08:57:55 +0200) ()
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.10.15-1-pve root=/dev/mapper/pve-root ro quiet
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] x86/fpu: Legacy x87 FPU detected.
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000cf378fff] usable
[ 0.000000] BIOS-e820: [mem 0x00000000cf379000-0x00000000cf38efff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000cf38f000-0x00000000cf3cdfff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x00000000cf3ce000-0x00000000cfffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fe000000-0x00000000ffffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000102fffffff] usable
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 2.6 present.
[ 0.000000] DMI: Dell Inc. PowerEdge R510/0DPRKF, BIOS 1.11.0 07/23/2012
[ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[ 0.000000] e820: last_pfn = 0x1030000 max_arch_pfn = 0x400000000
[ 0.000000] MTRR default type: uncachable
[ 0.000000] MTRR fixed ranges enabled:
[ 0.000000] 00000-9FFFF write-back
[ 0.000000] A0000-BFFFF uncachable
[ 0.000000] C0000-CBFFF write-protect
[ 0.000000] CC000-D3FFF write-back
[ 0.000000] D4000-EBFFF uncachable
[ 0.000000] EC000-FFFFF write-protect
[ 0.000000] MTRR variable ranges enabled:
[ 0.000000] 0 base 0000000000 mask FF80000000 write-back
[ 0.000000] 1 base 0080000000 mask FFC0000000 write-back
[ 0.000000] 2 base 00C0000000 mask FFF0000000 write-back
[ 0.000000] 3 base 0100000000 mask FF00000000 write-back
[ 0.000000] 4 base 0200000000 mask FE00000000 write-back
[ 0.000000] 5 base 0400000000 mask FC00000000 write-back
[ 0.000000] 6 base 0800000000 mask F800000000 write-back
[ 0.000000] 7 base 1000000000 mask FFC0000000 write-back
[ 0.000000] 8 disabled
[ 0.000000] 9 disabled
[ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WC UC- WT
[ 0.000000] e820: update [mem 0xd0000000-0xffffffff] usable ==> reserved
[ 0.000000] e820: last_pfn = 0xcf379 max_arch_pfn = 0x400000000
[ 0.000000] found SMP MP-table at [mem 0x000fe710-0x000fe71f] mapped at [ffff8ebd000fe710]
[ 0.000000] Scanning 1 areas for low memory corruption
[ 0.000000] Base memory trampoline at [ffff8ebd00098000] 98000 size 24576
[ 0.000000] Using GB pages for direct mapping
[ 0.000000] BRK [0x58242d000, 0x58242dfff] PGTABLE
[ 0.000000] BRK [0x58242e000, 0x58242efff] PGTABLE
[ 0.000000] BRK [0x58242f000, 0x58242ffff] PGTABLE
[ 0.000000] BRK [0x582430000, 0x582430fff] PGTABLE
[ 0.000000] BRK [0x582431000, 0x582431fff] PGTABLE
[ 0.000000] BRK [0x582432000, 0x582432fff] PGTABLE
[ 0.000000] BRK [0x582433000, 0x582433fff] PGTABLE
[ 0.000000] RAMDISK: [mem 0x34703000-0x36378fff]
[ 0.000000] ACPI: Early table checksum verification disabled
[ 0.000000] ACPI: RSDP 0x00000000000F1530 000024 (v02 DELL )
[ 0.000000] ACPI: XSDT 0x00000000000F1634 00009C (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: FACP 0x00000000CF3B3F9C 0000F4 (v03 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: DSDT 0x00000000CF38F000 003B44 (v01 DELL PE_SC3 00000001 INTL 20050624)
[ 0.000000] ACPI: FACS 0x00000000CF3B6000 000040
[ 0.000000] ACPI: FACS 0x00000000CF3B6000 000040
[ 0.000000] ACPI: APIC 0x00000000CF3B3478 00015E (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: SPCR 0x00000000CF3B35D8 000050 (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: HPET 0x00000000CF3B362C 000038 (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: DMAR 0x00000000CF3B3668 0001D0 (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: MCFG 0x00000000CF3B38C4 00003C (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: WD__ 0x00000000CF3B3904 000134 (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: SLIC 0x00000000CF3B3A3C 000024 (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: ERST 0x00000000CF392CE4 000270 (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: HEST 0x00000000CF392F54 0003A8 (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: BERT 0x00000000CF392B44 000030 (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: EINJ 0x00000000CF392B74 000170 (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: SRAT 0x00000000CF3B3BC0 000370 (v01 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: TCPA 0x00000000CF3B3F34 000064 (v02 DELL PE_SC3 00000001 DELL 00000001)
[ 0.000000] ACPI: SSDT 0x00000000CF3B7000 006C0C (v01 INTEL PPM RCM 80000001 INTL 20061109)
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 0x00 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 0x02 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 0x04 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x30 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 0x10 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x32 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 0x12 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x34 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 0x14 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 0x01 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 0x03 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 0x05 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x31 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 0x11 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x33 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 0x13 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x35 -> Node 0
[ 0.000000] SRAT: PXM 2 -> APIC 0x15 -> Node 1
[ 0.000000] ACPI: SRAT: Node 1 PXM 2 [mem 0x00000000-0xcfffffff]
[ 0.000000] ACPI: SRAT: Node 1 PXM 2 [mem 0x100000000-0x82fffffff]
[ 0.000000] ACPI: SRAT: Node 0 PXM 1 [mem 0x830000000-0x102fffffff]
[ 0.000000] NUMA: Node 1 [mem 0x00000000-0xcfffffff] + [mem 0x100000000-0x82fffffff] -> [mem 0x00000000-0x82fffffff]
[ 0.000000] NODE_DATA(0) allocated [mem 0x102ffd5000-0x102fffffff]
[ 0.000000] NODE_DATA(1) allocated [mem 0x82ffd5000-0x82fffffff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]
[ 0.000000] Normal [mem 0x0000000100000000-0x000000102fffffff]
[ 0.000000] Device empty
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 1: [mem 0x0000000000001000-0x000000000009dfff]
[ 0.000000] node 1: [mem 0x0000000000100000-0x00000000cf378fff]
[ 0.000000] node 1: [mem 0x0000000100000000-0x000000082fffffff]
[ 0.000000] node 0: [mem 0x0000000830000000-0x000000102fffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000830000000-0x000000102fffffff]
[ 0.000000] On node 0 totalpages: 8388608
[ 0.000000] Normal zone: 131072 pages used for memmap
[ 0.000000] Normal zone: 8388608 pages, LIFO batch:31
[ 0.000000] Initmem setup node 1 [mem 0x0000000000001000-0x000000082fffffff]
[ 0.000000] On node 1 totalpages: 8385302
[ 0.000000] DMA zone: 64 pages used for memmap
[ 0.000000] DMA zone: 21 pages reserved
[ 0.000000] DMA zone: 3997 pages, LIFO batch:0
[ 0.000000] DMA32 zone: 13198 pages used for memmap
[ 0.000000] DMA32 zone: 844665 pages, LIFO batch:31
[ 0.000000] Normal zone: 117760 pages used for memmap
[ 0.000000] Normal zone: 7536640 pages, LIFO batch:31
[ 0.000000] ACPI: PM-Timer IO Port: 0x808
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[ 0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[ 0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec80000, GSI 32-55
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] ACPI: IRQ0 used by override.
[ 0.000000] ACPI: IRQ9 used by override.
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x8086a301 base: 0xfed00000
[ 0.000000] smpboot: Allowing 24 CPUs, 0 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x000fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xcf379000-0xcf38efff]
[ 0.000000] PM: Registered nosave memory: [mem 0xcf38f000-0xcf3cdfff]
[ 0.000000] PM: Registered nosave memory: [mem 0xcf3ce000-0xcfffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xdfffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xe0000000-0xefffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xf0000000-0xfdffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfe000000-0xffffffff]
[ 0.000000] e820: [mem 0xd0000000-0xdfffffff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on bare hardware
[ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:24 nr_cpu_ids:24 nr_node_ids:2
[ 0.000000] percpu: Embedded 36 pages/cpu @ffff8ec50fa00000 s108056 r8192 d31208 u262144
[ 0.000000] pcpu-alloc: s108056 r8192 d31208 u262144 alloc=1*2097152
[ 0.000000] pcpu-alloc: [0] 00 02 04 06 08 10 12 14 [0] 16 18 20 22 -- -- -- --
[ 0.000000] pcpu-alloc: [1] 01 03 05 07 09 11 13 15 [1] 17 19 21 23 -- -- -- --
[ 0.000000] Built 2 zonelists in Node order, mobility grouping on. Total pages: 16511795
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.10.15-1-pve root=/dev/mapper/pve-root ro quiet
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Calgary: detecting Calgary via BIOS EBDA area
[ 0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[ 0.000000] Memory: 65927292K/67095640K available (9213K kernel code, 1673K rwdata, 3836K rodata, 2236K init, 2364K bss, 1168348K reserved, 0K cma-reserved)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=24, Nodes=2
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] Build-time adjustment of leaf fanout to 64.
[ 0.000000] RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=24.
[ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=24
[ 0.000000] NR_IRQS:524544 nr_irqs:1160 16
[ 0.000000] Console: colour VGA+ 80x25
[ 0.000000] console [tty0] enabled
[ 0.000000] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[ 0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[ 0.000000] hpet clockevent registered
[ 0.000000] tsc: Fast TSC calibration using PIT
[ 0.000000] tsc: Detected 2666.883 MHz processor
[ 0.000026] Calibrating delay loop (skipped), value calculated using timer frequency.. 5333.76 BogoMIPS (lpj=10667532)
[ 0.000028] pid_max: default: 32768 minimum: 301
[ 0.000045] ACPI: Core revision 20160930
[ 0.003740] ACPI: 2 ACPI AML tables successfully acquired and loaded
[ 0.003791] Security Framework initialized
[ 0.003792] Yama: becoming mindful.
[ 0.003826] AppArmor: AppArmor initialized
[ 0.006830] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
[ 0.019153] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[ 0.024608] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.024661] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.025308] CPU: Physical Processor ID: 1
[ 0.025308] CPU: Processor Core ID: 0
[ 0.025314] mce: CPU supports 9 MCE banks
[ 0.025321] CPU0: Thermal monitoring enabled (TM1)
[ 0.025329] process: using mwait in idle threads
[ 0.025331] Last level iTLB entries: 4KB 512, 2MB 7, 4MB 7
[ 0.025332] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32, 1GB 0
[ 0.025523] Freeing SMP alternatives memory: 36K
[ 0.026921] ftrace: allocating 34734 entries in 136 pages
[ 0.042752] smpboot: Max logical packages: 4
[ 0.042753] smpboot: CPU 0 Converting physical 1 to logical package 0
[ 0.042761] DMAR-IR: This system BIOS has enabled interrupt remapping
on a chipset that contains an erratum making that
feature unstable. To maintain system stability
interrupt remapping is being disabled. Please
contact your BIOS vendor for an update
[ 0.042764] Switched APIC routing to physical flat.
[ 0.043283] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.190717] smpboot: CPU0: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz (family: 0x6, model: 0x2c, stepping: 0x2)
[ 0.190804] Performance Events: PEBS fmt1+, Westmere events, 16-deep LBR, Intel PMU driver.
[ 0.190820] core: CPUID marked event: 'bus cycles' unavailable
[ 0.190822] ... version: 3
[ 0.190822] ... bit width: 48
[ 0.190822] ... generic registers: 4
[ 0.190823] ... value mask: 0000ffffffffffff
[ 0.190823] ... max period: 000000007fffffff
[ 0.190824] ... fixed-purpose events: 3
[ 0.190824] ... event mask: 000000070000000f
[ 0.192290] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[ 0.192311] smp: Bringing up secondary CPUs ...
[ 0.192423] x86: Booting SMP configuration:
[ 0.192424] .... node #1, CPUs: #1
[ 0.193158] smpboot: CPU 1 Converting physical 0 to logical package 1
[ 0.213497] .... node #0, CPUs: #2
[ 0.216460] .... node #1, CPUs: #3
[ 0.219326] .... node #0, CPUs: #4
[ 0.222122] .... node #1, CPUs: #5
[ 0.224977] .... node #0, CPUs: #6
[ 0.227774] .... node #1, CPUs: #7
[ 0.230633] .... node #0, CPUs: #8
[ 0.233378] .... node #1, CPUs: #9
[ 0.236212] .... node #0, CPUs: #10
[ 0.238950] .... node #1, CPUs: #11
[ 0.241796] .... node #0, CPUs: #12
[ 0.244599] .... node #1, CPUs: #13
[ 0.247467] .... node #0, CPUs: #14
[ 0.250267] .... node #1, CPUs: #15
[ 0.253117] .... node #0, CPUs: #16
[ 0.255923] .... node #1, CPUs: #17
[ 0.258785] .... node #0, CPUs: #18
[ 0.261593] .... node #1, CPUs: #19
[ 0.264459] .... node #0, CPUs: #20
[ 0.267197] .... node #1, CPUs: #21
[ 0.270047] .... node #0, CPUs: #22
[ 0.272782] .... node #1, CPUs: #23
[ 0.275482] smp: Brought up 2 nodes, 24 CPUs
[ 0.275485] smpboot: Total of 24 processors activated (128010.38 BogoMIPS)
[ 0.310187] devtmpfs: initialized
[ 0.310256] x86/mm: Memory block size: 2048MB
[ 0.312102] evm: security.selinux
[ 0.312103] evm: security.SMACK64
[ 0.312103] evm: security.SMACK64EXEC
[ 0.312104] evm: security.SMACK64TRANSMUTE
[ 0.312104] evm: security.SMACK64MMAP
[ 0.312104] evm: security.ima
[ 0.312105] evm: security.capability
[ 0.312269] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[ 0.312311] futex hash table entries: 8192 (order: 7, 524288 bytes)
[ 0.312475] pinctrl core: initialized pinctrl subsystem
[ 0.312599] RTC time: 13:30:53, date: 04/28/19
[ 0.312721] NET: Registered protocol family 16
[ 0.322715] cpuidle: using governor ladder
[ 0.338713] cpuidle: using governor menu
[ 0.338715] PCCT header not found.
[ 0.338766] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[ 0.338768] ACPI: bus type PCI registered
[ 0.338770] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 0.338855] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000)
[ 0.338899] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved in E820
[ 0.338911] PCI: Using configuration type 1 for base access
[ 0.341801] mtrr: your CPUs had inconsistent variable MTRR settings
[ 0.341802] mtrr: probably your BIOS does not setup all CPUs.
[ 0.341802] mtrr: corrected configuration.
[ 0.355012] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[ 0.355012] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 0.355488] ACPI: Added _OSI(Module Device)
[ 0.355488] ACPI: Added _OSI(Processor Device)
[ 0.355489] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 0.355490] ACPI: Added _OSI(Processor Aggregator Device)
[ 0.355891] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[ 0.358641] ACPI: Interpreter enabled
[ 0.358654] ACPI: (supports S0 S4 S5)
[ 0.358655] ACPI: Using IOAPIC for interrupt routing
[ 0.358770] HEST: Table parsing has been initialized.
[ 0.358773] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 0.363535] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 0.363540] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 0.363621] acpi PNP0A08:00: PCIe AER handled by firmware
[ 0.363773] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 0.363774] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[ 0.363951] PCI host bridge to bus 0000:00
[ 0.363953] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 0.363954] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]
[ 0.363955] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 0.363956] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xfdffffff window]
[ 0.363958] pci_bus 0000:00: root bus resource [mem 0xfed40000-0xfed44fff window]
[ 0.363959] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 0.363970] pci 0000:00:00.0: [8086:3403] type 00 class 0x060000
[ 0.364024] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[ 0.364091] pci 0000:00:01.0: [8086:3408] type 01 class 0x060400
[ 0.364139] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[ 0.364202] pci 0000:00:03.0: [8086:340a] type 01 class 0x060400
[ 0.364249] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[ 0.364309] pci 0000:00:07.0: [8086:340e] type 01 class 0x060400
[ 0.364357] pci 0000:00:07.0: PME# supported from D0 D3hot D3cold
[ 0.364424] pci 0000:00:09.0: [8086:3410] type 01 class 0x060400
[ 0.364486] pci 0000:00:09.0: PME# supported from D0 D3hot D3cold
[ 0.364575] pci 0000:00:0a.0: [8086:3411] type 01 class 0x060400
[ 0.364622] pci 0000:00:0a.0: PME# supported from D0 D3hot D3cold
[ 0.364685] pci 0000:00:14.0: [8086:342e] type 00 class 0x080000
[ 0.364771] pci 0000:00:14.1: [8086:3422] type 00 class 0x080000
[ 0.364855] pci 0000:00:14.2: [8086:3423] type 00 class 0x080000
[ 0.364944] pci 0000:00:1a.0: [8086:3a37] type 00 class 0x0c0300
[ 0.364980] pci 0000:00:1a.0: reg 0x20: [io 0xdc40-0xdc5f]
[ 0.365054] pci 0000:00:1a.1: [8086:3a38] type 00 class 0x0c0300
[ 0.365090] pci 0000:00:1a.1: reg 0x20: [io 0xdc60-0xdc7f]
[ 0.365171] pci 0000:00:1a.7: [8086:3a3c] type 00 class 0x0c0320
[ 0.365186] pci 0000:00:1a.7: reg 0x10: [mem 0xdf0fe000-0xdf0fe3ff]
[ 0.365261] pci 0000:00:1a.7: PME# supported from D0 D3hot D3cold
[ 0.365315] pci 0000:00:1d.0: [8086:3a34] type 00 class 0x0c0300
[ 0.365351] pci 0000:00:1d.0: reg 0x20: [io 0xdc80-0xdc9f]
[ 0.365427] pci 0000:00:1d.1: [8086:3a35] type 00 class 0x0c0300
[ 0.365462] pci 0000:00:1d.1: reg 0x20: [io 0xdca0-0xdcbf]
[ 0.365536] pci 0000:00:1d.2: [8086:3a36] type 00 class 0x0c0300
[ 0.365572] pci 0000:00:1d.2: reg 0x20: [io 0xdcc0-0xdcdf]
[ 0.365646] pci 0000:00:1d.3: [8086:3a39] type 00 class 0x0c0300
[ 0.365682] pci 0000:00:1d.3: reg 0x20: [io 0xdce0-0xdcff]
[ 0.365761] pci 0000:00:1d.7: [8086:3a3a] type 00 class 0x0c0320
[ 0.365777] pci 0000:00:1d.7: reg 0x10: [mem 0xdf0ff000-0xdf0ff3ff]
[ 0.365851] pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
[ 0.365901] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401
[ 0.365988] pci 0000:00:1f.0: [8086:3a16] type 00 class 0x060100
[ 0.366058] pci 0000:00:1f.0: quirk: [io 0x0800-0x087f] claimed by ICH6 ACPI/GPIO/TCO
[ 0.366062] pci 0000:00:1f.0: quirk: [io 0x0880-0x08bf] claimed by ICH6 GPIO
[ 0.366065] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 1 PIO at 0c00 (mask 007f)
[ 0.366067] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 2 PIO at 0ca0 (mask 000f)
[ 0.366069] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 3 PIO at 00e0 (mask 000f)
[ 0.366140] pci 0000:00:1f.2: [8086:3a20] type 00 class 0x01018f
[ 0.366151] pci 0000:00:1f.2: reg 0x10: [io 0xd8e0-0xd8e7]
[ 0.366158] pci 0000:00:1f.2: reg 0x14: [io 0xd8d0-0xd8d3]
[ 0.366164] pci 0000:00:1f.2: reg 0x18: [io 0xd8e8-0xd8ef]
[ 0.366170] pci 0000:00:1f.2: reg 0x1c: [io 0xd8d4-0xd8d7]
[ 0.366176] pci 0000:00:1f.2: reg 0x20: [io 0xdc00-0xdc0f]
[ 0.366182] pci 0000:00:1f.2: reg 0x24: [io 0xdc10-0xdc1f]
[ 0.366255] pci 0000:00:1f.5: [8086:3a26] type 00 class 0x010185
[ 0.366266] pci 0000:00:1f.5: reg 0x10: [io 0xd8f0-0xd8f7]
[ 0.366273] pci 0000:00:1f.5: reg 0x14: [io 0xd8d8-0xd8db]
[ 0.366279] pci 0000:00:1f.5: reg 0x18: [io 0xd8f8-0xd8ff]
[ 0.366285] pci 0000:00:1f.5: reg 0x1c: [io 0xd8dc-0xd8df]
[ 0.366291] pci 0000:00:1f.5: reg 0x20: [io 0xdc20-0xdc2f]
[ 0.366297] pci 0000:00:1f.5: reg 0x24: [io 0xdc30-0xdc3f]
[ 0.366409] pci 0000:01:00.0: [14e4:163b] type 00 class 0x020000
[ 0.366425] pci 0000:01:00.0: reg 0x10: [mem 0xd6000000-0xd7ffffff 64bit]
[ 0.366509] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[ 0.366571] pci 0000:01:00.1: [14e4:163b] type 00 class 0x020000
[ 0.366586] pci 0000:01:00.1: reg 0x10: [mem 0xd8000000-0xd9ffffff 64bit]
[ 0.366670] pci 0000:01:00.1: PME# supported from D0 D3hot D3cold
[ 0.380432] pci 0000:00:01.0: PCI bridge to [bus 01]
[ 0.380438] pci 0000:00:01.0: bridge window [mem 0xd6000000-0xd9ffffff]
[ 0.380499] pci 0000:02:00.0: [1000:0079] type 00 class 0x010400
[ 0.380512] pci 0000:02:00.0: reg 0x10: [io 0xfc00-0xfcff]
[ 0.380524] pci 0000:02:00.0: reg 0x14: [mem 0xdf1bc000-0xdf1bffff 64bit]
[ 0.380533] pci 0000:02:00.0: reg 0x1c: [mem 0xdf1c0000-0xdf1fffff 64bit]
[ 0.380543] pci 0000:02:00.0: reg 0x30: [mem 0xdf100000-0xdf13ffff pref]
[ 0.380579] pci 0000:02:00.0: supports D1 D2
[ 0.392428] pci 0000:00:03.0: PCI bridge to [bus 02]
[ 0.392432] pci 0000:00:03.0: bridge window [io 0xf000-0xffff]
[ 0.392435] pci 0000:00:03.0: bridge window [mem 0xdf100000-0xdf1fffff]
[ 0.392500] pci 0000:03:00.0: [117c:0049] type 00 class 0x010400
[ 0.392517] pci 0000:03:00.0: reg 0x10: [mem 0xdf2a0000-0xdf2bffff 64bit]
[ 0.392525] pci 0000:03:00.0: reg 0x18: [mem 0xdf2c0000-0xdf2fffff 64bit]
[ 0.392540] pci 0000:03:00.0: reg 0x30: [mem 0xdf200000-0xdf20ffff pref]
[ 0.392573] pci 0000:03:00.0: supports D1
[ 0.392574] pci 0000:03:00.0: PME# supported from D0 D1 D3hot
[ 0.404428] pci 0000:00:07.0: PCI bridge to [bus 03]
[ 0.404433] pci 0000:00:07.0: bridge window [mem 0xdf200000-0xdf2fffff]
[ 0.404499] pci 0000:04:00.0: [8086:10fb] type 00 class 0x020000
[ 0.404518] pci 0000:04:00.0: reg 0x10: [mem 0xdf380000-0xdf3fffff 64bit]
[ 0.404523] pci 0000:04:00.0: reg 0x18: [io 0xece0-0xecff]
[ 0.404537] pci 0000:04:00.0: reg 0x20: [mem 0xdf37c000-0xdf37ffff 64bit]
[ 0.404581] pci 0000:04:00.0: PME# supported from D0 D3hot
[ 0.404603] pci 0000:04:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref]
[ 0.404605] pci 0000:04:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs)
[ 0.404616] pci 0000:04:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref]
[ 0.404618] pci 0000:04:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs)
[ 0.416427] pci 0000:00:09.0: PCI bridge to [bus 04]
[ 0.416430] pci 0000:00:09.0: bridge window [io 0xe000-0xefff]
[ 0.416434] pci 0000:00:09.0: bridge window [mem 0xdf300000-0xdf3fffff]
[ 0.416499] pci 0000:05:00.0: [14e4:1639] type 00 class 0x020000
[ 0.416517] pci 0000:05:00.0: reg 0x10: [mem 0xda000000-0xdbffffff 64bit]
[ 0.416602] pci 0000:05:00.0: PME# supported from D0 D3hot D3cold
[ 0.416664] pci 0000:05:00.1: [14e4:1639] type 00 class 0x020000
[ 0.416679] pci 0000:05:00.1: reg 0x10: [mem 0xdc000000-0xddffffff 64bit]
[ 0.416763] pci 0000:05:00.1: PME# supported from D0 D3hot D3cold
[ 0.428428] pci 0000:00:0a.0: PCI bridge to [bus 05]
[ 0.428433] pci 0000:00:0a.0: bridge window [mem 0xda000000-0xddffffff]
[ 0.428493] pci 0000:06:03.0: [102b:0532] type 00 class 0x030000
[ 0.428511] pci 0000:06:03.0: reg 0x10: [mem 0xd5800000-0xd5ffffff pref]
[ 0.428519] pci 0000:06:03.0: reg 0x14: [mem 0xde7fc000-0xde7fffff]
[ 0.428527] pci 0000:06:03.0: reg 0x18: [mem 0xde800000-0xdeffffff]
[ 0.428556] pci 0000:06:03.0: reg 0x30: [mem 0x00000000-0x0000ffff pref]
[ 0.428639] pci 0000:00:1e.0: PCI bridge to [bus 06] (subtractive decode)
[ 0.428643] pci 0000:00:1e.0: bridge window [mem 0xde000000-0xdeffffff]
[ 0.428647] pci 0000:00:1e.0: bridge window [mem 0xd5800000-0xd5ffffff 64bit pref]
[ 0.428649] pci 0000:00:1e.0: bridge window [io 0x0000-0x0cf7 window] (subtractive decode)
[ 0.428650] pci 0000:00:1e.0: bridge window [io 0x0d00-0xffff window] (subtractive decode)
[ 0.428651] pci 0000:00:1e.0: bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[ 0.428652] pci 0000:00:1e.0: bridge window [mem 0xd0000000-0xfdffffff window] (subtractive decode)
[ 0.428653] pci 0000:00:1e.0: bridge window [mem 0xfed40000-0xfed44fff window] (subtractive decode)

It won't let me post the full output of dmesg since is too much. Let me know if I you need something more specific.

thank you
 
Last edited:
sergiu said:
[ 0.000000] Linux version 4.10.15-1-pve (root@stretchbuild) (gcc version 6.3.0 20170516 (Debian 6.3.0-18) ) #1 SMP PVE 4.10.15-15 (Fri, 23 Jun 2017 08:57:55 +0200) ()
Click to expand...
indicates an old kernel, please upgrade

sergiu said:
[ 0.042761] DMAR-IR: This system BIOS has enabled interrupt remapping
on a chipset that contains an erratum making that
feature unstable. To maintain system stability
interrupt remapping is being disabled. Please
contact your BIOS vendor for an update
Click to expand...
notes that interrupt remapping (necessary for iommu to work) is disabled because of chipset/bios bugs
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom