Virtualization of Beckhoff CX Controller using PCI passthrough

zhenit

Member
Nov 6, 2021
3
0
6
38
Hello all,
Very new to the scene and I hope this is the right place to ask for help with this. I am trying to virtualize an industrial PC (IPC) from a vendor (Beckhoff) while still being able to retain the ability to communicate with its embedded industrial bus (ie E-k Bus in drawing below).

1636220936749.png

Source: https://www.beckhoff.com/en-ca/products/ipc/embedded-pcs/cx20x2-intel-xeon-d/cx2072.html

The Host PC usually runs a version of Windows 10 IoT, which I have already successfully virtualized in Proxmox. While I am able to pass several of the devices seen above to the guest Windows 10 VM (such as the NICs and the USB devices), I am hitting a brick wall regarding the FPGA as even when I do appear to pass it, the guest OS does not assign it its normal drivers. I have followed most of the guides out there based on PCI GPU assignments to try and do this, but its quite possible that I am missing something entirely as I have never attempted to this before. Any help/tips would be greatly appreciated, even if its to learn that this is not possible to do.

I have found out several things:
1) I believe that the device in question is on PCI bus 4 as Twincat references it when trying to assign it and IOMMU does create a single group for it as seen below

04:00.0 Unassigned class [ff00]: Beckhoff GmbH Device [15ec:5000] (rev 02)
Subsystem: Beckhoff GmbH Device [15ec:5000]
Kernel driver in use: ec_bhf
Kernel modules: ec_bhf

2) I know the device works correctly when run natively on Windows 10. I am running a dual OS that allows me to boot back in its native Windows image and check using either device manager or Twincat (Beckhoff Automation Software).

3) If successful I believe the following device should appear in windows manager, however I have yet to see it assigned unless I reboot in native windows.

1636222798664.png

4) The device appears to resemble another PCI card for sale by the vendor

FC1121 | Infrastructure, 1-channel fieldbus card, EtherCAT, slave, PCI express, NOVRAM, RJ45

The manual for that card gives an overall idea of its functions and Bar Memory Mapping, and it appears to possibly use interrupts and PCIe
source: https://www.beckhoff.com/en-en/prod...ponents/fcxxxx-pci-fieldbus-cards/fc1121.html

5) Here is a dump of PCI devices on the original Windows machine, the last one in the list is probably what I need to pass and have windows recognize.

System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Home Agent 0
Host bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DMI2 Terminator 2x/i
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R2PCIe Agent
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link 0/1
PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D PCI Express Root Port 3 Terminator 2x/i
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 1 Terminator 2x/i
Ethernet controller: Intel Corporation I210 Gigabit Network Connection
Ethernet controller: Intel Corporation I210 Gigabit Network Connection
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D IIO Hot Plug
PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #2 Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D IIO RAS/Control Status/Global Errors
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link Debug
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 0 Thermal Control
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Target Address/Thermal/RAS
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 0 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 2 Thermal Control
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 2 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Ubox
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 0 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #3 Apple MacBookAir6,2 / MacBookPro11,1
RAID bus controller: Intel Corporation C600/X79 series chipset SATA RAID Controller
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Global Broadcast
ISA bridge: Intel Corporation C224 Series Chipset Family Server Standard SKU LPC Controller Apple MacBookAir6,2 / MacBookPro11,1
USB controller: Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #1 Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Map/VTd_Misc/System Management
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 3 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Home Agent 0
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link 0/1
PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D PCI Express Root Port 2 Terminator 2x/i
Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Cape Verde/Pitcairn HDMI Audio [Radeon HD 7700/7800 Series]
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Target Address/Thermal/RAS
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
Unassigned class: Intel Corporation 82599EB 10-Gigabit Dummy Function Ethernet Converged Network Adapter X710
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 1 Thermal Control
USB controller: Intel Corporation 8 Series/C220 Series Chipset Family USB xHCI Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 1 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 3 Thermal Control
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R2PCIe Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 3 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Ubox
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Broadcast
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 2 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D PCI Express Root Port 2 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
PIC: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D I/O APIC Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Ubox
PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #1 Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Venus PRO [Radeon E8860]
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link 0/1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
SMBus: Intel Corporation 8 Series/C220 Series Chipset Family SMBus Controller Apple MacBookAir6,2 / MacBookPro11,1
Unassigned class: Beckhoff GmbH NV5000SC

6) Here is my VM conf if it helps narrow it down

agent: 1
args: -cpu 'host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=NV43FIX,kvm=off'
bios: ovmf
boot: order=ide2;hostpci0;sata0;hostpci4;hostpci3;hostpci1;hostpci2;net0;usb0
cores: 4
cpu: host,hidden=1,flags=+pcid
hostpci0: 0000:04:00,pcie=1
hostpci1: 0000:00:14,pcie=1
hostpci2: 0000:00:1d.0,pcie=1
hostpci3: 0000:02:00,pcie=1
hostpci4: 0000:01:00,pcie=1
ide2: local:iso/virtio-win-0.1.208.iso,media=cdrom,size=543390K
machine: q35
memory: 8192
name: CX-360B86
net0: e1000=92:62:04:4E:33:D3,bridge=vmbr0,firewall=1
numa: 0
sata0: local:100/vm-100-disk-1.qcow2,size=38166M
scsihw: virtio-scsi-single
smbios1: uuid=0d97cf91-64df-4b1d-b49f-31714069c0c8
sockets: 1
usb0: host=0978:2100,usb3=1
vmgenid: 3c254684-f38d-4475-966d-b5395222b088

7) I am not sure if it is related but Sys logger reports the following when running the VM in question

Nov 06 13:54:22 pve kernel: kvm [3413]: vcpu0, guest rIP: 0xfffff805462688f2 kvm_set_msr_common: MSR_IA32_DEBUGCTLMSR 0x1, nop

Thank you for any help/suggestions in advance!
 
Last edited:
Hello all,
Very new to the scene and I hope this is the right place to ask for help with this. I am trying to virtualize an industrial PC (IPC) from a vendor (Beckhoff) while still being able to retain the ability to communicate with its embedded industrial bus (ie E-k Bus in drawing below).

View attachment 31145

Source: https://www.beckhoff.com/en-ca/products/ipc/embedded-pcs/cx20x2-intel-xeon-d/cx2072.html

The Host PC usually runs a version of Windows 10 IoT, which I have already successfully virtualized in Proxmox. While I am able to pass several of the devices seen above to the guest Windows 10 VM (such as the NICs and the USB devices), I am hitting a brick wall regarding the FPGA as even when I do appear to pass it, the guest OS does not assign it its normal drivers. I have followed most of the guides out there based on PCI GPU assignments to try and do this, but its quite possible that I am missing something entirely as I have never attempted to this before. Any help/tips would be greatly appreciated, even if its to learn that this is not possible to do.

I have found out several things:
1) I believe that the device in question is on PCI bus 4 as Twincat references it when trying to assign it and IOMMU does create a single group for it as seen below

04:00.0 Unassigned class [ff00]: Beckhoff GmbH Device [15ec:5000] (rev 02)
Subsystem: Beckhoff GmbH Device [15ec:5000]
Kernel driver in use: ec_bhf
Kernel modules: ec_bhf

2) I know the device works correctly when run natively on Windows 10. I am running a dual OS that allows me to boot back in its native Windows image and check using either device manager or Twincat (Beckhoff Automation Software).

3) If successful I believe the following device should appear in windows manager, however I have yet to see it assigned unless I reboot in native windows.

View attachment 31146

4) The device appears to resemble another PCI card for sale by the vendor

FC1121 | Infrastructure, 1-channel fieldbus card, EtherCAT, slave, PCI express, NOVRAM, RJ45

The manual for that card gives an overall idea of its functions and Bar Memory Mapping, and it appears to possibly use interrupts and PCIe
source: https://www.beckhoff.com/en-en/prod...ponents/fcxxxx-pci-fieldbus-cards/fc1121.html

5) Here is a dump of PCI devices on the original Windows machine, the last one in the list is probably what I need to pass and have windows recognize.

System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Home Agent 0
Host bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DMI2 Terminator 2x/i
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R2PCIe Agent
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link 0/1
PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D PCI Express Root Port 3 Terminator 2x/i
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 1 Terminator 2x/i
Ethernet controller: Intel Corporation I210 Gigabit Network Connection
Ethernet controller: Intel Corporation I210 Gigabit Network Connection
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D IIO Hot Plug
PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #2 Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D IIO RAS/Control Status/Global Errors
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link Debug
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 0 Thermal Control
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Target Address/Thermal/RAS
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 0 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 2 Thermal Control
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 2 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Ubox
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 0 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #3 Apple MacBookAir6,2 / MacBookPro11,1
RAID bus controller: Intel Corporation C600/X79 series chipset SATA RAID Controller
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Global Broadcast
ISA bridge: Intel Corporation C224 Series Chipset Family Server Standard SKU LPC Controller Apple MacBookAir6,2 / MacBookPro11,1
USB controller: Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #1 Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Map/VTd_Misc/System Management
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 3 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Home Agent 0
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link 0/1
PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D PCI Express Root Port 2 Terminator 2x/i
Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Cape Verde/Pitcairn HDMI Audio [Radeon HD 7700/7800 Series]
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Target Address/Thermal/RAS
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
Unassigned class: Intel Corporation 82599EB 10-Gigabit Dummy Function Ethernet Converged Network Adapter X710
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 1 Thermal Control
USB controller: Intel Corporation 8 Series/C220 Series Chipset Family USB xHCI Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 1 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 3 Thermal Control
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R2PCIe Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 3 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Ubox
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Broadcast
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 2 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D PCI Express Root Port 2 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
PIC: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D I/O APIC Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Ubox
PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #1 Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Venus PRO [Radeon E8860]
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link 0/1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
SMBus: Intel Corporation 8 Series/C220 Series Chipset Family SMBus Controller Apple MacBookAir6,2 / MacBookPro11,1
Unassigned class: Beckhoff GmbH NV5000SC

6) Here is my VM conf if it helps narrow it down

agent: 1
args: -cpu 'host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=NV43FIX,kvm=off'
bios: ovmf
boot: order=ide2;hostpci0;sata0;hostpci4;hostpci3;hostpci1;hostpci2;net0;usb0
cores: 4
cpu: host,hidden=1,flags=+pcid
hostpci0: 0000:04:00,pcie=1
hostpci1: 0000:00:14,pcie=1
hostpci2: 0000:00:1d.0,pcie=1
hostpci3: 0000:02:00,pcie=1
hostpci4: 0000:01:00,pcie=1
ide2: local:iso/virtio-win-0.1.208.iso,media=cdrom,size=543390K
machine: q35
memory: 8192
name: CX-360B86
net0: e1000=92:62:04:4E:33:D3,bridge=vmbr0,firewall=1
numa: 0
sata0: local:100/vm-100-disk-1.qcow2,size=38166M
scsihw: virtio-scsi-single
smbios1: uuid=0d97cf91-64df-4b1d-b49f-31714069c0c8
sockets: 1
usb0: host=0978:2100,usb3=1
vmgenid: 3c254684-f38d-4475-966d-b5395222b088

7) I am not sure if it is related but Sys logger reports the following when running the VM in question

Nov 06 13:54:22 pve kernel: kvm [3413]: vcpu0, guest rIP: 0xfffff805462688f2 kvm_set_msr_common: MSR_IA32_DEBUGCTLMSR 0x1, nop

Thank you for any help/suggestions in advance!
Hey,

DId you got the same result when passing trough only the Beckhoff GmbH NV5000SC ?
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!