Virtualization of Beckhoff CX Controller using PCI passthrough

zhenit

Member
Nov 6, 2021
3
0
6
40
Hello all,
Very new to the scene and I hope this is the right place to ask for help with this. I am trying to virtualize an industrial PC (IPC) from a vendor (Beckhoff) while still being able to retain the ability to communicate with its embedded industrial bus (ie E-k Bus in drawing below).

1636220936749.png

Source: https://www.beckhoff.com/en-ca/products/ipc/embedded-pcs/cx20x2-intel-xeon-d/cx2072.html

The Host PC usually runs a version of Windows 10 IoT, which I have already successfully virtualized in Proxmox. While I am able to pass several of the devices seen above to the guest Windows 10 VM (such as the NICs and the USB devices), I am hitting a brick wall regarding the FPGA as even when I do appear to pass it, the guest OS does not assign it its normal drivers. I have followed most of the guides out there based on PCI GPU assignments to try and do this, but its quite possible that I am missing something entirely as I have never attempted to this before. Any help/tips would be greatly appreciated, even if its to learn that this is not possible to do.

I have found out several things:
1) I believe that the device in question is on PCI bus 4 as Twincat references it when trying to assign it and IOMMU does create a single group for it as seen below

04:00.0 Unassigned class [ff00]: Beckhoff GmbH Device [15ec:5000] (rev 02)
Subsystem: Beckhoff GmbH Device [15ec:5000]
Kernel driver in use: ec_bhf
Kernel modules: ec_bhf

2) I know the device works correctly when run natively on Windows 10. I am running a dual OS that allows me to boot back in its native Windows image and check using either device manager or Twincat (Beckhoff Automation Software).

3) If successful I believe the following device should appear in windows manager, however I have yet to see it assigned unless I reboot in native windows.

1636222798664.png

4) The device appears to resemble another PCI card for sale by the vendor

FC1121 | Infrastructure, 1-channel fieldbus card, EtherCAT, slave, PCI express, NOVRAM, RJ45​

The manual for that card gives an overall idea of its functions and Bar Memory Mapping, and it appears to possibly use interrupts and PCIe
source: https://www.beckhoff.com/en-en/prod...ponents/fcxxxx-pci-fieldbus-cards/fc1121.html

5) Here is a dump of PCI devices on the original Windows machine, the last one in the list is probably what I need to pass and have windows recognize.

System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Home Agent 0
Host bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DMI2 Terminator 2x/i
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R2PCIe Agent
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link 0/1
PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D PCI Express Root Port 3 Terminator 2x/i
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 1 Terminator 2x/i
Ethernet controller: Intel Corporation I210 Gigabit Network Connection
Ethernet controller: Intel Corporation I210 Gigabit Network Connection
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D IIO Hot Plug
PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #2 Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D IIO RAS/Control Status/Global Errors
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link Debug
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 0 Thermal Control
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Target Address/Thermal/RAS
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 0 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 2 Thermal Control
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 2 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Ubox
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 0 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #3 Apple MacBookAir6,2 / MacBookPro11,1
RAID bus controller: Intel Corporation C600/X79 series chipset SATA RAID Controller
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Global Broadcast
ISA bridge: Intel Corporation C224 Series Chipset Family Server Standard SKU LPC Controller Apple MacBookAir6,2 / MacBookPro11,1
USB controller: Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #1 Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Map/VTd_Misc/System Management
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 3 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Home Agent 0
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link 0/1
PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D PCI Express Root Port 2 Terminator 2x/i
Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Cape Verde/Pitcairn HDMI Audio [Radeon HD 7700/7800 Series]
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Target Address/Thermal/RAS
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
Unassigned class: Intel Corporation 82599EB 10-Gigabit Dummy Function Ethernet Converged Network Adapter X710
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 1 Thermal Control
USB controller: Intel Corporation 8 Series/C220 Series Chipset Family USB xHCI Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 1 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 3 Thermal Control
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R2PCIe Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 3 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Ubox
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Broadcast
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 2 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D PCI Express Root Port 2 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
PIC: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D I/O APIC Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Ubox
PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #1 Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Venus PRO [Radeon E8860]
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link 0/1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
SMBus: Intel Corporation 8 Series/C220 Series Chipset Family SMBus Controller Apple MacBookAir6,2 / MacBookPro11,1
Unassigned class: Beckhoff GmbH NV5000SC

6) Here is my VM conf if it helps narrow it down

agent: 1
args: -cpu 'host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=NV43FIX,kvm=off'
bios: ovmf
boot: order=ide2;hostpci0;sata0;hostpci4;hostpci3;hostpci1;hostpci2;net0;usb0
cores: 4
cpu: host,hidden=1,flags=+pcid
hostpci0: 0000:04:00,pcie=1
hostpci1: 0000:00:14,pcie=1
hostpci2: 0000:00:1d.0,pcie=1
hostpci3: 0000:02:00,pcie=1
hostpci4: 0000:01:00,pcie=1
ide2: local:iso/virtio-win-0.1.208.iso,media=cdrom,size=543390K
machine: q35
memory: 8192
name: CX-360B86
net0: e1000=92:62:04:4E:33:D3,bridge=vmbr0,firewall=1
numa: 0
sata0: local:100/vm-100-disk-1.qcow2,size=38166M
scsihw: virtio-scsi-single
smbios1: uuid=0d97cf91-64df-4b1d-b49f-31714069c0c8
sockets: 1
usb0: host=0978:2100,usb3=1
vmgenid: 3c254684-f38d-4475-966d-b5395222b088

7) I am not sure if it is related but Sys logger reports the following when running the VM in question

Nov 06 13:54:22 pve kernel: kvm [3413]: vcpu0, guest rIP: 0xfffff805462688f2 kvm_set_msr_common: MSR_IA32_DEBUGCTLMSR 0x1, nop

Thank you for any help/suggestions in advance!
 
Last edited:
Hello all,
Very new to the scene and I hope this is the right place to ask for help with this. I am trying to virtualize an industrial PC (IPC) from a vendor (Beckhoff) while still being able to retain the ability to communicate with its embedded industrial bus (ie E-k Bus in drawing below).

View attachment 31145

Source: https://www.beckhoff.com/en-ca/products/ipc/embedded-pcs/cx20x2-intel-xeon-d/cx2072.html

The Host PC usually runs a version of Windows 10 IoT, which I have already successfully virtualized in Proxmox. While I am able to pass several of the devices seen above to the guest Windows 10 VM (such as the NICs and the USB devices), I am hitting a brick wall regarding the FPGA as even when I do appear to pass it, the guest OS does not assign it its normal drivers. I have followed most of the guides out there based on PCI GPU assignments to try and do this, but its quite possible that I am missing something entirely as I have never attempted to this before. Any help/tips would be greatly appreciated, even if its to learn that this is not possible to do.

I have found out several things:
1) I believe that the device in question is on PCI bus 4 as Twincat references it when trying to assign it and IOMMU does create a single group for it as seen below

04:00.0 Unassigned class [ff00]: Beckhoff GmbH Device [15ec:5000] (rev 02)
Subsystem: Beckhoff GmbH Device [15ec:5000]
Kernel driver in use: ec_bhf
Kernel modules: ec_bhf

2) I know the device works correctly when run natively on Windows 10. I am running a dual OS that allows me to boot back in its native Windows image and check using either device manager or Twincat (Beckhoff Automation Software).

3) If successful I believe the following device should appear in windows manager, however I have yet to see it assigned unless I reboot in native windows.

View attachment 31146

4) The device appears to resemble another PCI card for sale by the vendor

FC1121 | Infrastructure, 1-channel fieldbus card, EtherCAT, slave, PCI express, NOVRAM, RJ45​

The manual for that card gives an overall idea of its functions and Bar Memory Mapping, and it appears to possibly use interrupts and PCIe
source: https://www.beckhoff.com/en-en/prod...ponents/fcxxxx-pci-fieldbus-cards/fc1121.html

5) Here is a dump of PCI devices on the original Windows machine, the last one in the list is probably what I need to pass and have windows recognize.

System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Home Agent 0
Host bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DMI2 Terminator 2x/i
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R2PCIe Agent
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link 0/1
PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D PCI Express Root Port 3 Terminator 2x/i
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 1 Terminator 2x/i
Ethernet controller: Intel Corporation I210 Gigabit Network Connection
Ethernet controller: Intel Corporation I210 Gigabit Network Connection
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D IIO Hot Plug
PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #2 Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D IIO RAS/Control Status/Global Errors
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link Debug
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 0 Thermal Control
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Target Address/Thermal/RAS
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 0 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 2 Thermal Control
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 2 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Ubox
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 0 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #3 Apple MacBookAir6,2 / MacBookPro11,1
RAID bus controller: Intel Corporation C600/X79 series chipset SATA RAID Controller
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Global Broadcast
ISA bridge: Intel Corporation C224 Series Chipset Family Server Standard SKU LPC Controller Apple MacBookAir6,2 / MacBookPro11,1
USB controller: Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #1 Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Map/VTd_Misc/System Management
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 3 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Home Agent 0
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link 0/1
PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D PCI Express Root Port 2 Terminator 2x/i
Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Cape Verde/Pitcairn HDMI Audio [Radeon HD 7700/7800 Series]
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Target Address/Thermal/RAS
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel Target Address Decoder
Unassigned class: Intel Corporation 82599EB 10-Gigabit Dummy Function Ethernet Converged Network Adapter X710
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 1 Thermal Control
USB controller: Intel Corporation 8 Series/C220 Series Chipset Family USB xHCI Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 1 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 3 Thermal Control
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R2PCIe Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Memory Controller 0 - Channel 3 Error
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Ubox
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Broadcast
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon Processor D Family QuickData Technology Register DMA Channel 2 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
PCI bridge: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D PCI Express Root Port 2 Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
PIC: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D I/O APIC Terminator 2x/i
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
Performance counters: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Ubox
PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #1 Apple MacBookAir6,2 / MacBookPro11,1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Venus PRO [Radeon E8860]
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Power Control Unit
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D Caching Agent
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D R3 QPI Link 0/1
System peripheral: Intel Corporation Xeon E7 v4/Xeon E5 v4/Xeon E3 v4/Xeon D DDRIO Channel 0/1 Interface
SMBus: Intel Corporation 8 Series/C220 Series Chipset Family SMBus Controller Apple MacBookAir6,2 / MacBookPro11,1
Unassigned class: Beckhoff GmbH NV5000SC

6) Here is my VM conf if it helps narrow it down

agent: 1
args: -cpu 'host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=NV43FIX,kvm=off'
bios: ovmf
boot: order=ide2;hostpci0;sata0;hostpci4;hostpci3;hostpci1;hostpci2;net0;usb0
cores: 4
cpu: host,hidden=1,flags=+pcid
hostpci0: 0000:04:00,pcie=1
hostpci1: 0000:00:14,pcie=1
hostpci2: 0000:00:1d.0,pcie=1
hostpci3: 0000:02:00,pcie=1
hostpci4: 0000:01:00,pcie=1
ide2: local:iso/virtio-win-0.1.208.iso,media=cdrom,size=543390K
machine: q35
memory: 8192
name: CX-360B86
net0: e1000=92:62:04:4E:33:D3,bridge=vmbr0,firewall=1
numa: 0
sata0: local:100/vm-100-disk-1.qcow2,size=38166M
scsihw: virtio-scsi-single
smbios1: uuid=0d97cf91-64df-4b1d-b49f-31714069c0c8
sockets: 1
usb0: host=0978:2100,usb3=1
vmgenid: 3c254684-f38d-4475-966d-b5395222b088

7) I am not sure if it is related but Sys logger reports the following when running the VM in question

Nov 06 13:54:22 pve kernel: kvm [3413]: vcpu0, guest rIP: 0xfffff805462688f2 kvm_set_msr_common: MSR_IA32_DEBUGCTLMSR 0x1, nop

Thank you for any help/suggestions in advance!
Hey,

DId you got the same result when passing trough only the Beckhoff GmbH NV5000SC ?