[SOLVED] NVIDIA single GPU Passthrough with Ryzen

mik-2580

New Member
Dec 19, 2017
14
1
3
43
Hallo,

as holidays begin, I am going to try out Proxmox for my home-PC.

My system specs are as follows:

mainboard: MSI X370 SLI Plus
CPU: Ryzen R7 1700
ram: 16 Gb Vengance LPX
storage: for now, single HDD
graphics: EVGA GTX 1070 SC ACX 3.0
graphics2: some old HD7770 (to be removed)
wifi: Qualcomm Atheros AR93xx Wireless Network Adapter
VM1: Fedora 27
VM2: Windows 10

I managed to get proxmox (latest release) up and running and configured wifi. Next I installed the latest upgrades through apt and installed a kernel 4.14.7, as kernels <4.14 include the npt patch to get better performance in VMs.

Boot options as of now are:
GRUB_CMDLINE_LINUX_DEFAULT="quiet iommu=pt amd_iommu=1 pcie_acs_override=multifunction video=efifb: off"

To get the GPU passthrough up and running, I temporarily added the AMD graphics and used the NVIDIA in the second PCIe slot.
With this setup I achieved the following results (hostpci0: xx:00,pcie=1,x-vga=on) :

- VM 1 boots up with both GPUs AMD and NVIDIA
- VM 2 boots with both GPUs AMD and NVIDIA

As I got the NVIDIA graphics running I extracted the rom of my NVIDIA using gpu-z

Next try, still both GPUs installed (hostpci0: 27:00,pcie=1,x-vga=on,romfile=GP104.rom):

- VM1 boots up fine
- VM2 wont show graphical output

To verify that the system will boot with only the NVIDIA graphics installed I removed the AMD GPU and placed the NVIDIA in slot 1:

VM1:
runs fine, with or w/o the rom attached to the hostpci

VM2:
wont show graphical output neither way

The goal is obviously, to get the Windows VM (VM2) running with the NVIDIA graphics as a single GPU.

root@pve:~# tail -f /var/log/messages


Dec 19 14:18:16 pve pvedaemon[1373]: <root@pam> starting task UPID: pve:0000187C:00064A85:5A391198:qmstart:101:root@pam:
Dec 19 14:18:19 pve kernel: [ 4125.047104] vfio_ecap_init: 0000:26:00.0 hiding ecap 0x19@0x900
Dec 19 14:18:19 pve kernel: [ 4125.087100] vfio_ecap_init: 0000:03:00.0 hiding ecap 0x19@0x200
Dec 19 14:18:19 pve kernel: [ 4125.087105] vfio_ecap_init: 0000:03:00.0 hiding ecap 0x1e@0x400
Dec 19 14:18:19 pve kernel: [ 4125.088500] vfio-pci 0000:25:00.0: enabling device (0400 -> 0402)
Dec 19 14:18:20 pve kernel: [ 4126.119241] vfio_ecap_init: 0000:25:00.0 hiding ecap 0x19@0x200
Dec 19 14:18:20 pve kernel: [ 4126.121509] vfio-pci 0000:27:00.3: enabling device (0000 -> 0002)
Dec 19 14:18:23 pve pvedaemon[1373]: <root@pam> end task UPID: pve:0000187C:00064A85:5A391198:qmstart:101:root@pam: OK
same with and w/o the rom-file attached.
 
can you please post both vm configs?
Code:
qm config <VMID>
 
root@pve:~# qm config 100
bios: ovmf
bootdisk: sata0
cores: 8
efidisk0: vms:vm-100-disk-4,size=128K
hostpci0: 26:00,pcie=1,x-vga=on,romfile=GP104.rom
hostpci1: 03:00.0,pcie=1
hostpci2: 25:00.0,pcie=1
hostpci3: 27:00.3,pcie=1
ide2: none,media=cdrom
machine: q35
memory: 14336
name: Fedora
net0: virtio=xx:xx:xx:xx:xx:xx
numa: 0
ostype: l26
sata0: vms:vm-100-disk-3,size=20G
scsihw: virtio-scsi-pci
smbios1: uuid=xxxxxxxxxxxxxxxxxxxxxxxxxxxxx
sockets: 2

root@pve:~# qm config 101
bios: ovmf
boot: c
bootdisk: sata0
cores: 6
efidisk0: vms:vm-101-disk-2,size=128K
hostpci0: 26:00,pcie=1,x-vga=on
hostpci1: 03:00.0,pcie=1
hostpci2: 25:00.0,pcie=1
hostpci3: 27:00.3,pcie=1
machine: q35
memory: 8192
name: Windows10
net0: virtio=xx:xx:xx:xx:xx:xx
numa: 0
ostype: win10
sata0: vms:vm-101-disk-1,size=50G
sata1: local:iso/virtio-win-0.1.141.iso,media=cdrom,size=309208K
sata2: local:iso/Win10_1709_German_x64.iso,media=cdrom,size=4600548K
scsihw: virtio-scsi-pci
smbios1: uuid=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
sockets: 2
 
Last edited:
Next I installed the latest upgrades through apt and installed a kernel 4.14.7, as kernels <4.14 include the npt patch to get better performance in VMs.
fyi, kernels other than ours are generally not supported, though i do not think this is the issue here (though did you install a kernel with the acs override patch included? because you have it in your grub config)

also not connected to your issue: is there a reason why you use sata instead of scsi?

how do your lspci and your iommu groups look like?
 
kernel: I'm aware that other kernels are not supported. I would have used the proxmox kernel as it provides everything I need for now accept the npt patch. As I understand proxmox uses the ubuntu kernel with acs. That said the kernel in use is for ubuntu as well but a newer one.
The kernel has inclueded the acs patch, I need it to point the usb devices to other IOMMU groups (one USB controller is in one group with the SATA controller)
If you need me to, I could boot with the proxmox kernel 4.13.something

No particular reason to use sata, I was just trying the most efficient system. If scsi is the recommended one, I'll switch to this.

IOMMU Group 0 00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge [1022:1452]
IOMMU Group 10 03:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:43b9] (rev 02)
IOMMU Group 11 03:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] Device [1022:43b5] (rev 02)
IOMMU Group 12 03:00.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43b0] (rev 02)
IOMMU Group 13 04:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port [1022:43b4] (rev 02)
IOMMU Group 14 04:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port [1022:43b4] (rev 02)
IOMMU Group 14 1e:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 15)
IOMMU Group 15 04:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port [1022:43b4] (rev 02)
IOMMU Group 16 04:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port [1022:43b4] (rev 02)
IOMMU Group 17 04:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port [1022:43b4] (rev 02)
IOMMU Group 18 04:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port [1022:43b4] (rev 02)
IOMMU Group 19 04:06.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port [1022:43b4] (rev 02)
IOMMU Group 19 23:00.0 Network controller [0280]: Qualcomm Atheros AR93xx Wireless Network Adapter [168c:0030] (rev 01)
IOMMU Group 1 00:01.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1453]
IOMMU Group 20 04:07.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port [1022:43b4] (rev 02)
IOMMU Group 21 04:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port [1022:43b4] (rev 02)
IOMMU Group 21 25:00.0 USB controller [0c03]: ASMedia Technology Inc. Device [1b21:2142]
IOMMU Group 22 26:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP104 [GeForce GTX 1070] [10de:1b81] (rev a1)
IOMMU Group 23 26:00.1 Audio device [0403]: NVIDIA Corporation GP104 High Definition Audio Controller [10de:10f0] (rev a1)
IOMMU Group 2 00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge [1022:1452]
IOMMU Group 3 00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge [1022:1452]
IOMMU Group 4 00:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1453]
IOMMU Group 5 00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge [1022:1452]
IOMMU Group 6 00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge [1022:1452]
IOMMU Group 6 00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B [1022:1454]
IOMMU Group 6 27:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device [1022:145a]
IOMMU Group 6 27:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor [1022:1456]
IOMMU Group 6 27:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller [1022:145c]
IOMMU Group 7 00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge [1022:1452]
IOMMU Group 7 00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B [1022:1454]
IOMMU Group 7 28:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device [1022:1455]
IOMMU Group 7 28:00.2 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
IOMMU Group 7 28:00.3 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) HD Audio Controller [1022:1457]
IOMMU Group 8 00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 59)
IOMMU Group 8 00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
IOMMU Group 9 00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0 [1022:1460]
IOMMU Group 9 00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1 [1022:1461]
IOMMU Group 9 00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2 [1022:1462]
IOMMU Group 9 00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3 [1022:1463]
IOMMU Group 9 00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4 [1022:1464]
IOMMU Group 9 00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5 [1022:1465]
IOMMU Group 9 00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric Device 18h Function 6 [1022:1466]
IOMMU Group 9 00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7 [1022:1467]
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Root Complex
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) I/O Memory Management Unit
00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1453
00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1453
00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge
00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59)
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric Device 18h Function 6
00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
03:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 43b9 (rev 02)
03:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] Device 43b5 (rev 02)
03:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b0 (rev 02)
04:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
04:01.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
04:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
04:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
04:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
04:05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
04:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
04:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
04:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
1e:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 15)
23:00.0 Network controller: Qualcomm Atheros AR93xx Wireless Network Adapter (rev 01)
25:00.0 USB controller: ASMedia Technology Inc. Device 2142
26:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1070] (rev a1)
26:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev a1)
27:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
27:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor
27:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller
28:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
28:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
28:00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) HD Audio Controller
 
No particular reason to use sata, I was just trying the most efficient system. If scsi is the recommended one, I'll switch to this.
yes scsi with virtio-scsi should be best

afaics you pass through 3 usb controllers (why all 3 instead of one with an usb hub?), where one is still in an iommu group with other devices
IOMMU Group 6 00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe Dummy Host Bridge [1022:1452]
IOMMU Group 6 00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B [1022:1454]
IOMMU Group 6 27:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device [1022:145a]
IOMMU Group 6 27:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor [1022:1456]
IOMMU Group 6 27:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) USB 3.0 Host Controller [1022:145c]

do you really do not see anything on the display? not even the uefi boot screen?
as far as your configs go, aside from my remarks, there is nothing obviously wrong

i have a similar setup at home (though i have a small gt 710 for the host, and my board, asus x370 prime pro has a usb controller in a proper iommu group) which works without problems with windows 10
 
I just removed device 27:00.3 from the hostpci and rebooted to verify, it was not the IOMMU group to keep the sceen off. Same result though.
With just the NVIDIA card in slot 1, the system boots up into grub. As I shut off the efifb with my kernel arguments, it shows "booting kernel" and "starting initramdisk" (or similar, you get the point) and stays on. Only thoughs two lines. As soon as I start the Windows VM, the screen goes blank first (removing the 2 lines) and shuts off.
Stopping the VM (not shutdown, but actual stopping) and booting into the Linux VM gives me the expected result -> login screen.
Just to verify the Windows VM was running correctly, I tried to boot up the vm using spice, with a nice boot into the login screen.

I don't see the problem with the IOMMUs nor the board, as the AMD graphics card boot into windows just fine.
I think the problem is somewhere with the NVIDIA graphics card.
 
Stopping the VM (not shutdown, but actual stopping) and booting into the Linux VM gives me the expected result -> login screen.
maybe the host does not properly uninitialize the gpu? have you tried starting the windows vm a second time?
 
i believe so (have the amd installed currently)
I just extracted the amd GPU rom to verify it was bios only.
As the NVIDIA card as a dual rom (bios and uefi) it may be related to this. (As your card won't have efi support either, as I suspect)
I am going to install a second Windows VM, but in bios mode instead.
 
didnt change anything.
I also tried to start / stopp / start the Windows efi VM couple of times, wouldn't display anything.
 
mhmm then i am out of ideas ...
 
SUCCESS!

While reading a little bit about AMD RAID and linux, I got the last little piece to get my GTX 1070 to work as a single GPU in the Windows VM
-> Key feature being "Windows 10 WHQL support" to be set to "enabled", which creates a UEFI only environment.

quick guide:

1: switch your BIOS mode to "Windows WHQL" to enable
2: Install proxmox
3: follow the proxmox wiki to set up iommu and vfio
4: add efifb: off to your /etc/default/grub
Code:
GRUB_CMDLINE_LINUX_DEFAULT="quiet iommu=pt amd_iommu=1 pcie_acs_override=multifunction video=efifb:off"
5: using "ovmf" install windows with vnc/spice
6: import the GPU using:
Code:
hostpci0: xx:00,pcie=1,x-vga=on
machine: q35
7: reboot and/or start your VM
 
Last edited:
SUCCESS!

While reading a little bit about AMD RAID and linux, I got the last little piece to get my GTX 1070 to work as a single GPU in the Windows VM
-> Key feature being "Windows 10 WHQL support" to be set to "enabled", which creates a UEFI only environment.

quick guide:

1: switch your BIOS mode to "Windows WHQL" to enable
2: Install proxmox
3: follow the proxmox wiki to set up iommu and vfio
4: add efifb: off to your /etc/default/grub
Code:
GRUB_CMDLINE_LINUX_DEFAULT="quiet iommu=pt amd_iommu=1 pcie_acs_override=multifunction video=efifb:off"
5: using "ovmf" install windows with vnc/spice
6: import the GPU using:
Code:
hostpci0: xx:00,pcie=1,x-vga=on
machine: q35
7: reboot and/or start your VM
-From steps 1 (switch your BIOS mode to "Windows WHQL" to enable) and 2 (Install proxmox) i understand that the feature from 1 is part of the MB's BIOS.
Am i right?
I don't think i have such feature in my MB's BIOS..
What boot mode have you selected for your MB ([UEFI] / [LEGACY+UEFI])?
-For Win10 vm, at the beginning you tried a vm with a vbios, but you ended up with a vm which don't use a vbios?
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!