Could someone help me determine what I have done incorrectly. I am attempting to passthrough this card
https://www.startech.com/Cards-Adap...rt-pcie-usb-card-gigabit-ethernet~PEXUSB3S3GE
to this VM
hostpci1 is this card
hostpci0 is a video card.
if i remove hostpci1, the VM starts without error, & displays to its monitors.
When i add the card to the VM, the pve start task completes, however the VM status when I hover over it in GUI says "internal-error". I'm unable to interact with the VM or ping/connect remotely.
I've tried various combinations of the GUI checkmarks; all functions, rom-bar, pci-express. i did not checkmark primary gpu as this is not a video card.
Hardware
TRX40-e ROG Strix
Threadripper 3960
64GB Ram
two 5700 xt video cards
various hard drives
1000Watt PSU
/etc/default/grub
/etc/modules
/etc/modprobe.d/iommu_unsafe_interrupts.conf
I've been to BIOS to make sure Secure Virtual Machine is enabled
/etc/modprobe.d/blacklist.conf
/etc/modprobe.d/vfio.conf
Thank you
https://www.startech.com/Cards-Adap...rt-pcie-usb-card-gigabit-ethernet~PEXUSB3S3GE
to this VM
Code:
agent: 1
args: -cpu 'host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=NV43FIX,kvm=off'
balloon: 0
bios: ovmf
boot: cdn
bootdisk: virtio0
cores: 8
cpu: host,hidden=1,flags=+pcid
efidisk0: local-lvm:vm-100-disk-1,size=128K
hostpci0: 03:00,pcie=1,x-vga=1
hostpci1: 21:00.0,rombar=0
ide2: local:iso/proxmox-ve_6.1-1.iso,media=cdrom,size=794846K
machine: q35
memory: 20480
name: his
net0: virtio=4A:5C:E7:BA:18:3F,bridge=vmbr0,firewall=1
numa: 0
ostype: win10
scsi2: /dev/disk/by-id/ata-WDC_WD20EARS-00MVWB0_WD-WMAZA1112475,size=1953514584K
scsi3: /dev/disk/by-id/ata-WDC_WD3000HLFS-01G6U0_WD-WXLY08164321,size=293036184K
scsi4: /dev/disk/by-id/ata-CT2000BX500SSD1_2001E231F0C1,size=1953514584K
scsi5: /dev/disk/by-id/ata-OCZ-VERTEX3_OCZ-KOG60Y076HO72023,size=234431064K
scsi6: /dev/disk/by-id/ata-OCZ-VERTEX460_OCZ-7JWBHO7SN54GIPG8,size=468851544K
scsihw: virtio-scsi-pci
smbios1: uuid=9e1a83cb-3251-4660-b6d0-069b254b9eb1
sockets: 1
virtio0: local-lvm:vm-100-disk-0,cache=writeback,size=150G
vmgenid: a224fca7-b1f0-43d8-bd0f-1873b4d41b36hostpci1 is this card
hostpci0 is a video card.
if i remove hostpci1, the VM starts without error, & displays to its monitors.
When i add the card to the VM, the pve start task completes, however the VM status when I hover over it in GUI says "internal-error". I'm unable to interact with the VM or ping/connect remotely.
I've tried various combinations of the GUI checkmarks; all functions, rom-bar, pci-express. i did not checkmark primary gpu as this is not a video card.
Hardware
TRX40-e ROG Strix
Threadripper 3960
64GB Ram
two 5700 xt video cards
various hard drives
1000Watt PSU
Code:
pveversion -v
proxmox-ve: 6.1-2 (running kernel: 5.3.13-1-pve)
pve-manager: 6.1-3 (running version: 6.1-3/37248ce6)
pve-kernel-5.3: 6.0-12
pve-kernel-helper: 6.0-12
pve-kernel-5.3.13-1-pve: 5.3.13-1
pve-kernel-5.3.10-1-pve: 5.3.10-1
ceph-fuse: 12.2.11+dfsg1-2.1+b1
corosync: 3.0.2-pve4
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown: 0.8.35+pve1
ksm-control-daemon: 1.3-1
libjs-extjs: 6.0.1-10
libknet1: 1.13-pve1
libpve-access-control: 6.0-5
libpve-apiclient-perl: 3.0-2
libpve-common-perl: 6.0-9
libpve-guest-common-perl: 3.0-3
libpve-http-server-perl: 3.0-3
libpve-storage-perl: 6.1-2
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve3
lxc-pve: 3.2.1-1
lxcfs: 3.0.3-pve60
novnc-pve: 1.1.0-1
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.1-1
pve-cluster: 6.1-2
pve-container: 3.0-14
pve-docs: 6.1-3
pve-edk2-firmware: 2.20191002-1
pve-firewall: 4.0-9
pve-firmware: 3.0-4
pve-ha-manager: 3.0-8
pve-i18n: 2.0-3
pve-qemu-kvm: 4.1.1-2
pve-xtermjs: 3.13.2-1
qemu-server: 6.1-2
smartmontools: 7.0-pve2
spiceterm: 3.1-1
vncterm: 1.6-1
zfsutils-linux: 0.8.2-pve2/etc/default/grub
Code:
# If you change this file, run 'update-grub' afterwards to update
# /boot/grub/grub.cfg.
# For full documentation of the options in this file, see:
# info -f grub -n 'Simple configuration'
GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR="Proxmox Virtual Environment"
GRUB_CMDLINE_LINUX_DEFAULT="quiet nomodeset pcie_acs_override=downstream,multif$
GRUB_CMDLINE_LINUX=""
# Disable os-prober, it might add menu entries for each guest
GRUB_DISABLE_OS_PROBER=true
# Uncomment to enable BadRAM filtering, modify to suit your needs
# This works with Linux (no patch required) and with any kernel that obtains
# the memory map information from GRUB (GNU Mach, kernel of FreeBSD ...)
#GRUB_BADRAM="0x01234567,0xfefefefe,0x89abcdef,0xefefefef"/etc/modules
Code:
# /etc/modules: kernel modules to load at boot time.
#
# This file contains the names of kernel modules that should be loaded
# at boot time, one per line. Lines beginning with "#" are ignored.
vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd/etc/modprobe.d/iommu_unsafe_interrupts.conf
Code:
options vfio_iommu_type1 allow_unsafe_interrupts=1/etc/modprobe.d/blacklist.conf
Code:
blacklist radeon
blacklist nouveau
blacklist nvidia/etc/modprobe.d/vfio.conf
Code:
options vfio-pci ids=1002:731f,1002:ab38 disable_vga=1
options vfio-pci ids=10de:1187,10de:0e0a disable_vga=1Thank you
Last edited:
