[GPU Passthough -> Manjaro cinnamon VM] Day: 2 of trying to get NV drivers to work in VM (Manjaro) -- help

[ZnapG]

Hi Guys,
as you may have read in the title, im currently running against a wall while trying to get an Nvidia 1660ti fully working in an manjaro (arch - linux) VM.

Hope you guys can help me get things sorted, this is my last hope or im trying bare-metal:
So here all the information I can think of. If you need more, specific info please let me know.

BTW: not my first language so may expect typos..



What I have done so far - I've got a Proxmox Cluster up and running and its working like a charm.
On one of the nodes I created an manjaro VM with GPU passthrough with virtio (+ romfile), which does work, in fact Im on it rn, but only up to an quit old Nvidia driver 430xx. If I try to update the driver to for example the latest 440xx (tried all in between) it breaks my system. What I mean by that is that the connectet monitor no longer outputs video.

agent: 1
args: -cpu host,kvm=off
balloon: 6144
bios: ovmf
boot: cdn
bootdisk: scsi0
cores: 8
efidisk0: VM-StorageSSD:vm-102-disk-1,size=128K
hostpci0: 26:00,pcie=1,x-vga=on,romfile=1660patched.rom
machine: pc-q35-3.1
memory: 12292
name: Linux
net0: virtio=FA:7D:C4:0A:14:04,bridge=vmbr0,firewall=1
numa: 0
onboot: 1
ostype: l26
parent: lates_stable
scsi0: VM-StorageSSD:vm-102-disk-0,cache=writeback,size=100G
scsihw: virtio-scsi-pci
smbios1: uuid=ca90a43c-dff3-4b42-84a7-c62b8fef7399
sockets: 1
usb0: host=195d:2030,usb3=1
usb1: host=0951:16bc,usb3=1
usb2: host=5-4.2,usb3=1
usb3: host=5-4.3,usb3=1
vga: virtio
vmgenid: ab1dd38b-8b41-4ba6-ad44-17172234aa9c

If I connect via Proxmox to the machine it becomes clearer - the DisplayManager did not start at all.. but at least I got tty2 so there is clearly something wrong with the GPU part. 'Journalctl -b' only shows some errors which I also get when I do get into the VM, I guess.

Jan 25 21:21:46 manjaro kernel: pcieport 0000:00:1c.2: pciehp: Failed to check link status
Jan 25 21:21:46 manjaro kernel: pcieport 0000:00:1c.1: pciehp: Failed to check link status
Jan 25 21:21:46 manjaro kernel: pcieport 0000:00:1c.3: pciehp: Failed to check link status
Jan 25 21:21:46 manjaro accounts-daemon[742]: started daemon version 0.6.55
Jan 25 21:21:46 manjaro dbus-daemon[680]: [system] Successfully activated service 'freedesktop.Accounts'
Jan 25 21:21:46 manjaro systemd[1]: Started Accounts Service.
Jan 25 21:21:46 manjaro audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=accounts-daemon comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Jan 25 21:21:46 manjaro systemd[1]: Started Modem Manager.
Jan 25 21:21:46 manjaro audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=ModemManager comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Jan 25 21:21:46 manjaro kernel: nvidia-gpu 0000:01:00.3: i2c timeout error e0000000
Jan 25 21:21:47 manjaro kernel: ucsi_ccg 0-0008: i2c_transfer failed -110
Jan 25 21:21:47 manjaro kernel: ucsi_ccg 0-0008: ucsi_ccg_init failed - -110
Jan 25 21:21:47 manjaro kernel: ucsi_ccg: probe of 0-0008 failed with error -110
Jan 25 21:21:47 manjaro systemd[1]: Started Snappy daemon.
Jan 25 21:21:47 manjaro audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj==unconfined msg='unit=snapd comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Jan 25 21:21:47 manjaro systemd[1]: Reached target Multi-User System.
Jan 25 21:21:47 manjaro systemd[1]: Reached target Graphical Interface.
Jan 25 21:21:47 manjaro systemd[1]: Starting TLP system startup/shutdown...
Jan 25 21:21:47 manjaro snapd[682]: stateengine.go:150: state ensure error: Get api.snapcraft/api/v1/snaps/sections: dial tcp: lookup api.snapcraft: no such host
Jan 25 21:21:47 manjaro kernel: xhci_hcd 0000:07:1b.0: WARN Set TR Deq Ptr cmd failed due to incorrect slot or ep state.
Jan 25 21:21:47 manjaro kernel: usb 5-4.1: USB disconnect, device number 6
Jan 25 21:21:47 manjaro kernel: usb 5-4.1: 4:1: cannot set freq 48000 to ep 0x2
Jan 25 21:21:47 manjaro kernel: usb 5-4.1: 4:2: cannot set freq 48000 to ep 0x2
Jan 25 21:21:47 manjaro kernel: usb 5-4.1: 2:0: cannot get min/max values for control 2 (id 2)

TL;TR - Summary:

KVM GPU passthrough to Linux Arch VM works but only up to certain NV Drivers.
Update NV Driver -> breaks the Video out

Kernal Update from L54 to L55 and same NV Driver -> works
Kernal Update from L54 to L55 and updated / latest NV Driver -> no Video to connectet Monitor and DisplayManager dosent start anymore.

My Goal: A Manjaro VM with nvidia hardware acceleration / NVENC which require 'NVIDIA Linux display driver [ **435.21** ] or newer' see: "NVIDIA VIDEO CODEC SDK - Get Started"


All help is gladly appreciated since I'm kinda also breaking rn as often as I have reinstalled drivers.
Thanks all

Cheers
~Znap

 

[Stefan_R]

Have you tried checking the "All Functions" checkbox in the GUI, or alternatively manually passing through all subfunctions of your GPU device? (e.g. the audio device, usually at 00:XX.1 where 00:XX.0 is your GPU)

Other than that I could maybe also see your ROM file being broken in some way... Do you positively need that?