Question re GPU Passthrough and noVNC

[Mindbang]

Hey folks,
I have a couple of VMs running and one GPU passed through to them (they are never started at the same time). I'm wondering if it is possible to additionally use the console via noVNC (or Spice?) while a VM is running that is using a passed through GPU?

It seems that, by default, passing through a GPU disables the adapter that is required for a noVNC connection to work and qm also tells me that the VNC server is disabled. I can't find any details on how this is integrated into Proxmox - but isn't noVNC just a standard VNC protocol that uses Websockets? If yes, then shouldn't I be able to run a server while GPU passthrough is active and access it from the Proxmox UI through the Console?

This seems to be a rather silly question, but I could not find any solid pointers on the forum

I appreciate any input!

 

[wolfgang]

Hi,

the problem is the graphic output is on the physical GPU and can't redirected by KVM.

 

[efeu]

Well, it could be easily done by KVM using this "new" project. It would be nice if you would integrate this into, maybe, proxmox 6?

Read mem copied framebuffer, compress, display it in (no)VNC

https://looking-glass.hostfission.com/

 

[wolfgang]

Hi efeu

this is new to me and look promising.

It would be nice if you would integrate this into, maybe, proxmox 6?

I don't think it fit in our generic approach, because is support only Win10 with DXGI Desktop Duplication or NVIDIA Capture API.
DXGI is a Microsoft API and can never be used by other OS's.
Also the NVIDA Capture API will only support by the last 3 gen(Kepler/Maxwell/Pascal) of Quatro GPUs.

 

[dcsapak]

further thoughts:

since this is rather involved inside the vm, you could simply install a vncserver/enable rdp and use that
(instead of going the complicated route of gpu -> fb -> host -> vncserver -> api -> vncclient)

 

[efeu]

Well I'm using it already , it was just an idea on how it could be implemented w/o too much work.