AMD s7150x2 on Proxmox VE 6

[Jsingh]

I want to run the AMD Mx GPU s7150x2 on proxmox VE 6.
It's been a while since I did my research on this but as far as I remember that the AMD GIM driver does not compile for the Linux 5.x kernel in proxmox VE 6.0. There was a post somewhere I think in the proxmox support forums pointing to GIT repository with the necessary modifications so that the amd gim driver compiles for proxmox 6.x.

Could anybody help me with this?

 

[Jsingh]

Thanks! I will check it , currently I have used Flumm's modification:

https://github.com/flumm/MxGPU-Virtualization

but I am having issues Guest BSOD so I will try your modifications.


I am getting BSOD in the guest when I try to pass through a virtual function.

If I pass the whole chip to a guest then the guest is stable. Any suggestions on how to fix this?

 

[Jsingh]

@Gatex I looked into that file, which source file does it modify as I don't see it being included in the compilation.

 

[vaschthestampede]

Has anyone succeeded?

I have arrived at "make" but "make install" fails.

make -C /lib/modules/5.4.106-1-pve/build M=/MxGPU-Virtualization-main/drv modules_install
make[1]: Entering directory '/usr/src/linux-headers-5.4.106-1-pve'
  INSTALL /MxGPU-Virtualization-main/drv/gim.ko
  DEPMOD  5.4.106-1-pve
Warning: modules_install: missing 'System.map' file. Skipping depmod.
make[1]: Leaving directory '/usr/src/linux-headers-5.4.106-1-pve'

 

[Jsingh]

Has anyone succeeded?

I have arrived at "make" but "make install" fails.

make -C /lib/modules/5.4.106-1-pve/build M=/MxGPU-Virtualization-main/drv modules_install
make[1]: Entering directory '/usr/src/linux-headers-5.4.106-1-pve'
  INSTALL /MxGPU-Virtualization-main/drv/gim.ko
  DEPMOD  5.4.106-1-pve
Warning: modules_install: missing 'System.map' file. Skipping depmod.
make[1]: Leaving directory '/usr/src/linux-headers-5.4.106-1-pve'

The drivers are working for me properly. Which repository are you using to build the Mx-GPU drivers?

 

[vaschthestampede]

Various, in particular these two give me the reported error:
https://github.com/flumm/MxGPU-Virtualization/tree/kernel5.0
https://github.com/kasperlewau/MxGPU-Virtualization

To get them to that point I had to enable the PVE pve-no-subscription repository provided by proxmox.com.

echo "# PVE pve-no-subscription repository provided by proxmox.com," >> /etc/apt/sources.list
echo "# NOT recommended for production use" >> /etc/apt/sources.list
echo "deb http://download.proxmox.com/debian/pve buster pve-no-subscription" >> /etc/apt/sources.list

And install these components:

apt-get install build-essential pve-headers-`uname -r` make

For now I have a test server with four S7150x2.
I hope to put it into production.

 

[Jsingh]

Various, in particular these two give me the reported error:
https://github.com/flumm/MxGPU-Virtualization/tree/kernel5.0
https://github.com/kasperlewau/MxGPU-Virtualization

To get them to that point I had to enable the PVE pve-no-subscription repository provided by proxmox.com.

echo "# PVE pve-no-subscription repository provided by proxmox.com," >> /etc/apt/sources.list
echo "# NOT recommended for production use" >> /etc/apt/sources.list
echo "deb http://download.proxmox.com/debian/pve buster pve-no-subscription" >> /etc/apt/sources.list

And install these components:

apt-get install build-essential pve-headers-`uname -r` make

For now I have a test server with four S7150x2.
I hope to put it into production.

Did you check with the command lscpci -nn | grep AMD if the AMD virtual gpus are showing up?
I followed the steps here:
https://pve.proxmox.com/wiki/MxGPU_with_AMD_S7150_under_Proxmox_VE_5.x

with this repository https://github.com/kasperlewau/MxGPU-Virtualization and it worked like a charm.

I remember seeing the same output but I still was able to see and passthrough the virtual cards in lspci.

Don't forget to start the driver with modprobe gim every time you restart your server otherwise you won't see the virtual GPUs.

 

[vaschthestampede]

But that guide is for the VE 5.X (linux kernel 4), right?
I have the VE 6.X (linux kernel 5) and I don't want to upgrade to an older version.

 

[mac.linux.free]

I am running this on pm 6.2...so everything fine.

 

[Jsingh]

But that guide is for the VE 5.X (linux kernel 4), right?
I have the VE 6.X (linux kernel 5) and I don't want to upgrade to an older version.

Use the repository in my previous post, the steps remain the same from the guide. I am using this in production as well.

 

[vaschthestampede]

I just can't do the "make install".

And to get to the "make" I have to switch to the experimental version by unlocking the PVE pve-no-subscription repository, which I wanted to avoid in order not to recompile with every kernel update.

I don't know if it makes so much sense to insist now as the cards are now obsolete and these drivers shouldn't work for the Instinct.

 

[Jsingh]

One note I would like to add for me "make install" did not install the drivers as it skipped depmod so I just ran the command "depmod" and the driver was installed