Ah yes here is my config for GPU passthrough on the PowerEdge R710 I with Xeon E55xx CPUs using two GTX 750 Ti's (One on this machine and one on another:
Code:
agent: 1
balloon: 0
bios: ovmf
bootdisk: virtio0
cores: 3
cpu: host,hidden=1
hostpci0: 04:00,x-vga=1,pcie=1
hotplug: 0
ide2: none,media=cdrom
machine: q35
memory: 7168
name: WIN10X64PVEXXXX
net0: virtio=XX:XX:XX:XX:XX:XX,bridge=vmbr0
numa: 1
ostype: win10
scsihw: virtio-scsi-pci
smbios1: uuid=XXXXXXXX-XXXX-XXXX-XXXX-XXXXXXXXXXXX
sockets: 2
virtio0: local-lvm:vm-102-disk-0,cache=writeback,size=320G
vmgenid: XXXXXXXX-XXXX-XXXX-XXXX-XXXXXXXXXXXX
It would boot up the machine and crash the whole server with pcie without numa: 1 but without numa would run regular pci.
Instructions:
Hardware:
1. Solder in power plugs onto the power supply connector on the motherboard.
2. Using a razor knife and hot air soldering station heat up the PCI slit in the back (Using 400 degree heat on medium air or whatever works) and cut out the back of the PCI slot to fit cards.
Proxmox:
Edit grub command line w unsafe interrupts:
change:
Code:
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on vfio_iommu_type1.allow_unsafe_interrupts=1 video=efifb:eek:ff"
add to /etc/modules:
Code:
# echo "vfio" > /etc/modules
# echo "vfio_iommu_type1" > /etc/modules
# echo "vfio_pci" > /etc/modules
# echo "vfio_virqfd" > /etc/modules
Allow unsafe interrupts in vfio:
Code:
echo "options vfio_iommu_type1 allow_unsafe_interrupts=1" > /etc/modprobe.d/iommu_unsafe_interrupts.conf
Add dev id (either 04:00 or 06:00 on the R710):
Code:
lspci -n -s 04:00
04:00.0 0300: 10de:1380 (rev a2)
04:00.1 0403: 10de:0fbc (rev a1)
echo "options vfio-pci ids=10de:1380,10de:0fbc disable_vga=1" > /etc/modprobe.d/vfio.conf
blacklist drivers:
Code:
echo "blacklist radeon" >> /etc/modprobe.d/blacklist.conf
echo "blacklist nouveau" >> /etc/modprobe.d/blacklist.conf
echo "blacklist nvidia" >> /etc/modprobe.d/blacklist.conf
Make a new VM for windows 10 as usual: virtio lvm, virtio networking, cpu: host, hidden=1, machine: q35, bios: ovmf
add virtio drivers cdrom, install...
Code:
agent: 1
balloon: 0
bios: ovmf
bootdisk: virtio0
cores: 3
cpu: host,hidden=1
hotplug: 0
ide2: none,media=cdrom
machine: q35
memory: 7168
name: WIN10X64PVEXXXX
net0: virtio=XX:XX:XX:XX:XX:XX,bridge=vmbr0
ostype: win10
scsihw: virtio-scsi-pci
smbios1: uuid=XXXXXXXX-XXXX-XXXX-XXXX-XXXXXXXXXXXX
sockets: 2
virtio0: local-lvm:vm-102-disk-0,cache=writeback,size=320G
vmgenid: XXXXXXXX-XXXX-XXXX-XXXX-XXXXXXXXXXXX
After install enable RDP and add to the config:
Code:
hostpci0: 04:00,x-vga=1,pcie=1
numa: 1
install nvidia drivers as usual.
Tips on gaming:
install steam and set up steam in home streaming.
Streaming will only work on first boot of vm machine before logging in RDP.
Add notepad or some application as a non steam game (right click in notepad and search with bing to leave notepad and minimize)
Other notes on CPUs being that they are quade core sockets on the R710 the machine will crash and maybe crash the server if you use more than four cores without sockets: 2.
Still a very inexpensive buy for doing Autodesk work remotely and gaming while still having a little CPU power left over for running databases and developing websites and applications at home..
I think the nvidia drivers I'm using are 289.81 I wouldn't recommend installing any newer ones and those seem to be the ones people are recommending on steam for the 750 Ti. Although I heard you can get an RX 460 for around $50 these days.
