Hardware for my new test proxmox server

[Anila]

Hello guys,

i want to build my first own promox vm server with the following hardware:
Mainboard: ASRock X570 PG Velocita
CPU: AMD Ryzen 7 5700G
GPU: 2x Nivida Tesla K80 (with SLI-Support)


Do you know some issues ?

I dont find any problems on "hardware search"

 

[leesteken]

X570 chipset is the best choice for PCIe passthrough on Ryzen. I went with Gigabyte AERO because it has no fan, two separate USB controllers that can be passed through and the choice of boot GPU in BIOS.
5700G is great for Proxmox host console (but don't try to do passthrough). It will make the first PCIe x16 slot work as x8. This is not a big deal on the Velocita but would disable one x16 slot on other motherboards (like the Gigabyte AERO).
Note that your K80 GPUs, when put in the PCIe x16 slots, will run at x8 and x4. This is probably not be a problem (depending on your use case) and you'll probably need Threadripper, EPYC or Xeon if it is a problem. Best you can get on other consumer motherboards and without integrated graphics or APU is x8 and x8.

 

[Whisky]

X570 chipset is the best choice for PCIe passthrough on Ryzen. I went with Gigabyte AERO because it has no fan, two separate USB controllers that can be passed through and the choice of boot GPU in BIOS.
5700G is great for Proxmox host console (but don't try to do passthrough). It will make the first PCIe x16 slot work as x8. This is not a big deal on the Velocita but would disable one x16 slot on other motherboards (like the Gigabyte AERO).
Note that your K80 GPUs, when put in the PCIe x16 slots, will run at x8 and x4. This is probably not be a problem (depending on your use case) and you'll probably need Threadripper, EPYC or Xeon if it is a problem. Best you can get on other consumer motherboards and without integrated graphics or APU is x8 and x8.

Could you give some insight why the first PCIex16 goes down to x8?

 

[Dunuin]

Could you give some insight why the first PCIex16 goes down to x8?

Because the iGPU is needing those PCIe lanes. If you want those lanes for you PCIe slots you have to buy a CPU without an iGPU.

 

[vinnfts]

X570 chipset is the best choice for PCIe passthrough on Ryzen. I went with Gigabyte AERO because it has no fan, two separate USB controllers that can be passed through and the choice of boot GPU in BIOS.
5700G is great for Proxmox host console (but don't try to do passthrough). It will make the first PCIe x16 slot work as x8. This is not a big deal on the Velocita but would disable one x16 slot on other motherboards (like the Gigabyte AERO).
Note that your K80 GPUs, when put in the PCIe x16 slots, will run at x8 and x4. This is probably not be a problem (depending on your use case) and you'll probably need Threadripper, EPYC or Xeon if it is a problem. Best you can get on other consumer motherboards and without integrated graphics or APU is x8 and x8.

Hey, can you explain more about 5700g iGPU passthrough? It will need PCI lane of the motherboard?

 

[leesteken]

Hey, can you explain more about 5700g iGPU passthrough?

Integrated graphics is always more difficult to passthrough. It is also in the same IOMMU group as other devices, which requires an insecure work-around (which is why I advise against it). Lots of threads about this on this forum: https://forum.proxmox.com/search/7393236/?q=5700G&t=post&c[child_nodes]=1&c[nodes][0]=16&o=date

It will need PCI lane of the motherboard?

You will have 8 PCIe lanes less for other devices when using a Ryzen with integrated graphics. If you use a AM4 motherboard that can do two x16 slots, then only one with be usable when using a Ryzen with integrated graphics. This is usually indicated in the specifications of the motherboard on the website of the manufacturer.

 

[vinnfts]

Integrated graphics is always more difficult to passthrough. It is also in the same IOMMU group as other devices, which requires an insecure work-around (which is why I advise against it). Lots of threads about this on this forum: https://forum.proxmox.com/search/7393236/?q=5700G&t=post&c[child_nodes]=1&c[nodes][0]=16&o=date

You will have 8 PCIe lanes less for other devices when using a Ryzen with integrated graphics. If you use a AM4 motherboard that can do two x16 slots, then only one with be usable when using a Ryzen with integrated graphics. This is usually indicated in the specifications of the motherboard on the website of the manufacturer.

Oh I see, I have two 1650 GTX, B550 Plus Wifi Tuf Gaming and 5700G, if iGPU passthrough is not recommended, can I use both 1650 for that build? One for a linux NAS, one for Windows to render videos in Premiere Media Encoder

 

[leesteken]

can I use both 1650 for that build?

Probably not, as you lose one x16 slot because of the integrated graphics and the third x16 slot does not support passthrough (because it's a B550 and not a X570 motherboard). But I don't have the same or similar hardware to know for sure.

 

[vinnfts]

Probably not, as you lose one x16 slot because of the integrated graphics and the third x16 slot does not support passthrough (because it's a B550 and not a X570 motherboard). But I don't have the same or similar hardware to know for sure.

If I don't passthrough the iGPU, I still have 2 pci lanes on that motherboard?

 

[leesteken]

If I don't passthrough the iGPU, I still have 2 pci lanes on that motherboard?

It's not about passthrough. Ryzen only has a limited number of PCIe lanes (which are not the same as slots but maybe that a language translate thingy). A Ryzen with integrated graphics has 8 PCIe lanes less. Please look at Wikipedia and AMD's website if you don't believe me.

 

[vinnfts]

It's not about passthrough. Ryzen only has a limited number of PCIe lanes (which are not the same as slots but maybe that a language translate thingy). A Ryzen with integrated graphics has 8 PCIe lanes less. Please look at Wikipedia and AMD's website if you don't believe me.

Oh yeah! Do I really needs a GPU or iGPU to runs promox if I only manage Promox via web console? I intend to move to 5700x, and passthrough both 1650