Need suggestion for a cheap server to host powerful GPU(s)

proxwolfe

Active Member
Jun 20, 2020
449
38
33
49
Hi,

I want to get my feet wet in machine learning / artificial intelligence and for this purpose I have bought an NVidia RTX A5000. Unfortunately, this card requires more power than my small home lab servers can deliver with their measly 450W PSUs. So at the moment it lives in my workstation.

So I am looking at buying a "new" server to host my GPU. My requirements are:

- Powerful PSU (800W+) with 8PIN power cable(s)
- Support for one, ideally two GPU(s) (PCIe4.0+)
- Low power consumption in idle
- At least Haswell-CPU (avx2), ideally Skylake-X or later (avx512)
- Minimum of 128GB Ram
- Remote management capability
- Cheap to buy second hand

Does a server like that exist? Or is this just wishful thinking...

Thank you!
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!