Best way to use drives and NFS

rtsdfc

New Member
Nov 21, 2024
1
0
1
Hi All,
Finally decided to improve my homelab setup by adding a compute server running proxmox. While I've seen this topic discussed and read many posts, still can't decide on the best drive/install setup for my hardware. As drives I've installed:
  • 2x 2TB Samsung 990 Pro NVMe (new)
  • 1x 1TB Crucial MX500 SSD (37% wearout)
I addition to the new compute server I have a NAS with NFS enabled.

The current install options I'm exploring:
  1. Install proxmox on ZFS mirrored on the 2 NVMes.
  2. Partition both NVMes, maybe 50-100GB for proxmox on both NVMes in ZFS mirrored, and the rest of the drives also ZFS mirrored for storage. The SSD can be used for proxmox backups
  3. 1 NVME ZFS for proxmox, 1 NVME for storage
  4. other better option?
Some thoughts:
  • From reading around, it seems to be recommended that proxmox should have it's own disk or partition, not shared with other storage. This because if VMs or LXEs grow, they could utilize all the free space and render proxmox unusable.
  • Proxmox itself should not need more tha 50GB so giving it a full disk seems like a waste
  • Not sure if partitioning the disks adds too much complexity, even in case of a disk failure. If i understand correctly with ZFS, if a disk fails, then the new disk has to be setup the same with same partitions and sizes
  • If partitioning is the right way, can this be done at install, or does it need to be done beforehand?
Additional context on usage:
  • I'll be running 1 VM with docker and portainer and running applications from there. With time will split them to more VMs and maybe at some point to LXEs but not near future.
  • I will mount the NFS folders I use in the VMs. This is where and docker-compose volume will save the data (e.g. /srv/nfs/data/APPLICATION_NAME).
Questions:
  1. What is the best way you use my drives, and important considerations with the choice
  2. Should/could I also mount the NFS share at the proxmox node level and use the NAS for the VM disk? Or are there performance/other downsides to this approach, and vm disk should reside on the server it self? (keeping in mind the NFS shares are also mounted and used in VM)
Thanks for any help!
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!