New (re-)build suggestions

droidus

Member
Apr 5, 2020
107
2
23
34
I am running the latest version of Proxmox on my Dell R710. I have a raid hardware controller inside of it. Right now, I am using raid 1 and have 4 Black 1 TB drives. The first two are used for Proxmox OS and VMs, and the second two are used for storage/backups. I need to increase my drive space, so I would like to do at least 4 TB HDs I think with this upgrade. I am looking at the 4 TB Red Pro nas drives. And I am thinking of bumping up to Raid 5. I would use the same layout, with 3 drives for os/vms, and 3 for storage/backups. This is for home use only, and I would be the only user. I would like to "future-proof", and am considering zfs as my new fs. I would appreciate any tips and advice on my new setup.
 
what disk/raid controller do you have? some of the older dell controllers won't support drives bigger than 2TB
 
If you want to use ZFS, don't use the HW RAID controller. Either check if you can switch it to HBA/JBOD mode (not sure if the older Dells can do that) or try to get a cheap HBA controller and plug in the disk back plane there.

ZFS does want access to the disks as raw as possible and RAID controllers interfere in one way or another. Some people tend to use a lot of raid 0 for each disk as workaround. Don't do that. Handling a failed disk gets much more complicated, and you still have tha raid controller in between the disk and ZFS.

Regarding pool layout: For the system you can use a simple mirrored pool (using the installer). For the other pool where you will store your guests, go with a pool made up of mirrored disks (raid 10 like). You will get better IOPS which is what you want for multiple guests and avoid the unwelcome surprise of unexpected higher space usage due to parity data on any raidz(1,2,3) pools. The documentation has a section about this with more details.
 
If you want to use ZFS, don't use the HW RAID controller. Either check if you can switch it to HBA/JBOD mode (not sure if the older Dells can do that) or try to get a cheap HBA controller and plug in the disk back plane there.

ZFS does want access to the disks as raw as possible and RAID controllers interfere in one way or another. Some people tend to use a lot of raid 0 for each disk as workaround. Don't do that. Handling a failed disk gets much more complicated, and you still have tha raid controller in between the disk and ZFS.

Regarding pool layout: For the system you can use a simple mirrored pool (using the installer). For the other pool where you will store your guests, go with a pool made up of mirrored disks (raid 10 like). You will get better IOPS which is what you want for multiple guests and avoid the unwelcome surprise of unexpected higher space usage due to parity data on any raidz(1,2,3) pools. The documentation has a section about this with more details.
what disk/raid controller do you have? some of the older dell controllers won't support drives bigger than 2TB
Good to know, thank you. It is a PERC H700.
I will look into seeing if it supports that mode, or the alternative.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!