[SOLVED] help zfs on proxmox

[habnai]

I am building new home server my hardware is
E3-1245v3
32 GB ram
4 hdd wd red 3TB
2 ssd 240gb
Corsair rm750x 750w
I want setup proxmox with zfs
I don't know how use the hdd
I want use one ssd for system and 2 hdd as one pool and other 2hdd as backup.
It's good option or there's other option to get this, who have some experience or same setup?
I have two LSI raid controller card the same model it's better to use hw raid or zfs
Thank you and sorry for my english

 

[apoc]

I'd use ZFS. But you need to understand it is coming at a cost (memory wise)
32GB ram isn't that much so 2-4gb for ZFS may already crush the plans you have.
On the other hand ZFS and its checksumming provides good protection against bit errors and ensures you are not relying on invald data.

In your case I'd go with 3 individual ZFS pools.
SSDs: mirrored as boot and VM disks (boot)
2hdds as mirror for your data and 2 others as the backup you mentioned.
Since backup within the same system is always dangerous I however would recommend you get yourself another small system as backup server. This way you could throw all 4 HDDs in one pool and if your requirements allow (performance wise) also for for a Raid-Z to bump up usable disk space.

 

[habnai]

So y

I'd use ZFS. But you need to understand it is coming at a cost (memory wise)
32GB ram isn't that much so 2-4gb for ZFS may already crush the plans you have.
On the other hand ZFS and its checksumming provides good protection against bit errors and ensures you are not relying on invald data.

In your case I'd go with 3 individual ZFS pools.
SSDs: mirrored as boot and VM disks (boot)
2hdds as mirror for your data and 2 others as the backup you mentioned.
Since backup within the same system is always dangerous I however would recommend you get yourself another small system as backup server. This way you could throw all 4 HDDs in one pool and if your requirements allow (performance wise) also for for a Raid-Z to bump up usable disk space.

Thank you for clearing about ram I don't know it,so you think if use hw raid is bad idea because I want stable important then speed?

 

[habnai]

Wich will be best setup for 2ssd 240gb and 4 hdd 3tb is ssd mirror OS zfsraid 1 and 4 hdd raid 10 or one ssd OS is and other ssd cache?

 

[Dunuin]

The problem with hardware raid is, that you will never know if your files got damaged. You might find damaged files months later because something is crashing or you want to access a file and it can't be open. Or you never realize that some of your data got corrupted.
ZFS will create checksums and regularily check if a file still matches the checkum. If the checksum is different, the file got damaged and if you also got a mirrored configuration ZFS will automatically repair that damaged file.
Backups are good, but if you don't know if all your files are healthy, you will backup damaged files and think they are fine. So these backups wont protect you from corrupted files.

Most of the time you don't need SSD cache. And if you really need SSD caching then 1 SSD isn't enough and you need atleast 2 of them, because if one of the cache SSDs fails, everything is lost.

I would do that like tburger said and use the SSDs zfs mirrored as system + VM storage.
If you already got a NAS or something like that for backups use raid10. If you can't store external backups then create two zfs pools as mirror and replicate snapshots from the main pool to the backup pool.

 

[apoc]

Thank you for clearing about ram I don't know it,so you think if use hw raid is bad idea because I want stable important then speed?

I dont think you get much performance Out of 4 SATA drives anyways. So don't worry to much about the differences there.

It all depends on the decision you make.
You can add cache to your ZFS pools bit that is only read.
You can add a special device bit that should be redundant.
My advice: do it as simple as possible:
Pool1: Zfs mirror for ssd.
Pool2: ZFS (Pool if you can spare capacity also mirror) out of 2*2 HDDs

 

[habnai]

Thank you for all reply and for help I will go with zfs for better.

 

[Dunuin]

Just make sure your raid cards aren't working in raid mode. Or better connect the drives directly to your mainboards SATA ports. Free PCIe slots are great because later you can do nice stuff like GPU or NIC passthrough.