Hardware RAID controller with ZFS again

UK SPEED

Member
Dec 23, 2023
31
0
6
Hello
I have MCloud server and all of the 8 nodes with Hardware controllers, yesterday, I tried to install RAID 0 with ZFS in the top of RAID1 with 4TB micron 4300 ,
the performance was crazy and this was the first time to got this result.

root@s2219:~# dd if=/dev/zero of=tempfile bs=1M count=1024; sync
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.302078 s, 3.6 GB/s
root@s2219:~# dd if=/dev/zero of=tempfile bs=1M count=1024; sync
^[[A1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.300188 s, 3.6 GB/s
root@s2219:~# dd if=/dev/zero of=tempfile bs=1M count=1024; sync
^[[A
^[[A1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.307092 s, 3.5 GB/s
root@s2219:~# dd if=/dev/zero of=tempfile bs=1M count=1024; sync
^[[A
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.30569 s, 3.5 GB/s
root@s2219:~# dd if=/dev/zero of=tempfile bs=1M count=1024; sync

Do you think this is the wrong installation?
And what other option I can go with it to get good and stable result
 
You are testing your RAM performance, your test does nothing storage-related: you are writing a lot of zeros, which are compressed to... a very few zeros befor they go to storage, some seconds in the future.

For storage benchmarking search for fio.

And no, ZFS on any kind of hardware raid is not recommended. It is a call for trouble. The sad thing is that it will work when you set it up. But any rising problem might be much more difficult than necessary. Additionally you lose capabilities like "automatic repair" from ZFS... I am sure this has beed discussed a trillion times ;-)

So my personal recommendations is simply: do not do that. Never!
 
Thank you for your advise, what is the best way to user the Hardware controller with my scenario? ext4

I have 2 530 Micron SSDs and a hardware controller, do I need to remove it?
 
LVM-Thin on top of HW raid would allow thin-provisioning, snapshots and all that without any filesystem adding overhead.
 
so in the first page of the installation of the Proxmox, what can I choose? EXT4 ?
 

Attachments

  • select-proxmox-target-hard-disk.png
    select-proxmox-target-hard-disk.png
    57 KB · Views: 9
Ext4 should create a LVM with an ext4 formated LV as root filesystem and additional LVM-Thin thinpool for storing virtual disks. You have to decide while installing how much space you want for files and virtual disks.
 
I have another question

1- a scenario with no raid controller but with a software controller with a DELL server
two drives of Nvmes Dell 4TB + software controller (EMC PERC S 150 ) what is the best way to install a safe environment for Proxmox?



2- a scenario with no raid controller with the Asus server
two drives of Crucial T705 4TB SSD PCIe Gen5 NVMe M.2 and one of 9400 Micron MAX 12 TB
this is under the RS720A-E12-RS12 (90SF02E1-M004K0)
Thank you for your support
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!