8 x 870 Evo 4Tb SSD + 9500-8i HBA = Best FS & Disk Layout for IOPs

[the-last-englishman]

Hi All,

I got 8 x 870 Evo 4Tb Sata SSD's and would like to know whats the best disk layout and filesystem to use for maximizing IOPs for VM & LXC's ?

All SSD's are connected to a Broadcom 9500-8i Gen4 HBA @x16 link speed.

Not really interested in redundancy as all VM's are backed up nightly to to PBS server.

This is home lab environment and CPU is a AMD 7950x.

Would love to hear your thoughts

 

[_gabriel]

not zfs as will write many more TB than other fs, so Evo quickly ssd wear out.
Lvmthin datastore over a hw Raid10 ( with its cache bbu will be faster) live longer.
2 others disk (128gb) in raid1 for PVE os itself.

 

[Dunuin]

And without a BBU+cache or PLP or SLOG don't expect good IOPS performance when doing any sync writes like DBs do. IOPS performance will then drop to nearly HDD level while massively wearing the SSDs.

 

[the-last-englishman]

I was thinking something like mdadm raid 0 with the 8 ssd's and XFS file system on top of that.

 

[UdoB]

I was thinking something like mdadm raid 0 with the 8 ssd's and XFS file system on top of that.

Wow! So brave you are!

Prepare well and test your desaster recovery procedure.

Good luck

 

[the-last-englishman]

Wow! So brave you are!

Prepare well and test your desaster recovery procedure.

Good luck

Its pure lab with nothing to lose, I just wanna see how fast this HBA and SSD's can go

 

[UdoB]

Its pure lab with nothing to lose, I just wanna see how fast this HBA and SSD's can go

Okay, nice!

You're very welcome to post the results here.

To test the performance you may find some "fio"-command here in the forum; if you use the same commands it makes comparison easier.

 

[_gabriel]

Not better than one pcie ssd.