SN850X + rsync

[olk]

Hello,
I read that server grade SSDs are recommended - but those drives are expensive.

I plan to install the PVE system (used for development) on a 1TB WD SN850X and the data/images on a 4TB WD SN850X.
The configuration and the images/snapshots are saved each day on a separate NAS (using a RAID) via rsync.

The WD SN850X is a consumer grade SSD with 2GB DRAM and 2400 TBW. Do you know some configuration options that extend the lifetime of the SSD?

ty
Oliver

 

[Johannes S]

You could buy used enterprise SSD drives. They will still last longer than a usual consumer drive which puts the cost in a different light. For example on servershop24.de you can find enterprise ssd starting at around 240 GB which is more than enough for the boot partition.
You can also use stuff like folder2ram or log2ram to put the directories /var/log, /var/lib/pve-cluster and /var/lib/rrdcached on a ram disk but be aware that you might run into trouble in case of a loss of power.

ZFS also has a higher toll on disks but also features like bitrot-protection, compression, support for storage replication etc. So you might want to use another filesystem for the boot drive ( like XFS or ext4)

This being said and to put things in perspective: In an older german thread Mira of proxmox team pointed out that although enterprise disks are recommended for productive servers the developers also have consumer ssds on some of their developer workstations: https://forum.proxmox.com/threads/r...figuration-für-proxmox-cache-swap-usw.100014/
Mira also pointed out , that for os drives an HDD would also be ok although not recommended but not for the VMs (since VMs won't have good performance on a HDD).


However if you use consumer SSDs or NVMEs you need to plan to replace the boot drive more often, so again the question is whether a used enterprise ssd is actually that much more expensive.

Regards, Johannes

 

[olk]

However if you use consumer SSDs or NVMEs you need to plan to replace the boot drive more often, so again the question is whether a used enterprise ssd is actually that much more expensive.

When should I consider replacing my drive, and what factors support this recommendation?
I ask because I’ve been using a Samsung 960 NVMe as my system drive (with F2FS) on my development machine since 2017, and I haven’t encountered any issues so far.

 

[Johannes S]

You can monitor the SMART status and wearout of your disks in PVE. Basically if SMART gives errors or wearout nears 100% it indicates that the disk reached a state where it might fail at any moment according to the manufacturer. With other words: At that point you should replace the SSD or expect a failure and be prepared for it.
So like always it's a good idea to have backups and test restore.

 

[Johannes S]

You can also use stuff like folder2ram or log2ram to put the directories /var/log, /var/lib/pve-cluster and /var/lib/rrdcached on a ram disk but be aware that you might run into trouble in case of a loss of power.

After doing some research (aka google ) I think it's not a good idea to put anything but /var/log on a RAM disk since the other directories are used to save the current state of the PVE host and cluster. So in case of powerloss one might end up with a broken setup which would need a potential time and nerve costing restore from backup or even reinstall.
/var/log should be safe though since although log files might be important for troubleshooting they are not needed for the system to work.

I'm not quite sure about rrdcached: As far I know it's only used for the CPU/RAM usage diagrams in the GUI so it's basically like /var/log. On the other hand the whole point of rrdcached is to cache this data in RAM first before writing it to the disk (see https://oss.oetiker.ch/rrdtool/doc/rrdcached.en.html and https://oss.oetiker.ch/rrdtool/doc/rrdtool.en.html ) so putting it's results on a ram disk seems a little redundant. I found an older thread which discuss how to reconfigure rrdcached to reduce it's write (with the risc of loosing data in case of powerloss): https://forum.proxmox.com/threads/reducing-rrdcached-writes.64473/