[SOLVED] Tips on Upgrading SSDs for my Proxmox lab

If you could update as to the performance/endurance of those D3 S4610 over time, I'd really appreciate it - as I am astounded by the price.

Maybe you want to make a general pre-use capacity/bandwidth test/s. f3, fio etc.
 
  • Like
Reactions: westrangers
That would work, but is not the best solution. Two things to consider:
Proxmox itself has a certain IO load (more when updates are running), which is very low compared to the load of VMs, but it is there (which is why I literally burn up cheap SSDs for this, they are good enough for this). If you only have VMs on one mirror, then they have the full performance for themselves. This is the weaker argument, but it explains the principle. The stronger argument is that you might want a second 512G cheap/medium. Then you can make two mirrors. The 2x512G <- on it Proxmox, 2x2T <- VMs.
This way you have it cleanly separated and if something breaks at some point during an update or operating error in Proxmox, then you don't have to restore everything at once or laboriously take it apart. You then just delete the 2x512G mirror, reinstall Proxmox and import the 2x2T again. This means you have distributed the IO load sensibly (and the endurance as well), a disk can fail in both mirrors, both are cleanly separated and if something really bad goes wrong, you only have to restore one ZFS pool from your backup (time saving).
So that would be my tip... get another 512G (always check the firmware there too), then install proxmox fresh and then set it up accordingly.
Of course, you can also use each disk individually as storage. This gives you more available storage overall, but then no redundancy. It's never enough... :)
Very good tips! Thanks so much! I think this is indeed a solid plan and i will go straight to researching on how exactly i need to accomplish all of this. :)
 
If you could update as to the performance/endurance of those D3 S4610 over time, I'd really appreciate it - as I am astounded by the price.

Maybe you want to make a general pre-use capacity/bandwidth test/s. f3, fio etc.
Aboslutely I don't mind. However I never did this before but I can try. Is this purely to understand whether SSDs are legit/not deffective in some way or you just want to understand how S4610 performs in general?

Just keep in mind, I am pretty new to Proxmox world and only have like ~10VMs, so barely even using my single 512Gb SSD. So it would take some time before they all get some proper use and get filled up
 
Last edited:
Is this purely to understand whether SSDs are legit/not deffective in some way or you just want to understand how S4610 performs in general?
It is always good practice (and especially when purchasing from an unknown second-hand source) to test-drive the medium you will be becoming to rely on in the future. It is better to discover now something isn't right with that medium, than later. Trust me! Initial testing probably won't cover eventual long-time endurance, but it will cover the basics. All professional system admins perform some form of testing before committing medium to production use. You may be running some home lab, but in light of the price you paid, I personally would not use those disks until I tested them.

I run the smartctl on unsealed one and it showed latest firmware, Power on Hours = 0 and Power Cycle Count = 4
I don't want to cause unnecessary caution, and smartctl data can be a mixed bunch (& usually unreliable) but I've never seen a disk that has 4 power cycles but no power on hours. New disks usually have some power on hours, this comes from the regular factory testing & setup. Possibly this disk was tested for under an hour (under 30 mins?) - IDK. Probably ignore this concern if the above testing I suggested goes through without a hitch.

You possibly could lookup these disks with their serial numbers to at least see if they were legitimately produced by the manufacturer/vendor & when. You wont be able to rule out the fact that they may have been "fw wiped".
 
  • Like
Reactions: Kingneutron
It is always good practice (and especially when purchasing from an unknown second-hand source) to test-drive the medium you will be becoming to rely on in the future. It is better to discover now something isn't right with that medium, than later. Trust me! Initial testing probably won't cover eventual long-time endurance, but it will cover the basics. All professional system admins perform some form of testing before committing medium to production use. You may be running some home lab, but in light of the price you paid, I personally would not use those disks until I tested them.


I don't want to cause unnecessary caution, and smartctl data can be a mixed bunch (& usually unreliable) but I've never seen a disk that has 4 power cycles but no power on hours. New disks usually have some power on hours, this comes from the regular factory testing & setup. Possibly this disk was tested for under an hour (under 30 mins?) - IDK. Probably ignore this concern if the above testing I suggested goes through without a hitch.

You possibly could lookup these disks with their serial numbers to at least see if they were legitimately produced by the manufacturer/vendor & when. You wont be able to rule out the fact that they may have been "fw wiped".
Good to know! What tools would you recommend me to run? Is there a good guide to follow to perform these initial tests?
 
What tools would you recommend me to run?
I posted above f3 & fio, probably enough for your job. Search online on how to use.
I searched apt & on my current, fully updated Proxmox node they both exist (although you may have to install):
Code:
f3/stable 8.0-2 amd64
  test real flash memory capacity

fio/stable 3.33-3 amd64
  flexible I/O tester

# See also:

fio-examples/stable 3.33-3 all
  flexible I/O tester - example job files
 
I posted above f3 & fio, probably enough for your job. Search online on how to use.
I searched apt & on my current, fully updated Proxmox node they both exist (although you may have to install):
Code:
f3/stable 8.0-2 amd64
  test real flash memory capacity

fio/stable 3.33-3 amd64
  flexible I/O tester

# See also:

fio-examples/stable 3.33-3 all
  flexible I/O tester - example job files
Thanks for sharing!

So I did some tests on the older SSD. Also checked with Solidigm and they said one SSD is rom 2018 and one from 2023, that also aligns with one having original FW version and one the latest.

Bash:
root@mylab:~# badblocks -b 4096 -c 65535 -wsv /dev/sdc > badblocks_jan7_2025.log
Checking for bad blocks in read-write mode
From block 0 to 468843605
Testing with pattern 0xaa: done
Reading and comparing: done
Testing with pattern 0x55: done
Reading and comparing: done
Testing with pattern 0xff: done
Reading and comparing: done
Testing with pattern 0x00: done
Reading and comparing: done
Pass completed, 0 bad blocks found. (0/0/0 errors)

f3write went fine, but somehow I lost output in my terminal, so only got f3read below.

Code:
f3read /ssd_pool/ | tee f3read_log.txt

  Data OK: 1.68 TB (3604108301 sectors)
Data LOST: 0.00 Byte (0 sectors)
               Corrupted: 0.00 Byte (0 sectors)
        Slightly changed: 0.00 Byte (0 sectors)
             Overwritten: 0.00 Byte (0 sectors)
Average reading speed: 358.85 MB/s
 
Last edited:
Another legit pre-check: if a drive accepts (and executes) original firmware binary by updating it then you can rule out 99% that there was some shady tinkering with it before, most vendors have signed firmware for this purpose.

After firmware updates and some initial checks (fio) on SATA-SSDs I like to do a block discard to wipe rests of fio (btw. fio write tests on the device directly is destructive for data!) to have a clean state before I start using them.

blkdiscard -f -v /dev/sd$ CAUTION THAT DESTROYS THE DATA ON IT and only takes some seconds :)

https://www.man7.org/linux/man-pages/man8/blkdiscard.8.html
 
I just checked prices and yeah...175€ even in used condition is a really good price.

First thing to do check the firmware and upgrade:
https://www.thomas-krenn.com/de/wiki/Intel_D3-S4510_SSDs_und_D3-S4610_SSDs_Firmware_Update_XCV10110
https://www.thomas-krenn.com/de/wiki/Intel_D3-S4610_Series_SSDs
I am probably overlooking something obvious but i can't figure out how to update the firmware on D3-S4610... I am following this as per your tip, so first thing I need to install Intel® Memory and Storage Tool CLI. I thought I'll run on my Ubuntu LXC since it's supported on it and I have it ready.

Running
Bash:
intelmas show -intelssd
gives "No results". I suppose I need to passthrough the SSD to the LXC? I can't seem to figure out how to do that. Or perhaps there is an easier method?

Oh an also, does it matter than I put both SSDs into zfs mirror and then update firwmare on one?
 
Last edited:
You need a direct block access for that FW upgrade; don't think that is going to work on an LXC device. You may manage to do it in a VM with proper passthrough. I would probably do it on a bare-metal only. Just use some other PC & connect that drive.
 
You need a direct block access for that FW upgrade; don't think that is going to work on an LXC device. You may manage to do it in a VM with proper passthrough. I would probably do it on a bare-metal only. Just use some other PC & connect that drive.
Ah I see now! It does seem to be a bit combersome, but I guess FW updates on SSDs is not something very commonly done.
 
I just checked prices and yeah...175€ even in used condition is a really good price.

First thing to do check the firmware and upgrade:
https://www.thomas-krenn.com/de/wiki/Intel_D3-S4510_SSDs_und_D3-S4610_SSDs_Firmware_Update_XCV10110
https://www.thomas-krenn.com/de/wiki/Intel_D3-S4610_Series_SSDs
You need a direct block access for that FW upgrade; don't think that is going to work on an LXC device. You may manage to do it in a VM with proper passthrough. I would probably do it on a bare-metal only. Just use some other PC & connect that drive.

Managed to update by booting into Windows directly, but I had to use Solidigm™ Storage Tool since IntelMAS tool reported that those SSDs are no longer supported by Intel. Thanks for the tips!
 
Last edited:
  • Like
Reactions: mr44er
Good sign that you managed to update FW - they are probably legit drives.

Maybe mark this thread as Solved. At the top of the thread, choose the Edit thread button, then from the (no prefix) dropdown choose Solved.

Happy Proxmoxing!
 
  • Like
Reactions: westrangers
I always keep some old spare PCs lying around to do this stuff, also good for cards or just installing bare windows if some firmware needs it to be written. :)
 
  • Like
Reactions: westrangers