ZFS and special device how to use unused free space ?

Is this even possible to do ?

Hi,

I think you can do if you want. You need an extra SSD(= extra) that you will use in the migration process:

FOR each NVME1/2 DO:

- replace one of your NVME(=nvmeX) with "extra", and wait for resilver process to finish
- repartition your NVME as you like(one part for special dev, and the rest for whatever else)
- replace the "extra" with the "special dev part" of the nvmeX
- wait for resilver

END

In the end, you will have 2 partitions on each NVME, one who is "zfs special dev" and a second partition who can be used as you like!

Good luck!
 
  • Like
Reactions: takeokun
Hi, every one,

I have setup special+log+cache into rpool and was running well, now this ProxMox can not boot and hang in grub recuse mode, so I want to remove the special ,log and cache device. I know i can remove log and cache device any time, but i do not know if i can remove special device, could anybody tell me ? Thanks.
 
Hi, guletz, thanks for your reply. Is there a way to move the data from special device to other pool ?
 
Is there a way to move the data from special device to other pool ?
Hi again,

I do not know if it is possible. But, you can send your pool on another pool(local or remote) via pve-zsync or any script who can do zfs send/recive.
Then you can destroy your pool, create a new one(without special device) and then add the data back from the "another pool"(send/recive...)

Good luck / Bafta!
 
As long as it's not a raidz pool you can remove the special device.
 
Hi,

@gu1u , thanks for your advice. Yes I can backup all VMs, and then destroy zpool, and then recreate it , and then restore VMs from backup, but that is not what I want. Thanks anyway.
@H4R0 , thanks for your reply. my special device is only one device on nvme disk, but the zpool itself is mirror with two disks, will the removing action relocate the current data saved in special device automatically ? as there is 3G data size used in my special device, I do not know how to safely remove this special device without lost current data.

P.S. my special_small_blocks size is zero, so there is not small files saved into special device.
 
Last edited:
Hi, @H4R0 , thanks very much for your help.

Yes, you are right. I just run the "zpool remove rpool nvme0n1p1" and removed the special device(nvme0n1p1) from my zpool(rpool) successfull without lost any data, it take almost one minute to allocate the data from special device to other vdev devices. And one thing should be noted: I have to stop all VMs to prevent data writing.
 
  • Like
Reactions: takeokun

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!