Ditching Unraid in favor of Proxmox for ZFS storage shares?

Gymnae

New Member
Apr 26, 2024
2
1
3
Hi there,
I'm currently running Unraid in a VM on Proxmox and passing through the SATA controllers, as well as one NVME drive on my Motherboard.

I started using Unraid as an easy method to use disks of different sizes and have a cache in front. But over time, came to realize that the vanilla implementation of Unraid's mover isn't working the way I want it to - it doesn't provide a fast read and write cache. And it's a VM, adding a potential point of failure.

Within Unraid, I created two ZFS storage Pools:
  1. Primary pool: One single NVME drive as a kind of read and write cache, since it's running as a primary pool
  2. Secondary pool: Two spinning disks and an SSD L2ARC cache
A custom shell script moves data between primary and secondary based on age and modification time, ensuring files below a certain threshold are always available on primary but also backed up to secondary. Files above a certain size threshold and modification time are moved to secondary. This is an attempt to create my own read and write cache. ZFS special devices weren't available in Unraid at the time, and I am still unsure whether they would help me.

I access data stored in user shares in these pools via mounted NFS shares on the Proxmox host. From there, I bind-mount these shares to LXCs and VMs.

Now, I want to reduce complexity and, hopefully, increase speed by
  1. Removing the network layer of NFS
  2. Not relying on Unraid as a VM for delivering data, because if the VM is not running, LXCs and VMs requiring the bind mounts fail to start
  3. Getting rid of complex UID mapping and access right management between Unraid, NFS, and guests. Sledgehammer methods like all_squash help, but require manual intervention when mapping changes occur
  4. Getting rid of script-based moving between pools
I wonder if I could move the ZFS pools to Proxmox and replicate the convenience of user shares on either the Proxmox host or with the help of a lightweight LXC container.
I am open to changing my ZFS "infrastructure".

As I understand, backups would be atomic and faster with this when using the Proxmox backup server.
I am also unsure about the overhead NFS actually creates. I increased the MTU for the NFS exclusive internal virtual network between Proxmox and Unraid to 9000.

Could I achieve these goals with Proxmox without Unraid? Or is the NFS overhead not that meaningful?