Shared Remote ZFS Storage

J

jtremblay

Member
Dec 14, 2022
16
3
8
I would like to make a product request: would Proxmox be able to modify the PBS Code to deliver a ZFS over ISCSI pool? call it simply Proxmox Storage server. it doesn't have to be "HA" as it could use the "ZFS Replication" from the Truenas scale code. maybe even a merge of the truenas scale code and this https://marcelliot.net/zfs-over-iscsi-for-proxmox-and-freenas/

It doesn't have to be a feature rich , no need to share SMB or CIFS or even NFS to end users... just a rock solid implementation of zfs over iscsi
 
  • Like
Reactions: floh8
Is this really something you, or anyone else, see yourself paying a subscription fee for, like PBS or PVE?
You are aware, aren’t you, that the salaries of the Proxmox team are funded by the subscription side of their business?

PBS is a critical product for anyone running a serious business on PVE. It's so essential, in fact, that even Veeam decided to jump into the PVE backup game.

And now, you'd like the Proxmox team to cobble together some code from TrueNAS and a random third-party blog to churn out a non-HA iSCSI server of questionable utility?

Given that developer time isn’t infinite, which product or feature would you suggest putting on ice to focus on this homelab-oriented venture?
 
  • Like
Reactions: Johannes S
pveuser113 said:
Is this really something you, or anyone else, see yourself paying a subscription fee for, like PBS or PVE?
You are aware, aren’t you, that the salaries of the Proxmox team are funded by the subscription side of their business?

PBS is a critical product for anyone running a serious business on PVE. It's so essential, in fact, that even Veeam decided to jump into the PVE backup game.

And now, you'd like the Proxmox team to cobble together some code from TrueNAS and a random third-party blog to churn out a non-HA iSCSI server of questionable utility?

Given that developer time isn’t infinite, which product or feature would you suggest putting on ice to focus on this homelab-oriented venture?
Click to expand...
Yes. I and the company I work for would subscribe. we were looking into subscribing to Truenas Scale but they stopped supporting GlusterFS and won't support the ZFS over iSCSI plugin. i'm betting that there are a number of customers that would too. And Ceph isn't reliable with less than 4 hosts. p.s. this isn't some homelab venture. it would fit in nicely with the SMB market.. I.e. 3 compute nodes. 1 BPS node and one PSS (ProxMox Storage Server) node....This configuration would enable HA on the compute nodes. reliable backup and if we add a second PSS box . redundant storage
 
Last edited:
  • Like
Reactions: floh8
jtremblay said:
I would like to make a product request: would Proxmox be able to modify the PBS Code to deliver a ZFS over ISCSI pool?
Click to expand...
Not really within the product scope for PBS; I do understand what you're asking for however- the Proxmox guys might be interested in making a iscsi store for pve.

Having said that- there is already a supported, modern, cluster storage available to pve- https://pve.proxmox.com/wiki/Deploy_Hyper-Converged_Ceph_Cluster

I dont see much purpose for an inherently inferior solution based on single-host iscsi-over-zfs filer.
 
  • Like
Reactions: Johannes S
alexskysilk said:
Not really within the product scope for PBS; I do understand what you're asking for however- the Proxmox guys might be interested in making a iscsi store for pve.

Having said that- there is already a supported, modern, cluster storage available to pve- https://pve.proxmox.com/wiki/Deploy_Hyper-Converged_Ceph_Cluster

I dont see much purpose for an inherently inferior solution based on single-host iscsi-over-zfs filer.
Click to expand...
Again, ceph requires more hardware and resources to be stable and convenient...
Something as easy to stand up as PBS with a possible clustering in it's future... Well .... Much appreciated
 
Hi,

The thing you’re seeking already exist, StarWind made virtual storage appliances that can be clustered and HA.

Best regards,
janus57
 
  • Like
Reactions: Johannes S
janus57 said:
Hi,

The thing you’re seeking already exist, StarWind made virtual storage appliances that can be clustered and HA.

Best regards,
janus57
Click to expand...
As far as I can see, it's primarily hosted on Windows and has a community limit of 10 tb, and isn't easy to get.
 
  • Like
Reactions: Johannes S
LnxBil said:
I'm using ZFS-over-iSCSI (on physical and virtual hardware) for many years now and it works as it should without patching PVE just by using Debian or PVE as the basis and it's dead simple to setup. I used this tutorial by a fellow forum member (german).
Click to expand...
Sounds great, I'm trying to use TrueNAS scale ATM. It would be awesome to have a native product....i.e. VMWare vSAN p.s. is this instead of the "zfs over iscsi" in the ui?
 
Last edited:
jtremblay said:
I'm trying to use TrueNAS scale ATM. It would be awesome to have a native product
Click to expand...
AFAIK, there is no native integration into PVE, so what's the point in using a "native product" on one side, and monkey-patch something else on the other side? Stock PVE on both side and installed iscsi daemon is IMHO the better solution.

jtremblay said:
....i.e. VMWare vSAN p.s.
Click to expand...
If you want a much better solution than vSAN, just go with CEPH as it was already pointed out. It's superior in any way if you don't use VMware.

jtremblay said:
is this instead of the "zfs over iscsi" in the ui?
Click to expand...
No, not instead, it is ZFS-over-iSCSI. No fuzz, it just works.
 
  • Like
Reactions: Johannes S
LnxBil said:
Stock PVE on both side and installed iscsi daemon is IMHO the better solution.
Click to expand...
This is EXACTLY what i'm asking to avoid, some sort of "solution" that relies on questionable installation instructions to turn a random OS, or even PVE, install into a ZFS iSCSI target . what's needed is one that is 1000% assured to be compatible and integrated with PVE... PBS Style. i.e. a professional solution.
The goal of any product is to be as usable as possible at the "average" (or lower) skill level, there are still hundreds of Accountants still in charge of SMB IT systems.
 
jt_telrite said:
i.e. a professional solution.
Click to expand...
There is not market for that without HA. If there would be, at least one vendor would support it or a product would exist. There is only one vendor that I know of that has official PVE support and that is BlockBridge. Everything else works, yet no official support.

jt_telrite said:
This is EXACTLY what i'm asking to avoid, some sort of "solution" that relies on questionable installation instructions
Click to expand...
That sounds really, really strange to me. You would be more satisfied if the same instructions would be in a official documentation or on the PVE wiki?
 
Last edited:
  • Like
Reactions: Johannes S
alexskysilk said:
By whom?


Truenas Scale uses LIO. PVE has a plugin.
Click to expand...
yes, and I'm using it.... my fear is that the plugin gets out of sync with the PVE code it "patches" .
jtremblay said:
I would like to make a product request: would Proxmox be able to modify the PBS Code to deliver a ZFS over ISCSI pool? call it simply Proxmox Storage server. it doesn't have to be "HA" as it could use the "ZFS Replication" from the Truenas scale code. maybe even a merge of the truenas scale code and this https://marcelliot.net/zfs-over-iscsi-for-proxmox-and-freenas/

It doesn't have to be a feature rich , no need to share SMB or CIFS or even NFS to end users... just a rock solid implementation of zfs over iscsi
Click to expand...
As of November , Truenas seems to be unresponsive to community requests to add support for the "ZFS Over iSCSI" version in proxmox
https://forums.truenas.com/t/add-li...roxmox-zfs-over-iscsi-can-work-natively/25374
 
jt_telrite said:
yes, and I'm using it.... my fear is that the plugin gets out of sync with the PVE code it "patches" .
Click to expand...
The bigger risk is if Truenas changes the iscsi target.

jt_telrite said:
As of November , Truenas seems to be unresponsive to community requests to add support for the "ZFS Over iSCSI" version in proxmox
Click to expand...
that doesnt engender confidence....
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom