Support External RBD And CephFS with Erasure Coded Data Pool

[ronweister]

We want to run backup of CephFS with erasure coded backed pool at k=10 m=2, but we couldn't get this to mount on our proxmox ve 5.3

Also, being able to create EC RBD pools would be great where we are running with k=2 m=1, which has faster reads at low disk cost than replica=3

 

[janos]

https://bugzilla.proxmox.com/show_bug.cgi?id=1816

 

[ronweister]

[Fixed] the ceph fs part with ec coded pool on external ceph.


Additionally, for the rbd we shouldn't have to specify --data on every single image creation. I hope proxmox by default doesn't do it as the pool being used is the default rbd pool regardless of the following setting in my ceph.conf which is followed by openstack.

[client.admin]
rbd default data pool = rbd-ec112

This should ideally work as it does with openstack. Any reason proxmox doesn't respect this rule?

 

[lifeboy]

It's been a while since this has been revisited. Is the proxmox team still adamant that Erasure Coded pools will not be supported?

It's becoming a game changer out there, so why would a 2018 decision still hold? Ceph and Erasure Coding have signficant benefits for hosting:

1. More efficient use of disks (50% saving)
2. Consequently less power is used (very significant for large clusters)
3. EC is reliable
4. OpenStack has been supporting this for quite some time

Your comments would be appreciated.

 

[ppyy]

request for support Erasure Coded pools

 

[DemiNe0]

Also requesting support for EC pools.

 

[lifeboy]

Can one of the Proxmox Staff members give us an indication of how one can set up a bounty for this or better still, how one can contribute resources so this is being implimented please? This is something we really want, but I can't find info on how we could do this.

 

[aaron]

Can one of the Proxmox Staff members give us an indication of how one can set up a bounty for this or better still, how one can contribute resources so this is being implimented please?

We usually don't do bounties. If you want to financially support us, consider getting subscriptions

Since our software is open source, you are free to contribute and implement features yourself, should you feel up for that https://pve.proxmox.com/wiki/Developer_Documentation


Besides that, I recently started to look into how we can support EC pools directly. https://lists.proxmox.com/pipermail/pve-devel/2022-January/051485.html
There are likely a few more iterations until it will be part of one of the next PVE versions.

 

[lifeboy]

We usually don't do bounties. If you want to financially support us, consider getting subscriptions

Since our software is open source, you are free to contribute and implement features yourself, should you feel up for that https://pve.proxmox.com/wiki/Developer_Documentation

Thanks for that, we'll definitely look into it.

Besides that, I recently started to look into how we can support EC pools directly. https://lists.proxmox.com/pipermail/pve-devel/2022-January/051485.html
There are likely a few more iterations until it will be part of one of the next PVE versions.

That is really good news!