Support External RBD And CephFS with Erasure Coded Data Pool

ronweister

New Member
Mar 23, 2018
14
1
3
27
We want to run backup of CephFS with erasure coded backed pool at k=10 m=2, but we couldn't get this to mount on our proxmox ve 5.3

Also, being able to create EC RBD pools would be great where we are running with k=2 m=1, which has faster reads at low disk cost than replica=3
 
  • Like
Reactions: janos

ronweister

New Member
Mar 23, 2018
14
1
3
27
[Fixed] the ceph fs part with ec coded pool on external ceph.


Additionally, for the rbd we shouldn't have to specify --data on every single image creation. I hope proxmox by default doesn't do it as the pool being used is the default rbd pool regardless of the following setting in my ceph.conf which is followed by openstack.

[client.admin]
rbd default data pool = rbd-ec112

This should ideally work as it does with openstack. Any reason proxmox doesn't respect this rule?
 

lifeboy

Active Member
It's been a while since this has been revisited. Is the proxmox team still adamant that Erasure Coded pools will not be supported?

It's becoming a game changer out there, so why would a 2018 decision still hold? Ceph and Erasure Coding have signficant benefits for hosting:
  1. More efficient use of disks (50% saving)
  2. Consequently less power is used (very significant for large clusters)
  3. EC is reliable
  4. OpenStack has been supporting this for quite some time
Your comments would be appreciated.
 

lifeboy

Active Member
Can one of the Proxmox Staff members give us an indication of how one can set up a bounty for this or better still, how one can contribute resources so this is being implimented please? This is something we really want, but I can't find info on how we could do this.
 

aaron

Proxmox Staff Member
Staff member
Jun 3, 2019
2,824
429
88
Can one of the Proxmox Staff members give us an indication of how one can set up a bounty for this or better still, how one can contribute resources so this is being implimented please?
We usually don't do bounties. If you want to financially support us, consider getting subscriptions :)

Since our software is open source, you are free to contribute and implement features yourself, should you feel up for that :) https://pve.proxmox.com/wiki/Developer_Documentation


Besides that, I recently started to look into how we can support EC pools directly. https://lists.proxmox.com/pipermail/pve-devel/2022-January/051485.html
There are likely a few more iterations until it will be part of one of the next PVE versions.
 
  • Like
Reactions: DerDanilo

lifeboy

Active Member
We usually don't do bounties. If you want to financially support us, consider getting subscriptions :)

Since our software is open source, you are free to contribute and implement features yourself, should you feel up for that :) https://pve.proxmox.com/wiki/Developer_Documentation
Thanks for that, we'll definitely look into it.

Besides that, I recently started to look into how we can support EC pools directly. https://lists.proxmox.com/pipermail/pve-devel/2022-January/051485.html
There are likely a few more iterations until it will be part of one of the next PVE versions.
That is really good news!
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!