Recent content by aaron

  1. aaron

    Ceph storage fully although storage is still available

    Ah okay. I hope only on different minor versions, though you should keep the cluster in sync when installing updates. The min-compat-client setting is still on "jewel" and the balancer needs "luminous" to work. Run ceph osd set-require-min-compat-client luminous to set the requirements for...
  2. aaron

    Ceph storage fully although storage is still available

    Okay, so unless data has been moved away from the Ceph cluster, things did improve a little bit. osd 6 is now "only" 80% full. Still not great though. Has this cluster been running for a while and gone through a few updates since then? I don't like the output of the balancer status. Can you...
  3. aaron

    Ceph storage fully although storage is still available

    Hmm, is the recovery done? Could you post ceph -s, ceph osd df tree and ceph balancer status again? Having the disks spread out that unevenly among the cluster nodes might be an issue that could prevent Ceph from balancing the data more evenly. But honestly, there are enough nodes in the...
  4. aaron

    Partitioning help: separate root and data volumes?

    Why disable the lvm-thin storage and try to mount the pve-data volume? Which doesn't contain a file system unless you formatted it. The installer provides these defaults to have a thin provisioned LVM to store container and VM disk images directly in LVs. If you do prefer your very custom disk...
  5. aaron

    Move Proxmox to another disk on the same machine?

    If I understand it correctly, you want to reinstall a node and join it again to the cluster? Well, first you should disable the qdevice: pvecm qdevice remove. Then remove the node from the cluster. Then, reinstall the node and join it to the cluster. Install the qdevice package on the new node...
  6. aaron

    Ceph storage fully although storage is still available

    Okay, that would have been useful information :) As long as you have a single OSD that is much fuller than the others, it will be the limiting factor for how much space is estimated as free. That is why an increase in the PG_num should result in a better distribution and therefore that one...
  7. aaron

    Ceph storage fully although storage is still available

    From what I can see, osd.6 is the one which is fullest at the moment (~85%), but not as full as yesterday (~87%). I assume that Ceph is currently rebalancing quite some data. How is the situation in the meantime. Do you see a bit more space, or is it still decreasing? The whole increasing of...
  8. aaron

    Ceph storage fully although storage is still available

    Can you post the current output of ceph osd df tree? Please also provide the output of pveceph pool ls --noborder. Please make sure that the window is wide enough, as the command will just cut off anything that doesn't fit. Please also post the output of pveversion -v, or if you click on a node...
  9. aaron

    Ceph storage fully although storage is still available

    Hmm okay. So if you edit the pool and enable the "Advanced" checkbox next to the OK buttons, do you have a target_ratio set? If not, please do so, a "1" should be plenty fine. The .mgr pool can be ignored as it will not take ip any significant amount of space. If the pool does not have any...
  10. aaron

    Ceph storage fully although storage is still available

    Well, some of the SSD OSDs are quite full, therefore the pool using SSDs (I assume you have device class specific rules), sees almost no free space as the fullest OSD is the limit. One thing I noticed is that the OSDs could have more PGs. That might also make it easier for the balancer to...
  11. aaron

    Ceph storage fully although storage is still available

    Can you post the output of ceph osd df tree? Best inside tags. As well as ceph balancer status?
  12. aaron

    GDPR : Deletion of user data

    What about encrypted backups? Then, even if someone can restore the chunks, they are useless unless they have access to the key. Depending on where the backups are stored, "overwriting" is also not working as expected. For example, ZFS or any other Copy-on-Write file system will not write to...
  13. aaron

    GDPR : Deletion of user data

    Then I would try to separate these / each customer in such a way, that you can easily remove all the associated backups to that customer without affecting other backups. And yes, after you remove the backups, the chunks belonging to that backup will be removed a day later.
  14. aaron

    GDPR : Deletion of user data

    Also, AFAIR the GDPR is usually interpreted that it is unreasonable to remove the data from backups, as there are also quite a lot of other reasons why a complete removal of user data is against other, higher valued interests. A quick search brought up this page. But, as @fabian said, better...
  15. aaron

    Ceph reinstallieren

    Auf die letzte Version upgraden klingt gut. Das Wissen um die Feinheiten von alten Versionen nimmt halt doch mit zunehmendem Alter ab. Wenn du die Node laut Anleitung aus dem Cluster nimmst, solltest du Sie auch wieder mit gleichem Namen und IP in den Cluster aufnehmen können. Evtl. wirst du...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!