Search results

  1. F

    [SOLVED] 3-node Ceph: missing 11TB space, no failover anymore

    The nice circular graphics that usually is nice and green and represents the current state of the OSDs, became completely ugly red and after a while the VMs were unresponsive and the ceph-fs went offline in the gui. In words: All pgs are active+undersized+degraded I would have expected to be...
  2. F

    [SOLVED] 3-node Ceph: missing 11TB space, no failover anymore

    No, not at all. Planned Hardware-maintenance. Yes, sure. Every host runs one mon, mgr and mds. That is part of my question to re-assure myself, that I have understood how it should work. It seams, basically I have understood how it should work, thank you for that summary. That was very...
  3. F

    [SOLVED] 3-node Ceph: missing 11TB space, no failover anymore

    Thank your for pointing that out, how ever, that is not my question... my question is, where those 11TB are, that differ between pool-size usage and real size, as specially concerning my cephfs "ceph-iso" And therefore I might have found a reason, how ever I am not sure: I use the ceph-fs mainly...
  4. F

    [SOLVED] 3-node Ceph: missing 11TB space, no failover anymore

    ceph osd df tree ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS TYPE NAME -1 43.66425 - 44 TiB 27 TiB 27 TiB 9.5 GiB 62 GiB 17 TiB 61.92 1.00 - root default -3...
  5. F

    [SOLVED] 3-node Ceph: missing 11TB space, no failover anymore

    Hi Everyone, I run a 3-node proxmox+ceph cluster in my home-lab serving as rdb storage for virtual machines for 2 years now. When I installed it, I did some testing to ensure, that when one node would fail, the remaining 2 nodes would keep the system up while the 3rd node is being replaced...
  6. F

    PXE in UEFI/OVMF mode "client does not accept options"

    Hi again, this issues still persists. I'd be very happy, if someone could shed some light on that issue. Thanks, regards and nice week-end! Felix
  7. F

    PXE in UEFI/OVMF mode "client does not accept options"

    Hi everyone, Unfortunately I did not find any satisfying answers to this topics in any other post, so I'm starting a new one: In short: If I boot a VM in OVMF using vmxnet3 (I also tried e1000) aiming to boot via pxe to my tftp server, where it is served ipxe.efi (a build working fine on dozens...
  8. F

    Module 'volumes' has failed dependency: /lib/python3/dist-packages/cephfs.cpython-37m-x86_64-linux-gnu.so: undefined symbol: ceph_abort_conn

    dpkg -S libceph-common librados2: /usr/lib/ceph/libceph-common.so.2 No, I use the same sources on the entire cluster, I have 3 clusters using that configuration, and one node, that's behaving like this! I have manually created some symlinks to match those on the working node, so currently the...
  9. F

    Module 'volumes' has failed dependency: /lib/python3/dist-packages/cephfs.cpython-37m-x86_64-linux-gnu.so: undefined symbol: ceph_abort_conn

    LANG=CC dpkg -S /usr/lib/x86_64-linux-gnu/ceph/libceph-common.so.0 dpkg-query: no path found matching pattern /usr/lib/x86_64-linux-gnu/ceph/libceph-common.so.0
  10. F

    Module 'volumes' has failed dependency: /lib/python3/dist-packages/cephfs.cpython-37m-x86_64-linux-gnu.so: undefined symbol: ceph_abort_conn

    Good node: dpkg -l librados2 Gewünscht=Unbekannt/Installieren/R=Entfernen/P=Vollständig Löschen/Halten | Status=Nicht/Installiert/Config/U=Entpackt/halb konFiguriert/ Halb installiert/Trigger erWartet/Trigger anhängig |/ Fehler?=(kein)/R=Neuinstallation notwendig (Status, Fehler...
  11. F

    Module 'volumes' has failed dependency: /lib/python3/dist-packages/cephfs.cpython-37m-x86_64-linux-gnu.so: undefined symbol: ceph_abort_conn

    Good Morning! I think, I could nail down the problem, but I don't know, how to solve it: On the good node: ldd /lib/python3/dist-packages/cephfs.cpython-37m-x86_64-linux-gnu.so| grep libceph-common libceph-common.so.2 => /usr/lib/ceph/libceph-common.so.2 (0x00007fe0502ef000) On the bad...
  12. F

    Module 'volumes' has failed dependency: /lib/python3/dist-packages/cephfs.cpython-37m-x86_64-linux-gnu.so: undefined symbol: ceph_abort_conn

    Found something else: This is from the broken host: ldd /lib/python3/dist-packages/cephfs.cpython-37m-x86_64-linux-gnu.so linux-vdso.so.1 (0x00007ffcba889000) libcephfs.so.2 => /lib/x86_64-linux-gnu/libcephfs.so.2 (0x00007f5c06ec7000) libcrypt.so.1 =>...
  13. F

    Module 'volumes' has failed dependency: /lib/python3/dist-packages/cephfs.cpython-37m-x86_64-linux-gnu.so: undefined symbol: ceph_abort_conn

    This is not a stupid question at all, but I did via the gui. Your question, how ever inspired me, to restart the daemons on each host via the systemctl restart ceph-mgr@hostname.service Out of an old sysadmin habit, I always check systemctl status daemon-name afterwards, which I did this time...
  14. F

    Module 'volumes' has failed dependency: /lib/python3/dist-packages/cephfs.cpython-37m-x86_64-linux-gnu.so: undefined symbol: ceph_abort_conn

    ceph versions { "mon": { "ceph version 15.2.14 (e3964f3ac2e00e5baacdec60b36e45d1c2e8571b) octopus (stable)": 3 }, "mgr": { "ceph version 15.2.14 (e3964f3ac2e00e5baacdec60b36e45d1c2e8571b) octopus (stable)": 2 }, "osd": { "ceph version 15.2.14...
  15. F

    Module 'volumes' has failed dependency: /lib/python3/dist-packages/cephfs.cpython-37m-x86_64-linux-gnu.so: undefined symbol: ceph_abort_conn

    Here's a list of all ceph and python related packages: dpkg --list | grep -i python ii libpython-stdlib:amd64 2.7.16-1 amd64 interactive high-level object-oriented language (Python2) ii libpython2-stdlib:amd64 2.7.16-1...
  16. F

    Module 'volumes' has failed dependency: /lib/python3/dist-packages/cephfs.cpython-37m-x86_64-linux-gnu.so: undefined symbol: ceph_abort_conn

    ldd /lib/python3/dist-packages/cephfs.cpython-37m-x86_64-linux-gnu.so linux-vdso.so.1 (0x00007ffd6fd2b000) libcephfs.so.2 => /lib/libcephfs.so.2 (0x00007f0878016000) libcrypt.so.1 => /lib/x86_64-linux-gnu/libcrypt.so.1 (0x00007f0877fdc000) libpthread.so.0 =>...
  17. F

    Module 'volumes' has failed dependency: /lib/python3/dist-packages/cephfs.cpython-37m-x86_64-linux-gnu.so: undefined symbol: ceph_abort_conn

    Good Morning! There is no python-cephfs package in http://download.proxmox.com/debian/ceph-octopus/dists/buster/main/binary-amd64/ only python3-cephfs, which is already installed. So I removed the obviously wrong package python-cephfs and reinstalled python3-cephfs. How ever, the problem is...
  18. F

    Module 'volumes' has failed dependency: /lib/python3/dist-packages/cephfs.cpython-37m-x86_64-linux-gnu.so: undefined symbol: ceph_abort_conn

    dpkg --list | grep ceph ii ceph 15.2.14-pve1~bpo10 amd64 distributed storage and file system ii ceph-base 15.2.14-pve1~bpo10 amd64 common ceph daemon libraries and management tools ii ceph-common...