Recent content by joshbgosh10592

  1. Ceph config broken

    Or is the ceph config in that directory? I've only found: http://docs.ceph.com/docs/master/rados/deployment/ceph-deploy-purge/ online.
  2. Ceph config broken

    What directories/files do I need to remove to remove the ceph config?
  3. Ceph config broken

    Thank you! So, I ran apt remove ceph ceph-base ceph-mon ceph-osd that seems to have worked fine, but pveceph purge only completed silently on one node (PVE-Witness) The other two returned: root@PVE-1:~# pveceph purge unable to get monitor info from DNS SRV with service name: ceph-mon no...
  4. Ceph config broken

    Thank you, tried that and now: root@PVE-2:~# ceph-mon -i PVE-2 --mkfs 2019-06-28 11:00:25.671562 7f0e2cc90100 -1 mon.PVE-2@-1(probing) e0 unable to find a keyring file on /etc/pve/priv/ceph.mon.PVE-2.keyring: (2) No such file or directory 2019-06-28 11:00:25.671607 7f0e2cc90100 -1 ceph-mon...
  5. Ceph config broken

    I was able to inject the tmpfile on PVE-1 and PVE-Witness (I had to delete /var/lib/ceph/mon/ceph-PVE-Witness/store.db/LOCK) but it completed for those two. However for PVE-2, /var/lib/ceph/mon/ceph-PVE-2/store.db doesn't exist, and I didn't delete it... I created the directories, and it still...
  6. Ceph config broken

    Any thoughts? Thank you again so far.
  7. Ceph config broken

    By "start the ceph-mon on this node" i'm assuming "service ceph start mon"? I did that, and attempted to "systemctl start ceph.service" same thing. Assuming the '-m' on the ceph command to specify the IP of the MON needs to be done before I can start the ceph.service, but I'm not sure which ceph...
  8. Ceph config broken

    Well, I'm embarrassed about that part. I even did a search for it and didn't find it previously. So, I'm able to inject now, but root@PVE-1:~# ceph mon getmap -o tmpfile still returns timeout. What else do I need to get this to a healthy state? Does ceph.service need to be running for that...
  9. Ceph config broken

    The LOCK file was able to be deleted, and now trying inject: root@PVE-1:/var/lib/ceph/mon/ceph-PVE-1/store.db# ceph-mon -i PVE-1 --inject-monmap tmpfile 2019-05-21 22:38:49.287841 7f9d2c9de100 -1 unable to read monmap from tmpfile: can't open tmpfile: (2) No such file or directory And...
  10. Ceph config broken

    Ah, that makes sense then. "systemctl status ceph" returns root@PVE-1:~# systemctl status ceph ● ceph.service - PVE activate Ceph OSD disks Loaded: loaded (/etc/systemd/system/ceph.service; enabled; vendor preset: enabled) Active: inactive (dead) since Mon 2019-05-13 22:17:53 EDT; 3 days...
  11. Ceph config broken

    I ran "service ceph stop mon || stop ceph-mon-all" multiple times to make sure the service didn't start. It would make sense that the database would be locked because the service was running, but in this case, I told it to stop. "ceph status" hangs the console on all three nodes and eventually...
  12. Ceph config broken

    So I was finally able to remove the monitors so now "monmap --print tmpfile" returns with no monitors. Even though the webUI still returns PVE-1 and PVE-Witness..... However, trying to "ceph-mon -i PVE-1 --inject-monmap tmpfile" returns with OI error: lock...
  13. Ceph config broken

    I don't see anything in there to see where Proxmox created it originally (I used the WebUI to install Ceph). Trying to remove a monitor (manual) fails with a timeout, and "removing monitors for an unhealthy cluster" fails at step 3 on PVE-1 with: root@PVE-1:~# ceph-mon -i PVE-2...
  14. Ceph config broken

    Thank you for that. I've tried following the directions, but I don't know where my "mommap" file is. Any time I've looked at the config, it's just been "tmpfile", and "find / -name monfile" returns only: find: ‘/var/lib/lxcfs/cgroup/blkio/system.slice/pvesr.service’: No such file or directory...
  15. Ceph config broken

    Hi! So, I started to install and configure Ceph before I fully knew how I wanted to have it configured (mistake #1). Now, after following https://forum.proxmox.com/threads/changing-ceph-public-network.33083/ I've made some changes, but they're now really incorrect to the point where "monmaptool...

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE and Proxmox Mail Gateway. We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get your own in 60 seconds.

Buy now!