Search results

Reading lots of stuff on ceph and other distributed storage setups lately... Q: can anyone confirm or give any insight into performance or reliability or other issues with Vitastor vs Ceph? Very young project but seems to be 10x faster on some things... Vitastor v Ceph Plus, they're baking in...

This was very helpful - I have same net range on cluster and private but different switches - one nic for private IP to router for public wan and then 4 nic per node bonded for server to server on different ip but all connected up to main switch through another server server switch... anyhow -...

I just turned off my proxmox firewall after 4 months of scratching and playing with all sorts of settings - and all of a sudden it all started communicating and balancing... omg.. bug or hang up with the upgrade I think.

ok - I was able to recover - turned off proxmox firewall and it all started communicating again and rebalancing and now it is live. Something with upgrade and firewall broke my ceph.

did you solve this?

Any concerns or instruction on installing and using Calamari or Kraken tools/gui for proxmox cluster ceph? PM gui is quite powerful but limited on ceph management functions - so relegated to CLI only - which is fine - but I am curious if we can use the tools built into another desktop gui...

I upgraded and everything broke too... been down for 4 months... just too busy to try to think about it much anymore. Come back every week to see if anyone else had similar issues I can learn from without being called names... if this got resolved, would love to hear how.

Ever solve this? I have similar issues

yeah I am trying to reduce down to just one monitor and manager and then add back but nothign seems to be helping... so much frustration over last 3 months now since upgrade... I did have some vm I would like to restore and save so only reason I am trying so hard not to lose everything.

ceph health details [/B] root@node2:~# ceph health detail HEALTH_WARN 1 filesystem is degraded; 1 MDSs report slow metadata IOs; 6 osds down; 2 hosts (2 osds) down; Reduced data availability: 484 pgs inactive, 52 pgs down, 29 pgs peering; Degraded data redundancy: 24966/267340 objects...

Just in case it helps: ceph -s root@node2:~# ceph -s cluster: id: cfa7f7e5-64a7-48dd-bd77-466ff1e77bbb health: HEALTH_WARN 1 filesystem is degraded 1 MDSs report slow metadata IOs 6 osds down 2 hosts (2 osds) down...

All the proxmox nodes seem connected fine and working - but ceph is giving me fits every node shows timeout when using gui to see ceph status... in fact every node is not responding to ceph commands at cli except for node 2 - which is the node I decided to keep for the last known good monitor...

did this get resolved? How?

ceph -s root@node2:~# ceph -s cluster: id: cfa7f7e5-64a7-48dd-bd77-466ff1e77bbb health: HEALTH_WARN 1 filesystem is degraded insufficient standby MDS daemons available 1 MDSs report slow metadata IOs 6 osds down 2 hosts (2...

Can anyone point me in the right direction to fix this? ceph-osd --check-wants-journal root@node2:/var/lib/ceph/osd/ceph-1# ceph-osd --check-wants-journal 2022-04-14T20:55:43.210-0500 7f71cd669f00 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-admin/keyring: (2) No such file or...

I wonder if this is similar to my problem when I updated... now I get ceph-osd --check-wants-journal root@node2:/var/lib/ceph/osd/ceph-1# ceph-osd --check-wants-journal 2022-04-14T20:55:43.210-0500 7f71cd669f00 -1 auth: unable to find a keyring on /var/lib/ceph/osd/ceph-admin/keyring: (2) No...

can this be done without losing the data on the drive though?

https://forum.proxmox.com/threads/zippys-noob-log-of-how-to-for-proxmox-and-linux-admin-noob.107537/#post-462320 just started adding stuff there - feel free to correct me and I will update as I go along...

can also resize swap or data patition or logical volumes and increase pve-root (I have a noob thread going with instructions)..

feel free to suggest edits and additions - but give me a link to add to it for reference and more reading