Search results

I can only imagine. That said, it's definitely a feature that would take Proxmox to the next level. :)

Something like this would probably accomplish what I'm looking for: https://forum.proxmox.com/threads/multi-datacenter.35043/ (Assuming live migration for compute was a feature) <D>

I want to avoid down time with my workloads. I think there is a benefit at a certain scale if we had the ability to balance compute, in total, regardless of what is happening with CEPH environment(s). There's always risk when changes are made to a CEPH cluster (say during an upgrade). If a...

Thanks for the tip on the CEPH, RBD Mirroring, Alwin, I'll give that a read. With regards to "cluster redundancy", sorry if I wasn't more clear. While it's true that there is "some" redundancy INSIDE a ceph cluster, I'm looking for more redundancy one level up. So, two Ceph clusters. Yes I...

@aaron Sorry for the delayed response. Somehow taking 2 weeks off during the holidays = 2 months behind at work.... :) In summary, I want some redundancy at the CEPH cluster level while at the same time allowing me to freely migrate compute (VM/Containers) around all nodes as needed. Simply...

Hey all, JOOC, can PVE be configured so that there is a single PVE Cluster with multiple CEPH clusters. In other words, I want to run all my PVE nodes in one cluster but have half serving one CEPH cluster and the other half serving another, separate, CEPH cluster. (I'm aware that I can define...

This solved my ghosting issue on my node post PVE5 to PVE6 upgrade. Interestingly, this node was one time a MON but using the older PVECEPH tools to remove/destroy it probably didn't clean up things enough. Anyway, thanks for the posted solve. Cheers! <D>

I'm running into something similar. I seem to have an "unknown monitor" displayed in the gui for one of my nodes that is NOT actually designated as a monitor. It also has a duplicate. Also having a bit of a hard time understanding the solution. Are you saying if you ssh into the node, you run...

That's indeed the case. Thank you for a quick response and confirming, Stefan. Much appreciated! <D>

Hi all, Just curious: I am preparing a PVE 5.4.X cluster for upgrade to PVE 6 and in doing so, I've run the pve5to6 prep script. It has noted a few warnings that I've sorted out except for this last one: I have a 'local' and 'local-lvm' "enabled" on each node. The 'local' is enabled and...

Agreed. I've been running it for about 4 years. It's pretty great.

@RobFantini It's really wonderful that you actually took the time to come back here to update this thread. Too often people just abandon the thread and never update it (of course we've all probably done that!). Thank you for doing it in this case. It really helped. If you are ever in the San...

Thank you very much for the quick response, Rob! Just to confirm, you didn't have a "mon =" line in the global config of your ceph.conf and you added something like this to it?: mon_host = 10.10.10.132 10.10.10.133 10.10.10.134 It sounds like a very bad sunday indeed. I've been running CEPH...

JOOC, how long did you leave it running with these changes before doing the upgrade? I'm working through some of the pre-flight checks and it could be a week or two before I can actually get to the upgrade. Wondering if I can set these and run for a while or if it's something you did node by...

@Alwin Thank you for the detailed explanations. I have a couple questions about some of them. Question 1: When @Adam Koczarski created his 220GB partitions on the NVMe and then used the Proxmox GUI to create the OSD's and designate the DB/WAL location to these partitions is this still true...

Hmmm...I guess where I'm confused is if I point, say, each OSD I'm creating at the same drive, will the creation process be smart enough to create partitions automatically without overwriting other partitions? (I've never been through the process before...). Apologies for the elementary...

Seems like this is a bug with Proxmox's GUI wrapper...? Seems like "Destroy" should also unmount the OSD's mount point, no?

Makes total sense. Thanks again for the time and input on this! :)

@Alwin Thank you for your detailed response and time. Much appreciated. One final (probably obvious) question related to storing the meta data (DB/Wal) on SSD: If I am going to do a 4 to 1 ratio (assuming the disk's bandwidth can handle the throughput for this) is it required to manually...

Thank you Kmgish! Much appreciated. So here's another couple questions related to your response: When you first implemented CEPH with the ssd backend hdds did you only have that one pool and no special ruleset for it because it was, at the time, homogenous? (I originally implemented my...