In a 3 node cluster with size=3, min_size=2 and the default replica rule, Ceph won't rebalance anything if one node fails. To comply with the default rule "three replicas en three OSD located in three different servers" you need 3 servers, if...
Yeah, you can switch the network in the Datacenter menu under Options. Just keep in mind that 2x10G isn’t a lot for Ceph, if a migration starts running, you can hit bottlenecks pretty fast. I think, there’s also an option to limit the migration...
The package cloud-init is part of Debian. This version normally fixed for each Debian release, so with the advent of Debian 14 Forky and upcoming PVE 10 the current version available right now is 25.3, so not that much newer. That may for Debian...
What is FTT in this context? The memory target for OSDs should be 8 GB, which means 8GB per daemon. Anything lower usually sacrifices performance during recovery. With the memory target using EC or replica doesn't make a difference.
Yes...
By default /etc/ceph/ceph.conf is a symlink to /etc/pve/ceph.conf which makes it the same on each cluster node.
AFAIK it is easier to use ceph config set to set the values in the config db for each Proxmox node.
ceph config set client.HOSTNAME...
I misspoke.
PVE does not have any such functionality. What I MEANT was to do it at the local debian level (and since thats where the entirety of the pve stack resides it was convenient shorthand)
there are a bunch of tutorials for "setting up...
Proxmox VE is a bare-metal hypervisor platform aimed at IT professionals and system administrators. It is not a product or service directed at children ...
Überrannt trifft es ziemlich gut, wenn Leute anstatt mal versuchen ihr Problem zu verstehen und mit eigenen Worten zu beschreiben sich das durch die KI vorformulieren lassen und nicht mal mehr checken, ob das überhaupt ihr Problem richtig...
Da bin ich deiner Meinung. Ich nutze sie beispielsweise für Rechtschreibprüfungen bei längeren Texten und für Übersetzungen bei englischen Beiträgen. Manchmal nutze ich sie auch zur Ideensammlung oder um erste Abklärungen zu treffen, was das...
Looking at the graphs you posted, a few things stand out.
The Ceph pool metrics show almost no writes — IOPS and throughput on `pve_ceph_prod_3az` are nearly 100% read. Cross-AZ write latency is not what's hurting you here. The good news is that...
I was thinking abaou PBR (policy-based routing)—i.e., forcing SDN traffic out through a different NIC.
Right now, in my cluster the management VLAN/interface has the default route, which means the SDN traffic would break out into my management...
AFAIK NetApp has one of the fastest and most stable NFS server implementation in the industry.
If you already have that I would definitely run some benchmarks on it.
Ceph is the only "all features" supported shared solution easily available for PVE. Its also the most heavily worked on for other Virt platforms such as XCP-NG and various flavors of kvm. Your decision tree going forward heavily depends on WHY...
And RedHat already has a virtualization offering for their enterprise customers. I doubt that anybody really entrenched into the "Enterprise" RHEL ecosystem is looking elsewhere.
Most large organizations treat Proxmox VE in terms of accrediation/ATO as an appliance. Since PVE is a hypervisor platform. It's NOT meant to directly run workloads. Workloads are done via VMs/LXCs.
Same with PBS & PDM. It's treated as an...
Feature requests should be filed on bugzilla.proxmox.com since there is no guarantee the developers will read everything on the forum. On Bugzilla however any new issue is read by a staff member.
Now I'm not part of the team but a fellow...
Sorry for necroposting but I want to add some considerations for anyone stumbling onto this thread in the future:
Physical redundancy/separation (separate NICs, cables, switches etc.) is probably the most important part of a redundant cluster...