gurubert's latest activity
-
Any advice on powering down two clusters ? I have a 6 node closure on 8.3.1 (Enterprise repo) with 50-65 VMs pre node. Storage is a separate 5 node Proxmox cluster with Ceph same 8.3.1 version - this cluster is not running nay VMs. We have to... -
gurubert replied to the thread Ceph flapping OSDs - OSDs only using public network not the cluster one.OSDs need both networks (Ceph public_network and cluster_network) to function on all nodes to be able to properly work . If one of these two networks do not work the OSDs flap.
-
gurubert reacted to SteveITS's post in the thread Ceph flapping OSDs - OSDs only using public network not the cluster one with
Like.
That’s what I was trying to say…AFAIK the cluster network is only for replication. The VMs talk to it on the public network so that needs to be working. -
gurubert reacted to Johannes S's post in the thread Proximo - The Proxmox MCP/A2A you can hand the keys — VE + Backup Server + Mail Gateway + Datacenter Manager on one audited trust core with Like.
Why did you open a new thread and why didn't you link the old one with it's critism? I still think that handing the keys to a vibecoded ai agent is a bad idea...
-
gurubert replied to the thread Promiscuous Port in PVE Cluster.Is it configurable after you manually migrate the VM to node 2? What happens to the mirror port on node 1 after the migration?
-
Thanks for sharing. Please note that Proxmox is a registered trademark, so please don't use it as part of your own product/app/tool name. You can indicate that your work is for Proxmox VE by, e.g., using a wording that avoids suggesting that this...
-
gurubert replied to the thread latency on ceph ssd.Slow networking also adds latency.
-
see this old blog: https://www.sebastien-han.fr/blog/2014/10/10/ceph-how-to-test-if-your-ssd-is-suitable-as-a-journal-device/ The main reason is sync write, without plp, the ssd need to write directly to a full nand. for example, you need to...
-
It's just that these are SSD consumer drives without PLP. These are slow if you force them to write the data (sync writes). You'll find many threads about this on the forum. Maybe you could buy small enterprise SSDs with PLP and put the WAL+DB...
-
don't use consumer ssd with ceph or zfs. you need PLP to handle sync write
-
I went through the list. I see two problems with your SSDs: - All the SSDs have no Power-Loss-Protection (PLP). Without PLP all writes have to be completed to report it as finished. This slows Ceph writes down. With PLP the drive could report...
-
gurubert replied to the thread Ceph in 2026 HDD.For erasure coding with k=8 and m=3 you need at least 12 nodes.
-
Those were hacks and only accelerated specific workloads or patterns. Cache misses still gave the worst case scenario performance and VM and databases both are workloads that should be calculated accordingly (unlike filer NAS). Ceph/Linux has a...
-
The main bottleneck with hard drives is that they’re relatively slow. So ~100 IOPS peak and maybe 5-10MB/s in random read write scenarios. You need to read/write 100TB/day -> 1200MB/sec -> you need 300 disks just to keep up multiplied by the...
-
Hello, I wonder, what's the rationale behind a tool like this. What problem is it trying to solve?
-
We have a 24 node cluster, some on 10G, soon all will be on 2x100G. No problems, even having 14 nodes on a very busy 2x10G segment, with Ceph and no dedicated fabric. Things are way more robust than people like to make it sound. There are some...
-
gurubert reacted to Johannes S's post in the thread Clarification about Ceph suitability for a 2-node storage architecture with a witness/quorum node with Like.
Don't. Ceph needs at least three nodes unless you change the defaults ( and doing this is a bad idea, see: https://forum.proxmox.com/threads/ceph-pool-size-is-2-1-really-a-bad-idea.68939/ ) The recommended requirements in the documentation are...
-
gurubert reacted to MarkusKo's post in the thread Clarification about Ceph suitability for a 2-node storage architecture with a witness/quorum node with Like.
No, Ceph needs at least 3 nodes, for production 5 nodes or more (odd number) are recommended: PVE docs
-
gurubert reacted to UdoB's post in the thread Clarification about Ceph suitability for a 2-node storage architecture with a witness/quorum node with Like.
Two years ago I tried to use Ceph in my homelab. My experience: https://forum.proxmox.com/threads/fabu-can-i-use-ceph-in-a-_very_-small-cluster.159671/ I am not a Ceph user now. But I would not start with fewer than five active nodes. Just my...
-
Have you already purchased the motherboards? If not price out single cpu systems with plenty of memory. The savings over dual cpu ( assuming you were pricing that out) may leave cash to afford nvme’s or data a center grade ssd