your pg number seem quite low, it could impact write performance with pg_lock.
try to set pg target ratio to 1.0 in your ceph pool
Also, verify in your bios that your server is set to max performance profile. (you want cpu always at their max...
Odd
Odd, the article you referenced states:
'Many RAID HBAs can be configured with an IT-mode “personality” or “JBOD mode” for streamlined operation'
I've used "JBOD mode" without issues on the past, both for Ceph and ZFS. It disables block...
Have a checkout of the https://github.com/Corsinvest/cv4pve-report tool. This to me is close to what RVTools in the VMware world gave.
But +1 to adding the functionality inside the PVE GUI or PDM inventory views.
Check also yet another API consumer:
https://github.com/ciroiriarte/pve-cli
Would be nice to hear from feedback at your scale. VM count sounds a little low for 64 clusters though
please do not double-post as this just splits the discussion into 2 places - posting a link here to the thread in the PVE forum for reference - and closing this one...
I'd like to share **pve-cli** (`pc`), an open-source command-line client for Proxmox VE — and Proxmox Datacenter Manager (PDM) — that I've been building and testing against live 9.x clusters.
The idea is "remote-first": you run `pc <resource>...
I'd like to share **pve-cli** (`pc`), an open-source command-line client for Proxmox VE — and Proxmox Datacenter Manager (PDM) — that I've been building and testing against live 9.x clusters.
The idea is "remote-first": you run `pc <resource>...
Haben Sie zufällig ein Labor mit Alletra? Ich arbeite an etwas Ähnlichem für eine andere Marke, und wenn es funktioniert, möchte ich es in ein Multi-Vendor-Framework integrieren, müsste dafür aber für jede Marke/Produktlinie den spezifischen...
There is a known error:
https://forum.proxmox.com/threads/ceph-20-2-tentacle-release-available-as-test-preview-and-ceph-18-2-reef-soon-to-be-fully-eol.178960/post-847433
I think you're asking the wrong question.
what is the workload in vm count and minimum required iops/vm? how much capacity do you need?
ceph works fine with hard drives. its just slow.
Hmm, in the order of magnitude of things, that's not a thing anymore. AMD for example can give incentive to vendors for that to disappear.
The biggest issue is on memory and flash disks. Cost went x3-x6 depending on your volume and regular...
Well, I've seen happy users purchasing second hand Enterprise SSD/SAS disks. Would that work?
Money is going to NVMe these days.
I've seen Ceph from other vendors with bcache to paste both SSD and HDD. Haven't done it with PVE.
On the other...
Volume seems low, go with SAS/SSD or NVMe. Ceph per se doesn't do tiering.Unless you are able to do an educated placement of vdisks per pool per requirement, don't go with rotational disks.