Hello,
i've build a 3 nodes PVE cluster with following specificities by nodes
All was ok during months, but since 2,3 weeks, all VMs that uses CEPH storage experienced major performance losses.
ssd led activities seems to be now continuous on 2 of 3 nodes (in the pas ssd activty were less stressed on all nodes)
And VM systems responses are very slow.
The status:
Even if i well understood that CEPH role is oriented data integrity and not data access performance, this behavior change is really suprising.
If you have any idea? I will be really interested to have some steps to investigate.
Thanks in advance for your support.
i've build a 3 nodes PVE cluster with following specificities by nodes
- 128Go RAM
- 3x2,5 GBPS networks cards ( Service / Admin / Ceph) - Operation will be to change CEPH network cards from 2,5 to 10GPBS in proach future
- 5 1To OSDs (ssd) hosting their own OSD caches
All was ok during months, but since 2,3 weeks, all VMs that uses CEPH storage experienced major performance losses.
ssd led activities seems to be now continuous on 2 of 3 nodes (in the pas ssd activty were less stressed on all nodes)
And VM systems responses are very slow.
The status:
- All OSD are in satus green
- CEPH global status is green
- Numerous event as mgr.nodename (mgr.1872281) 109502 : cluster 0 pgmap v109794: 129 pgs: 129 active+clean; 1.9 TiB data, 5.8 TiB used, 7.9 TiB / 14 TiB avail; 834 KiB/s rd, 12 MiB/s
Even if i well understood that CEPH role is oriented data integrity and not data access performance, this behavior change is really suprising.
If you have any idea? I will be really interested to have some steps to investigate.
Thanks in advance for your support.