Good Morning
While we were doing upgrades to our cluster (upgraded each memory from 256 to 512 - 3 identical nodes), doing one node at a time and all VM's removed from HA and switched off, we noticed that after a node comes online it takes approximately 20-30 minutes for the Remap/Scrub/Clean process to finish (thus adding about 1.5 hours additional to the maintenance window) with speeds not reaching more than 160MiBS. Everything goes well. We're just concerned about the speeds and wondered what the expected results should be?
Cluster breakdown:
PVE version 8.4.1
CEPH version 19.2.1
2x LACP Bond (routed setup with fall back per WIKI)
Licensed Enterprise Repos for each node.
4 Monitors Per Node (12 Total Healthy)
NvME Drives for CEPH
25Gbps Meshed Network via DAC connections. (No switch between nodes) direct connections. Ports are 25Gbpsports. Confirmed 25Gbps connectivity.
Dual Socket Nodes.
While we were doing upgrades to our cluster (upgraded each memory from 256 to 512 - 3 identical nodes), doing one node at a time and all VM's removed from HA and switched off, we noticed that after a node comes online it takes approximately 20-30 minutes for the Remap/Scrub/Clean process to finish (thus adding about 1.5 hours additional to the maintenance window) with speeds not reaching more than 160MiBS. Everything goes well. We're just concerned about the speeds and wondered what the expected results should be?
Cluster breakdown:
PVE version 8.4.1
CEPH version 19.2.1
2x LACP Bond (routed setup with fall back per WIKI)
Licensed Enterprise Repos for each node.
4 Monitors Per Node (12 Total Healthy)
NvME Drives for CEPH
25Gbps Meshed Network via DAC connections. (No switch between nodes) direct connections. Ports are 25Gbpsports. Confirmed 25Gbps connectivity.
Dual Socket Nodes.
Last edited:
