Search results

Check cabling, you have errors on mirror-1 and mirror-0 ,where on mirror0 total damage.

Bring up independent proxmox clusters for each location

If i'm seeing good, the usage of ecoVolumes is really low, so they don't need autoscaling.

Can we see your pools? Usually there is a autoscaler problem if you leave some pools on default or something like that.

Yes, but these are striped mirrors, not just mirrors-mirrors, so it is easier to call them raid10(which means striped mirror). by default raidz(1,2,3) will always be slower than anything else ,because they are doing mathematical calculations for parity. Execute this on zfs pool: sudo fio...

Hardly 10% when raid5 reads are okay,but writes are the IOPS of one disk. Whereas raid10 IOPS *3

Latency will probably kill your cluster.

i can't give you exact number,but lets say 50% . And compression by default.

Yeah that is true.

Use Raid10 if you want best performance, not any Raidz.

Try without name, maybe it will work. so just: zpool import or: zpool import -f something should work.

not really.

with zfs, just add disks to new installation, and do something like zpool import pool(your pool name) . This should be enough.

Just do the backups again on them,just for peace of mind.

try with qm unlock 102 or 103 on that host(pve2?)

The CEPH is rather specific, because it is a complex software, which can kill your storage pretty fast. That is why i usually recommend bringing 3-node test cluster,and there you can molest it and everything you need, intentionally crash it etc,etc. Then when you see everything ceph can...

Contact support, or hire someone who knows what he is doing.

i would in your case drop GPT and hire and engineer,atleast for a few hours.

you don't need HA.

You have separate public and cluster ceph networks, are they both available? do you have a need for cluster network? if not use just public_network. Also, there are a lot of osds down, i would check the disks if they are working as expected(hddsentinel?) .Moreover, why so many pools? Usually one...