Search results

i'm still into it. updated the drivers inside the vms and rechecked. Virtio 0.1.165 Drivers under windows server 2012r2 winsat disk -ran -write -drive c Windows-Systembewertungstool > Wird ausgeführt: Featureaufzählung '' > Laufzeit 00:00:00.00 > Wird ausgeführt: Speicherbewertung '-ran -write...

in the end, it was a faulty ssd which had terrible iops and r/w performance after removal, speed is back to normal is there a log file for slow osds?

funny, i removed some of the ssds and added them right back into the ceph-cluster and suddenly we got performance inside our vms. read-iops before 8-10 - now 400-500.... and backfilling is on the way with 36pgs what is that??? feels like the system is setting the osds in hibernate and to...

default (kvm64) linux debian 9 but i have debian 10 also, windows server, windows 10, freebsd

did you replaced the ssds to get the performance up again? i'm still wondering why performance in vms is so poor. Tried to update the virtio drivers in the kernel, but didn't find any new version.

iops are the same, but the defect ssd was interrupting all vms, now the vms are much faster then before. i think i have to check each ssd. thank you.

one of the pgs are not active since it is too full, i guess on this pg the vm stores its data

30 iops is what i got with ceph bench.... 30 iops times 7 (osds in each server) would be amazing.... removed one osd, wiped it and readded it. Turned out that there was another osd that has a latency of about 2000ms. Pulled that out the cluster, now waiting for recovery then i'll retest.

Hi, @spirit yes to test the really performance of an underlaying storage you have to make sync=1 otherwise he will use the memory as cache. This will not represent the really performance of the storage. I'm not expecting 4k-IOPS, but all of our vms are slow. An Windows-Update took 3 hours to...

do i have to change anything in the config of the vm? result after enabling krbd, stop and start of the vm : fio --ioengine=psync --filename=/root/test --size=1G --time_based --name=fio --group_reporting --runtime=60 --direct=1 --sync=1 --rw=write --bs=4M --numjobs=4 --iodepth=32 fio: (g=0)...

krbd disabled fio --ioengine=psync --filename=/root/test --size=1G --time_based --name=fio --group_reporting --runtime=60 --direct=1 --sync=1 --rw=write --bs=4M --numjobs=4 --iodepth=32 fio: (g=0): rw=write, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync...

did read somewhere that it may has to do something with the virtio driver i'm using. added a scsi0 device and retested: fio --rw=write --name=test --size=20M --direct=1 test: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1 fio-3.12 Starting 1...

i see 64 as maximum. i migrated most of the vms, but this special one has to get some extra memory so i shut it down, moved it to another already upgraded server and started it there. it is RBP bootdisk: virtio0 cores: 8 description: BLABLABLABLA ide2: none,media=cdrom memory: 16384 name...

rados bench 600 write -b 4M -t 16 -p test hints = 1 Maintaining 16 concurrent writes of 4194304 bytes to objects of size 4194304 for up to 600 seconds or 0 objects Object prefix: benchmark_data_pve5-1_589524 sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 0...

with this hardware specs i set it up with 1024pgs is that maybe the problem?

thank you, but mons cpu are not at 100% ;) and we're at 15.2.11

can you link that please?

hi aaron, thanks for your reply. 3 mons, each has a CPU-Usage at about 10% Load Average on all three server about at: 1.25,1.69,1.72

Hi, i know there are many of ceph problems struggling with performance here, and i thought i got it but things are telling me a better story... Here is our setup: 9 PVE-Nodes with each minimum 128GB RAM, 12Core Processor 2x HDDs or SSDs (newer Server have got SSDs) used for ZFS-R1 for the...

you guys are the best. thank you root@pve5-9:/etc/pve# mv /etc/pve/nodes/pve5-9/pve-ssl.key /root/pve-ssl.key.bck root@pve5-9:/etc/pve# pvecm updatecerts -f (re)generate node files generate new node certificate merge authorized SSH keys and known hosts