Ceph rados benchmark question...

[nethfel]

If I run:
rados -p test bench 60 write --no-cleanup
and I get my results of the write.
Clean the caches ( echo 3 into drop_caches)
run:

rados -p test bench 60 seq
on the node I did the write to, I get good results.
If I run read on any other node in the cluster I get:

rados -p test bench 60 seq
   sec Cur ops   started  finished  avg MB/s  cur MB/s  last lat   avg lat
     0       0         0         0         0         0         -         0
read got -2
error during benchmark: -5
error 5: (5) Input/output error

Is that normal? Am I supposed to only run the read benchmark on the same machine I ran the write benchmark?

 

[udo]

If I run:
rados -p test bench 60 write --no-cleanup
and I get my results of the write.
Clean the caches ( echo 3 into drop_caches)
run:

rados -p test bench 60 seq
on the node I did the write to, I get good results.
If I run read on any other node in the cluster I get:

rados -p test bench 60 seq
   sec Cur ops   started  finished  avg MB/s  cur MB/s  last lat   avg lat
     0       0         0         0         0         0         -         0
read got -2
error during benchmark: -5
error 5: (5) Input/output error

Is that normal? Am I supposed to only run the read benchmark on the same machine I ran the write benchmark?

Hi,
that's because the benchmark data is named like the host:

rados ls -p test
...
benchmark_data_proxmox4_289519_object739
benchmark_data_proxmox4_580298_object2825
benchmark_data_proxmox4_289519_object4802
benchmark_data_proxmox4_572822_object2264
benchmark_data_proxmox4_531677_object4511
...

In this case I do the benchmark from proxmox4.

Udo

 

[nethfel]

Ooooh, ok - I didn't actually list out the data stored on the pool, I thought it stored it with a generic file name that would be recognized anywhere - now I understand. Thanks again Udo