Hello,
We run our PBS and have mounted RBD block devices from a Ceph cluster.
The Ceph cluster consists of 12, 14, and 16 enterprise HDDs (not SSDs), making it relatively cheap, large, but somewhat slow in terms of I/O performance.
Benchmarks with parallel threads perform very well.
However...