Hi all, I have a test Lab with specs:
3 node HP dl360 gen9
32 x Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz (2 Sockets)
96GB DDR4 ECC ram
3x Samsung PM1643 SAS SSD 1.92 TB /per node = 9 CEPH OSD SSDs in total
2x Intel 240gb SSD for OS /per node - zfs raid1 PVE OS setup
3x dual 10gb lan /per node - LACP bond0 CEPH_STORAGE traffic, LACP bond1 PVE CLUSTER traffic, LACP bond2 VM traffic - all 9000mtu
PVE 6.4-13
Ceph 15.2.13
Setup:
Size:3
Min Size:2
replicated_rule
PG: 256
PG Auto Scale: off
Created a RBD storage, and created hard disk for vm:
Bus/Device: SCSI
SCSI Controller: VirtIO SCSI
Size: 32GiB
IO thread: enabled
Cache: Default (No cache)
Ceph 9xOSDs storage :
Single SSD Directory storage:
Does someone else have similar experience with lower write speeds in similar setup?
Any suggestions on how to increase the write speed or is this expected?
I cant add/modify the hardware just tune the general setup if necessary.
Thanks
3 node HP dl360 gen9
32 x Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz (2 Sockets)
96GB DDR4 ECC ram
3x Samsung PM1643 SAS SSD 1.92 TB /per node = 9 CEPH OSD SSDs in total
2x Intel 240gb SSD for OS /per node - zfs raid1 PVE OS setup
3x dual 10gb lan /per node - LACP bond0 CEPH_STORAGE traffic, LACP bond1 PVE CLUSTER traffic, LACP bond2 VM traffic - all 9000mtu
PVE 6.4-13
Ceph 15.2.13
Setup:
Size:3
Min Size:2
replicated_rule
PG: 256
PG Auto Scale: off
Created a RBD storage, and created hard disk for vm:
Bus/Device: SCSI
SCSI Controller: VirtIO SCSI
Size: 32GiB
IO thread: enabled
Cache: Default (No cache)
Ceph 9xOSDs storage :
Single SSD Directory storage:
Does someone else have similar experience with lower write speeds in similar setup?
Any suggestions on how to increase the write speed or is this expected?
I cant add/modify the hardware just tune the general setup if necessary.
Thanks