VM using local OSD ceph disks

[apar]

Hello,

I am mounting a proxmox HA cluster, using ceph as distributed storage. (I'm doing the lab with Proxmox 5)

Initial setting:

3 nodes with this config:
16 cores, 32GB RAM, 2x500GB SSD RAID 1 (PROXMOX OS), 2 x 500 SSD (OSD DISKS)

Can I force it in any way, or configure the virtual machines to use the OSDs they have in the same host?

This way it would be faster and would not saturate the network.

Thank you very much

 

[dcsapak]

this is not how ceph works at all

if you have replica 3 for example, ceph waits always until the data is replicated onto 3 nodes (in our default setup) until it reports that the data is written

 

[apar]

Correct, but can you force ceph so that on the same host that has the OSD, use OSD for local machines, making less use of the storage network?

Thank you

 

[dcsapak]

no because then it could not guarantee data safety...

 

[Flolingo]

Hi, I understand that it won't work with writing, but why not with reading. It only reads from one osd so why not take the local one and go over the bus. When i put all osds in out (except the one on the proxmox host), i can read with 4000mb/s but with other osds it reads through the networkinterface. So i want to be able to have multiple osds and have the host go over the bus if it has an osd in it.