Proxmox VE Ceph

[John Wick]

Hi,

Is it possible to seperate proxmox ve and ceph? Mean 3 server host proxmox ve and 2 server host proxmox with ceph. The 3 server is cluster. 2 server will not run VM's on it. Advice needed.

Thanks/.

 

[spirit]

yes sure.

you need 3 monitor minimum. (you can have storage (osd) on 2 nodes, but you need 3 monitors for quorum).

ceph nodes can be proxmox nodes in the same proxmox cluster or in another proxmox cluster or nodes without proxmox (but you don't have proxmox gui in this case)

 

[John Wick]

Yeah, will include 3 monitor server. Is there any document for my setup?

 

[spirit]

I think for you, easy way is to create 1 proxmox cluster with 5 nodes.

then create mon on 3 servers, osd on 2 servers

and when you configure storage configuration for your vm, only enable it for the 3 nodes where you don't have osd.

just follow the wiki.

 

[John Wick]

Thanks, that really helpful.

 

[Neb]

Hi,

So is it possible to have 1 cluster of 2 nodes (at least) for ceph-osd and ceph-mds daemons, and a separated cluster which includes several nodes and runs VMs with the 3 ceph-mon daemons on each nodes ?

Thanks you

 

[fabian]

Hi,

So is it possible to have 1 cluster of 2 nodes (at least) for ceph-osd and ceph-mds daemons, and a separated cluster which includes several nodes and runs VMs with the 3 ceph-mon daemons on each nodes ?

Thanks you

it is "possible", but it does not sound like a very sane setup.

 

[Neb]

Ok, I saw this somewhere

So it is recommended to have one proxmox cluster with at least three nodes for Ceph and other proxmox cluster(s) for the virtual machine
but can we manage ceph storage in the GUI with this configuration on the cluster which runs VMs ?

Thanks

 

[fabian]

you can only manage the ceph cluster using the PVE GUI if it is running on the same PVE cluster, not if it is an external one. you can use an external ceph cluster as storage though.