Mixed ZFS and CEPH Cluster

yena

Renowned Member
Nov 18, 2011
378
5
83
Hello,
i have a 21 Nodes Cluster, separate ZFS FS.
Can i add 2 or 3 more nodes configured with Ceph FS ?

Could there be any drawbacks?

Thanks!
 
Do I understand you correctly? The Cluster currently has 21 nodes, all using local ZFS for storage?

Adding more Nodes which do have a Ceph cluster should work. If the other 21 nodes should also access the Ceph storage, make sure they have a (fast) network connection to the Ceph Public network.

If you only want those 3 Nodes to access the Ceph network, you can limit it in the Datacenter -> Storage -> <your ceph storage> configuration.

If you limit the storages on specific nodes and use HA, make sure to use HA Groups and restrict VMs to only the nodes where they can actually access their disks.
 
  • Like
Reactions: Tmanok
Do I understand you correctly? The Cluster currently has 21 nodes, all using local ZFS for storage?

Adding more Nodes which do have a Ceph cluster should work. If the other 21 nodes should also access the Ceph storage, make sure they have a (fast) network connection to the Ceph Public network.

If you only want those 3 Nodes to access the Ceph network, you can limit it in the Datacenter -> Storage -> <your ceph storage> configuration.

If you limit the storages on specific nodes and use HA, make sure to use HA Groups and restrict VMs to only the nodes where they can actually access their disks.

Yes 21 nodes ZFS local sotorage.
We have 10G SFP connection.
And Yes, i wont those 3 Nodes to access the Ceph
Thanks!
 
  • Like
Reactions: Tmanok

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!