Proxmox Ceph w/ VMWare vSAN

[pg1]

Hello everyone

I understand that with Proxmox I can use Ceph, which in itself allows to build a hyper converged system (so with the storage integrated within each server/node on the cluster), which is what I used to do with a vmware vSAN. My question is, apart from the possibility to completely switch to Ceph, what if I want to have both? So connect a Ceph storage environment to an external and/or pre-exhistent vSAN. Is this kind of compatibility possible within Proxmox?

 

[complexplaster27]

I tried using Ceph with Backup Server and while it worked alright backing up, when it came time to verify the disks were so slow because as you can imagine having 3 replicas of all your backups over many disks would take forever to check and confirm. I ultimately decided to go with a ZFS array as it's much faster.

 

[pg1]

I tried using Ceph with Backup Server and while it worked alright backing up, when it came time to verify the disks were so slow because as you can imagine having 3 replicas of all your backups over many disks would take forever to check and confirm. I ultimately decided to go with a ZFS array as it's much faster.

Thanks for your answer!

When you say "verify", do you mean verifying the integrity of the disks? If so, isn't that something that Ceph does automatically and periodically?

By the way, ZFS is more of a local storage solution, right? If instead I want something distributed, scalable and HAvailable I may need to go with Ceph, right?

Thanks again for your answer

 

[complexplaster27]

Thanks for your answer!

When you say "verify", do you mean verifying the integrity of the disks? If so, isn't that something that Ceph does automatically and periodically?

By the way, ZFS is more of a local storage solution, right? If instead I want something distributed, scalable and HAvailable I may need to go with Ceph, right?

Thanks again for your answer

The Verify I'm referring to is backup job verification, the IOPS required to verify backups is quite large and Ceph slows this process down a lot because it also has to run it's own replication checks ontop of your backup verification, this why the PBS documentation recommends running Solid State for your backup disks.

I have enough Disks to create multiple ZFS arrays and then have multiple PBS syncing the backups to each other, this way I can keep the fast storage and then if a backup server dies for whatever reason I have redundancy that way, additionally ZFS arrays allow you to replace disks that have died in the array.

Hope this helps!