I've read through both the books and the online docs for Proxmox over the last couple of weeks. I am planning to set up a cluster to replace 4 physical servers, one of which contains about 5 virtual machines on it already which I manually manage.
My plan is to get 3 servers each with SSD for boot/OS, and 4 x 1TB drives for data on a Ceph cluster, 32GB RAM and 10Gb ethernet for the inter-node communications. Every tutorial I see shows the ceph redundancy at 3 copies. I was planning to use a 2 copy redundancy. I will have backups go to an NFS file server. All of the VMs will be KVM based and running mostly FreeBSD for web site development purposes, and one for the office file share. I need a total of about 2TB of disk today, with room to grow.
I know if two nodes go down I will lose data that is not backed up. Anything else? Will there be a noticeable speed impact on the performance of the VMs? Some of the files will have to come from a remote node, but at the 10Gb speed I'm thinking it will be ok.
Is there some other fatal flaw in doing this? Will it make upgrading hardware (ie replace a whole node with bigger faster hardware) difficult?
My plan is to get 3 servers each with SSD for boot/OS, and 4 x 1TB drives for data on a Ceph cluster, 32GB RAM and 10Gb ethernet for the inter-node communications. Every tutorial I see shows the ceph redundancy at 3 copies. I was planning to use a 2 copy redundancy. I will have backups go to an NFS file server. All of the VMs will be KVM based and running mostly FreeBSD for web site development purposes, and one for the office file share. I need a total of about 2TB of disk today, with room to grow.
I know if two nodes go down I will lose data that is not backed up. Anything else? Will there be a noticeable speed impact on the performance of the VMs? Some of the files will have to come from a remote node, but at the 10Gb speed I'm thinking it will be ok.
Is there some other fatal flaw in doing this? Will it make upgrading hardware (ie replace a whole node with bigger faster hardware) difficult?