My homelab consists of four (4) Intel NUCs (BEH8i7) with 32G of memory, 512GB NVMe SSD, and 1TB SATA HD. Each NUC also has a USB-3 gigabit network adapter.
My first foray into Proxmox clustering was attempting to CEPH for my shared storage solution but quickly found out that my twelve (12) VM's (even with just six (6) of my mandatory ones) crushes the network and causes kernel panics of some of the VMs. This was all running from the built in network interface. (10Gig network not in my future.) So in preperation to rebuild the cluster I added a fifth node (xeon e3-1275, 32GB memory, 512 GB SSD, and 2TB SATA HD (x2). I added the drives to the OSD pools and migrated all VM's to this one system. The e3 node is handling the necessities to keep me in good graces with the wife but is a single point of failure.
My goals for the rebuild if possible are:
Still trying to figure out the best way to re-ip the cluster network and migrate the current IP assignments to the USB-3 NICS.
Looking forward to hearing ideas
TIA
- Ron
My first foray into Proxmox clustering was attempting to CEPH for my shared storage solution but quickly found out that my twelve (12) VM's (even with just six (6) of my mandatory ones) crushes the network and causes kernel panics of some of the VMs. This was all running from the built in network interface. (10Gig network not in my future.) So in preperation to rebuild the cluster I added a fifth node (xeon e3-1275, 32GB memory, 512 GB SSD, and 2TB SATA HD (x2). I added the drives to the OSD pools and migrated all VM's to this one system. The e3 node is handling the necessities to keep me in good graces with the wife but is a single point of failure.
My goals for the rebuild if possible are:
- is to use the internal network interfaces for the backend clustering communication and use the USB-3 network interfaces for management and the VM's network connectivity.
- Shared Storage (be able to migrate VMs to do maintenance on a node)
- considering zfs with glusterfs (idea from https://www.servethehome.com/building-a-proxmox-ve-lab-part-2-deploying/)
- Keep my virtualization playground.
- Be stable.
Still trying to figure out the best way to re-ip the cluster network and migrate the current IP assignments to the USB-3 NICS.
Looking forward to hearing ideas
TIA
- Ron