Forgive me but I'm a network guy first and systems second.
I've been a home user for some time with a single node (no ceph, corosync, ha of any kind, etc) which is about as simple as it gets. I'm in the early phases of bringing up online nearly a 1/2 cabinet full of hardware that was used previously for openstack but it's been decommissioned. Just imagine someone plopping this gear in your lap and saying "here"....kinda where I'm at.
I haven't gotten into all the hardware details but there are 3 servers labeled "compute", 3 labeled "storage", and 3 labeled "control". Yea, I know this is greatly oversimplifying. For simplicity I'm just going to use the 3 compute & 3 storage chassis.
My high level plan is as follows
* Install PVE6 on everything
* Setup the datacenter
* Setup HA on the 3 compute hosts
* Deploy ceph
What I'm trying to understand is the proper networking as I think I have ample resources to do it right. My thoughts are as follow. There are vacant ports on each machine so I can modify this.
1x 1g for out of band to the servers...ipmi/idrac
2x 10g for ceph & corosync
1x 1g for the actual VM traffic to intranet/internet
I've been a home user for some time with a single node (no ceph, corosync, ha of any kind, etc) which is about as simple as it gets. I'm in the early phases of bringing up online nearly a 1/2 cabinet full of hardware that was used previously for openstack but it's been decommissioned. Just imagine someone plopping this gear in your lap and saying "here"....kinda where I'm at.
I haven't gotten into all the hardware details but there are 3 servers labeled "compute", 3 labeled "storage", and 3 labeled "control". Yea, I know this is greatly oversimplifying. For simplicity I'm just going to use the 3 compute & 3 storage chassis.
My high level plan is as follows
* Install PVE6 on everything
* Setup the datacenter
* Setup HA on the 3 compute hosts
* Deploy ceph
What I'm trying to understand is the proper networking as I think I have ample resources to do it right. My thoughts are as follow. There are vacant ports on each machine so I can modify this.
1x 1g for out of band to the servers...ipmi/idrac
2x 10g for ceph & corosync
1x 1g for the actual VM traffic to intranet/internet