Enquiry on setting up a local network

[uglyxiaodi]

Dear Team,

Im trying to setup local private network, currently I have 2 servers , each with 1gbps NIC and link up with lan cable. I do have a public network for each server

I have no issues in setting up public network and link them using

server 1
I have created vmbr0 as Linux bridge, bridge port is eth0 which I have set as public network
I have left eth0 as blank
I have created eth1 as local private network which is 10.10.10.35/29

cat /etc/network/interfaces
auto lo
iface lo inet loopback

iface eth0 inet manual

auto eth1
iface eth1 inet static
address 10.10.10.35/29

auto vmbr0
iface vmbr0 inet static
address 169.231.43.35/29
gateway 169.231.43.33
bridge-ports eth0
bridge-stp off
bridge-fd 0
===
server 2
I have created vmbr0 as Linux bridge, bridge port is eno1 which I have set as public network
I have left eno1 as blank
I have created eno2 as local private network which is 10.10.10.139/29

cat /etc/network/interfaces
auto lo
iface lo inet loopback

iface eno1 inet manual

auto eno2
iface eno2 inet static
address 10.10.10.139/29

auto vmbr0
iface vmbr0 inet static
address 169.231.43.139/29
gateway 169.231.43.137
bridge-ports eno1
bridge-stp off
bridge-fd 0


is that the correct way to set up both public and private network?

 

[Dominic]

is that the correct way to set up both public and private network?

Does it work? Your addresses do not seem to be in the same subnet?

 

[uglyxiaodi]

Dear Dominic,

Ideally I'm using few servers to setup proxmox and test H.A with Ceph . There is limited source I can search for proxmox to setup Ceph.

1) if node A is down, it will be automatically load all the VPS in Node A in Node B with minimize downtime
2) to have a backup of the VMs

My understanding is to create a local private network to link these servers for the purpose of Ceph.

Meanwhile the VMs will be having public network where they can access

My understanding is to install DHCP server in each ndoe to auto generate the IP address and assign to each VMs created

1.Install isc-dhcp-server with apt.
#apt install -y isc-dhcp-server

2 nano /etc/default/isc-dhcp-server
Add configuration for DHCPDv4. INTERFACESv4 is a network interface name which is connected to a network which you try to provided DHCP.

INTERFACESv4="vmbr0"

3.# systemctl enable isc-dhcp-server

4.# nano /etc/dhcp/dhcpd.conf
subnet 169.231.43.0 netmask 255.255.255.0{
range 169.231.43.36 169.231.43.38;
option subnet-mask 255.255.255.0;
option routers 169.231.43.33;
option broadcast-address 169.231.43.39;
default-lease-time 600;
option domain-name-servers 8.8.8.8, 8.8.4.4;
max-lease-time 7200;
}

Any advise if the above is setup in the right path? otherwise how do I setup correctly?

Thank you

 

[Dominic]

Ideally I'm using few servers to setup proxmox and test H.A with Ceph . There is limited source I can search for proxmox to setup Ceph.

The best resource for Ceph on PVE is the respective chapter in the PVE administration guide.

1) if node A is down, it will be automatically load all the VPS in Node A in Node B with minimize downtime

To do so, you should set up HA in PVE.

2) to have a backup of the VMs

You can set up CephFS in the GUI. CephFS can hold VM backups.

My understanding is to create a local private network to link these servers for the purpose of Ceph.

Having a separate network for Ceph is certainly a good idea.

My understanding is to install DHCP server in each ndoe to auto generate the IP address and assign to each VMs created

You can install a DHCP server if you want. But everything should work with static ip addresses, too.