Proxmox Internal Cluster LAN via 10G

[FWO]

Hi,

following setup

node01
NIC1 => with public IP
NIC2 => connected to an internal 10G SWITCH

node02
NIC1 => with public IP
NIC2 => connected to an internal 10G SWITCH


/etc/network/interfaces

#Public Interface
auto eno1
iface eno1 inet static
        address 23.XX.XX.XX/26
        gateway 23.XX.XX.XX
        up route add -net 23.XX.XX.XX netmask 255.255.255.192 gw 23.XX.XX.XX dev eno1

#Private 10G Interface
auto ens21
iface ens21 inet static
        address 10.2.99.2/24
        mtu 1500

auto ens21.2000
iface ens21.2000 inet manual

auto vmbr2000
iface vmbr2000 inet manual
        bridge-ports ens21.2000
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 2-4094

With this Setup I can't reach a client with is not on the same host.
Client1 on Node1 can ping Client2 on Node1
but not Client3 on Node2

A VLAN over the Public NIC works fine ... but it's not as fast as I would like to have...


Can anybody help me - what's missing ??

Thank you very much...

 

[FWO]

these are hosted Servers at a big DataCenter.... (every Server has it's own public ip)
but it's protected with a firewall => so nobody can reach them


node01 can ping and transfer via 10G to node02 ...
just the clients don't work

Where do you think the route is missing


MY Provider (Het***) offers vswitches with VLANs for internal communication...
The whole setup works perfect with this vswitches..
But it's too slow for me..

So I decided to connect the nodes to an additional physical privat Switch (10G).
So it's possible to transfer Data in a ten times higher rate...
That works really great for the nodes -> replication is very fast now...

Now I want to use the private switch also for the communication between the VMs ...
That would speed the internal traffic up !!

That's my use case..