How to direct link 10gig between 2VMs on 2 Seperate Proxmox servers

[av8r]

I know this has probably been asked before, but I can't seem to find the answer.

I have 2 Proxmox servers 1 HPE DL360 and 1 HPE DL380 both have dual 10gig nic. (not clustered)
- DL360 lives on 192.168.1.80, and DL380 lives on 192.168.1.81
- DL 360 has an ubuntu server vm that houses all my docker containers
- DL380 has My truenas scale VM NFS shares
I'm trying to set up a direct link 10gig connection between the ubuntu VM and the TrueNAS VM

In proxmox on both servers I have made a "mvbr1" network with respective separate IPs "10.10.11.10 and 10.10.11.11" (no gateway)
I can ping from pve1 to pve2 and the 10 gig works.

- I have added a "network-device vmbr1" on both VMs, but now I cannot ping "10.10.11.10 | 10.10.11.11" 100% package loss.

I'm sure this has a simple answer, but I'm neither a technical writer or a Network Engineer. If you know how to connect these two VMs on the two separate proxmox servers, or if you have managed to find a link to thread with the answer in it. I would be much obliged if you could help me out.
#
DL360 network config:

auto lo
iface lo inet loopback

iface eno1 inet manual

iface eno2 inet manual

iface eno3 inet manual

iface eno4 inet manual

auto eno49
iface eno49 inet manual

auto eno50
iface eno50 inet manual

auto vmbr0
iface vmbr0 inet static
        address 192.168.1.80/24
        gateway 192.168.1.1
        bridge-ports eno1
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 2-4094

auto vmbr1
iface vmbr1 inet static
        address 10.10.11.10/8
        bridge-ports eno50
        bridge-stp off
        bridge-fd 0
#10gig link PVE1/2 VP

source /etc/network/interfaces.d/*

###
DL380 network config:

auto lo
iface lo inet loopback

iface eno50 inet manual

iface eno1 inet manual

iface eno2 inet manual

iface eno3 inet manual

iface eno4 inet manual

auto eno49
iface eno49 inet manual

auto vmbr0
iface vmbr0 inet static
        address 192.168.1.81/24
        gateway 192.168.1.1
        bridge-ports eno50
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 2-4094

auto vmbr1
iface vmbr1 inet static
        address 10.10.11.11/8
        bridge-ports eno49
        bridge-stp off
        bridge-fd 0
#10gig link pve2/1

source /etc/network/interfaces.d/*

#

 

[news]

You must setup the ipv4 ip on the VM of Proxmox VE 1/2 Server by hand.
There is no dhcpd running.
Please check the VM IPv4 and tell us.

The IPs 10.10.11.10/8 and 10.10.11.11/8 are the interface ip from the Proxmox VE 1/2 Server!
You don't need a /8 Netmask, common my be the Network 10.10.11.0/24.

 

[av8r]

Thank you for the reply, I did not know that, guess I need to read up on how to do that on ubuntu and TrueNAS fist.

IPv4 of Ubuntu VM: 192.168.200.6
IPv4 of TrueNAS VM: 192.168.200.60

enp6s18: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000
    link/ether bc:25:**:**:**:** brd ff:ff:ff:ff:ff:ff
    inet 192.168.200.6/24 metric 100 brd 192.168.200.255 scope global dynamic enp6s18
       valid_lft 1994sec preferred_lft 1994sec
    inet6 fe80::be24:11ff:fecb:ebf4/64 scope link
       valid_lft forever preferred_lft forever

 

[av8r]

This is my ubuntu vm /etc/netplan/50-cloud-init.yaml:

network:
    version: 2
    ethernets:
        enp6s18:
           dhcp4: true
           addresses:
               - 192.168.200.6/24
               - 10.10.11.10/24
           routes:
               - to: default
                 via: 192.168.1.1
           nameservers:
             addresses: [192.168.1.53, 192.168.20.53, 192.168.200.53]

I can now ping 10.10.11.10/Ubuntu VM from the Ubuntu VM, I could not do that before. but working on trying to get it set up right on the trueNAS VM

this is ip a:

 enp6s18: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000
    link/ether bc:24:**:**:**:f4 brd ff:ff:ff:ff:ff:ff
    inet 192.168.200.6/24 metric 100 brd 192.168.200.255 scope global dynamic enp6s18
       valid_lft 2165sec preferred_lft 2165sec
    inet 10.10.11.10/24 brd 10.10.11.255 scope global enp6s18
       valid_lft forever preferred_lft forever
    inet6 fe80::be24:11ff:fecb:ebf4/64 scope link
       valid_lft forever preferred_lft forever