Cannot connect to Proxmox

eiger3970

Well-Known Member
Sep 9, 2012
276
3
58
New thread following from https://forum.proxmox.com/threads/h...oxmox-and-pfsense-vm.50443/page-2#post-235379

Basically I can no longer ping or browse Proxmox after trying to setup a vm router pfsense.

My personal PC is connected from a NIC port via Cat6e Ethernet cable to the Proxmox NIC1.
Proxmox PC NIC0 has no lights on when I connect it.
Proxmox PC NIC1 has lights on when I connect it.

Personal PC details:
Code:
arp -a ->
(proxmox /etc/network/interfaces (eth0))
? (192.168.1.140) at <incomplete> on enp3s0
? (192.168.1.141) at <incomplete> on enp3s0
? (192.168.1.170) at 40:16:7e:37:21:b0 [ether] on enp3s0
? (192.168.1.1) at <incomplete> on enp3s0
? (192.168.1.180) at 00:ea:21:62:38:ce [ether] on enp3s0
? (192.168.1.110) at 40:6c:8f:2e:7b:18 [ether] on enp3s


Browse:
192.168.1.140: This site can't be reached.
192.168.1.170: This site can't be reached.


/etc/network/interfaces ->
auto lo
iface lo inet loopback

auto enp3s0
iface enp3s0 inet static
address 192.168.1.120
netmask 255.255.255.0
network 192.168.1.0
gateway 192.168.1.170
dns-nameserver 8.8.8.8
dns-nameserver 8.8.4.4


ip a ->
1: lo: <LOOPBACK,UP,LOWER_UP>
2: enp3s0:  88:d7:f6:c9:08:eb   inet 192.168.1.120/24   brd 192.168.1.255


ping 192.168.1.140 Destination Host Unreachable.
ping 192.168.1.170 -> Terminal freezes.


tcpdump ->
listening on enp3s0, link-type EN10MB (Ethernet), capture size 262144 bytes
17:37:54.446458 IP 192.168.1.180.kerberos > 192.168.1.120.46104: Flags [.], seq 2073547753:2073549201, ack 3675183164, win 1028, options [nop,nop,TS val 25772171 ecr 44298896], length 1448
17:37:54.446783 IP 192.168.1.180.kerberos > 192.168.1.120.46104: Flags [.], seq 1448:2896, ack 1, win 1028, options [nop,nop,TS val 25772171 ecr 44298896], length 1448
17:37:54.446839 IP 192.168.1.120.46104 > 192.168.1.180.kerberos: Flags [.], ack 2896, win 1829, options [nop,nop,TS val 44298936 ecr 25772171], length 0


arp -a ->
(proxmox /etc/network/interfaces (eth1))
? (192.168.1.140) at <incomplete> on enp3s0
? (192.168.1.141) at <incomplete> on enp3s0
? (192.168.1.170) at 40:16:7e:37:21:b0 [ether] on enp3s0
? (192.168.1.1) at <incomplete> on enp3s0
? (192.168.1.180) at 00:ea:21:62:38:ce [ether] on enp3s0
? (192.168.1.110) at 40:6c:8f:2e:7b:18 [ether] on enp3s0


Browse:
192.168.1.140: This site can't be reached.
192.168.1.170: This site can't be reached.


/etc/network/interfaces ->
auto lo
iface lo inet loopback

auto enp3s0
iface enp3s0 inet static
address 192.168.1.120
netmask 255.255.255.0
network 192.168.1.0
gateway 192.168.1.170
dns-nameserver 8.8.8.8
dns-nameserver 8.8.4.4


ip a ->
1: lo: <LOOPBACK,UP,LOWER_UP>
2: enp3s0:  88:d7:f6:c9:08:eb   inet 192.168.1.120/24   brd 192.168.1.255


ping 192.168.1.140 Destination Host Unreachable.
ping 192.168.1.170 -> Terminal freezes.


tcpdump ->
listening on enp3s0, link-type EN10MB (Ethernet), capture size 262144 bytes
21:40:27.325783 IP 192.168.1.120.37263 > 8.8.4.4.domain: 21895+ A? clients1.google.com. (37)
21:40:27.326662 IP 192.168.1.120.41883 > 8.8.8.8.domain: 65309+ PTR? 4.4.8.8.in-addr.arpa. (38)
21:40:27.462355 IP6 fe80::1c7e:412a:4aa9:f081.dhcpv6-client > ff02::1:2.dhcpv6-server: dhcp6 inf-req
21:40:27.739048 IP 192.168.1.120.36167 > 8.8.4.4.domain: 15136+ A? play.google.com. (33)


arp -a ->
(proxmox /etc/network/interfaces (vmbr0))
? (192.168.1.140) at 40:16:7e:37:21:b0 [ether] on enp3s0
? (192.168.1.141) at <incomplete> on enp3s0
? (192.168.1.170) at 40:16:7e:37:21:b0 [ether] on enp3s0
? (192.168.1.1) at <incomplete> on enp3s0
? (192.168.1.180) at 00:ea:21:62:38:ce [ether] on enp3s0
? (192.168.1.110) at 40:6c:8f:2e:7b:18 [ether] on enp3s0


Browse:
192.168.1.140: This site can't be reached.
192.168.1.170: This site can't be reached.


/etc/network/interfaces ->
auto lo
iface lo inet loopback

auto enp3s0
iface enp3s0 inet static
address 192.168.1.120
netmask 255.255.255.0
network 192.168.1.0
gateway 192.168.1.170
dns-nameserver 8.8.8.8
dns-nameserver 8.8.4.4


ip a ->
1: lo: <LOOPBACK,UP,LOWER_UP>
2: enp3s0:  88:d7:f6:c9:08:eb   inet 192.168.1.120/24   brd 192.168.1.255


ping 192.168.1.140 Destination Host Unreachable.
ping 192.168.1.170 -> Terminal freezes.


tcpdump ->
listening on enp3s0, link-type EN10MB (Ethernet), capture size 262144 bytes
16:13:43.000459 IP 192.168.1.180.kerberos > 192.168.1.120.46104: Flags [.], seq 4130475592:4130477040, ack 3675183164, win 1028, options [nop,nop,TS val 25269994 ecr 43036039], length 1448
16:13:43.000945 IP 192.168.1.180.kerberos > 192.168.1.120.46104: Flags [.], seq 1448:2896, ack 1, win 1028, options [nop,nop,TS val 25269994 ecr 43036039], length 1448
16:13:43.001012 IP 192.168.1.120.46104 > 192.168.1.180.kerberos: Flags [.], ack 2896, win 1829, options [nop,nop,TS val 43036075 ecr 25269994], length 0
16:13:43.001408 IP 192.168.1.180.kerberos > 192.168.1.120.46104: Flags [.], seq 2896:4344, ack 1, win 1028, options [nop,nop,TS val 25269994 ecr 43036039], length 1448


arp -a ->
(proxmox /etc/network/interfaces (vmbr1))
? (192.168.1.140) at 40:16:7e:37:21:b0 [ether] on enp3s0
? (192.168.1.141) at <incomplete> on enp3s0
? (192.168.1.170) at 40:16:7e:37:21:b0 [ether] on enp3s0
? (192.168.1.1) at <incomplete> on enp3s0
? (192.168.1.180) at 00:ea:21:62:38:ce [ether] on enp3s0
? (192.168.1.110) at 40:6c:8f:2e:7b:18 [ether] on enp3s0


Browse:
192.168.1.140: This site can't be reached.
192.168.1.170: This site can't be reached.


/etc/network/interfaces ->
auto lo
iface lo inet loopback

auto enp3s0
iface enp3s0 inet static
address 192.168.1.120
netmask 255.255.255.0
network 192.168.1.0
gateway 192.168.1.170
dns-nameserver 8.8.8.8
dns-nameserver 8.8.4.4


ip a ->
1: lo: <LOOPBACK,UP,LOWER_UP>
2: enp3s0:  88:d7:f6:c9:08:eb   inet 192.168.1.120/24   brd 192.168.1.255


ping 192.168.1.140 connects.
ping 192.168.1.170 connects.


tcpdump ->
listening on enp3s0, link-type EN10MB (Ethernet), capture size 262144 bytes
14:08:12.531811 IP 192.168.1.120.38129 > 8.8.4.4.domain: 12667+ A? www.gstatic.com. (33)
14:08:12.532689 IP 192.168.1.120.36659 > 8.8.8.8.domain: 49236+ PTR? 4.4.8.8.in-addr.arpa. (38)
14:08:12.594481 IP 192.168.1.120.52437 > 8.8.4.4.domain: 43332+ A? ssl.gstatic.com. (33)
14:08:12.723172 IP 192.168.1.120.47361 > 8.8.8.8.domain: 29060+ A? www.google.com. (32)
14:08:13.114901 IP 192.168.1.120.37329 > 8.8.8.8.domain: 53626+ A? clients1.google.com. (37)
14:08:13.313828 IP 192.168.1.100.3073 > 255.255.255.255.6524: UDP, length 21
14:08:13.313963 IP 192.168.1.100.3073 > 255.255.255.255.6524: UDP, length 21
14:08:52.570690 IP 192.168.1.120.33680 > 8.8.8.8.domain: 52410+ PTR? 8.8.8.8.in-addr.arpa. (38)
14:09:12.591331 IP 192.168.1.120.42319 > 8.8.8.8.domain: 31462+ PTR? 255.255.255.255.in-addr.arpa. (46)
14:09:12.655930 IP 192.168.1.120.38962 > 8.8.4.4.domain: 22505+ A? ssl.gstatic.com. (33)
14:09:13.178822 IP 192.168.1.120.39281 > 8.8.8.8.domain: 8633+ A? clients1.google.com. (37)
14:09:13.417228 IP6 fe80::1:1 > ip6-allnodes: ICMP6, router advertisement, length 56
14:09:52.632532 IP 192.168.1.120.45379 > 8.8.8.8.domain: 38986+ PTR? 1.0.0.0.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.8.e.f.ip6.arpa. (90)
14:09:52.693869 IP 192.168.1.120.50304 > 8.8.4.4.domain: 46991+ A? ssl.gstatic.com. (33)
14:09:53.220149 IP 192.168.1.120.58060 > 8.8.8.8.domain: 52620+ A? clients1.google.com. (37)
14:09:53.248778 IP 192.168.1.120.45825 > 8.8.4.4.domain: 14240+ A? www.googleapis.com. (36)
14:09:53.532065 ARP, Request who-has 192.168.1.170 tell 192.168.1.140, length 46


arp -a ->
(proxmox /etc/network/interfaces (vmbr2))
? (192.168.1.140) at <incomplete> on enp3s0
? (192.168.1.141) at <incomplete> on enp3s0
? (192.168.1.170) at 40:16:7e:37:21:b0 [ether] on enp3s0
? (192.168.1.1) at <incomplete> on enp3s0
? (192.168.1.180) at 00:ea:21:62:38:ce [ether] on enp3s0
? (192.168.1.110) at 40:6c:8f:2e:7b:18 [ether] on enp3s0


Browse:
192.168.1.140: This site can't be reached.
192.168.1.170: This site can't be reached.


/etc/network/interfaces ->
auto lo
iface lo inet loopback

auto enp3s0
iface enp3s0 inet static
address 192.168.1.120
netmask 255.255.255.0
network 192.168.1.0
gateway 192.168.1.170
dns-nameserver 8.8.8.8
dns-nameserver 8.8.4.4


ip a ->
1: lo: <LOOPBACK,UP,LOWER_UP>
2: enp3s0:  88:d7:f6:c9:08:eb   inet 192.168.1.120/24   brd 192.168.1.255


ping 192.168.1.140 Destination Host Unreachable.
ping 192.168.1.170 -> Terminal freezes.


tcpdump ->
listening on enp3s0, link-type EN10MB (Ethernet), capture size 262144 bytes
16:53:30.104310 IP 192.168.1.180.kerberos > 192.168.1.120.46104: Flags [.], seq 947807923:947809371, ack 3675183164, win 1028, options [nop,nop,TS val 25507173 ecr 43632819], length 1448
16:53:30.104634 IP 192.168.1.180.kerberos > 192.168.1.120.46104: Flags [.], seq 1448:2896, ack 1, win 1028, options [nop,nop,TS val 25507173 ecr 43632819], length 1448
16:53:30.104702 IP 192.168.1.120.46104 > 192.168.1.180.kerberos: Flags [.], ack 2896, win 1829, options [nop,nop,TS val 43632851 ecr 25507173], length 0


Proxmox PC details:
Code:
arp -a ->
no output.


/etc/network/interfaces.eth0 ->
auto lo
iface lo inet loopback

iface eth0 inet static
    address 192.168.1.140
    netmask 255.255.255.0
    gateway 192.168.1.170

iface eth1 inet manual

auto vmbr0
iface vmbr0 inet manual
    bridge_ports none
    bridge_stp off
    bridge_fd 0

auto vmbr1
iface vmbr1 inet manual
    bridge_ports eth1
    bridge_stp off
    bridge_fd 0

auto vmbr2
iface vmbr2 inet manual
    bridge_ports eth2
    bridge_stp off
    bridge_fd 0


/etc/pve/qemu-server/143.conf ->
bootdisk: virtio0
cores: 2
ide2: local:iso/pfSense-CE-2.4.4-RELEASEp1-adm64.iso,media=cdrom
memory: 1024
name: RouterPfsense
net0: virtio=16:62:51:C6:E7:DE,bridge=vmbr0
net1: virtio=EE:1A:D6:89:DC:97,bridge=vmbr1
?uma: 0
?nboot: 1
?stype: other
?csihw: virtio-scsi-pci
?mbios1: uuid=cf318945-2812-4524-b919-ea13f4210341
sockets: 1
virtio0: local-zfs:vm-143-disk-1,size=8G


ip a ->
lo:         <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
eth0:       <BROADCAST,MULTICAST> mtu 1500 qdisc mq master vmbr0 state DOWN 40:16:7e:37:21:af
eth1:       <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr1 state UP 40:16:7e:37:21:b0
vmbr0:      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP c6:65:69:df:39:4c
vmbr1:      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP 40:16:7e:37:21:b0 
vmbr2:      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 16:f5:30:15:4b:eb
tap143i0:   <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UNKNOWN c6:65:69:df:39:4c
tap143i1:   <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr1 state UNKNOWN 4e:76:ec:86:dc:5f
tap145i0:   <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UNKNOWN 52:cc:a1:c6:3f:83


ping 192.168.1.120 Network is unreachable.
ping 192.168.1.170 Network is unreachable.


Port lights:
top port: no lights.
bottom port: top green blinking, bottom green on.


tcpdump ->
listening on vmbr0, link-type EN10MB (Ethernet), capture size 262144 bytes
IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, Request from 16:62:51:c6:e7:de (oui Unknown), length 300


ETH1:
arp -a ->
no output.


/etc/network/interfaces.eth1 ->
auto lo
iface lo inet loopback

iface eth0 inet manual

iface eth1 inet static
    address 192.168.1.140
    netmask 255.255.255.0
    gateway 192.168.1.170

auto vmbr0
iface vmbr0 inet manual
    bridge_ports none
    bridge_stp off
    bridge_fd 0

auto vmbr1
iface vmbr1 inet manual
    bridge_ports eth1
    bridge_stp off
    bridge_fd 0

auto vmbr2
iface vmbr2 inet manual
    bridge_ports eth2
    bridge_stp off
    bridge_fd 0


/etc/pve/qemu-server/143.conf ->
bootdisk: virtio0
cores: 2
ide2: local:iso/pfSense-CE-2.4.4-RELEASEp1-adm64.iso,media=cdrom
memory: 1024
name: RouterPfsense
net0: virtio=16:62:51:C6:E7:DE,bridge=vmbr0
net1: virtio=EE:1A:D6:89:DC:97,bridge=vmbr1
?uma: 0
?nboot: 1
?stype: other
?csihw: virtio-scsi-pci
?mbios1: uuid=cf318945-2812-4524-b919-ea13f4210341
sockets: 1
virtio0: local-zfs:vm-143-disk-1,size=8G


ip a ->
lo:         <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
eth0:       <BROADCAST,MULTICAST> mtu 1500 qdisc mq master vmbr0 state DOWN 40:16:7e:37:21:af
eth1:       <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr1 state UP 40:16:7e:37:21:b0
vmbr0:      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP ba:f2:bd:af:59:25
vmbr1:      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP 40:16:7e:37:21:b0 
vmbr2:      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 56:99:ce:95:2a:Bd
tap143i0:   <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UNKNOWN ba:f2:bd:af:59:25
tap143i1:   <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr1 state UNKNOWN e6:a2:d1:23:81:0a
tap145i0:   <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UNKNOWN ba:e3:f6:25:46:18


ping 192.168.1.120 Network is unreachable.
ping 192.168.1.170 Network is unreachable.


Port lights:
top port: no lights.
bottom port: top green blinking, bottom green on.


tcpdump ->
listening on vmbr0, link-type EN10MB (Ethernet), capture size 262144 bytes
IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, Request from 16:62:51:c6:e7:de (oui Unknown), length 300
ARP, Request who-has 192.168.1.170 tell 192.168.1.145, length 46


VMBR0:
arp -a ->
(192.168.1.170) at <incomplete> on vmbr0


/etc/network/interfaces.vmbr0 ->
auto lo
iface lo inet loopback

iface eth0 inet manual

iface eth1 inet manual

auto vmbr0
iface vmbr0 inet static
    address 192.168.1.140
    netmask 255.255.255.0
    gateway 192.168.1.170
    bridge_ports none
    bridge_stp off
    bridge_fd 0

auto vmbr1
iface vmbr1 inet manual
    bridge_ports eth1
    bridge_stp off
    bridge_fd 0

auto vmbr2
iface vmbr2 inet manual
    bridge_ports eth2
    bridge_stp off
    bridge_fd 0


/etc/pve/qemu-server/143.conf ->
bootdisk: virtio0
cores: 2
ide2: local:iso/pfSense-CE-2.4.4-RELEASEp1-adm64.iso,media=cdrom
memory: 1024
name: RouterPfsense
net0: virtio=16:62:51:C6:E7:DE,bridge=vmbr0
net1: virtio=EE:1A:D6:89:DC:97,bridge=vmbr1
?uma: 0
?nboot: 1
?stype: other
?csihw: virtio-scsi-pci
?mbios1: uuid=cf318945-2812-4524-b919-ea13f4210341
sockets: 1
virtio0: local-zfs:vm-143-disk-1,size=8G


ip a ->
lo:         <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
eth0:       <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq master vmbr0 state DOWN 40:16:7e:37:21:af
eth1:       <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr1 state UP 40:16:7e:37:21:b0
vmbr0:      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP 40:16:7e:37:21:af inet 192.168.1.140/24 brd 192.168.1.255
vmbr1:      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP 40:16:7e:37:21:b0 
vmbr2:      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN ee:99:4b:79:60:dc
tap143i0:   <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UNKNOWN 12:69:95:9c:6d:5a
tap143i1:   <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr1 state UNKNOWN f3:93:ac:94:ed:93
tap145i0:   <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UNKNOWN 86:f9:8a:96:87:ef


ping 192.168.1.120 Destination Host Unreachable
ping 192.168.1.170 Destination Host Unreachable


Port lights:
top port: no lights.
bottom port: top green blinking, bottom green on.


tcpdump ->
listening on vmbr0, link-type EN10MB (Ethernet), capture size 262144 bytes
ARP, Requestwho-has 192.168.1.170 tell proxmox.com, length 28
IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, Request from 16:62:51:c6:e7:de (oui Unknown), length 300


VMBR1:
arp -a ->
(192.168.1.170) at <incomplete> on vmbr1
(192.168.1.120) at 88:d7:f6:c9:08:eb [ether] on vmbr1


/etc/network/interfaces.vmbr1 ->
auto lo
iface lo inet loopback

iface eth0 inet manual

iface eth1 inet manual

auto vmbr0
iface vmbr0 inet manual
    bridge_ports none
    bridge_stp off
    bridge_fd 0

auto vmbr1
iface vmbr1 inet static
    address 192.168.1.140
    netmask 255.255.255.0
    gateway 192.168.1.170
    bridge_ports eth1
    bridge_stp off
    bridge_fd 0

auto vmbr2
iface vmbr2 inet manual
    bridge_ports eth2
    bridge_stp off
    bridge_fd 0


/etc/pve/qemu-server/143.conf ->
bootdisk: virtio0
cores: 2
ide2: local:iso/pfSense-CE-2.4.4-RELEASEp1-adm64.iso,media=cdrom
memory: 1024
name: RouterPfsense
net0: virtio=16:62:51:C6:E7:DE,bridge=vmbr0
net1: virtio=EE:1A:D6:89:DC:97,bridge=vmbr1
?uma: 0
?nboot: 1
?stype: other
?csihw: virtio-scsi-pci
?mbios1: uuid=cf318945-2812-4524-b919-ea13f4210341
sockets: 1
virtio0: local-zfs:vm-143-disk-1,size=8G


ip a ->
lo:         <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
eth0:       <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 40:16:7e:37:21:af
eth1:       <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr1 state UP 40:16:7e:37:21:b0
vmbr0:      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP aa:94:c6:9:e1:0f
vmbr1:      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP 40:16:7e:37:21:b0  inet 192.168.1.140/24 brd 192.168.1.255
vmbr2:      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN fa:5a:a3:1e:5e:ae
tap143i0:   <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UNKNOWN aa:94:c6:91:e1:0f
tap143i1:   <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr1 state UNKNOWN a2:aa:c6:fe:1a:9e
tap145i0:   <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UNKNOWN ae:78:60:05:51:75


ping 192.168.1.120: connects.
ping 192.168.1.170: Destination Host Unreachable.


Port lights:
top port: no lights.
bottom port: top green blinking, bottom green on.


tcpdump ->
listening on vmbr0, link-type EN10MB (Ethernet), capture size 262144 bytes
IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, Request from 16:62:51:c6:e7:de (oui Unknown), length 300


VMBR2:
arp -a ->
(192.168.1.170) at <incomplete> on vmbr2


/etc/network/interfaces.vmbr2 ->
auto lo
iface lo inet loopback

iface eth0 inet manual

iface eth1 inet manual

auto vmbr0
iface vmbr0 inet manual
    bridge_ports none
    bridge_stp off
    bridge_fd 0

auto vmbr1
iface vmbr1 inet manual
    bridge_ports eth1
    bridge_stp off
    bridge_fd 0

auto vmbr2
iface vmbr2 inet static
    address 192.168.1.140
    netmask 255.255.255.0
    gateway 192.168.1.170
    bridge_ports eth2
    bridge_stp off
    bridge_fd 0


/etc/pve/qemu-server/143.conf ->
bootdisk: virtio0
cores: 2
ide2: local:iso/pfSense-CE-2.4.4-RELEASEp1-adm64.iso,media=cdrom
memory: 1024
name: RouterPfsense
net0: virtio=16:62:51:C6:E7:DE,bridge=vmbr0
net1: virtio=EE:1A:D6:89:DC:97,bridge=vmbr1
?uma: 0
?nboot: 1
?stype: other
?csihw: virtio-scsi-pci
?mbios1: uuid=cf318945-2812-4524-b919-ea13f4210341
sockets: 1
virtio0: local-zfs:vm-143-disk-1,size=8G


ip a ->
lo:         <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
eth0:       <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN 40:16:7e:37:21:af
eth1:       <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq master vmbr1 state UP 40:16:7e:37:21:b0
vmbr0:      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP c6:8f:eb:50:c0:3e
vmbr1:      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP 40:16:7e:37:21:b0
vmbr2:      <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN 62:f1:ad:b3:22:9d inet 192.168.1.140/24 brd 192.168.1.255
tap143i0:   <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UNKNOWN c6:8f:eb:50:c0:3e
tap143i1:   <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr1 state UNKNOWN 7e:8f:d3:0b:5c:86
tap145i0:   <BROADCAST,MULTICAST,PROMISC,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast master vmbr0 state UNKNOWN 1e:8d:83:6b:cb:89


ping 192.168.1.120: Destination Host Unreachable.
ping 192.168.1.170: Destination Host Unreachable.


Port lights:
top port: no lights.
bottom port: top green blinking, bottom green on.


tcpdump ->
listening on vmbr0, link-type EN10MB (Ethernet), capture size 262144 bytes
IP 0.0.0.0.bootpc > 255.255.255.255.bootps: BOOTP/DHCP, Request from 16:62:51:c6:e7:de (oui Unknown), length 300
ARP, Request who-has 192.168.1.170 tell 192.168.1.145, length 46
 
192.168.1.120:
Code:
route -n ->
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
0.0.0.0         192.168.1.170   0.0.0.0         UG    0      0        0 enp3s0
169.254.0.0     0.0.0.0         255.255.0.0     U     1000   0        0 enp3s0
192.168.1.0     0.0.0.0         255.255.255.0   U     0      0        0 enp3s0

192.168.1.140:
Code:
(eth0)
route -n ->
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface


(eth1)
route -n ->
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface


route -n:
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
0.0.0.0         192.168.1.170   0.0.0.0         UG    0      0        0 vmbr0
192.168.1.0     0.0.0.0         255.255.255.0   U     0      0        0 vmbr0


route -n ->
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
0.0.0.0         192.168.1.170   0.0.0.0         UG    0      0        0 vmbr1
192.168.1.0     0.0.0.0         255.255.255.0   U     0      0        0 vmbr1


route -n ->
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
0.0.0.0         192.168.1.170   0.0.0.0         UG    0      0        0 vmbr2
192.168.1.0     0.0.0.0         255.255.255.0   U     0      0        0 vmbr2
 
I think I may have messed up the Proxmox /etc/network/interface settings for eth0 or eth1?
Is it notable that the NIC0 doesn't light up, even with a cable connected...only NIC1 seems to work.
 
Check if your adapters really discovered as eth0 and not with the new biosdevnames. It seems you have the biosdevnames in your routing table but in the config you are still using eth0.
 
How do I do this? It's likely something like this or the MAC addresses, which may have been messed up upon setting up bridges to a vm pfsense.
 
All fixed!
I didn't fully understand the results from $ip link.
Figured out how the eth0,eth1,vmbr0 and vmbr1 interfaces connected to each other and that master vmbrX is the parent of the ethX. From there was easy to read the UP DOWN statuses and then configure /etc/network/interfaces correctly.
 
Now I am only unclear on what happens when my new vm router fails. The network will be down and I'll need to access Proxmox to repair the vm router.
I have 2 NICs, a 3rd NIC would allow Proxmox management, however I think there's a way to work with 2 NICs, but don't have my head around it just yet.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!