currently i am having this probelm
connection to proxmox managment is fine, after a while VM's stop repsonding to pings or any kind of traffic. 2 nodes 1 truenas server not hosted on proxmox. any of the machines have to re rebooted in order for comms to re establish.
all use 10gbe both severs have all firmware updates and possible updates both are cisco BE6k m3's. each server has a BCM57810 installed.
here is my networking config
auto lo
iface lo inet loopback
auto enp3s0f0
iface enp3s0f0 inet manual
mtu 9126
bridge-stp off
#Prod
auto enp1s0f0
iface enp1s0f0 inet manual
# Test
auto enp1s0f1
iface enp1s0f1 inet manual
auto enp3s0f1
iface enp3s0f1 inet manual
mtu 9126
auto vmbr0
iface vmbr0 inet static
address xxx.xxx.xxx.xxx/16
gateway xxx.xxx.xxx.xxx
bridge-ports enp3s0f0
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094
mtu 9126
auto vmbr1
iface vmbr1 inet static
address xxx.xxx.xxx.xxx/23
bridge-ports enp1s0f0
bridge-stp off
bridge-fd 0
auto vlan3
iface vlan3 inet manual
mtu 9126
vlan-raw-device vmbr0
auto vlan10
iface vlan10 inet manual
mtu 9126
vlan-raw-device vmbr0
auto vlan800
iface vlan800 inet static
address xxx.xxx.xxx.xxx/24
mtu 9126
vlan-raw-device enp3s0f0
auto vlan880
iface vlan880 inet manual
mtu 9126
vlan-raw-device vmbr0
nothing in prod uses the test nic.
i do see this alot though.
Jul 11 19:11:57 pve1 kernel: net_ratelimit: 148 callbacks suppressed
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
FWIW vlan 60 is a remote span, has nothing to do with the devices.
pve version
proxmox-ve: 8.3.0 (running kernel: 6.8.12-8-pve)
pve-manager: 8.3.5 (running version: 8.3.5/dac3aa88bac3f300)
proxmox-kernel-helper: 8.1.1
proxmox-kernel-6.8: 6.8.12-8
proxmox-kernel-6.8.12-8-pve-signed: 6.8.12-8
proxmox-kernel-6.8.12-4-pve-signed: 6.8.12-4
ceph-fuse: 17.2.7-pve3
corosync: 3.1.7-pve3
criu: 3.17.1-2+deb12u1
glusterfs-client: 10.3-5
ifupdown2: 3.2.0-1+pmx11
ksm-control-daemon: 1.5-1
libjs-extjs: 7.0.0-5
libknet1: 1.28-pve1
libproxmox-acme-perl: 1.6.0
libproxmox-backup-qemu0: 1.5.1
libproxmox-rs-perl: 0.3.5
libpve-access-control: 8.2.0
libpve-apiclient-perl: 3.3.2
libpve-cluster-api-perl: 8.0.10
libpve-cluster-perl: 8.0.10
libpve-common-perl: 8.2.9
libpve-guest-common-perl: 5.1.6
libpve-http-server-perl: 5.2.0
libpve-network-perl: 0.10.1
libpve-rs-perl: 0.9.2
libpve-storage-perl: 8.3.3
libspice-server1: 0.15.1-1
lvm2: 2.03.16-2
lxc-pve: 6.0.0-1
lxcfs: 6.0.0-pve2
novnc-pve: 1.5.0-1
proxmox-backup-client: 3.3.3-1
proxmox-backup-file-restore: 3.3.3-1
proxmox-firewall: 0.6.0
proxmox-kernel-helper: 8.1.1
proxmox-mail-forward: 0.3.1
proxmox-mini-journalreader: 1.4.0
proxmox-offline-mirror-helper: 0.6.7
proxmox-widget-toolkit: 4.3.6
pve-cluster: 8.0.10
pve-container: 5.2.4
pve-docs: 8.3.1
pve-edk2-firmware: 4.2023.08-4
pve-esxi-import-tools: 0.7.2
pve-firewall: 5.1.0
pve-firmware: 3.14-3
pve-ha-manager: 4.0.6
pve-i18n: 3.4.0
pve-qemu-kvm: 9.2.0-2
pve-xtermjs: 5.3.0-3
qemu-server: 8.3.8
smartmontools: 7.3-pve1
spiceterm: 3.3.0
swtpm: 0.8.0+pve1
vncterm: 1.8.0
zfsutils-linux: 2.2.7-pve1
connection to proxmox managment is fine, after a while VM's stop repsonding to pings or any kind of traffic. 2 nodes 1 truenas server not hosted on proxmox. any of the machines have to re rebooted in order for comms to re establish.
all use 10gbe both severs have all firmware updates and possible updates both are cisco BE6k m3's. each server has a BCM57810 installed.
here is my networking config
auto lo
iface lo inet loopback
auto enp3s0f0
iface enp3s0f0 inet manual
mtu 9126
bridge-stp off
#Prod
auto enp1s0f0
iface enp1s0f0 inet manual
# Test
auto enp1s0f1
iface enp1s0f1 inet manual
auto enp3s0f1
iface enp3s0f1 inet manual
mtu 9126
auto vmbr0
iface vmbr0 inet static
address xxx.xxx.xxx.xxx/16
gateway xxx.xxx.xxx.xxx
bridge-ports enp3s0f0
bridge-stp off
bridge-fd 0
bridge-vlan-aware yes
bridge-vids 2-4094
mtu 9126
auto vmbr1
iface vmbr1 inet static
address xxx.xxx.xxx.xxx/23
bridge-ports enp1s0f0
bridge-stp off
bridge-fd 0
auto vlan3
iface vlan3 inet manual
mtu 9126
vlan-raw-device vmbr0
auto vlan10
iface vlan10 inet manual
mtu 9126
vlan-raw-device vmbr0
auto vlan800
iface vlan800 inet static
address xxx.xxx.xxx.xxx/24
mtu 9126
vlan-raw-device enp3s0f0
auto vlan880
iface vlan880 inet manual
mtu 9126
vlan-raw-device vmbr0
nothing in prod uses the test nic.
i do see this alot though.
Jul 11 19:11:57 pve1 kernel: net_ratelimit: 148 callbacks suppressed
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
Jul 11 19:11:57 pve1 kernel: vmbr0: received packet on enp3s0f0 with own address as source address (addr:9c:dc:71:6f:10:e8, vlan:60)
FWIW vlan 60 is a remote span, has nothing to do with the devices.
pve version
proxmox-ve: 8.3.0 (running kernel: 6.8.12-8-pve)
pve-manager: 8.3.5 (running version: 8.3.5/dac3aa88bac3f300)
proxmox-kernel-helper: 8.1.1
proxmox-kernel-6.8: 6.8.12-8
proxmox-kernel-6.8.12-8-pve-signed: 6.8.12-8
proxmox-kernel-6.8.12-4-pve-signed: 6.8.12-4
ceph-fuse: 17.2.7-pve3
corosync: 3.1.7-pve3
criu: 3.17.1-2+deb12u1
glusterfs-client: 10.3-5
ifupdown2: 3.2.0-1+pmx11
ksm-control-daemon: 1.5-1
libjs-extjs: 7.0.0-5
libknet1: 1.28-pve1
libproxmox-acme-perl: 1.6.0
libproxmox-backup-qemu0: 1.5.1
libproxmox-rs-perl: 0.3.5
libpve-access-control: 8.2.0
libpve-apiclient-perl: 3.3.2
libpve-cluster-api-perl: 8.0.10
libpve-cluster-perl: 8.0.10
libpve-common-perl: 8.2.9
libpve-guest-common-perl: 5.1.6
libpve-http-server-perl: 5.2.0
libpve-network-perl: 0.10.1
libpve-rs-perl: 0.9.2
libpve-storage-perl: 8.3.3
libspice-server1: 0.15.1-1
lvm2: 2.03.16-2
lxc-pve: 6.0.0-1
lxcfs: 6.0.0-pve2
novnc-pve: 1.5.0-1
proxmox-backup-client: 3.3.3-1
proxmox-backup-file-restore: 3.3.3-1
proxmox-firewall: 0.6.0
proxmox-kernel-helper: 8.1.1
proxmox-mail-forward: 0.3.1
proxmox-mini-journalreader: 1.4.0
proxmox-offline-mirror-helper: 0.6.7
proxmox-widget-toolkit: 4.3.6
pve-cluster: 8.0.10
pve-container: 5.2.4
pve-docs: 8.3.1
pve-edk2-firmware: 4.2023.08-4
pve-esxi-import-tools: 0.7.2
pve-firewall: 5.1.0
pve-firmware: 3.14-3
pve-ha-manager: 4.0.6
pve-i18n: 3.4.0
pve-qemu-kvm: 9.2.0-2
pve-xtermjs: 5.3.0-3
qemu-server: 8.3.8
smartmontools: 7.3-pve1
spiceterm: 3.3.0
swtpm: 0.8.0+pve1
vncterm: 1.8.0
zfsutils-linux: 2.2.7-pve1
