Packet loss and high ping after upgrade to proxmox 7.x

wolowizard

New Member
Dec 8, 2021
1
0
1
45
Hi,

I upgrade my proxmox server from 6.4 to the latest version, and after that I have to much packet loss from my bgp virtual machine and sometimes high ping...
On bgp virtual machine I have passthrough network card.


Default grub setting for passthrough on proxmox host:

Code:
GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on"

after reboot:

Code:
dmesg | grep -e DMAR -e IOMMU -e AMD-Vi
[    0.013667] ACPI: DMAR 0x000000007D3346F4 000158 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.013717] ACPI: Reserving DMAR table memory at [mem 0x7d3346f4-0x7d33484b]
[    0.453412] DMAR: IOMMU enabled
[    1.060460] DMAR: Host address width 46
[    1.060461] DMAR: DRHD base: 0x000000cf000000 flags: 0x0
[    1.060467] DMAR: dmar0: reg_base_addr cf000000 ver 1:0 cap d2078c106f0466 ecap f020de
[    1.060469] DMAR: DRHD base: 0x000000dc900000 flags: 0x1
[    1.060473] DMAR: dmar1: reg_base_addr dc900000 ver 1:0 cap d2078c106f0466 ecap f020de
[    1.060475] DMAR: RMRR base: 0x0000007f458000 end: 0x0000007f46ffff
[    1.060477] DMAR: RMRR base: 0x0000007f450000 end: 0x0000007f450fff
[    1.060478] DMAR: RMRR base: 0x0000007f452000 end: 0x0000007f452fff
[    1.060479] DMAR: ATSR flags: 0x0
[    1.060481] DMAR-IR: IOAPIC id 2 under DRHD base  0xcf000000 IOMMU 0
[    1.060483] DMAR-IR: IOAPIC id 0 under DRHD base  0xdc900000 IOMMU 1
[    1.060484] DMAR-IR: IOAPIC id 1 under DRHD base  0xdc900000 IOMMU 1
[    1.060486] DMAR-IR: HPET id 0 under DRHD base 0xdc900000
[    1.060487] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit.
[    1.060488] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting.
[    1.061104] DMAR-IR: Enabled IRQ remapping in xapic mode
[    1.493794] DMAR: No SATC found
[    1.493798] DMAR: dmar0: Using Queued invalidation
[    1.493809] DMAR: dmar1: Using Queued invalidation
[    1.551438] DMAR: Intel(R) Virtualization Technology for Directed I/O

find /sys/kernel/iommu_groups/ -type l
/sys/kernel/iommu_groups/55/devices/0000:40:05.2
/sys/kernel/iommu_groups/17/devices/0000:01:00.1
/sys/kernel/iommu_groups/45/devices/0000:3f:10.4
/sys/kernel/iommu_groups/73/devices/0000:7f:10.4
/sys/kernel/iommu_groups/35/devices/0000:3f:0f.0
/sys/kernel/iommu_groups/7/devices/0000:00:05.2
/sys/kernel/iommu_groups/63/devices/0000:7f:0f.0
/sys/kernel/iommu_groups/25/devices/0000:08:00.0
/sys/kernel/iommu_groups/53/devices/0000:40:03.2
/sys/kernel/iommu_groups/15/devices/0000:00:1f.2
/sys/kernel/iommu_groups/15/devices/0000:00:1f.0
/sys/kernel/iommu_groups/43/devices/0000:3f:10.2
/sys/kernel/iommu_groups/71/devices/0000:7f:10.2
/sys/kernel/iommu_groups/33/devices/0000:3f:0d.3
/sys/kernel/iommu_groups/33/devices/0000:3f:0d.1
/sys/kernel/iommu_groups/33/devices/0000:3f:0d.4
/sys/kernel/iommu_groups/33/devices/0000:3f:0d.2
/sys/kernel/iommu_groups/33/devices/0000:3f:0d.0
/sys/kernel/iommu_groups/5/devices/0000:00:03.2
/sys/kernel/iommu_groups/61/devices/0000:7f:0d.0
/sys/kernel/iommu_groups/61/devices/0000:7f:0d.3
/sys/kernel/iommu_groups/61/devices/0000:7f:0d.1
/sys/kernel/iommu_groups/61/devices/0000:7f:0d.4
/sys/kernel/iommu_groups/61/devices/0000:7f:0d.2
/sys/kernel/iommu_groups/23/devices/0000:03:00.2
/sys/kernel/iommu_groups/51/devices/0000:40:02.0
/sys/kernel/iommu_groups/13/devices/0000:00:1d.0
/sys/kernel/iommu_groups/41/devices/0000:3f:10.0
/sys/kernel/iommu_groups/31/devices/0000:3f:0b.0
/sys/kernel/iommu_groups/31/devices/0000:3f:0b.3
/sys/kernel/iommu_groups/3/devices/0000:00:02.2
/sys/kernel/iommu_groups/21/devices/0000:03:00.0
/sys/kernel/iommu_groups/11/devices/0000:00:1c.0
/sys/kernel/iommu_groups/68/devices/0000:7f:0f.5
/sys/kernel/iommu_groups/1/devices/0000:00:01.0
/sys/kernel/iommu_groups/58/devices/0000:7f:0a.0
/sys/kernel/iommu_groups/58/devices/0000:7f:0a.3
/sys/kernel/iommu_groups/58/devices/0000:7f:0a.1
/sys/kernel/iommu_groups/58/devices/0000:7f:0a.2
/sys/kernel/iommu_groups/48/devices/0000:3f:13.0
/sys/kernel/iommu_groups/48/devices/0000:3f:13.5
/sys/kernel/iommu_groups/48/devices/0000:3f:13.1
/sys/kernel/iommu_groups/48/devices/0000:3f:13.4
/sys/kernel/iommu_groups/76/devices/0000:7f:13.4
/sys/kernel/iommu_groups/76/devices/0000:7f:13.0
/sys/kernel/iommu_groups/76/devices/0000:7f:13.5
/sys/kernel/iommu_groups/76/devices/0000:7f:13.1
/sys/kernel/iommu_groups/38/devices/0000:3f:0f.3
/sys/kernel/iommu_groups/66/devices/0000:7f:0f.3
/sys/kernel/iommu_groups/28/devices/0000:3f:08.0
/sys/kernel/iommu_groups/56/devices/0000:7f:08.0
/sys/kernel/iommu_groups/18/devices/0000:01:00.2
/sys/kernel/iommu_groups/46/devices/0000:3f:10.5
/sys/kernel/iommu_groups/74/devices/0000:7f:10.5
/sys/kernel/iommu_groups/36/devices/0000:3f:0f.1
/sys/kernel/iommu_groups/8/devices/0000:00:11.0
/sys/kernel/iommu_groups/64/devices/0000:7f:0f.1
/sys/kernel/iommu_groups/26/devices/0000:09:00.0
/sys/kernel/iommu_groups/26/devices/0000:0b:00.0
/sys/kernel/iommu_groups/26/devices/0000:0a:00.0
/sys/kernel/iommu_groups/54/devices/0000:40:05.0
/sys/kernel/iommu_groups/16/devices/0000:01:00.0
/sys/kernel/iommu_groups/44/devices/0000:3f:10.3
/sys/kernel/iommu_groups/72/devices/0000:7f:10.3
/sys/kernel/iommu_groups/34/devices/0000:3f:0e.1
/sys/kernel/iommu_groups/34/devices/0000:3f:0e.0
/sys/kernel/iommu_groups/6/devices/0000:00:05.0
/sys/kernel/iommu_groups/62/devices/0000:7f:0e.1
/sys/kernel/iommu_groups/62/devices/0000:7f:0e.0
/sys/kernel/iommu_groups/24/devices/0000:03:00.3
/sys/kernel/iommu_groups/52/devices/0000:40:03.0
/sys/kernel/iommu_groups/14/devices/0000:00:1e.0
/sys/kernel/iommu_groups/42/devices/0000:3f:10.1
/sys/kernel/iommu_groups/70/devices/0000:7f:10.1
/sys/kernel/iommu_groups/32/devices/0000:3f:0c.4
/sys/kernel/iommu_groups/32/devices/0000:3f:0c.2
/sys/kernel/iommu_groups/32/devices/0000:3f:0c.0
/sys/kernel/iommu_groups/32/devices/0000:3f:0c.3
/sys/kernel/iommu_groups/32/devices/0000:3f:0c.1
/sys/kernel/iommu_groups/4/devices/0000:00:03.0
/sys/kernel/iommu_groups/60/devices/0000:7f:0c.4
/sys/kernel/iommu_groups/60/devices/0000:7f:0c.2
/sys/kernel/iommu_groups/60/devices/0000:7f:0c.0
/sys/kernel/iommu_groups/60/devices/0000:7f:0c.3
/sys/kernel/iommu_groups/60/devices/0000:7f:0c.1
/sys/kernel/iommu_groups/22/devices/0000:03:00.1
/sys/kernel/iommu_groups/50/devices/0000:40:01.0
/sys/kernel/iommu_groups/12/devices/0000:00:1c.7
/sys/kernel/iommu_groups/40/devices/0000:3f:0f.5
/sys/kernel/iommu_groups/69/devices/0000:7f:10.0
/sys/kernel/iommu_groups/30/devices/0000:3f:0a.3
/sys/kernel/iommu_groups/30/devices/0000:3f:0a.1
/sys/kernel/iommu_groups/30/devices/0000:3f:0a.2
/sys/kernel/iommu_groups/30/devices/0000:3f:0a.0
/sys/kernel/iommu_groups/2/devices/0000:00:02.0
/sys/kernel/iommu_groups/59/devices/0000:7f:0b.3
/sys/kernel/iommu_groups/59/devices/0000:7f:0b.0
/sys/kernel/iommu_groups/20/devices/0000:02:00.0
/sys/kernel/iommu_groups/49/devices/0000:3f:16.2
/sys/kernel/iommu_groups/49/devices/0000:3f:16.0
/sys/kernel/iommu_groups/49/devices/0000:3f:16.1
/sys/kernel/iommu_groups/77/devices/0000:7f:16.2
/sys/kernel/iommu_groups/77/devices/0000:7f:16.0
/sys/kernel/iommu_groups/77/devices/0000:7f:16.1
/sys/kernel/iommu_groups/10/devices/0000:00:1a.0
/sys/kernel/iommu_groups/39/devices/0000:3f:0f.4
/sys/kernel/iommu_groups/67/devices/0000:7f:0f.4
/sys/kernel/iommu_groups/29/devices/0000:3f:09.0
/sys/kernel/iommu_groups/0/devices/0000:00:00.0
/sys/kernel/iommu_groups/57/devices/0000:7f:09.0
/sys/kernel/iommu_groups/19/devices/0000:01:00.3
/sys/kernel/iommu_groups/47/devices/0000:3f:10.7
/sys/kernel/iommu_groups/75/devices/0000:7f:10.7
/sys/kernel/iommu_groups/37/devices/0000:3f:0f.2
/sys/kernel/iommu_groups/9/devices/0000:00:16.0
/sys/kernel/iommu_groups/9/devices/0000:00:16.1
/sys/kernel/iommu_groups/65/devices/0000:7f:0f.2
/sys/kernel/iommu_groups/27/devices/0000:09:01.0

BPG machines is based on debian 10.10 with kernel:

Code:
4.19.0-17-amd64 #1 SMP Debian 4.19.194-3 (2021-07-18) x86_64 GNU/Linux

lspci
00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] (rev 02)
00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II]
00:01.1 IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]
00:01.2 USB controller: Intel Corporation 82371SB PIIX3 USB [Natoma/Triton II] (rev 01)
00:01.3 Bridge: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 03)
00:02.0 VGA compatible controller: Device 1234:1111 (rev 02)
00:03.0 Unclassified device [00ff]: Red Hat, Inc Virtio memory balloon
00:05.0 SCSI storage controller: Red Hat, Inc Virtio SCSI
00:10.0 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
00:1e.0 PCI bridge: Red Hat, Inc. QEMU PCI-PCI bridge
00:1f.0 PCI bridge: Red Hat, Inc. QEMU PCI-PCI bridge

Any ideas what changed that I have network problem on my virtual machine after upgrade?
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!