Opt-in Linux 6.5 Kernel with ZFS 2.2 for Proxmox VE 8 available on test & no-subscription

[d0glesby]

Interesting. I just checked and the x2APIC Mode is enabled on my Dell PowerEdge R740.

Looked at three of my R730 systems I have for testing, and x2APIC was disabled on all of those. I'm going to enable x2APIC and see if that triggers any bad behavior from the kernel on the R730 systems.

 

[d0glesby]

Interesting. I just checked and the x2APIC Mode is enabled on my Dell PowerEdge R740.

Looked at three of my R730 systems I have for testing, and x2APIC was disabled on all of those. I'm going to enable x2APIC and see if that triggers any bad behavior from the kernel on the R730 systems.

So far, so good on the R730 systems after enabling x2APIC. All three are fresh installs of 8.1, fully updated, and running as a hyperconverged cluster (PVE + Ceph on all nodes).

Edit to add: The R740 previously mentioned, and the three R730 systems are dual CPU socket systems, with dual physical CPUs installed, if that makes a difference comparing data with other systems that are having issues.

 

[mmenaz]

I contirm disabling x2APIC works!
Dell PowerEdge R240

 

[ivenae]

I contirm disabling x2APIC works!

Problem found. Thanks to all.

is it possible to fix that in the kernel instead of changing the bios, because this is a regression.

 

[sl4vik]

Same here: after deactivating x2APIC, Dell Poweredge T140 is working with 6.5 kernel.

Is there a possibility to fix that in the kernel instead of changing the bios, because this is a regression.

But I would also agree to this. It should work without the need to change bios settings.

 

[llevet]

I confirm on Dell PowerEdge T340 disabling x2APIC works with 6.5 kernel.

 

[llevet]

It seem to be a kernel regression as on 6.2 kernel x2APIC works well :
.
..
[Mon Jan 8 16:08:45 2024] x2apic: enabled by BIOS, switching to x2apic ops
[Mon Jan 8 16:08:45 2024] Setting APIC routing to cluster x2apic.
[Mon Jan 8 16:08:45 2024] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[Mon Jan 8 16:08:45 2024] DMAR-IR: Enabled IRQ remapping in x2apic mode
[Mon Jan 8 16:08:45 2024] x2apic enabled
...

 

[d0glesby]

Here's what I'm seeing on my systems with x2apic enabled in BIOS running the 6.5 kernel:

Dell R740:

root@test-r740-pve:~# dmesg | grep -i x2apic
[    0.000695] x2apic: enabled by BIOS, switching to x2apic ops
[    0.008418] Setting APIC routing to cluster x2apic.
[    0.445745] ACPI: X2APIC_NMI (uid[0xffffffff] high level lint[0x1])
[    1.068963] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[    1.070836] DMAR-IR: Enabled IRQ remapping in x2apic mode
root@test-r740-pve:~# uname -a
Linux test-r740-pve 6.5.11-7-pve #1 SMP PREEMPT_DYNAMIC PMX 6.5.11-7 (2023-12-05T09:44Z) x86_64 GNU/Linux
root@test-r740-pve:~# grep "model name" /proc/cpuinfo | sort -u
model name      : Intel(R) Xeon(R) Platinum 8280 CPU @ 2.70GHz

Dell R730:

root@usd-pve-hcc-201:~# dmesg | grep -i x2apic
[    0.000385] x2apic: enabled by BIOS, switching to x2apic ops
[    0.008701] Setting APIC routing to cluster x2apic.
[    0.562358] ACPI: X2APIC_NMI (uid[0x00] high level lint[0x1])
[    0.562360] ACPI: X2APIC_NMI (uid[0x01] high level lint[0x1])
[    0.562361] ACPI: X2APIC_NMI (uid[0x02] high level lint[0x1])
[    0.562361] ACPI: X2APIC_NMI (uid[0x03] high level lint[0x1])
[    0.562362] ACPI: X2APIC_NMI (uid[0x04] high level lint[0x1])
[    0.562363] ACPI: X2APIC_NMI (uid[0x05] high level lint[0x1])
[    0.562364] ACPI: X2APIC_NMI (uid[0x06] high level lint[0x1])
[    0.562365] ACPI: X2APIC_NMI (uid[0x07] high level lint[0x1])
[    0.562366] ACPI: X2APIC_NMI (uid[0x08] high level lint[0x1])
[    0.562367] ACPI: X2APIC_NMI (uid[0x09] high level lint[0x1])
[    0.562368] ACPI: X2APIC_NMI (uid[0x0a] high level lint[0x1])
[    0.562368] ACPI: X2APIC_NMI (uid[0x0b] high level lint[0x1])
[    0.562369] ACPI: X2APIC_NMI (uid[0x0c] high level lint[0x1])
[    0.562370] ACPI: X2APIC_NMI (uid[0x0d] high level lint[0x1])
[    0.562371] ACPI: X2APIC_NMI (uid[0x0e] high level lint[0x1])
[    0.562372] ACPI: X2APIC_NMI (uid[0x0f] high level lint[0x1])
[    0.562372] ACPI: X2APIC_NMI (uid[0x10] high level lint[0x1])
[    0.562373] ACPI: X2APIC_NMI (uid[0x11] high level lint[0x1])
[    0.562374] ACPI: X2APIC_NMI (uid[0x12] high level lint[0x1])
[    0.562375] ACPI: X2APIC_NMI (uid[0x13] high level lint[0x1])
[    0.562375] ACPI: X2APIC_NMI (uid[0x14] high level lint[0x1])
[    0.562376] ACPI: X2APIC_NMI (uid[0x15] high level lint[0x1])
[    0.562377] ACPI: X2APIC_NMI (uid[0x16] high level lint[0x1])
[    0.562378] ACPI: X2APIC_NMI (uid[0x17] high level lint[0x1])
[    0.562378] ACPI: X2APIC_NMI (uid[0x18] high level lint[0x1])
[    0.562379] ACPI: X2APIC_NMI (uid[0x19] high level lint[0x1])
[    0.562380] ACPI: X2APIC_NMI (uid[0x1a] high level lint[0x1])
[    0.562381] ACPI: X2APIC_NMI (uid[0x1b] high level lint[0x1])
[    0.562382] ACPI: X2APIC_NMI (uid[0x1c] high level lint[0x1])
[    0.562382] ACPI: X2APIC_NMI (uid[0x1d] high level lint[0x1])
[    0.562383] ACPI: X2APIC_NMI (uid[0x1e] high level lint[0x1])
[    0.562384] ACPI: X2APIC_NMI (uid[0x1f] high level lint[0x1])
[    0.562385] ACPI: X2APIC_NMI (uid[0x20] high level lint[0x1])
[    0.562386] ACPI: X2APIC_NMI (uid[0x21] high level lint[0x1])
[    0.562387] ACPI: X2APIC_NMI (uid[0x22] high level lint[0x1])
[    0.562387] ACPI: X2APIC_NMI (uid[0x23] high level lint[0x1])
[    0.562388] ACPI: X2APIC_NMI (uid[0x24] high level lint[0x1])
[    0.562389] ACPI: X2APIC_NMI (uid[0x25] high level lint[0x1])
[    0.562390] ACPI: X2APIC_NMI (uid[0x26] high level lint[0x1])
[    0.562390] ACPI: X2APIC_NMI (uid[0x27] high level lint[0x1])
[    0.562391] ACPI: X2APIC_NMI (uid[0x28] high level lint[0x1])
[    0.562392] ACPI: X2APIC_NMI (uid[0x29] high level lint[0x1])
[    0.562393] ACPI: X2APIC_NMI (uid[0x2a] high level lint[0x1])
[    0.562394] ACPI: X2APIC_NMI (uid[0x2b] high level lint[0x1])
[    0.562394] ACPI: X2APIC_NMI (uid[0x2c] high level lint[0x1])
[    0.562395] ACPI: X2APIC_NMI (uid[0x2d] high level lint[0x1])
[    0.562396] ACPI: X2APIC_NMI (uid[0x2e] high level lint[0x1])
[    0.562397] ACPI: X2APIC_NMI (uid[0x2f] high level lint[0x1])
[    0.562398] ACPI: X2APIC_NMI (uid[0x30] high level lint[0x1])
[    0.562398] ACPI: X2APIC_NMI (uid[0x31] high level lint[0x1])
[    0.562399] ACPI: X2APIC_NMI (uid[0x32] high level lint[0x1])
[    0.562400] ACPI: X2APIC_NMI (uid[0x33] high level lint[0x1])
[    0.562401] ACPI: X2APIC_NMI (uid[0x34] high level lint[0x1])
[    0.562402] ACPI: X2APIC_NMI (uid[0x35] high level lint[0x1])
[    0.562402] ACPI: X2APIC_NMI (uid[0x36] high level lint[0x1])
[    0.562403] ACPI: X2APIC_NMI (uid[0x37] high level lint[0x1])
[    0.562404] ACPI: X2APIC_NMI (uid[0x38] high level lint[0x1])
[    0.562405] ACPI: X2APIC_NMI (uid[0x39] high level lint[0x1])
[    0.562405] ACPI: X2APIC_NMI (uid[0x3a] high level lint[0x1])
[    0.562406] ACPI: X2APIC_NMI (uid[0x3b] high level lint[0x1])
[    0.562407] ACPI: X2APIC_NMI (uid[0x3c] high level lint[0x1])
[    0.562408] ACPI: X2APIC_NMI (uid[0x3d] high level lint[0x1])
[    0.562408] ACPI: X2APIC_NMI (uid[0x3e] high level lint[0x1])
[    0.562409] ACPI: X2APIC_NMI (uid[0x3f] high level lint[0x1])
[    0.562410] ACPI: X2APIC_NMI (uid[0x40] high level lint[0x1])
[    0.562411] ACPI: X2APIC_NMI (uid[0x41] high level lint[0x1])
[    0.562411] ACPI: X2APIC_NMI (uid[0x42] high level lint[0x1])
[    0.562412] ACPI: X2APIC_NMI (uid[0x43] high level lint[0x1])
[    0.562413] ACPI: X2APIC_NMI (uid[0x44] high level lint[0x1])
[    0.562414] ACPI: X2APIC_NMI (uid[0x45] high level lint[0x1])
[    0.562414] ACPI: X2APIC_NMI (uid[0x46] high level lint[0x1])
[    0.562415] ACPI: X2APIC_NMI (uid[0x47] high level lint[0x1])
[    0.562416] ACPI: X2APIC_NMI (uid[0x48] high level lint[0x1])
[    0.562417] ACPI: X2APIC_NMI (uid[0x49] high level lint[0x1])
[    0.562418] ACPI: X2APIC_NMI (uid[0x4a] high level lint[0x1])
[    0.562418] ACPI: X2APIC_NMI (uid[0x4b] high level lint[0x1])
[    0.562419] ACPI: X2APIC_NMI (uid[0x4c] high level lint[0x1])
[    0.562420] ACPI: X2APIC_NMI (uid[0x4d] high level lint[0x1])
[    0.562421] ACPI: X2APIC_NMI (uid[0x4e] high level lint[0x1])
[    0.562422] ACPI: X2APIC_NMI (uid[0x4f] high level lint[0x1])
[    0.562423] ACPI: X2APIC_NMI (uid[0x50] high level lint[0x1])
[    0.562424] ACPI: X2APIC_NMI (uid[0x51] high level lint[0x1])
[    0.562424] ACPI: X2APIC_NMI (uid[0x52] high level lint[0x1])
[    0.562425] ACPI: X2APIC_NMI (uid[0x53] high level lint[0x1])
[    0.562426] ACPI: X2APIC_NMI (uid[0x54] high level lint[0x1])
[    0.562427] ACPI: X2APIC_NMI (uid[0x55] high level lint[0x1])
[    0.562427] ACPI: X2APIC_NMI (uid[0x56] high level lint[0x1])
[    0.562428] ACPI: X2APIC_NMI (uid[0x57] high level lint[0x1])
[    0.562429] ACPI: X2APIC_NMI (uid[0x58] high level lint[0x1])
[    0.562429] ACPI: X2APIC_NMI (uid[0x59] high level lint[0x1])
[    0.562430] ACPI: X2APIC_NMI (uid[0x5a] high level lint[0x1])
[    0.562431] ACPI: X2APIC_NMI (uid[0x5b] high level lint[0x1])
[    0.562432] ACPI: X2APIC_NMI (uid[0x5c] high level lint[0x1])
[    0.562432] ACPI: X2APIC_NMI (uid[0x5d] high level lint[0x1])
[    0.562433] ACPI: X2APIC_NMI (uid[0x5e] high level lint[0x1])
[    0.562434] ACPI: X2APIC_NMI (uid[0x5f] high level lint[0x1])
[    0.562435] ACPI: X2APIC_NMI (uid[0x60] high level lint[0x1])
[    0.562435] ACPI: X2APIC_NMI (uid[0x61] high level lint[0x1])
[    0.562436] ACPI: X2APIC_NMI (uid[0x62] high level lint[0x1])
[    0.562437] ACPI: X2APIC_NMI (uid[0x63] high level lint[0x1])
[    0.562438] ACPI: X2APIC_NMI (uid[0x64] high level lint[0x1])
[    0.562438] ACPI: X2APIC_NMI (uid[0x65] high level lint[0x1])
[    0.562439] ACPI: X2APIC_NMI (uid[0x66] high level lint[0x1])
[    0.562440] ACPI: X2APIC_NMI (uid[0x67] high level lint[0x1])
[    0.562441] ACPI: X2APIC_NMI (uid[0x68] high level lint[0x1])
[    0.562442] ACPI: X2APIC_NMI (uid[0x69] high level lint[0x1])
[    0.562442] ACPI: X2APIC_NMI (uid[0x6a] high level lint[0x1])
[    0.562443] ACPI: X2APIC_NMI (uid[0x6b] high level lint[0x1])
[    0.562444] ACPI: X2APIC_NMI (uid[0x6c] high level lint[0x1])
[    0.562445] ACPI: X2APIC_NMI (uid[0x6d] high level lint[0x1])
[    0.562446] ACPI: X2APIC_NMI (uid[0x6e] high level lint[0x1])
[    0.562446] ACPI: X2APIC_NMI (uid[0x6f] high level lint[0x1])
[    0.562447] ACPI: X2APIC_NMI (uid[0x70] high level lint[0x1])
[    0.562448] ACPI: X2APIC_NMI (uid[0x71] high level lint[0x1])
[    0.562449] ACPI: X2APIC_NMI (uid[0x72] high level lint[0x1])
[    0.562450] ACPI: X2APIC_NMI (uid[0x73] high level lint[0x1])
[    0.562450] ACPI: X2APIC_NMI (uid[0x74] high level lint[0x1])
[    0.562451] ACPI: X2APIC_NMI (uid[0x75] high level lint[0x1])
[    0.562452] ACPI: X2APIC_NMI (uid[0x76] high level lint[0x1])
[    0.562453] ACPI: X2APIC_NMI (uid[0x77] high level lint[0x1])
[    0.562454] ACPI: X2APIC_NMI (uid[0x78] high level lint[0x1])
[    0.562454] ACPI: X2APIC_NMI (uid[0x79] high level lint[0x1])
[    0.562455] ACPI: X2APIC_NMI (uid[0x7a] high level lint[0x1])
[    0.562456] ACPI: X2APIC_NMI (uid[0x7b] high level lint[0x1])
[    0.562457] ACPI: X2APIC_NMI (uid[0x7c] high level lint[0x1])
[    0.562458] ACPI: X2APIC_NMI (uid[0x7d] high level lint[0x1])
[    0.562458] ACPI: X2APIC_NMI (uid[0x7e] high level lint[0x1])
[    0.562459] ACPI: X2APIC_NMI (uid[0x7f] high level lint[0x1])
[    0.562460] ACPI: X2APIC_NMI (uid[0x80] high level lint[0x1])
[    0.562461] ACPI: X2APIC_NMI (uid[0x81] high level lint[0x1])
[    0.562462] ACPI: X2APIC_NMI (uid[0x82] high level lint[0x1])
[    0.562462] ACPI: X2APIC_NMI (uid[0x83] high level lint[0x1])
[    0.562463] ACPI: X2APIC_NMI (uid[0x84] high level lint[0x1])
[    0.562464] ACPI: X2APIC_NMI (uid[0x85] high level lint[0x1])
[    0.562465] ACPI: X2APIC_NMI (uid[0x86] high level lint[0x1])
[    0.562465] ACPI: X2APIC_NMI (uid[0x87] high level lint[0x1])
[    0.562466] ACPI: X2APIC_NMI (uid[0x88] high level lint[0x1])
[    0.562467] ACPI: X2APIC_NMI (uid[0x89] high level lint[0x1])
[    0.562468] ACPI: X2APIC_NMI (uid[0x8a] high level lint[0x1])
[    0.562468] ACPI: X2APIC_NMI (uid[0x8b] high level lint[0x1])
[    0.562469] ACPI: X2APIC_NMI (uid[0x8c] high level lint[0x1])
[    0.562470] ACPI: X2APIC_NMI (uid[0x8d] high level lint[0x1])
[    0.562471] ACPI: X2APIC_NMI (uid[0x8e] high level lint[0x1])
[    0.562471] ACPI: X2APIC_NMI (uid[0x8f] high level lint[0x1])
[    0.562472] ACPI: X2APIC_NMI (uid[0x90] high level lint[0x1])
[    0.562473] ACPI: X2APIC_NMI (uid[0x91] high level lint[0x1])
[    0.562474] ACPI: X2APIC_NMI (uid[0x92] high level lint[0x1])
[    0.562474] ACPI: X2APIC_NMI (uid[0x93] high level lint[0x1])
[    0.562475] ACPI: X2APIC_NMI (uid[0x94] high level lint[0x1])
[    0.562476] ACPI: X2APIC_NMI (uid[0x95] high level lint[0x1])
[    0.562477] ACPI: X2APIC_NMI (uid[0x96] high level lint[0x1])
[    0.562477] ACPI: X2APIC_NMI (uid[0x97] high level lint[0x1])
[    0.562478] ACPI: X2APIC_NMI (uid[0x98] high level lint[0x1])
[    0.562479] ACPI: X2APIC_NMI (uid[0x99] high level lint[0x1])
[    0.562480] ACPI: X2APIC_NMI (uid[0x9a] high level lint[0x1])
[    0.562480] ACPI: X2APIC_NMI (uid[0x9b] high level lint[0x1])
[    0.562481] ACPI: X2APIC_NMI (uid[0x9c] high level lint[0x1])
[    0.562482] ACPI: X2APIC_NMI (uid[0x9d] high level lint[0x1])
[    0.562483] ACPI: X2APIC_NMI (uid[0x9e] high level lint[0x1])
[    0.562483] ACPI: X2APIC_NMI (uid[0x9f] high level lint[0x1])
[    0.562484] ACPI: X2APIC_NMI (uid[0xa0] high level lint[0x1])
[    0.562485] ACPI: X2APIC_NMI (uid[0xa1] high level lint[0x1])
[    0.562486] ACPI: X2APIC_NMI (uid[0xa2] high level lint[0x1])
[    0.562486] ACPI: X2APIC_NMI (uid[0xa3] high level lint[0x1])
[    0.562487] ACPI: X2APIC_NMI (uid[0xa4] high level lint[0x1])
[    0.562488] ACPI: X2APIC_NMI (uid[0xa5] high level lint[0x1])
[    0.562489] ACPI: X2APIC_NMI (uid[0xa6] high level lint[0x1])
[    0.562489] ACPI: X2APIC_NMI (uid[0xa7] high level lint[0x1])
[    0.562490] ACPI: X2APIC_NMI (uid[0xa8] high level lint[0x1])
[    0.562491] ACPI: X2APIC_NMI (uid[0xa9] high level lint[0x1])
[    0.562492] ACPI: X2APIC_NMI (uid[0xaa] high level lint[0x1])
[    0.562493] ACPI: X2APIC_NMI (uid[0xab] high level lint[0x1])
[    0.562494] ACPI: X2APIC_NMI (uid[0xac] high level lint[0x1])
[    0.562495] ACPI: X2APIC_NMI (uid[0xad] high level lint[0x1])
[    0.562496] ACPI: X2APIC_NMI (uid[0xae] high level lint[0x1])
[    0.562497] ACPI: X2APIC_NMI (uid[0xaf] high level lint[0x1])
[    0.562497] ACPI: X2APIC_NMI (uid[0xb0] high level lint[0x1])
[    0.562498] ACPI: X2APIC_NMI (uid[0xb1] high level lint[0x1])
[    0.562499] ACPI: X2APIC_NMI (uid[0xb2] high level lint[0x1])
[    0.562500] ACPI: X2APIC_NMI (uid[0xb3] high level lint[0x1])
[    0.562501] ACPI: X2APIC_NMI (uid[0xb4] high level lint[0x1])
[    0.562501] ACPI: X2APIC_NMI (uid[0xb5] high level lint[0x1])
[    0.562502] ACPI: X2APIC_NMI (uid[0xb6] high level lint[0x1])
[    0.562503] ACPI: X2APIC_NMI (uid[0xb7] high level lint[0x1])
[    0.562504] ACPI: X2APIC_NMI (uid[0xb8] high level lint[0x1])
[    0.562504] ACPI: X2APIC_NMI (uid[0xb9] high level lint[0x1])
[    0.562505] ACPI: X2APIC_NMI (uid[0xba] high level lint[0x1])
[    0.562506] ACPI: X2APIC_NMI (uid[0xbb] high level lint[0x1])
[    0.562506] ACPI: X2APIC_NMI (uid[0xbc] high level lint[0x1])
[    0.562507] ACPI: X2APIC_NMI (uid[0xbd] high level lint[0x1])
[    0.562508] ACPI: X2APIC_NMI (uid[0xbe] high level lint[0x1])
[    0.562509] ACPI: X2APIC_NMI (uid[0xbf] high level lint[0x1])
[    1.303372] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[    1.304023] DMAR-IR: Enabled IRQ remapping in x2apic mode
root@usd-pve-hcc-201:~# uname -a
Linux usd-pve-hcc-201 6.5.11-7-pve #1 SMP PREEMPT_DYNAMIC PMX 6.5.11-7 (2023-12-05T09:44Z) x86_64 GNU/Linux
root@usd-pve-hcc-201:~#  grep "model name" /proc/cpuinfo | sort -u
model name      : Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz

 

[Dunuin]

What's the latest state about Realtek r8111/8411/8168 support with the 6.5 kernel?
Form what I've read so far over the last months, with PVE7 and kernel 5.15 those NICs were working fine. Starting with PVE 8.0 and kernel 6.2 those stopped working with the r8168 driver that comes shipped with PVE and the fix for the 6.2 kernel was to replace it with the "r8168-dkms" package.
Is this supposed to work again using the 6.5 kernel of PVE 8.1 out of the box?
Because here it still stopped working after upgrading PVE from 7.4 with 5.15 kernel to PVE 8.1 using the 6.5 kernel.
And someone knows if the "r8168-dkms" package is compatible with the 6.5 kernel at all? I was able to build that "r8168-dkms" package for the 6.1 kernel but when trying to make it for the 6.5 kernel the make will fail with this error:

 

[ivenae]

Kernel 6.5.11-8 does NOT solve the x2api issue.

 

[cigas4]

Just installed Kernel Linux 6.5.11-8-pve (2024-01-30T12:27Z) today and got some issues inside my VMs.
I can also see some repetative message in syslog:

Feb 03 18:19:03 proxmox kernel: amdgpu 0000:01:00.0: [drm] Cannot find any crtc or sizes
Feb 03 18:19:13 proxmox kernel: [drm] PCIE GART of 256M enabled (table at 0x000000F400580000).
Feb 03 18:19:13 proxmox kernel: [drm] UVD and UVD ENC initialized successfully.

How can I fix it or downgrade my kernel? Unfortunately, I do not know which version it was before update..

pveversion -v
proxmox-ve: 8.1.0 (running kernel: 6.5.11-8-pve)
pve-manager: 8.1.4 (running version: 8.1.4/ec5affc9e41f1d79)
proxmox-kernel-helper: 8.1.0
pve-kernel-6.2: 8.0.5
proxmox-kernel-6.5: 6.5.11-8
proxmox-kernel-6.5.11-8-pve-signed: 6.5.11-8
proxmox-kernel-6.5.11-7-pve-signed: 6.5.11-7
proxmox-kernel-6.2.16-20-pve: 6.2.16-20
proxmox-kernel-6.2: 6.2.16-20
pve-kernel-6.2.16-5-pve: 6.2.16-6
pve-kernel-6.2.16-4-pve: 6.2.16-5
pve-kernel-6.2.16-1-pve: 6.2.16-1
pve-kernel-6.1.10-1-pve: 6.1.10-1
ceph-fuse: 17.2.7-pve2
corosync: 3.1.7-pve3
criu: 3.17.1-2
glusterfs-client: 10.3-5
ifupdown2: 3.2.0-1+pmx8
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-4
libknet1: 1.28-pve1
libproxmox-acme-perl: 1.5.0
libproxmox-backup-qemu0: 1.4.1
libproxmox-rs-perl: 0.3.3
libpve-access-control: 8.0.7
libpve-apiclient-perl: 3.3.1
libpve-common-perl: 8.1.0
libpve-guest-common-perl: 5.0.6
libpve-http-server-perl: 5.0.5
libpve-network-perl: 0.9.5
libpve-rs-perl: 0.8.8
libpve-storage-perl: 8.0.5
libspice-server1: 0.15.1-1
lvm2: 2.03.16-2
lxc-pve: 5.0.2-4
lxcfs: 5.0.3-pve4
novnc-pve: 1.4.0-3
proxmox-backup-client: 3.1.3-1
proxmox-backup-file-restore: 3.1.3-1
proxmox-kernel-helper: 8.1.0
proxmox-mail-forward: 0.2.3
proxmox-mini-journalreader: 1.4.0
proxmox-offline-mirror-helper: 0.6.4
proxmox-widget-toolkit: 4.1.3
pve-cluster: 8.0.5
pve-container: 5.0.8
pve-docs: 8.1.3
pve-edk2-firmware: 4.2023.08-3
pve-firewall: 5.0.3
pve-firmware: 3.9-1
pve-ha-manager: 4.0.3
pve-i18n: 3.2.0
pve-qemu-kvm: 8.1.2-6
pve-xtermjs: 5.3.0-3
qemu-server: 8.0.10
smartmontools: 7.3-pve1
spiceterm: 3.3.0
swtpm: 0.8.0+pve1
vncterm: 1.8.0
zfsutils-linux: 2.2.2-pve1

 

[d0glesby]

Kernel 6.5.11-8 does NOT solve the x2api issue.

Make sure you are running on the latest BIOS version for your system, and verify that IOMMU support, Virtualization support, and x2APIC are all enabled in the BIOS configuration. I have x2APIC enabled on several clusters at this point, running the 6.5.11-8 kernel (Dell R730, R740, and R750 platforms) without any issues.

 

[learnedmachine]

@t.lamprecht

1. Updated now 5 Servers, all with very different Hardware (2x Silver 4210R / 1x Ryzen 5800X / 1x Nuc13 i3-1315U / 1x Nuc11 / 1x Xeon-E5 v3)
--> So very mixed old/new Hardware and everything works perfect!
--> ZFS Upgrade went perfect either on all Servers

2. Arc A380 DGPU
--> Works very reliable with 6.5 Kernel and absolutely perfect, no issues anymore at all.
--> On 6.2 Kernels, the GPU worked for transcoding, but crashed randomly especially with jellyfin, plex rarely either.

3. Docker Container on ZFS (LXC)
--> YESSSSS, finally every docker image works without issues!
--> On zfs 2.1, 80% of docker images worked, but some like speedtest-tracker don't.

4. Mellanox ConnectX-4 Lx
--> No change, vlans on the bridge aren't working until you set the Adapter into Promiscous mode.
--> Known Bug, newest FW, there are more topics about this. I had hope that 6.5 fixes this either, but no

Otherwise 6.5 works perfect, no issues & great work like always
Thank you

Did your system with the Arc gpu have that as its only gpu? I can't get proxmox to work with arc gpus. It works perfectly fine with a 3090, but as soon as I slot in an arc gpu (A380 or A750), the computer doesn't post anything. The same computer was working perfectly fine with these arc gpus on windows.

 

[Ramalama]

Did your system with the Arc gpu have that as its only gpu? I can't get proxmox to work with arc gpus. It works perfectly fine with a 3090, but as soon as I slot in an arc gpu (A380 or A750), the computer doesn't post anything. The same computer was working perfectly fine with these arc gpus on windows.

Yeah, its an x570 with an Ryzen 5800X, so no other GPU.
But i have no issues at all, tbh its my favorite GPU for Linux or Proxmox, or however you take it, since you don't need to do anthing, because everything is already in the Kernel.

The only wish i would have, would be SR-IOV, but there are Intel Flex GPU's comming finally, which costs too much, but for a company its nothing

However, the ARC works even from an M.2 Slot (Im using an Riser Cable from M.2 Gen4 x4 Slot), so its not even connected fully with 8 Lanes. Still no issues. And inside an normal Slot (16 Lanes), no issues either.

I had just huge issue with older Kernels, like 6.2 and before...
Maybe you have a defective Arc GPU?