[Solved] Proxmox / Linux, Intel X540-AT2 and "BUG: soft lockup - CPU stuck for 23s!"

F

FrowningDingo

New Member
Apr 12, 2020
3
1
1
23
1/3
This is a solved problem - I wanted to post this for anyone else who had the same issue.

TL;DR: If using an Intel X540-AT2, don't use vLAN aware bridging and instead define vLANs + define a bridge per vLAN

I installed Proxmox 6.1.8 on an Asrock D1541DU-2T82 which has an Intel X540-AT2 10-Gigabit Ethernet Controller. I migrated my VMs from my old Proxmox server to the new node. Each time I tried to start a VM, either via `qm start` or via the web UI, the task returned `failed: got timeout`. I also saw `kernel: [ 280.507903] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [ip:28456]` logged to the console.

The following was logged to /var/log/syslog:

Code: 
Apr 11 11:48:53 koga kernel: [ 5592.765780] watchdog: BUG: soft lockup - CPU#7 stuck for 22s! [ip:25681]
Apr 11 11:48:53 koga kernel: [ 5592.765826] Modules linked in: ebtable_filter ebtables ip_set ip6table_raw iptable_raw ip6table_filter ip6_tables iptable_filter bpfilter 8021q garp mrp softdog bonding nfnetlink_log nfnetlink intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass vhost_net vhost tap ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ipmi_ssif crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel ast drm_vram_helper ttm aes_x86_64 crypto_simd drm_kms_helper cryptd glue_helper drm mei_me i2c_algo_bit intel_cstate fb_sys_fops syscopyarea sysfillrect intel_rapl_perf input_leds pcspkr mxm_wmi intel_pch_thermal sysimgblt mei ioatdma acpi_pad mac_hid ipmi_si ipmi_devintf ipmi_msghandler sunrpc ip_tables x_tables autofs4 zfs(PO) zunicode(PO) zlua(PO) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) btrfs xor zstd_compress raid6_pq libcrc32c hid_generic usbkbd usbhid ixgbe hid ahci xfrm_algo i2c_i801 dca libahci lpc_ich
Apr 11 11:48:53 koga kernel: [ 5592.765860]  mdio mpt3sas raid_class scsi_transport_sas wmi
Apr 11 11:48:53 koga kernel: [ 5592.766139] CPU: 7 PID: 25681 Comm: ip Tainted: P           O      5.3.18-3-pve #1
Apr 11 11:48:53 koga kernel: [ 5592.766162] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./D1541D4U-2T8R, BIOS L1.13C 06/12/2018
Apr 11 11:48:53 koga kernel: [ 5592.766200] RIP: 0010:ixgbe_read_reg+0x34/0xf0 [ixgbe]
Apr 11 11:48:53 koga kernel: [ 5592.766217] Code: 57 41 56 41 55 41 54 53 48 83 ec 10 4c 8b 27 4d 85 e4 74 2c 41 89 f7 49 89 fd f6 87 0b 06 00 00 02 75 24 4d 01 fc 41 8b 1c 24 <83> fb ff 74 60 48 83 c4 10 89 d8 5b 41 5c 41 5d 41 5e 41 5f 5d c3
Apr 11 11:48:53 koga kernel: [ 5592.766269] RSP: 0018:ffffac8f7a6f71e0 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff13
Apr 11 11:48:53 koga kernel: [ 5592.766291] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
Apr 11 11:48:53 koga kernel: [ 5592.766312] RDX: 00000000ffffffff RSI: 000000000000a834 RDI: ffff8a55ed021a40
Apr 11 11:48:53 koga kernel: [ 5592.766333] RBP: ffffac8f7a6f7218 R08: 0000000080000000 R09: 0000000000000034
Apr 11 11:48:53 koga kernel: [ 5592.766353] R10: 00000000fdcf3c54 R11: 000000000000001a R12: ffffac8f40c0a834
Apr 11 11:48:53 koga kernel: [ 5592.766374] R13: ffff8a55ed021a40 R14: 0000000000000000 R15: 000000000000a834
Apr 11 11:48:53 koga kernel: [ 5592.766395] FS:  00007fdf57ba3e40(0000) GS:ffff8a55ff9c0000(0000) knlGS:0000000000000000
Apr 11 11:48:53 koga kernel: [ 5592.766418] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Apr 11 11:48:53 koga kernel: [ 5592.766435] CR2: 0000557a35ffae88 CR3: 000000080a1ae006 CR4: 00000000003626e0
Apr 11 11:48:53 koga kernel: [ 5592.766456] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Apr 11 11:48:53 koga kernel: [ 5592.766477] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Apr 11 11:48:53 koga kernel: [ 5592.766497] Call Trace:
Apr 11 11:48:53 koga kernel: [ 5592.766514]  ixgbe_clear_vmdq_generic+0x4e/0x150 [ixgbe]
Apr 11 11:48:53 koga kernel: [ 5592.766536]  ixgbe_clear_rar_generic+0x91/0x120 [ixgbe]
Apr 11 11:48:53 koga kernel: [ 5592.767592]  ixgbe_full_sync_mac_table+0x88/0xa0 [ixgbe]
Apr 11 11:48:53 koga kernel: [ 5592.768641]  ixgbe_restore_vf_multicasts+0x107/0x130 [ixgbe]
Apr 11 11:48:53 koga kernel: [ 5592.769688]  ? ixgbe_fwd_del+0x110/0x110 [ixgbe]
Apr 11 11:48:53 koga kernel: [ 5592.770765]  ixgbe_set_rx_mode+0xd9/0x670 [ixgbe]
Apr 11 11:48:53 koga kernel: [ 5592.771797]  __dev_set_rx_mode+0x57/0x90
Apr 11 11:48:53 koga kernel: [ 5592.772812]  dev_uc_sync_multiple+0x88/0xa0
Apr 11 11:48:53 koga kernel: [ 5592.773856]  bond_set_rx_mode+0x91/0xc0 [bonding]
Apr 11 11:48:53 koga kernel: [ 5592.774896]  __dev_set_rx_mode+0x57/0x90
Apr 11 11:48:53 koga kernel: [ 5592.775917]  dev_mc_sync+0x88/0xa0
Apr 11 11:48:53 koga kernel: [ 5592.776932]  vlan_dev_set_rx_mode+0x1c/0x30 [8021q]
Apr 11 11:48:53 koga kernel: [ 5592.777961]  __dev_set_rx_mode+0x57/0x90
Apr 11 11:48:53 koga kernel: [ 5592.778953]  dev_uc_del+0x65/0x70
Apr 11 11:48:53 koga kernel: [ 5592.779896]  br_fdb_unsync_static+0x44/0x80
Apr 11 11:48:53 koga kernel: [ 5592.780830]  br_port_set_promisc+0x31/0x40
Apr 11 11:48:53 koga kernel: [ 5592.781768]  br_manage_promisc+0xa0/0xf0
Apr 11 11:48:53 koga kernel: [ 5592.765780] watchdog: BUG: soft lockup - CPU#7 stuck for 22s! [ip:25681]
Apr 11 11:48:53 koga kernel: [ 5592.765826] Modules linked in: ebtable_filter ebtables ip_set ip6table_raw iptable_raw ip6table_filter ip6_tables iptable_filter bpfilter 8021q garp mrp softdog bonding nfnetlink_log nfnetlink intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass vhost_net vhost tap ib_iser rdma_cm iw_cm ib_cm ib_core iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ipmi_ssif crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel ast drm_vram_helper ttm aes_x86_64 crypto_simd drm_kms_helper cryptd glue_helper drm mei_me i2c_algo_bit intel_cstate fb_sys_fops syscopyarea sysfillrect intel_rapl_perf input_leds pcspkr mxm_wmi intel_pch_thermal sysimgblt mei ioatdma acpi_pad mac_hid ipmi_si ipmi_devintf ipmi_msghandler sunrpc ip_tables x_tables autofs4 zfs(PO) zunicode(PO) zlua(PO) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) btrfs xor zstd_compress raid6_pq libcrc32c hid_generic usbkbd usbhid ixgbe hid ahci xfrm_algo i2c_i801 dca libahci lpc_ich
Apr 11 11:48:53 koga kernel: [ 5592.765860]  mdio mpt3sas raid_class scsi_transport_sas wmi
Apr 11 11:48:53 koga kernel: [ 5592.766139] CPU: 7 PID: 25681 Comm: ip Tainted: P           O      5.3.18-3-pve #1
Apr 11 11:48:53 koga kernel: [ 5592.766162] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./D1541D4U-2T8R, BIOS L1.13C 06/12/2018
Apr 11 11:48:53 koga kernel: [ 5592.766200] RIP: 0010:ixgbe_read_reg+0x34/0xf0 [ixgbe]
Apr 11 11:48:53 koga kernel: [ 5592.766217] Code: 57 41 56 41 55 41 54 53 48 83 ec 10 4c 8b 27 4d 85 e4 74 2c 41 89 f7 49 89 fd f6 87 0b 06 00 00 02 75 24 4d 01 fc 41 8b 1c 24 <83> fb ff 74 60 48 83 c4 10 89 d8 5b 41 5c 41 5d 41 5e 41 5f 5d c3
Apr 11 11:48:53 koga kernel: [ 5592.766269] RSP: 0018:ffffac8f7a6f71e0 EFLAGS: 00000282 ORIG_RAX: ffffffffffffff13
Apr 11 11:48:53 koga kernel: [ 5592.766291] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
Apr 11 11:48:53 koga kernel: [ 5592.766312] RDX: 00000000ffffffff RSI: 000000000000a834 RDI: ffff8a55ed021a40
Apr 11 11:48:53 koga kernel: [ 5592.766333] RBP: ffffac8f7a6f7218 R08: 0000000080000000 R09: 0000000000000034
Apr 11 11:48:53 koga kernel: [ 5592.766353] R10: 00000000fdcf3c54 R11: 000000000000001a R12: ffffac8f40c0a834
Apr 11 11:48:53 koga kernel: [ 5592.766374] R13: ffff8a55ed021a40 R14: 0000000000000000 R15: 000000000000a834
Apr 11 11:48:53 koga kernel: [ 5592.766395] FS:  00007fdf57ba3e40(0000) GS:ffff8a55ff9c0000(0000) knlGS:0000000000000000
Apr 11 11:48:53 koga kernel: [ 5592.766418] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Apr 11 11:48:53 koga kernel: [ 5592.766435] CR2: 0000557a35ffae88 CR3: 000000080a1ae006 CR4: 00000000003626e0
Apr 11 11:48:53 koga kernel: [ 5592.766456] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Apr 11 11:48:53 koga kernel: [ 5592.766477] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Apr 11 11:48:53 koga kernel: [ 5592.766497] Call Trace:
Apr 11 11:48:53 koga kernel: [ 5592.766514]  ixgbe_clear_vmdq_generic+0x4e/0x150 [ixgbe]
Apr 11 11:48:53 koga kernel: [ 5592.766536]  ixgbe_clear_rar_generic+0x91/0x120 [ixgbe]
Apr 11 11:48:53 koga kernel: [ 5592.767592]  ixgbe_full_sync_mac_table+0x88/0xa0 [ixgbe]
Apr 11 11:48:53 koga kernel: [ 5592.768641]  ixgbe_restore_vf_multicasts+0x107/0x130 [ixgbe]
Apr 11 11:48:53 koga kernel: [ 5592.769688]  ? ixgbe_fwd_del+0x110/0x110 [ixgbe]
Apr 11 11:48:53 koga kernel: [ 5592.770765]  ixgbe_set_rx_mode+0xd9/0x670 [ixgbe]
Apr 11 11:48:53 koga kernel: [ 5592.771797]  __dev_set_rx_mode+0x57/0x90
Apr 11 11:48:53 koga kernel: [ 5592.772812]  dev_uc_sync_multiple+0x88/0xa0
Apr 11 11:48:53 koga kernel: [ 5592.773856]  bond_set_rx_mode+0x91/0xc0 [bonding]
Apr 11 11:48:53 koga kernel: [ 5592.774896]  __dev_set_rx_mode+0x57/0x90
Apr 11 11:48:53 koga kernel: [ 5592.775917]  dev_mc_sync+0x88/0xa0
Apr 11 11:48:53 koga kernel: [ 5592.776932]  vlan_dev_set_rx_mode+0x1c/0x30 [8021q]
Apr 11 11:48:53 koga kernel: [ 5592.777961]  __dev_set_rx_mode+0x57/0x90
Apr 11 11:48:53 koga kernel: [ 5592.778953]  dev_uc_del+0x65/0x70
Apr 11 11:48:53 koga kernel: [ 5592.779896]  br_fdb_unsync_static+0x44/0x80
Apr 11 11:48:53 koga kernel: [ 5592.780830]  br_port_set_promisc+0x31/0x40
Apr 11 11:48:53 koga kernel: [ 5592.781768]  br_manage_promisc+0xa0/0xf0

(cont'd in first reply)
 
2/3

(cont'd)

Seeing ixgbe in the stack trace made me immediately suspect a network driver/ethernet controller problem. My network configuration included bonding, vlans and bridging:

Code: 
auto lo
iface lo inet loopback

iface enp7s0f0 inet manual
iface enp7s0f1 inet manual

auto bond0
iface bond0 inet manual
        slaves enp7s0f0 enp7s0f1
        bond-mode 2
        bond-miimon 100
        bond-downdelay 200
        bond-updelay 200

auto vmbr0
iface vmbr0 inet static
        address 172.16.1.62
        netmask 255.255.248.0
        gateway 172.16.1.1
        bridge_ports bond0
        bridge_stp on
        bridge_bridgeprio 36864
        bridge_hello 2
        bridge_maxage 20
        bridge_maxwait 30    
        bridge_fd 15                                                                   
        bridge_vlan_aware yes
        post-up ( echo -n 1 > /sys/devices/virtual/net/vmbr0/bridge/multicast_querier )
#Bikeshed.Internal
                          
auto vlan2010                
iface vlan2010 inet manual
        vlan-raw-device bond0
                       
auto vmbr1                   
iface vmbr1 inet manual
        bridge_ports vlan2010
        bridge_stp on                                              
        bridge_bridgeprio 36864                                                        
        bridge_hello 2
        bridge_maxage 20
        bridge_maxwait 30
        bridge_fd 15      
        bridge_vlan_aware yes
        pre-up ( ip addr flush dev vmbr1 > /dev/null 2>&1 || true )
        post-up ( echo -n 1 > /sys/devices/virtual/net/vmbr1/bridge/multicast_querier )
#Bikeshed.Lab          
                             
auto vlan2020         
iface vlan2020 inet manual
        vlan-raw-device bond0                                      
                                                                                       
auto vmbr2      
iface vmbr2 inet manual
        bridge_ports vlan2020
        bridge_stp on     
        bridge_bridgeprio 36864
        bridge_hello 2
        bridge_maxage 20
        bridge_maxwait 30
        bridge_fd 15         
        bridge_vlan_aware yes
        pre-up ( ip addr flush dev vmbr2 > /dev/null 2>&1 || true )
        post-up ( echo -n 1 > /sys/devices/virtual/net/vmbr2/bridge/multicast_querier )
#Independent.Lab                                                                       
             
auto vlan2030
iface vlan2030 inet manual
        vlan-raw-device bond0
                             
auto vmbr3
iface vmbr3 inet manual
        bridge_ports vlan2030
        bridge_stp on        
        bridge_bridgeprio 36864
        bridge_hello 2
        bridge_maxage 20                                           
        bridge_maxwait 30                                                              
        bridge_fd 15
        bridge_vlan_aware yes
        pre-up ( ip addr flush dev vmbr3 > /dev/null 2>&1 || true )
        post-up ( echo -n 1 > /sys/devices/virtual/net/vmbr3/bridge/multicast_querier )
#Bikeshed.DMZ         
                          
auto vlan2040             
iface vlan2040 inet manual
        vlan-raw-device bond0
                       
auto vmbr4                      
iface vmbr4 inet manual
        bridge_ports vlan2040
        bridge_stp on     
        bridge_bridgeprio 36864
        bridge_hello 2
        bridge_maxage 20
        bridge_maxage 20
        bridge_maxwait 30    
        bridge_fd 15                                                                   
        bridge_vlan_aware yes
        post-up ( echo -n 1 > /sys/devices/virtual/net/vmbr0/bridge/multicast_querier )
#Bikeshed.Internal
                          
auto vlan2010                
iface vlan2010 inet manual
        vlan-raw-device bond0
                       
auto vmbr1                   
iface vmbr1 inet manual
        bridge_ports vlan2010
        bridge_stp on                                              
        bridge_bridgeprio 36864                                                        
        bridge_hello 2
        bridge_maxage 20
        bridge_maxwait 30
        bridge_fd 15      
        bridge_vlan_aware yes
        pre-up ( ip addr flush dev vmbr1 > /dev/null 2>&1 || true )
        post-up ( echo -n 1 > /sys/devices/virtual/net/vmbr1/bridge/multicast_querier )
#Bikeshed.Lab          
                             
auto vlan2020         
iface vlan2020 inet manual
        vlan-raw-device bond0                                      
                                                                                       
auto vmbr2      
iface vmbr2 inet manual
        bridge_ports vlan2020
        bridge_stp on     
        bridge_bridgeprio 36864
        bridge_hello 2
        bridge_maxage 20
        bridge_maxwait 30
        bridge_fd 15         
        bridge_vlan_aware yes
        pre-up ( ip addr flush dev vmbr2 > /dev/null 2>&1 || true )
        post-up ( echo -n 1 > /sys/devices/virtual/net/vmbr2/bridge/multicast_querier )
#Independent.Lab                                                                       
             
auto vlan2030
iface vlan2030 inet manual
        vlan-raw-device bond0
                             
auto vmbr3
iface vmbr3 inet manual
        bridge_ports vlan2030
        bridge_stp on        
        bridge_bridgeprio 36864
        bridge_hello 2
        bridge_maxage 20                                           
        bridge_maxwait 30                                                              
        bridge_fd 15
        bridge_vlan_aware yes
        pre-up ( ip addr flush dev vmbr3 > /dev/null 2>&1 || true )
        post-up ( echo -n 1 > /sys/devices/virtual/net/vmbr3/bridge/multicast_querier )
#Bikeshed.DMZ         
                          
auto vlan2040             
iface vlan2040 inet manual
        vlan-raw-device bond0
                       
auto vmbr4                      
iface vmbr4 inet manual
        bridge_ports vlan2040
        bridge_stp on     
        bridge_bridgeprio 36864
        bridge_hello 2
        bridge_maxage 20
        bridge_maxwait 30
        bridge_fd 15       
        bridge_vlan_aware yes
        pre-up ( ip addr flush dev vmbr4 > /dev/null 2>&1 || true )
        post-up ( echo -n 1 > /sys/devices/virtual/net/vmbr4/bridge/multicast_querier )
#Bikeshed.CCTV

I stripped the network configuration down to the bare minimum:

Code: 
auto lo
iface lo inet loopback

iface enp7s0f0 inet manual

auto vmbr0
iface vmbr0 inet static
        address 172.16.1.62
        netmask 255.255.248.0
        gateway 172.16.1.1
        bridge_ports enp7s0f0
        bridge_stp off
        bridge_fd 15                                                                   
#Bikeshed.Internal

I was then able to start the VMs attached to vmbr0. I re-added the bonding configuration and I was still able to start the VMs attached to vmbr0. I then re-added the other bridges, initially without spanning tree, `bridge_vlan_aware yes` and the pre-up/post-up commands. All was fine.

I didn't re-add spanning tree, as that was left over from when I was debugging some problems with LACP and spanning tree which turned out to be a problem with the TP-Link switch I have.

I re-added `bridge_vlan_aware yes` to vmbr4 and attempted to start a VM attached to that bridge. Once again the task returned `failed: got timeout`and the `BUG: soft lockup` / `CPU stuck` recurred. I once again removed `bridge_vlan_aware yes` from vmbr4 and I was able to start the attached VM again.

I was not using bridges in a vlan aware fashion anyway, so the `bridge_vlan_aware yes` directive was completely pointless in my configuration. However, if you are using it so that you can directly vLAN tag interfaces on Proxmox VMs, the solution is to seperately define the vLANs and then bridge each of them.

Final working network configuration:

Code: 
auto lo
iface lo inet loopback

iface enp7s0f0 inet manual
iface enp7s0f1 inet manual

auto bond0
iface bond0 inet manual
        slaves enp7s0f0 enp7s0f1
        bond-mode 2
        bond-miimon 100
        bond-downdelay 200
        bond-updelay 200

auto vmbr0
iface vmbr0 inet static
        address 172.16.1.62
        netmask 255.255.248.0
        gateway 172.16.1.1
        bridge_ports bond0
        bridge_stp off
        bridge_fd 15
        bridge_vlan_aware yes
        post-up ( echo -n 1 > /sys/devices/virtual/net/vmbr0/bridge/multicast_querier )
#Bikeshed.Internal

auto vlan2010
iface vlan2010 inet manual
        vlan-raw-device bond0

auto vmbr1
iface vmbr1 inet manual
        bridge_ports vlan2010
        bridge_stp off
        bridge_fd 15
        pre-up ( ip addr flush dev vmbr1 > /dev/null 2>&1 || true )
        post-up ( echo -n 1 > /sys/devices/virtual/net/vmbr1/bridge/multicast_querier )
#Bikeshed.Lab

auto vlan2020
iface vlan2020 inet manual
        vlan-raw-device bond0

auto vmbr2
iface vmbr2 inet manual
        bridge_ports vlan2020
        bridge_stp off
        bridge_fd 15
        pre-up ( ip addr flush dev vmbr2 > /dev/null 2>&1 || true )
        post-up ( echo -n 1 > /sys/devices/virtual/net/vmbr2/bridge/multicast_querier )
#Independent.Lab

auto vlan2030
iface vlan2030 inet manual
        vlan-raw-device bond0

auto vmbr3
iface vmbr3 inet manual
        bridge_ports vlan2030
        bridge_stp off
        bridge_fd 15
        pre-up ( ip addr flush dev vmbr3 > /dev/null 2>&1 || true )
        post-up ( echo -n 1 > /sys/devices/virtual/net/vmbr3/bridge/multicast_querier )
#Bikeshed.DMZ

auto vlan2040
iface vlan2040 inet manual
        vlan-raw-device bond0

auto vmbr4
iface vmbr4 inet manual
        bridge_ports vlan2040
        bridge_stp off
        bridge_fd 15
        pre-up ( ip addr flush dev vmbr4 > /dev/null 2>&1 || true )
        post-up ( echo -n 1 > /sys/devices/virtual/net/vmbr4/bridge/multicast_querier )
#Bikeshed.CCTV

(cont'd)
 
  • Like
Reactions: Alibek
3/3

(cont'd)

Supplementary information:

Code: 
BS.INT  root@koga:~# pveversion --verbose
proxmox-ve: 6.1-2 (running kernel: 5.3.18-3-pve)
pve-manager: 6.1-8 (running version: 6.1-8/806edfe1)
pve-kernel-helper: 6.1-8
pve-kernel-5.3: 6.1-6
pve-kernel-5.3.18-3-pve: 5.3.18-3
pve-kernel-5.3.18-2-pve: 5.3.18-2
ceph-fuse: 12.2.11+dfsg1-2.1+b1
corosync: 3.0.3-pve1
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown: 0.8.35+pve1
ksm-control-daemon: 1.3-1
libjs-extjs: 6.0.1-10
libknet1: 1.15-pve1
libpve-access-control: 6.0-6
libpve-apiclient-perl: 3.0-3
libpve-common-perl: 6.0-17
libpve-guest-common-perl: 3.0-5
libpve-http-server-perl: 3.0-5
libpve-storage-perl: 6.1-5
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve4
lxc-pve: 3.2.1-1
lxcfs: 4.0.1-pve1
novnc-pve: 1.1.0-1
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.1-3
pve-cluster: 6.1-4
pve-container: 3.0-23
pve-docs: 6.1-6
pve-edk2-firmware: 2.20200229-1
pve-firewall: 4.0-10
pve-firmware: 3.0-7
pve-ha-manager: 3.0-9
pve-i18n: 2.0-4
pve-qemu-kvm: 4.1.1-4
pve-xtermjs: 4.3.0-1
qemu-server: 6.1-7
smartmontools: 7.1-pve2
spiceterm: 3.1-1
vncterm: 1.6-1
zfsutils-linux: 0.8.3-pve1
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom