Proxmox crushing.

[Alexdev96]

Hi. I'm installing ver 6.0-4 and every morning watching frozen pc. After physical reboot, i'm find this logs:

Sep 23 19:09:00 pve systemd[1]: Starting Proxmox VE replication runner...
Sep 23 19:09:01 pve systemd[1]: pvesr.service: Succeeded.
Sep 23 19:09:01 pve systemd[1]: Started Proxmox VE replication runner.
Sep 23 19:09:10 pve kernel: [17879.773301] general protection fault: 0000 [#1] SMP NOPTI
Sep 23 19:09:10 pve kernel: [17879.773332] CPU: 9 PID: 1380 Comm: pve-firewall Tainted: P O 5.0.15-1-pve #1
Sep 23 19:09:10 pve kernel: [17879.773367] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./A320M Pro4, BIOS P6.10 08/09/2019
Sep 23 19:09:10 pve kernel: [17879.773411] RIP: 0010:task_work_run+0x8e/0xc0
Sep 23 19:09:10 pve kernel: [17879.773430] Code: 85 c9 75 e0 41 f6 44 24 24 04 4c 89 fa 49 0f 45 d6 eb d1 48 8b 7d d0 c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 48 85 c9 74 1e <48> 8b 1a 48 8b 42 08 48 89 d7 e8 b3 68 d4 00 e8 4e 9d 99 00 48 89
Sep 23 19:09:10 pve kernel: [17879.773509] RSP: 0018:ffffaa8608fb3ed8 EFLAGS: 00010206
Sep 23 19:09:10 pve kernel: [17879.773531] RAX: 0000000000000000 RBX: 0800000000000000 RCX: 0000000000000020
Sep 23 19:09:10 pve kernel: [17879.773561] RDX: 0800000000000000 RSI: ffff96415d1a1100 RDI: 0000000000000246
Sep 23 19:09:10 pve kernel: [17879.773591] RBP: ffffaa8608fb3f08 R08: 0000000000000000 R09: ffffffffb5c11000
Sep 23 19:09:10 pve kernel: [17879.773621] R10: ffff9641ae61ae88 R11: 0000000000000001 R12: ffff9641ae1fae00
Sep 23 19:09:10 pve kernel: [17879.773651] R13: ffff9641ae1fb900 R14: ffffffffb735b2a0 R15: 0000000000000000
Sep 23 19:09:10 pve kernel: [17879.773682] FS: 00007fb8e756c1c0(0000) GS:ffff9641be840000(0000) knlGS:0000000000000000
Sep 23 19:09:10 pve kernel: [17879.773716] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Sep 23 19:09:10 pve kernel: [17879.773740] CR2: 000055bc7d8ba6c8 CR3: 00000007f2e3e000 CR4: 00000000003406e0
Sep 23 19:09:10 pve kernel: [17879.773769] Call Trace:
Sep 23 19:09:10 pve kernel: [17879.773783] exit_to_usermode_loop+0xf2/0x100
Sep 23 19:09:10 pve kernel: [17879.773803] do_syscall_64+0xf0/0x110
Sep 23 19:09:10 pve kernel: [17879.773820] entry_SYSCALL_64_after_hwframe+0x44/0xa9
Sep 23 19:09:10 pve kernel: [17879.773842] RIP: 0033:0x7fb8e77795b1
Sep 23 19:09:10 pve kernel: [17879.773857] Code: 2d aa 00 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b3 0f 1f 80 00 00 00 00 8b 05 9a ee 00 00 85 c0 75 16 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f c3 66 0f 1f 44 00 00 53 89 fb 48 83 ec 10
Sep 23 19:09:10 pve kernel: [17879.773935] RSP: 002b:00007fff56b286b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000003
Sep 23 19:09:10 pve kernel: [17879.773994] RAX: 0000000000000000 RBX: 0000000000000010 RCX: 00007fb8e77795b1
Sep 23 19:09:10 pve kernel: [17879.774016] RDX: 000055bc77f0b500 RSI: 0000000000000000 RDI: 0000000000000010
Sep 23 19:09:10 pve kernel: [17879.774038] RBP: 000055bc79b74260 R08: 0000000000000000 R09: 0000000000000009
Sep 23 19:09:10 pve kernel: [17879.774060] R10: 0000000000000007 R11: 0000000000000246 R12: 000055bc7dfd60e0
Sep 23 19:09:10 pve kernel: [17879.774081] R13: 000055bc79b74260 R14: 0000000000000000 R15: 0000000000000000
Sep 23 19:09:10 pve kernel: [17879.774104] Modules linked in: veth tcp_diag inet_diag ebtable_filter ebtables ip_set ip6table_filter ip6_tables iptable_filter bpfilter softdog nfnetlink_log nfnetlink edac_mce_amd kvm_amd kvm irqbypass nls_iso8859_1 zfs(PO) zunicode(PO) zlua(PO) crct10dif_pclmul crc32_pclmul ghash_clmulni_intel snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio aesni_intel amdgpu snd_hda_codec_hdmi aes_x86_64 wmi_bmof crypto_simd chash cryptd input_leds amd_iommu_v2 glue_helper gpu_sched snd_hda_intel joydev ttm snd_hda_codec drm_kms_helper snd_hda_core pcspkr snd_hwdep k10temp drm snd_pcm i2c_algo_bit fb_sys_fops snd_timer syscopyarea sysfillrect sysimgblt snd soundcore ccp mac_hid zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) vhost_net vhost tap ib_iser rdma_cm iw_cm ib_cm ib_core sunrpc iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_tables x_tables autofs4 btrfs xor zstd_compress raid6_pq dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio libcrc32c hid_generic usbkbd usbmouse
Sep 23 19:09:10 pve kernel: [17879.774133] usbhid hid i2c_piix4 r8169 ahci realtek libahci wmi gpio_amdpt gpio_generic
Sep 23 19:09:10 pve kernel: [17879.774433] ---[ end trace 0b7407669d03f003 ]---
Sep 23 19:09:10 pve kernel: [17879.774450] RIP: 0010:task_work_run+0x8e/0xc0
Sep 23 19:09:10 pve kernel: [17879.774464] Code: 85 c9 75 e0 41 f6 44 24 24 04 4c 89 fa 49 0f 45 d6 eb d1 48 8b 7d d0 c6 07 00 0f 1f 40 00 fb 66 0f 1f 44 00 00 48 85 c9 74 1e <48> 8b 1a 48 8b 42 08 48 89 d7 e8 b3 68 d4 00 e8 4e 9d 99 00 48 89
Sep 23 19:09:10 pve systemd[1]: pve-firewall.service: Main process exited, code=killed, status=11/SEGV
Sep 23 19:09:10 pve systemd[1]: pve-firewall.service: Failed with result 'signal'.
Sep 23 19:09:10 pve kernel: [17879.774519] RSP: 0018:ffffaa8608fb3ed8 EFLAGS: 00010206
Sep 23 19:09:10 pve kernel: [17879.774534] RAX: 0000000000000000 RBX: 0800000000000000 RCX: 0000000000000020
Sep 23 19:09:10 pve kernel: [17879.774552] RDX: 0800000000000000 RSI: ffff96415d1a1100 RDI: 0000000000000246
Sep 23 19:09:10 pve kernel: [17879.774570] RBP: ffffaa8608fb3f08 R08: 0000000000000000 R09: ffffffffb5c11000
Sep 23 19:09:10 pve kernel: [17879.774584] R10: ffff9641ae61ae88 R11: 0000000000000001 R12: ffff9641ae1fae00
Sep 23 19:09:10 pve kernel: [17879.774599] R13: ffff9641ae1fb900 R14: ffffffffb735b2a0 R15: 0000000000000000
Sep 23 19:09:10 pve kernel: [17879.774614] FS: 00007fb8e756c1c0(0000) GS:ffff9641be840000(0000) knlGS:0000000000000000
Sep 23 19:09:10 pve kernel: [17879.774631] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Sep 23 19:09:10 pve kernel: [17879.774643] CR2: 000055bc7d8ba6c8 CR3: 00000007f2e3e000 CR4: 00000000003406e0
Sep 23 19:10:00 pve systemd[1]: Starting Proxmox VE replication runner...
Sep 23 19:10:01 pve systemd[1]: pvesr.service: Succeeded.
Sep 23 19:10:01 pve systemd[1]: Started Proxmox VE replication runner.
Sep 23 19:11:00 pve systemd[1]: Starting Proxmox VE replication runner...
Sep 23 19:11:01 pve systemd[1]: pvesr.service: Succeeded.
Sep 23 19:11:01 pve systemd[1]: Started Proxmox VE replication runner.
Sep 23 19:11:21 pve smartd[920]: Device: /dev/sdb [SAT], SMART Usage Attribute: 190 Airflow_Temperature_Cel changed from 66 to 67
Sep 23 19:11:21 pve smartd[920]: Device: /dev/sdb [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 34 to 33
Sep 23 19:12:00 pve systemd[1]: Starting Proxmox VE replication runner...
Sep 23 19:12:01 pve systemd[1]: pvesr.service: Succeeded.
Sep 23 19:12:01 pve systemd[1]: Started Proxmox VE replication runner.

Sep 23 19:16:01 pve systemd[1]: Started Proxmox VE replication runner.
Sep 23 19:17:00 pve systemd[1]: Starting Proxmox VE replication runner...
Sep 23 19:17:01 pve systemd[1]: pvesr.service: Succeeded.
Sep 23 19:17:01 pve systemd[1]: Started Proxmox VE replication runner.
Sep 23 19:17:01 pve CRON[18027]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Sep 23 19:18:00 pve systemd[1]: Starting Proxmox VE replication runner...
Sep 23 19:18:01 pve systemd[1]: pvesr.service: Succeeded.
Sep 23 19:18:01 pve systemd[1]: Started Proxmox VE replication runner.
Sep 23 19:19:00 pve systemd[1]: Starting Proxmox VE replication runner...
Sep 23 19:19:01 pve systemd[1]: pvesr.service: Succeeded.
Sep 23 19:19:01 pve systemd[1]: Started Proxmox VE replication runner.

Sep 23 19:40:01 pve systemd[1]: Started Proxmox VE replication runner.
Sep 23 19:41:00 pve systemd[1]: Starting Proxmox VE replication runner...
Sep 23 19:41:01 pve systemd[1]: pvesr.service: Succeeded.
Sep 23 19:41:01 pve systemd[1]: Started Proxmox VE replication runner.
Sep 23 19:41:21 pve smartd[920]: Device: /dev/nvme0, number of Error Log entries increased from 36 to 38
Sep 23 19:41:22 pve postfix/qmgr[1285]: 242B41E0D2D: from=<root@pve.asiart.invalid>, size=1029, nrcpt=1 (queue active)
Sep 23 19:41:22 pve postfix/local[19295]: error: open database /etc/aliases.db: No such file or directory
Sep 23 19:41:22 pve postfix/local[19295]: warning: hash:/etc/aliases is unavailable. open database /etc/aliases.db: No such file or directory
Sep 23 19:41:22 pve postfix/local[19295]: warning: hash:/etc/aliases: lookup of 'root' failed
Sep 23 19:41:22 pve postfix/local[19295]: 242B41E0D2D: to=<root@pve.asiart.invalid>, orig_to=<root>, relay=local, delay=9000, delays=9000/0.01/0/0.01, dsn=4.3.0, status=deferred (alias database unavailable)
Sep 23 19:41:22 pve postfix/local[19295]: using backwards-compatible default setting relay_domains=$mydestination to update fast-flush logfile for domain "pve.asiart.invalid"
Sep 23 19:42:00 pve systemd[1]: Starting Proxmox VE replication runner...
Sep 23 20:17:01 pve systemd[1]: pvesr.service: Succeeded.
Sep 23 20:17:01 pve systemd[1]: Started Proxmox VE replication runner.
Sep 23 20:17:01 pve CRON[21146]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Sep 23 20:18:00 pve systemd[1]: Starting Proxmox VE replication runner...
Sep 23 20:18:01 pve systemd[1]: pvesr.service: Succeeded.

 

[t.lamprecht]

Hi,

hmm, the pve-firewall services produces a general protection fault, that's a bit strange..

Can you post your (compiled) firewall rules?

pve-firewall compile

Also, a newer kernel than 5.0.15 is available, 5.0.21 based, with quite some fixes included, can you upgraded to that one and see if that helps? Just ensure you have either a valid subscription for the Enterprise Repository or setup the public accessible community package repository, see https://pve.proxmox.com/wiki/Package_Repositories#_proxmox_ve_no_subscription_repository

 

[t.lamprecht]

it's this?

No, either over a SSH shell or over the Webinterface (Node -> Shell) execute:

pve-firewall compile

and post the outputs here, not sure if it can help to determine the issue, but more information would be good to have here.