proxmox VE 7.1-11 free segfaults with excessive io delay

[stvarkas]

Hello,
i have a proxmox VE 7.1-11 with lcx containers and experiencing the following condition.
Sometimes the server seems to have excessive io delay and the containers become inaccessible
with the following messages in the system log.

Jun 2 04:35:04 proms kernel: [4423712.381603] free[3570756]: segfault at 607000 ip 0000000000401da1 sp 00007fff7b372060 error 4 in free[400000+3000]
Jun 2 04:35:04 proms kernel: [4423712.381625] Code: 1f 23 40 00 b9 00 20 00 00 ba 01 00 00 00 be 00 20 00 00 bf e0 41 60 00 e8 0c f3 ff ff 83 f8 04 0f 8e 67 01 00 00 48 83 c3 01 <0f> be 2b 40 80 fd 30 0f 84 56 01 00 00 b8 f4 40 60
00 89 de 48 c7
Jun 2 04:37:39 proms kernel: [4423866.963099] free[3580496]: segfault at 607000 ip 0000000000401da1 sp 00007ffe210eee50 error 4 in free[400000+3000]
Jun 2 04:37:39 proms kernel: [4423866.963121] Code: 1f 23 40 00 b9 00 20 00 00 ba 01 00 00 00 be 00 20 00 00 bf e0 41 60 00 e8 0c f3 ff ff 83 f8 04 0f 8e 67 01 00 00 48 83 c3 01 <0f> be 2b 40 80 fd 30 0f 84 56 01 00 00 b8 f4 40 60
00 89 de 48 c7
Jun 2 04:39:06 proms kernel: [4423954.092806] free[3585332]: segfault at 607000 ip 0000000000401da1 sp 00007ffe7d2b0980 error 4 in free[400000+3000]
Jun 2 04:39:06 proms kernel: [4423954.092820] Code: 1f 23 40 00 b9 00 20 00 00 ba 01 00 00 00 be 00 20 00 00 bf e0 41 60 00 e8 0c f3 ff ff 83 f8 04 0f 8e 67 01 00 00 48 83 c3 01 <0f> be 2b 40 80 fd 30 0f 84 56 01 00 00 b8 f4 40 60
00 89 de 48 c7
Jun 2 04:42:18 proms kernel: [4424145.864732] free[3596027]: segfault at 607000 ip 0000000000401da1 sp 00007ffec2aec490 error 4 in free[400000+3000]
Jun 2 04:42:18 proms kernel: [4424145.864746] Code: 1f 23 40 00 b9 00 20 00 00 ba 01 00 00 00 be 00 20 00 00 bf e0 41 60 00 e8 0c f3 ff ff 83 f8 04 0f 8e 67 01 00 00 48 83 c3 01 <0f> be 2b 40 80 fd 30 0f 84 56 01 00 00 b8 f4 40 60
00 89 de 48 c7
Jun 2 04:48:39 proms kernel: [4424527.438429] free[3611422]: segfault at 607000 ip 0000000000401da1 sp 00007ffcac748850 error 4 in free[400000+3000]
Jun 2 04:48:39 proms kernel: [4424527.438450] Code: 1f 23 40 00 b9 00 20 00 00 ba 01 00 00 00 be 00 20 00 00 bf e0 41 60 00 e8 0c f3 ff ff 83 f8 04 0f 8e 67 01 00 00 48 83 c3 01 <0f> be 2b 40 80 fd 30 0f 84 56 01 00 00 b8 f4 40 60
00 89 de 48 c7

The server becomes operational again without any action , sometimes the server seems to crash and reboot.

thainks in advance

 

[fabian]

that usually indicates either a disk or memory hardware issue. check with memtest86 and debsums/smartctl.

 

[stvarkas]

thanks for the quick reply,
i have the swap off on the host , you have any indications that may be this causing the problem ?

The memory usage never exceeds the 60% of the available RAM

 

[fabian]

no - it's a pointer to some hardware being broken..