LXC Containers not booting after node failed in cluster

abulhallaj

New Member
Jan 1, 2025
6
0
1
Hi

yesterday one of my 5 nodes in cluster failed and some containers migrated from that node to others, but they didn't boot up and have some strange error, containers stored on NAS storage via NFS. If I stop an runnig LXC is w

  • Containers not starting
  • Can't move or migrate Containers
  • Can't Backup Containers
  • All VM's in OK
  • All Running containers is OK
  • If i try to restart a container it won't start
root@pve02:~# lxc-start -n 108 -F -lDEBUG -o lxc-108.log
lxc-start: 108: ../src/lxc/utils.c: run_buffer: 571 Script exited with status 1
lxc-start: 108: ../src/lxc/start.c: lxc_init: 845 Failed to run lxc.hook.pre-start for container "108"
lxc-start: 108: ../src/lxc/start.c: __lxc_start: 2034 Failed to initialize container "108"
lxc-start: 108: ../src/lxc/tools/lxc_start.c: lxc_start_main: 307 The container failed to start
lxc-start: 108: ../src/lxc/tools/lxc_start.c: lxc_start_main: 312 Additional information can be obtained by setting the --logfile and --logpriority options
lxc-start 108 20250430201239.180 INFO confile - ../src/lxc/confile.c:set_config_idmaps:2273 - Read uid map: type u nsid 0 hostid 100000 range 65536
lxc-start 108 20250430201239.180 INFO confile - ../src/lxc/confile.c:set_config_idmaps:2273 - Read uid map: type g nsid 0 hostid 100000 range 65536
lxc-start 108 20250430201239.181 INFO lsm - ../src/lxc/lsm/lsm.c:lsm_init_static:38 - Initialized LSM security driver AppArmor
lxc-start 108 20250430201239.181 INFO utils - ../src/lxc/utils.c:run_script_argv:587 - Executing script "/usr/share/lxc/hooks/lxc-pve-prestart-hook" for container "108", config section "lxc"
lxc-start 108 20250430201240.404 DEBUG utils - ../src/lxc/utils.c:run_buffer:560 - Script exec /usr/share/lxc/hooks/lxc-pve-prestart-hook 108 lxc pre-start produced output: close (rename) atomic file '/etc/systemd/system-preset/00-pve.preset' failed: Structure needs cleaning

lxc-start 108 20250430201240.410 DEBUG utils - ../src/lxc/utils.c:run_buffer:560 - Script exec /usr/share/lxc/hooks/lxc-pve-prestart-hook 108 lxc pre-start produced output: error in setup task PVE::LXC::Setup::pre_start_hook

lxc-start 108 20250430201240.469 ERROR utils - ../src/lxc/utils.c:run_buffer:571 - Script exited with status 1
lxc-start 108 20250430201240.469 ERROR start - ../src/lxc/start.c:lxc_init:845 - Failed to run lxc.hook.pre-start for container "108"
lxc-start 108 20250430201240.469 ERROR start - ../src/lxc/start.c:__lxc_start:2034 - Failed to initialize container "108"
lxc-start 108 20250430201240.470 INFO utils - ../src/lxc/utils.c:run_script_argv:587 - Executing script "/usr/share/lxc/hooks/lxc-pve-poststop-hook" for container "108", config section "lxc"
lxc-start 108 20250430201241.539 INFO utils - ../src/lxc/utils.c:run_script_argv:587 - Executing script "/usr/share/lxcfs/lxc.reboot.hook" for container "108", config section "lxc"
lxc-start 108 20250430201242.447 ERROR lxc_start - ../src/lxc/tools/lxc_start.c:lxc_start_main:307 - The container failed to start
lxc-start 108 20250430201242.448 ERROR lxc_start - ../src/lxc/tools/lxc_start.c:lxc_start_main:312 - Additional information can be obtained by setting the --logfile and --logpriority options
lxc-start 108 20250501102914.808 INFO confile - ../src/lxc/confile.c:set_config_idmaps:2273 - Read uid map: type u nsid 0 hostid 100000 range 65536
lxc-start 108 20250501102914.808 INFO confile - ../src/lxc/confile.c:set_config_idmaps:2273 - Read uid map: type g nsid 0 hostid 100000 range 65536
lxc-start 108 20250501102914.809 INFO lsm - ../src/lxc/lsm/lsm.c:lsm_init_static:38 - Initialized LSM security driver AppArmor
lxc-start 108 20250501102914.809 INFO utils - ../src/lxc/utils.c:run_script_argv:587 - Executing script "/usr/share/lxc/hooks/lxc-pve-prestart-hook" for container "108", config section "lxc"
lxc-start 108 20250501102915.957 DEBUG utils - ../src/lxc/utils.c:run_buffer:560 - Script exec /usr/share/lxc/hooks/lxc-pve-prestart-hook 108 lxc pre-start produced output: close (rename) atomic file '/etc/systemd/system-preset/00-pve.preset' failed: Structure needs cleaning

lxc-start 108 20250501102915.961 DEBUG utils - ../src/lxc/utils.c:run_buffer:560 - Script exec /usr/share/lxc/hooks/lxc-pve-prestart-hook 108 lxc pre-start produced output: error in setup task PVE::LXC::Setup::pre_start_hook

lxc-start 108 20250501102915.994 ERROR utils - ../src/lxc/utils.c:run_buffer:571 - Script exited with status 1
lxc-start 108 20250501102915.994 ERROR start - ../src/lxc/start.c:lxc_init:845 - Failed to run lxc.hook.pre-start for container "108"
lxc-start 108 20250501102915.994 ERROR start - ../src/lxc/start.c:__lxc_start:2034 - Failed to initialize container "108"
lxc-start 108 20250501102915.995 INFO utils - ../src/lxc/utils.c:run_script_argv:587 - Executing script "/usr/share/lxc/hooks/lxc-pve-poststop-hook" for container "108", config section "lxc"
lxc-start 108 20250501102917.558 INFO utils - ../src/lxc/utils.c:run_script_argv:587 - Executing script "/usr/share/lxcfs/lxc.reboot.hook" for container "108", config section "lxc"
lxc-start 108 20250501102917.561 ERROR lxc_start - ../src/lxc/tools/lxc_start.c:lxc_start_main:307 - The container failed to start
lxc-start 108 20250501102917.561 ERROR lxc_start - ../src/lxc/tools/lxc_start.c:lxc_start_main:312 - Additional information can be obtained by setting the --logfile and --logpriority options
 
lxc-start 108 20250430201240.404 DEBUG utils - ../src/lxc/utils.c:run_buffer:560 - Script exec /usr/share/lxc/hooks/lxc-pve-prestart-hook 108 lxc pre-start produced output: close (rename) atomic file '/etc/systemd/system-preset/00-pve.preset' failed: Structure needs cleaning
Looks like ext4 needs fsck in image file. Do a loop mount of your image and run it on. Then umount and try to start lxc again.