lvm issue

RobFantini · Sep 8, 2016

Hello,

we have 10 lxc running on lvm storage . after a system crash [ due to a power issue ] lvm has issues.

the lxc's will not start. here is output from debug mode:

Code:

lxc-start -n 12740 -F --logfile=lxc.log --logpriority=debug

mount: special device /dev/pve/vm-12740-disk-1 does not exist
command 'mount /dev/pve/vm-12740-disk-1 /var/lib/lxc/12740/rootfs//' failed: exit code 32
lxc-start: conf.c: run_buffer: 347 Script exited with status 32
lxc-start: start.c: lxc_init: 465 failed to run pre-start hooks for container '12740'.
lxc-start: start.c: __lxc_start: 1313 failed to initialize the container
lxc-start: tools/lxc_start.c: main: 344 The container failed to start.
lxc-start: tools/lxc_start.c: main: 348 Additional information can be obtained by setting the --logfile and --logpriority options.

and /dev/pve just has:

Code:

lrwxrwxrwx 1 root root 7 Sep  7 21:10 root -> ../dm-0
lrwxrwxrwx 1 root root 7 Sep  7 21:10 swap -> ../dm-1

on system startup lvm2 complains , from syslog:

Code:

Sep  7 21:10:34 pve-in-kvm systemd[1]: lvm2-activation-early.service: main process exited, code=exited, status=5/NOTINSSTALLED
Sep  7 21:10:34 pve-in-kvm systemd[1]: Unit lvm2-activation-early.service entered failed state.
Sep  7 21:10:34 pve-in-kvm systemd[1]: lvm2-activation.service: main process exited, code=exited, status=5/NOTINSSTALLED
Sep  7 21:10:34 pve-in-kvm systemd[1]: Unit lvm2-activation.service entered failed state.

I searched and tried this:

Code:

# vgchange -a y
  Check of pool pve/data failed (status:1). Manual repair required!
  2 logical volume(s) in volume group "pve" now active

lvm info:

Code:

pve-in-kvm  /fbc/adm/lxc # pvs
  PV  VG  Fmt  Attr PSize  PFree  
  /dev/vda3  pve  lvm2 a--  599.87g 109.77g
pve-in-kvm  /fbc/adm/lxc # vgs
  VG  #PV #LV #SN Attr  VSize  VFree  
  pve  1  14  0 wz--n- 599.87g 109.77g
pve-in-kvm  /fbc/adm/lxc # lvs
  LV  VG  Attr  LSize  Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  data  pve  twi---tz-- 468.25g   
  root  pve  -wi-ao----  19.75g   
  swap  pve  -wi-a-----  2.00g   
  vm-12101-disk-2 pve  Vwi---tz--  4.00g data   
  vm-12106-disk-1 pve  Vwi---tz--  32.00g data   
  vm-12108-disk-1 pve  Vwi---tz--  8.00g data   
  vm-12110-disk-1 pve  Vwi---tz--  8.00g data   
  vm-12444-disk-1 pve  Vwi---tz--  14.00g data   
  vm-12501-disk-1 pve  Vwi---tz--  14.00g data   
  vm-12710-disk-1 pve  Vwi---tz--  30.00g data   
  vm-12720-disk-1 pve  Vwi---tz--  50.00g data   
  vm-12730-disk-1 pve  Vwi---tz--  2.00g data   
  vm-12740-disk-1 pve  Vwi---tz--  6.00g data   
  vm-12750-disk-1 pve  Vwi---tz--  16.00g data

Does anyone have a suggestion to try to get this fixed?

dietmar · Sep 8, 2016

Please try to activate LV pve/data

# lvchange -a y pve/data

dietmar · Sep 8, 2016

Oh, seem pve/data is damaged somehow, so you need to repair that. I assume you have a backup of all important data? If not, I would make a copy of the whole disk and do all further work on that copy.

To actually repair the lvm thin pool, you can try:

# lvconvert --repair pve/data

RobFantini · Sep 8, 2016

dietmar said:
Oh, seem pve/data is damaged somehow, so you need to repair that. I assume you have a backup of all important data? If not, I would make a copy of the whole disk and do all further work on that copy.

To actually repair the lvm thin pool, you can try:

# lvconvert --repair pve/data

Code:

# lvchange -a y pve/data   
  Check of pool pve/data failed (status:1). Manual repair required!
pve-in-kvm  ~ #  lvconvert --repair pve/data
  WARNING: If everything works, remove "pve/data_meta0".
  WARNING: Use pvmove command to move "pve/data_tmeta" on the best fitting PV.
pve-in-kvm  ~ # ./start-debug-mode 12740   
mount: special device /dev/pve/vm-12740-disk-1 does not exist
command 'mount /dev/pve/vm-12740-disk-1 /var/lib/lxc/12740/rootfs//' failed: exit code 32
lxc-start: conf.c: run_buffer: 347 Script exited with status 32
lxc-start: start.c: lxc_init: 465 failed to run pre-start hooks for container '12740'.
lxc-start: start.c: __lxc_start: 1313 failed to initialize the container
lxc-start: tools/lxc_start.c: main: 344 The container failed to start.
lxc-start: tools/lxc_start.c: main: 348 Additional information can be obtained by setting the --logfile and --logpriority options.

I do have data backed up. However would like to continue trying to get his fixed.

More information: the VG had only 9GB free , before posting here I added 100GB to the disk and lvm following pve wiki.

dietmar · Sep 8, 2016

Can you activate the volume after the repair? What is the output of 'lvs'?

RobFantini · Sep 8, 2016

dietmar said:
Can you activate the volume after the repair? What is the output of 'lvs'?

Code:

pve-in-kvm  ~ #  lvchange -a y pve/data
pve-in-kvm  ~ # lvs
  LV  VG  Attr  LSize  Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  data  pve  twi-aotz-- 468.25g  0.00  3.64   
  data_meta0  pve  -wi-a-----  52.00m   
  root  pve  -wi-ao----  19.75g   
  swap  pve  -wi-a-----  2.00g   
  vm-12101-disk-2 pve  Vwi---tz--  4.00g data   
  vm-12106-disk-1 pve  Vwi---tz--  32.00g data   
  vm-12108-disk-1 pve  Vwi---tz--  8.00g data   
  vm-12110-disk-1 pve  Vwi---tz--  8.00g data   
  vm-12444-disk-1 pve  Vwi---tz--  14.00g data   
  vm-12501-disk-1 pve  Vwi---tz--  14.00g data   
  vm-12710-disk-1 pve  Vwi---tz--  30.00g data   
  vm-12720-disk-1 pve  Vwi---tz--  50.00g data   
  vm-12730-disk-1 pve  Vwi---tz--  2.00g data   
  vm-12740-disk-1 pve  Vwi---tz--  6.00g data   
  vm-12750-disk-1 pve  Vwi---tz--  16.00g data

RobFantini · Sep 8, 2016

will check in again after sleep.

Iventa Markus Kaefer · Nov 19, 2017

Hello!

I am pushing this thread, because it seems I have a similar problem. My RAID Controller crashed and was replaced by the server provider. (it is a dedicated server)

I am running 4.4-12/e71b7a74.

After the replacement Proxmox booted normally and mounted root and swap filesystem.
the vg pve was completly inactive and needed manual repair to activate them.

First I was not able to activate the LVs but after
lvconvert --repair pve/data
a data_meta0 was created and I was able to activate the LVs with the command
lvchange -a y pve/data

BUT my lxc's are not booting. The web interface only gives me the message that I should look at the systemctl.
the Systemctl shows:
root@david:~# systemctl status lxc@101.service

Code:

root@david:~# systemctl status lxc@101.service
● lxc@101.service - LXC Container: 101
   Loaded: loaded (/lib/systemd/system/lxc@.service; disabled)
  Drop-In: /usr/lib/systemd/system/lxc@.service.d
           └─pve-reboot.conf
   Active: failed (Result: exit-code) since Sun 2017-11-19 22:07:26 CET; 39min ago
     Docs: man:lxc-start
           man:lxc
  Process: 6452 ExecStart=/usr/bin/lxc-start -n %i (code=exited, status=1/FAILURE)

Nov 19 22:07:26 david lxc-start[6452]: lxc-start: tools/lxc_start.c: main: 366 The container failed to start.
Nov 19 22:07:26 david lxc-start[6452]: lxc-start: tools/lxc_start.c: main: 368 To get more details, run the container in foreground mode.
Nov 19 22:07:26 david lxc-start[6452]: lxc-start: tools/lxc_start.c: main: 370 Additional information can be obtained by setting the --logfile and --logpriority options.
Nov 19 22:07:26 david systemd[1]: lxc@101.service: control process exited, code=exited status=1
Nov 19 22:07:26 david systemd[1]: Failed to start LXC Container: 101.
Nov 19 22:07:26 david systemd[1]: Unit lxc@101.service entered failed state.

If I turn on DEBUG the following entries are in the logfile:

Code:

      lxc-start 20171119221009.708 INFO     lxc_start_ui - tools/lxc_start.c:main:275 - using rcfile /var/lib/lxc/100/config
      lxc-start 20171119221009.708 WARN     lxc_confile - confile.c:config_pivotdir:1910 - lxc.pivotdir is ignored.  It will soon become an error.
      lxc-start 20171119221009.708 WARN     lxc_start - start.c:lxc_check_inherited:238 - Inherited fd: 3.
      lxc-start 20171119221009.708 INFO     lxc_lsm - lsm/lsm.c:lsm_init:48 - LSM security driver AppArmor
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:402 - processing: .reject_force_umount  # comment this to allow umount -f;  not recommended.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:567 - Adding native rule for reject_force_umount action 0.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:251 - Setting Seccomp rule to reject force umounts.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:570 - Adding compat rule for reject_force_umount action 0.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:251 - Setting Seccomp rule to reject force umounts.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:402 - processing: .[all].
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:402 - processing: .kexec_load errno 1.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:567 - Adding native rule for kexec_load action 327681.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:570 - Adding compat rule for kexec_load action 327681.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:402 - processing: .open_by_handle_at errno 1.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:567 - Adding native rule for open_by_handle_at action 327681.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:570 - Adding compat rule for open_by_handle_at action 327681.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:402 - processing: .init_module errno 1.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:567 - Adding native rule for init_module action 327681.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:570 - Adding compat rule for init_module action 327681.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:402 - processing: .finit_module errno 1.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:567 - Adding native rule for finit_module action 327681.
      lxc-start 20171119221009.708 WARN     lxc_seccomp - seccomp.c:do_resolve_add_rule:270 - Seccomp: got negative for syscall: -10085: finit_module.
      lxc-start 20171119221009.708 WARN     lxc_seccomp - seccomp.c:do_resolve_add_rule:271 - This syscall will NOT be blacklisted.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:570 - Adding compat rule for finit_module action 327681.
      lxc-start 20171119221009.708 WARN     lxc_seccomp - seccomp.c:do_resolve_add_rule:270 - Seccomp: got negative for syscall: -10085: finit_module.
      lxc-start 20171119221009.708 WARN     lxc_seccomp - seccomp.c:do_resolve_add_rule:271 - This syscall will NOT be blacklisted.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:402 - processing: .delete_module errno 1.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:567 - Adding native rule for delete_module action 327681.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:570 - Adding compat rule for delete_module action 327681.
      lxc-start 20171119221009.709 INFO     lxc_seccomp - seccomp.c:parse_config_v2:580 - Merging in the compat Seccomp ctx into the main one.
      lxc-start 20171119221009.709 INFO     lxc_conf - conf.c:run_script_argv:424 - Executing script "/usr/share/lxc/hooks/lxc-pve-prestart-hook" for container "100", config section "lxc".
      lxc-start 20171119221010.237 DEBUG    lxc_start - start.c:setup_signal_fd:273 - Set SIGCHLD handler with file descriptor: 6.
      lxc-start 20171119221010.238 DEBUG    console - console.c:lxc_console_peer_default:430 - opening /dev/tty for console peer
      lxc-start 20171119221010.238 DEBUG    console - console.c:lxc_console_peer_default:436 - using '/dev/tty' as console
      lxc-start 20171119221010.238 DEBUG    console - console.c:lxc_console_sigwinch_init:144 - 16592 got SIGWINCH fd 10
      lxc-start 20171119221010.238 DEBUG    console - console.c:lxc_console_winsz:71 - set winsz dstfd:7 cols:209 rows:48
      lxc-start 20171119221010.238 INFO     lxc_start - start.c:lxc_init:475 - Container "100" is initialized.
      lxc-start 20171119221010.238 DEBUG    lxc_start - start.c:__lxc_start:1336 - Not dropping CAP_SYS_BOOT or watching utmp.
      lxc-start 20171119221010.239 INFO     lxc_conf - conf.c:run_script:475 - Executing script "/usr/share/lxc/lxcnetaddbr" for container "100", config section "net".
      lxc-start 20171119221010.576 DEBUG    lxc_conf - conf.c:instantiate_veth:2694 - instantiated veth 'veth100i0/vethV1DPDW', index is '8'
      lxc-start 20171119221010.576 INFO     lxc_cgroup - cgroups/cgroup.c:cgroup_init:68 - cgroup driver cgroupfs-ng initing for 100
      lxc-start 20171119221010.576 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:filter_and_set_cpus:475 - No isolated cpus detected.
      lxc-start 20171119221010.576 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:handle_cpuset_hierarchy:645 - "cgroup.clone_children" was already set to "1".
      lxc-start 20171119221010.577 INFO     lxc_start - start.c:lxc_spawn:1155 - Cloned CLONE_NEWNS.
      lxc-start 20171119221010.577 INFO     lxc_start - start.c:lxc_spawn:1155 - Cloned CLONE_NEWPID.
      lxc-start 20171119221010.577 INFO     lxc_start - start.c:lxc_spawn:1155 - Cloned CLONE_NEWUTS.
      lxc-start 20171119221010.577 INFO     lxc_start - start.c:lxc_spawn:1155 - Cloned CLONE_NEWIPC.
      lxc-start 20171119221010.577 INFO     lxc_start - start.c:lxc_spawn:1155 - Cloned CLONE_NEWNET.
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.deny' set to 'a'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c *:* m'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'b *:* m'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:3 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:5 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:7 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 5:0 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 5:1 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 5:2 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:8 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:9 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 136:* rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:229 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 254:0 rm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:200 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:228 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:232 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'memory.limit_in_bytes' set to '8589934592'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'memory.memsw.limit_in_bytes' set to '10737418240'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'cpu.shares' set to '1024'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'cpuset.cpus' set to '2-4,6'
      lxc-start 20171119221010.577 INFO     lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2013 - cgroup has been setup
      lxc-start 20171119221010.623 DEBUG    lxc_conf - conf.c:lxc_assign_network:3190 - move 'vethV1DPDW'/'eth0' to '16635': .
      lxc-start 20171119221010.625 DEBUG    lxc_conf - conf.c:setup_rootfs:1273 - mounted '/var/lib/lxc/100/rootfs' on '/usr/lib/x86_64-linux-gnu/lxc/rootfs'
      lxc-start 20171119221010.625 INFO     lxc_conf - conf.c:setup_utsname:901 - 'web' hostname has been setup
      lxc-start 20171119221010.639 DEBUG    lxc_conf - conf.c:setup_hw_addr:2225 - mac address '56:C2:08:8A:9F:CB' on 'eth0' has been setup
      lxc-start 20171119221010.639 DEBUG    lxc_conf - conf.c:setup_netdev:2452 - 'eth0' has been setup
      lxc-start 20171119221010.639 INFO     lxc_conf - conf.c:setup_network:2473 - network has been setup
      lxc-start 20171119221010.639 INFO     lxc_conf - conf.c:mount_autodev:1130 - Mounting container /dev
      lxc-start 20171119221010.639 INFO     lxc_conf - conf.c:mount_autodev:1153 - Mounted tmpfs onto /usr/lib/x86_64-linux-gnu/lxc/rootfs/dev
      lxc-start 20171119221010.639 INFO     lxc_conf - conf.c:mount_autodev:1171 - Mounted container /dev
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1715 - remounting /sys/fs/fuse/connections on /usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/fs/fuse/connections to respect bind or remount options
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1730 - (at remount) flags for /sys/fs/fuse/connections was 4096, required extra flags are 0
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1739 - mountflags already was 4096, skipping remount
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1765 - mounted '/sys/fs/fuse/connections' on '/usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/fs/fuse/connections', type 'none'
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1715 - remounting /sys/kernel/debug on /usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/kernel/debug to respect bind or remount options
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1730 - (at remount) flags for /sys/kernel/debug was 4096, required extra flags are 0
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1739 - mountflags already was 4096, skipping remount
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1765 - mounted '/sys/kernel/debug' on '/usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/kernel/debug', type 'none'
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1715 - remounting /sys/kernel/security on /usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/kernel/security to respect bind or remount options
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1730 - (at remount) flags for /sys/kernel/security was 4110, required extra flags are 14
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1765 - mounted '/sys/kernel/security' on '/usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/kernel/security', type 'none'
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1715 - remounting /sys/fs/pstore on /usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/fs/pstore to respect bind or remount options
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1730 - (at remount) flags for /sys/fs/pstore was 4110, required extra flags are 14
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1765 - mounted '/sys/fs/pstore' on '/usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/fs/pstore', type 'none'
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1765 - mounted 'mqueue' on '/usr/lib/x86_64-linux-gnu/lxc/rootfs/dev/mqueue', type 'mqueue'
      lxc-start 20171119221010.663 INFO     lxc_conf - conf.c:mount_file_entries:1985 - mount points have been setup
      lxc-start 20171119221010.663 INFO     lxc_conf - conf.c:run_script_argv:424 - Executing script "/usr/share/lxcfs/lxc.mount.hook" for container "100", config section "lxc".
      lxc-start 20171119221010.686 INFO     lxc_conf - conf.c:run_script_argv:424 - Executing script "/usr/share/lxc/hooks/lxc-pve-autodev-hook" for container "100", config section "lxc".
      lxc-start 20171119221010.807 INFO     lxc_conf - conf.c:fill_autodev:1199 - Creating initial consoles under container /dev
      lxc-start 20171119221010.807 INFO     lxc_conf - conf.c:fill_autodev:1210 - Populating container /dev
      lxc-start 20171119221010.807 INFO     lxc_conf - conf.c:fill_autodev:1247 - Populated container /dev
      lxc-start 20171119221010.807 INFO     lxc_conf - conf.c:setup_ttydir_console:1516 - created /usr/lib/x86_64-linux-gnu/lxc/rootfs/dev/lxc
      lxc-start 20171119221010.807 INFO     lxc_conf - conf.c:setup_ttydir_console:1562 - console has been setup on lxc/console
      lxc-start 20171119221010.807 INFO     lxc_utils - utils.c:mount_proc_if_needed:1785 - I am 1, /proc/self points to '1'
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:setup_rootfs_pivot_root:1108 - pivot_root syscall to '/usr/lib/x86_64-linux-gnu/lxc/rootfs' successful
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:lxc_create_tty:3434 - allocated pty '/dev/pts/0' (12/15)
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:lxc_create_tty:3434 - allocated pty '/dev/pts/1' (16/17)
      lxc-start 20171119221010.819 INFO     lxc_conf - conf.c:lxc_create_tty:3445 - tty's configured
      lxc-start 20171119221010.819 INFO     lxc_conf - conf.c:setup_tty:1053 - 2 tty(s) has been setup
      lxc-start 20171119221010.819 INFO     lxc_conf - conf.c:setup_personality:1451 - set personality to '0x0'
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:setup_caps:2135 - drop capability 'mac_admin' (33)
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:setup_caps:2135 - drop capability 'mac_override' (32)
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:setup_caps:2135 - drop capability 'sys_time' (25)
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:setup_caps:2135 - drop capability 'sys_module' (16)
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:setup_caps:2135 - drop capability 'sys_rawio' (17)
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:setup_caps:2144 - capabilities have been setup
      lxc-start 20171119221010.819 NOTICE   lxc_conf - conf.c:lxc_setup:3982 - '100' is setup.
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.deny' set to 'a'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c *:* m'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'b *:* m'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:3 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:5 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:7 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 5:0 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 5:1 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 5:2 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:8 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:9 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 136:* rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:229 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 254:0 rm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:200 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:228 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:232 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'memory.limit_in_bytes' set to '8589934592'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'memory.memsw.limit_in_bytes' set to '10737418240'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'cpu.shares' set to '1024'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'cpuset.cpus' set to '2-4,6'
      lxc-start 20171119221010.819 INFO     lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2013 - cgroup has been setup
      lxc-start 20171119221010.839 INFO     lxc_start - start.c:do_start:836 - Unshared CLONE_NEWCGROUP.
      lxc-start 20171119221010.839 INFO     lxc_apparmor - lsm/apparmor.c:apparmor_process_label_set:238 - changed apparmor profile to lxc-container-default-cgns
      lxc-start 20171119221010.840 NOTICE   lxc_start - start.c:start:1447 - Exec'ing "/sbin/init".
      lxc-start 20171119221010.896 NOTICE   lxc_start - start.c:post_start:1458 - Started "/sbin/init" with pid "16635".
      lxc-start 20171119221010.896 WARN     lxc_start - start.c:signal_handler:322 - Invalid pid for SIGCHLD. Received pid 16601, expected pid 16635.
      lxc-start 20171119221018.636 DEBUG    lxc_commands - commands.c:lxc_cmd_handler:935 - Peer has disconnected.
This last messages is repeated endlessly.

Can any1 please help! I dont know were to look next. What am I missing?

Thanks in advance

Best regards
Markus

muner · Jun 23, 2023

dietmar said:
Oh, seem pve/data is damaged somehow, so you need to repair that. I assume you have a backup of all important data? If not, I would make a copy of the whole disk and do all further work on that copy.

To actually repair the lvm thin pool, you can try:

# lvconvert --repair pve/data

Search

Search

lvm issue

RobFantini

Famous Member

dietmar

Proxmox Staff Member

dietmar

Proxmox Staff Member

RobFantini

Famous Member

dietmar

Proxmox Staff Member

RobFantini

Famous Member

RobFantini

Famous Member

Iventa Markus Kaefer

New Member

muner

New Member