lvm issue

RobFantini

Famous Member
May 24, 2012
2,043
111
133
Boston,Mass
Hello,

we have 10 lxc running on lvm storage . after a system crash [ due to a power issue ] lvm has issues.


the lxc's will not start. here is output from debug mode:
Code:
lxc-start -n 12740 -F --logfile=lxc.log --logpriority=debug

mount: special device /dev/pve/vm-12740-disk-1 does not exist
command 'mount /dev/pve/vm-12740-disk-1 /var/lib/lxc/12740/rootfs//' failed: exit code 32
lxc-start: conf.c: run_buffer: 347 Script exited with status 32
lxc-start: start.c: lxc_init: 465 failed to run pre-start hooks for container '12740'.
lxc-start: start.c: __lxc_start: 1313 failed to initialize the container
lxc-start: tools/lxc_start.c: main: 344 The container failed to start.
lxc-start: tools/lxc_start.c: main: 348 Additional information can be obtained by setting the --logfile and --logpriority options.


and /dev/pve just has:
Code:
lrwxrwxrwx 1 root root 7 Sep  7 21:10 root -> ../dm-0
lrwxrwxrwx 1 root root 7 Sep  7 21:10 swap -> ../dm-1

on system startup lvm2 complains , from syslog:
Code:
Sep  7 21:10:34 pve-in-kvm systemd[1]: lvm2-activation-early.service: main process exited, code=exited, status=5/NOTINSSTALLED
Sep  7 21:10:34 pve-in-kvm systemd[1]: Unit lvm2-activation-early.service entered failed state.
Sep  7 21:10:34 pve-in-kvm systemd[1]: lvm2-activation.service: main process exited, code=exited, status=5/NOTINSSTALLED
Sep  7 21:10:34 pve-in-kvm systemd[1]: Unit lvm2-activation.service entered failed state.

I searched and tried this:
Code:
# vgchange -a y
  Check of pool pve/data failed (status:1). Manual repair required!
  2 logical volume(s) in volume group "pve" now active

lvm info:
Code:
pve-in-kvm  /fbc/adm/lxc # pvs
  PV  VG  Fmt  Attr PSize  PFree  
  /dev/vda3  pve  lvm2 a--  599.87g 109.77g
pve-in-kvm  /fbc/adm/lxc # vgs
  VG  #PV #LV #SN Attr  VSize  VFree  
  pve  1  14  0 wz--n- 599.87g 109.77g
pve-in-kvm  /fbc/adm/lxc # lvs
  LV  VG  Attr  LSize  Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  data  pve  twi---tz-- 468.25g   
  root  pve  -wi-ao----  19.75g   
  swap  pve  -wi-a-----  2.00g   
  vm-12101-disk-2 pve  Vwi---tz--  4.00g data   
  vm-12106-disk-1 pve  Vwi---tz--  32.00g data   
  vm-12108-disk-1 pve  Vwi---tz--  8.00g data   
  vm-12110-disk-1 pve  Vwi---tz--  8.00g data   
  vm-12444-disk-1 pve  Vwi---tz--  14.00g data   
  vm-12501-disk-1 pve  Vwi---tz--  14.00g data   
  vm-12710-disk-1 pve  Vwi---tz--  30.00g data   
  vm-12720-disk-1 pve  Vwi---tz--  50.00g data   
  vm-12730-disk-1 pve  Vwi---tz--  2.00g data   
  vm-12740-disk-1 pve  Vwi---tz--  6.00g data   
  vm-12750-disk-1 pve  Vwi---tz--  16.00g data

Does anyone have a suggestion to try to get this fixed?
 
Oh, seem pve/data is damaged somehow, so you need to repair that. I assume you have a backup of all important data? If not, I would make a copy of the whole disk and do all further work on that copy.

To actually repair the lvm thin pool, you can try:

# lvconvert --repair pve/data
 
Oh, seem pve/data is damaged somehow, so you need to repair that. I assume you have a backup of all important data? If not, I would make a copy of the whole disk and do all further work on that copy.

To actually repair the lvm thin pool, you can try:

# lvconvert --repair pve/data

Code:
# lvchange -a y pve/data   
  Check of pool pve/data failed (status:1). Manual repair required!
pve-in-kvm  ~ #  lvconvert --repair pve/data
  WARNING: If everything works, remove "pve/data_meta0".
  WARNING: Use pvmove command to move "pve/data_tmeta" on the best fitting PV.
pve-in-kvm  ~ # ./start-debug-mode 12740   
mount: special device /dev/pve/vm-12740-disk-1 does not exist
command 'mount /dev/pve/vm-12740-disk-1 /var/lib/lxc/12740/rootfs//' failed: exit code 32
lxc-start: conf.c: run_buffer: 347 Script exited with status 32
lxc-start: start.c: lxc_init: 465 failed to run pre-start hooks for container '12740'.
lxc-start: start.c: __lxc_start: 1313 failed to initialize the container
lxc-start: tools/lxc_start.c: main: 344 The container failed to start.
lxc-start: tools/lxc_start.c: main: 348 Additional information can be obtained by setting the --logfile and --logpriority options.

I do have data backed up. However would like to continue trying to get his fixed.

More information: the VG had only 9GB free , before posting here I added 100GB to the disk and lvm following pve wiki.
 
Can you activate the volume after the repair? What is the output of 'lvs'?
Code:
pve-in-kvm  ~ #  lvchange -a y pve/data
pve-in-kvm  ~ # lvs
  LV  VG  Attr  LSize  Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  data  pve  twi-aotz-- 468.25g  0.00  3.64   
  data_meta0  pve  -wi-a-----  52.00m   
  root  pve  -wi-ao----  19.75g   
  swap  pve  -wi-a-----  2.00g   
  vm-12101-disk-2 pve  Vwi---tz--  4.00g data   
  vm-12106-disk-1 pve  Vwi---tz--  32.00g data   
  vm-12108-disk-1 pve  Vwi---tz--  8.00g data   
  vm-12110-disk-1 pve  Vwi---tz--  8.00g data   
  vm-12444-disk-1 pve  Vwi---tz--  14.00g data   
  vm-12501-disk-1 pve  Vwi---tz--  14.00g data   
  vm-12710-disk-1 pve  Vwi---tz--  30.00g data   
  vm-12720-disk-1 pve  Vwi---tz--  50.00g data   
  vm-12730-disk-1 pve  Vwi---tz--  2.00g data   
  vm-12740-disk-1 pve  Vwi---tz--  6.00g data   
  vm-12750-disk-1 pve  Vwi---tz--  16.00g data
 
Hello!

I am pushing this thread, because it seems I have a similar problem. My RAID Controller crashed and was replaced by the server provider. (it is a dedicated server)

I am running 4.4-12/e71b7a74.

After the replacement Proxmox booted normally and mounted root and swap filesystem.
the vg pve was completly inactive and needed manual repair to activate them.

First I was not able to activate the LVs but after
lvconvert --repair pve/data
a data_meta0 was created and I was able to activate the LVs with the command
lvchange -a y pve/data

BUT my lxc's are not booting. The web interface only gives me the message that I should look at the systemctl.
the Systemctl shows:
root@david:~# systemctl status lxc@101.service

Code:
root@david:~# systemctl status lxc@101.service
● lxc@101.service - LXC Container: 101
   Loaded: loaded (/lib/systemd/system/lxc@.service; disabled)
  Drop-In: /usr/lib/systemd/system/lxc@.service.d
           └─pve-reboot.conf
   Active: failed (Result: exit-code) since Sun 2017-11-19 22:07:26 CET; 39min ago
     Docs: man:lxc-start
           man:lxc
  Process: 6452 ExecStart=/usr/bin/lxc-start -n %i (code=exited, status=1/FAILURE)

Nov 19 22:07:26 david lxc-start[6452]: lxc-start: tools/lxc_start.c: main: 366 The container failed to start.
Nov 19 22:07:26 david lxc-start[6452]: lxc-start: tools/lxc_start.c: main: 368 To get more details, run the container in foreground mode.
Nov 19 22:07:26 david lxc-start[6452]: lxc-start: tools/lxc_start.c: main: 370 Additional information can be obtained by setting the --logfile and --logpriority options.
Nov 19 22:07:26 david systemd[1]: lxc@101.service: control process exited, code=exited status=1
Nov 19 22:07:26 david systemd[1]: Failed to start LXC Container: 101.
Nov 19 22:07:26 david systemd[1]: Unit lxc@101.service entered failed state.

If I turn on DEBUG the following entries are in the logfile:
Code:
      lxc-start 20171119221009.708 INFO     lxc_start_ui - tools/lxc_start.c:main:275 - using rcfile /var/lib/lxc/100/config
      lxc-start 20171119221009.708 WARN     lxc_confile - confile.c:config_pivotdir:1910 - lxc.pivotdir is ignored.  It will soon become an error.
      lxc-start 20171119221009.708 WARN     lxc_start - start.c:lxc_check_inherited:238 - Inherited fd: 3.
      lxc-start 20171119221009.708 INFO     lxc_lsm - lsm/lsm.c:lsm_init:48 - LSM security driver AppArmor
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:402 - processing: .reject_force_umount  # comment this to allow umount -f;  not recommended.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:567 - Adding native rule for reject_force_umount action 0.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:251 - Setting Seccomp rule to reject force umounts.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:570 - Adding compat rule for reject_force_umount action 0.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:do_resolve_add_rule:251 - Setting Seccomp rule to reject force umounts.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:402 - processing: .[all].
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:402 - processing: .kexec_load errno 1.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:567 - Adding native rule for kexec_load action 327681.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:570 - Adding compat rule for kexec_load action 327681.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:402 - processing: .open_by_handle_at errno 1.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:567 - Adding native rule for open_by_handle_at action 327681.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:570 - Adding compat rule for open_by_handle_at action 327681.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:402 - processing: .init_module errno 1.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:567 - Adding native rule for init_module action 327681.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:570 - Adding compat rule for init_module action 327681.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:402 - processing: .finit_module errno 1.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:567 - Adding native rule for finit_module action 327681.
      lxc-start 20171119221009.708 WARN     lxc_seccomp - seccomp.c:do_resolve_add_rule:270 - Seccomp: got negative for syscall: -10085: finit_module.
      lxc-start 20171119221009.708 WARN     lxc_seccomp - seccomp.c:do_resolve_add_rule:271 - This syscall will NOT be blacklisted.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:570 - Adding compat rule for finit_module action 327681.
      lxc-start 20171119221009.708 WARN     lxc_seccomp - seccomp.c:do_resolve_add_rule:270 - Seccomp: got negative for syscall: -10085: finit_module.
      lxc-start 20171119221009.708 WARN     lxc_seccomp - seccomp.c:do_resolve_add_rule:271 - This syscall will NOT be blacklisted.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:402 - processing: .delete_module errno 1.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:567 - Adding native rule for delete_module action 327681.
      lxc-start 20171119221009.708 INFO     lxc_seccomp - seccomp.c:parse_config_v2:570 - Adding compat rule for delete_module action 327681.
      lxc-start 20171119221009.709 INFO     lxc_seccomp - seccomp.c:parse_config_v2:580 - Merging in the compat Seccomp ctx into the main one.
      lxc-start 20171119221009.709 INFO     lxc_conf - conf.c:run_script_argv:424 - Executing script "/usr/share/lxc/hooks/lxc-pve-prestart-hook" for container "100", config section "lxc".
      lxc-start 20171119221010.237 DEBUG    lxc_start - start.c:setup_signal_fd:273 - Set SIGCHLD handler with file descriptor: 6.
      lxc-start 20171119221010.238 DEBUG    console - console.c:lxc_console_peer_default:430 - opening /dev/tty for console peer
      lxc-start 20171119221010.238 DEBUG    console - console.c:lxc_console_peer_default:436 - using '/dev/tty' as console
      lxc-start 20171119221010.238 DEBUG    console - console.c:lxc_console_sigwinch_init:144 - 16592 got SIGWINCH fd 10
      lxc-start 20171119221010.238 DEBUG    console - console.c:lxc_console_winsz:71 - set winsz dstfd:7 cols:209 rows:48
      lxc-start 20171119221010.238 INFO     lxc_start - start.c:lxc_init:475 - Container "100" is initialized.
      lxc-start 20171119221010.238 DEBUG    lxc_start - start.c:__lxc_start:1336 - Not dropping CAP_SYS_BOOT or watching utmp.
      lxc-start 20171119221010.239 INFO     lxc_conf - conf.c:run_script:475 - Executing script "/usr/share/lxc/lxcnetaddbr" for container "100", config section "net".
      lxc-start 20171119221010.576 DEBUG    lxc_conf - conf.c:instantiate_veth:2694 - instantiated veth 'veth100i0/vethV1DPDW', index is '8'
      lxc-start 20171119221010.576 INFO     lxc_cgroup - cgroups/cgroup.c:cgroup_init:68 - cgroup driver cgroupfs-ng initing for 100
      lxc-start 20171119221010.576 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:filter_and_set_cpus:475 - No isolated cpus detected.
      lxc-start 20171119221010.576 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:handle_cpuset_hierarchy:645 - "cgroup.clone_children" was already set to "1".
      lxc-start 20171119221010.577 INFO     lxc_start - start.c:lxc_spawn:1155 - Cloned CLONE_NEWNS.
      lxc-start 20171119221010.577 INFO     lxc_start - start.c:lxc_spawn:1155 - Cloned CLONE_NEWPID.
      lxc-start 20171119221010.577 INFO     lxc_start - start.c:lxc_spawn:1155 - Cloned CLONE_NEWUTS.
      lxc-start 20171119221010.577 INFO     lxc_start - start.c:lxc_spawn:1155 - Cloned CLONE_NEWIPC.
      lxc-start 20171119221010.577 INFO     lxc_start - start.c:lxc_spawn:1155 - Cloned CLONE_NEWNET.
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.deny' set to 'a'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c *:* m'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'b *:* m'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:3 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:5 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:7 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 5:0 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 5:1 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 5:2 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:8 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:9 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 136:* rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:229 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 254:0 rm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:200 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:228 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:232 rwm'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'memory.limit_in_bytes' set to '8589934592'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'memory.memsw.limit_in_bytes' set to '10737418240'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'cpu.shares' set to '1024'
      lxc-start 20171119221010.577 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'cpuset.cpus' set to '2-4,6'
      lxc-start 20171119221010.577 INFO     lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2013 - cgroup has been setup
      lxc-start 20171119221010.623 DEBUG    lxc_conf - conf.c:lxc_assign_network:3190 - move 'vethV1DPDW'/'eth0' to '16635': .
      lxc-start 20171119221010.625 DEBUG    lxc_conf - conf.c:setup_rootfs:1273 - mounted '/var/lib/lxc/100/rootfs' on '/usr/lib/x86_64-linux-gnu/lxc/rootfs'
      lxc-start 20171119221010.625 INFO     lxc_conf - conf.c:setup_utsname:901 - 'web' hostname has been setup
      lxc-start 20171119221010.639 DEBUG    lxc_conf - conf.c:setup_hw_addr:2225 - mac address '56:C2:08:8A:9F:CB' on 'eth0' has been setup
      lxc-start 20171119221010.639 DEBUG    lxc_conf - conf.c:setup_netdev:2452 - 'eth0' has been setup
      lxc-start 20171119221010.639 INFO     lxc_conf - conf.c:setup_network:2473 - network has been setup
      lxc-start 20171119221010.639 INFO     lxc_conf - conf.c:mount_autodev:1130 - Mounting container /dev
      lxc-start 20171119221010.639 INFO     lxc_conf - conf.c:mount_autodev:1153 - Mounted tmpfs onto /usr/lib/x86_64-linux-gnu/lxc/rootfs/dev
      lxc-start 20171119221010.639 INFO     lxc_conf - conf.c:mount_autodev:1171 - Mounted container /dev
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1715 - remounting /sys/fs/fuse/connections on /usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/fs/fuse/connections to respect bind or remount options
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1730 - (at remount) flags for /sys/fs/fuse/connections was 4096, required extra flags are 0
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1739 - mountflags already was 4096, skipping remount
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1765 - mounted '/sys/fs/fuse/connections' on '/usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/fs/fuse/connections', type 'none'
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1715 - remounting /sys/kernel/debug on /usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/kernel/debug to respect bind or remount options
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1730 - (at remount) flags for /sys/kernel/debug was 4096, required extra flags are 0
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1739 - mountflags already was 4096, skipping remount
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1765 - mounted '/sys/kernel/debug' on '/usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/kernel/debug', type 'none'
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1715 - remounting /sys/kernel/security on /usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/kernel/security to respect bind or remount options
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1730 - (at remount) flags for /sys/kernel/security was 4110, required extra flags are 14
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1765 - mounted '/sys/kernel/security' on '/usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/kernel/security', type 'none'
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1715 - remounting /sys/fs/pstore on /usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/fs/pstore to respect bind or remount options
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1730 - (at remount) flags for /sys/fs/pstore was 4110, required extra flags are 14
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1765 - mounted '/sys/fs/pstore' on '/usr/lib/x86_64-linux-gnu/lxc/rootfs/sys/fs/pstore', type 'none'
      lxc-start 20171119221010.663 DEBUG    lxc_conf - conf.c:mount_entry:1765 - mounted 'mqueue' on '/usr/lib/x86_64-linux-gnu/lxc/rootfs/dev/mqueue', type 'mqueue'
      lxc-start 20171119221010.663 INFO     lxc_conf - conf.c:mount_file_entries:1985 - mount points have been setup
      lxc-start 20171119221010.663 INFO     lxc_conf - conf.c:run_script_argv:424 - Executing script "/usr/share/lxcfs/lxc.mount.hook" for container "100", config section "lxc".
      lxc-start 20171119221010.686 INFO     lxc_conf - conf.c:run_script_argv:424 - Executing script "/usr/share/lxc/hooks/lxc-pve-autodev-hook" for container "100", config section "lxc".
      lxc-start 20171119221010.807 INFO     lxc_conf - conf.c:fill_autodev:1199 - Creating initial consoles under container /dev
      lxc-start 20171119221010.807 INFO     lxc_conf - conf.c:fill_autodev:1210 - Populating container /dev
      lxc-start 20171119221010.807 INFO     lxc_conf - conf.c:fill_autodev:1247 - Populated container /dev
      lxc-start 20171119221010.807 INFO     lxc_conf - conf.c:setup_ttydir_console:1516 - created /usr/lib/x86_64-linux-gnu/lxc/rootfs/dev/lxc
      lxc-start 20171119221010.807 INFO     lxc_conf - conf.c:setup_ttydir_console:1562 - console has been setup on lxc/console
      lxc-start 20171119221010.807 INFO     lxc_utils - utils.c:mount_proc_if_needed:1785 - I am 1, /proc/self points to '1'
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:setup_rootfs_pivot_root:1108 - pivot_root syscall to '/usr/lib/x86_64-linux-gnu/lxc/rootfs' successful
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:lxc_create_tty:3434 - allocated pty '/dev/pts/0' (12/15)
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:lxc_create_tty:3434 - allocated pty '/dev/pts/1' (16/17)
      lxc-start 20171119221010.819 INFO     lxc_conf - conf.c:lxc_create_tty:3445 - tty's configured
      lxc-start 20171119221010.819 INFO     lxc_conf - conf.c:setup_tty:1053 - 2 tty(s) has been setup
      lxc-start 20171119221010.819 INFO     lxc_conf - conf.c:setup_personality:1451 - set personality to '0x0'
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:setup_caps:2135 - drop capability 'mac_admin' (33)
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:setup_caps:2135 - drop capability 'mac_override' (32)
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:setup_caps:2135 - drop capability 'sys_time' (25)
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:setup_caps:2135 - drop capability 'sys_module' (16)
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:setup_caps:2135 - drop capability 'sys_rawio' (17)
      lxc-start 20171119221010.819 DEBUG    lxc_conf - conf.c:setup_caps:2144 - capabilities have been setup
      lxc-start 20171119221010.819 NOTICE   lxc_conf - conf.c:lxc_setup:3982 - '100' is setup.
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.deny' set to 'a'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c *:* m'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'b *:* m'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:3 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:5 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:7 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 5:0 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 5:1 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 5:2 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:8 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 1:9 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 136:* rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:229 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 254:0 rm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:200 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:228 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'devices.allow' set to 'c 10:232 rwm'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'memory.limit_in_bytes' set to '8589934592'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'memory.memsw.limit_in_bytes' set to '10737418240'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'cpu.shares' set to '1024'
      lxc-start 20171119221010.819 DEBUG    lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2009 - cgroup 'cpuset.cpus' set to '2-4,6'
      lxc-start 20171119221010.819 INFO     lxc_cgfsng - cgroups/cgfsng.c:cgfsng_setup_limits:2013 - cgroup has been setup
      lxc-start 20171119221010.839 INFO     lxc_start - start.c:do_start:836 - Unshared CLONE_NEWCGROUP.
      lxc-start 20171119221010.839 INFO     lxc_apparmor - lsm/apparmor.c:apparmor_process_label_set:238 - changed apparmor profile to lxc-container-default-cgns
      lxc-start 20171119221010.840 NOTICE   lxc_start - start.c:start:1447 - Exec'ing "/sbin/init".
      lxc-start 20171119221010.896 NOTICE   lxc_start - start.c:post_start:1458 - Started "/sbin/init" with pid "16635".
      lxc-start 20171119221010.896 WARN     lxc_start - start.c:signal_handler:322 - Invalid pid for SIGCHLD. Received pid 16601, expected pid 16635.
      lxc-start 20171119221018.636 DEBUG    lxc_commands - commands.c:lxc_cmd_handler:935 - Peer has disconnected.
This last messages is repeated endlessly.

Can any1 please help! I dont know were to look next. What am I missing?

Thanks in advance

Best regards
Markus
 
Oh, seem pve/data is damaged somehow, so you need to repair that. I assume you have a backup of all important data? If not, I would make a copy of the whole disk and do all further work on that copy.

To actually repair the lvm thin pool, you can try:

# lvconvert --repair pve/data
Screenshot 2023-06-23 at 12.04.30.png