LVM-Thin data storage content lost after reboot

[cmonty14]

Hi,
after rebooting my PVE node with LVM-Thin data storage the content is unavailable.

However the logical volume is active and visible:
root@ld4257:~# lvscan
ACTIVE '/dev/vg_backup_r5/backup' [305,63 TiB] inherit
ACTIVE '/dev/pve/swap' [8,00 GiB] inherit
ACTIVE '/dev/pve/root' [10,00 GiB] inherit
ACTIVE '/dev/pve/data' [10,00 GiB] inherit

root@ld4257:~# lvs -a
LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert
data pve twi-aotz-- 10,00g 0,00 0,62
[data_tdata] pve Twi-ao---- 10,00g
[data_tmeta] pve ewi-ao---- 12,00m
[lvol0_pmspare] pve ewi------- 12,00m
root pve -wi-ao---- 10,00g
swap pve -wi-ao---- 8,00g
backup vg_backup_r5 -wi-ao---- 305,63t

root@ld4257:~# lvdisplay pve/data
--- Logical volume ---
LV Name data
VG Name pve
LV UUID tCojYI-260l-HFQB-jdMQ-K5zb-DBfq-6KjDJp
LV Write Access read/write
LV Creation host, time ld4257, 2018-08-02 13:28:15 +0200
LV Pool metadata data_tmeta
LV Pool data data_tdata
LV Status available
# open 1
LV Size 10,00 GiB
Allocated pool data 0,00%
Allocated metadata 0,62%
Current LE 2560
Segments 1
Allocation inherit
Read ahead sectors auto
- currently set to 256
Block device 253:5


Why is PVE not identifying this storage?
I cannot mount the logical volume either.

THX

 

[dcsapak]

after rebooting my PVE node with LVM-Thin data storage the content is unavailable.

what content? what was on there? lvm seems to not detect any vm/ct images

I cannot mount the logical volume either.

what do you mean? this is a thinpool and not something you can mount

 

[cmonty14]

Yeah, mounting was just a stupid idea to fix the issue.

Anyway, I stored the root disk of several LXCs in this storage.
Please check the example in the attached screenshot.

I cannot start the related LXCs anymore because the resource is missing.

 

[dcsapak]

can you post your /etc/pve/storage.cfg ?
your screenshot shows a storage: data_ld4257

 

[cmonty14]

root@ld4257:~# more /etc/pve/storage.cfg
dir: local
path /var/lib/vz
content iso,vztmpl
maxfiles 1
shared 1

rbd: pve_vm
content images
krbd 0
pool pve

rbd: pve_ct
content rootdir
krbd 1
pool pve

dir: data_ld4257
path /mnt/pve/data
content backup,images,rootdir
maxfiles 0
shared 1


root@ld4257:~# ls -l /mnt/pve/data/
insgesamt 12
drwxr-xr-x 2 root root 4096 Okt 25 17:57 dump
drwxr-xr-x 2 root root 4096 Okt 25 17:57 images
drwxr-xr-x 2 root root 4096 Okt 25 17:57 private
root@ld4257:~# ls -l /mnt/pve/data/images/
insgesamt 0

 

[dcsapak]

dir: data_ld4257
path /mnt/pve/data
content backup,images,rootdir
maxfiles 0
shared 1

why shared 1 ? is it shared?
is there nothing in the images folder?

 

[cmonty14]

Nope.
I shared it with the other 2 nodes of the cluster.
However I assume this was not a good idea; thin LVM should never be shared and used locally only.

 

[dcsapak]

that storage is a directory and not a lvmthin? how did you share it? and no you cannot share a lvmthin...

 

[cmonty14]

OK.
Let's recap:
/mnt/pve/data/ is a directory storage
pve/data is a thin LVM

But where is the data?
CT207 was running before host reboot.

 

[dcsapak]

your screenshot would suggest it is under /mnt/pve/data/images/207/
if it is not there, maybe a mount point is not mounted? check fstab or similar
how did you create that storage?

 

[cmonty14]

I do believe there's an issue with Thin LVM.
There was an error during bootup related to this, something like "not supported by CPU".