Strange issue with LVMs

[Ivan Gersi]

I have 2 nodes, pve1 4.4.1 and pve2 4.4.13.
Now I can see I`m missing one lvm partition on pve1.
root@pve1:/etc/pve# lvs
File descriptor 7 (pipe:[172207]) leaked on lvs invocation. Parent PID 31744: bash
LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert
data pve twi-a-tz-- 1.70t 0.00 0.42
root pve -wi-ao---- 96.00g
swap pve -wi-ao---- 8.00g

vs

root@pve2:~# lvs -v
Using logical volume(s) on command line.
Finding all volume groups.
LV VG #Seg Attr LSize Maj Min KMaj KMin Pool Origin Data% Meta% Move Cpy%Sync Log Convert LV UUID LProfile
data pve 1 -wi-ao---- 3.51t -1 -1 251 2 0QnaPM-vGKh-epyQ-db2z-e2HX-tbjK-Ht8KqN
root pve 1 -wi-ao---- 96.00g -1 -1 251 0 DFvH5w-afZe-XeQb-wLHZ-fLXG-i9uK-jzgpm9
swap pve 1 -wi-ao---- 15.00g -1 -1 251 1 UBObk5-X8G5-qnEw-AiGr-pxpm-h2Kw-l2Rz26

pve1 machine ignore data and use only root partition in ocal storage.
root@pve1:/etc/pve# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1.8T 0 disk
├─sda1 8:1 0 1M 0 part
├─sda2 8:2 0 256M 0 part
└─sda3 8:3 0 1.8T 0 part
├─pve-root 251:0 0 96G 0 lvm /
├─pve-swap 251:1 0 8G 0 lvm [SWAP]
├─pve-data_tmeta 251:2 0 112M 0 lvm
│ └─pve-data 251:4 0 1.7T 0 lvm
└─pve-data_tdata 251:3 0 1.7T 0 lvm
└─pve-data 251:4 0 1.7T 0 lvm
sr0 11:0 1 1024M 0 rom

I`ve tried to "mount" data volume, but I failed (edit fstab, mount via cli, edit storage.cfg). I`ll probaly upgrade all machines to 5.2 but is there som way to allocate pve-data as on 2nd machine?
I`d like to get similar result:
root@pve2:~# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 3.7T 0 disk
├─sda1 8:1 0 1007K 0 part
├─sda2 8:2 0 127M 0 part /boot/efi
└─sda3 8:3 0 3.7T 0 part
├─pve-root 251:0 0 96G 0 lvm /
├─pve-swap 251:1 0 15G 0 lvm [SWAP]
└─pve-data 251:2 0 3.5T 0 lvm /var/lib/vz
sr0 11:0 1 1024M 0 rom

I`ve found similar problems on this forum but I can`t see resolution in my case.
Any idea?

 

[aPollO]

Whats the type of the filesystem of the data logical volume? Post output of file -sL /etc/pve/data please. Do you get any error message while trying to mount the volume?

 

[Ivan Gersi]

There is no /etc/pve/data file I suppose you though /dev/pve/data.
I have at pve2 in fstab (/dev/pve/data /var/lib/vz ext3 defaults 0 1) so I tried mount ext3.
But there are some differencies.
root@pve2:/etc# file -sL /dev/pve/data
/dev/pve/data: Linux rev 1.0 ext3 filesystem data, UUID=ced2cd20-b9d3-416b-bb04-0c27b78f5451 (needs journal recovery) (large files)
vs
root@pve1:/etc/pve# file -sL /dev/pve/data
/dev/pve/data: data

 

[aPollO]

Sorry. Yes i mean /dev/pve/data.

Ok looks for me like your filesystem table isn't there. Have you already data on this logical volume? If not then just reformat it.

 

[Ivan Gersi]

How elementary dear Watson...I thought this is the right way but I was not too brave to do it...and it works! Thanks I will get another skiil. Solved.
I don`t understand split (tmeta and tdata) but it seem everything working properly.
root@pve1:~# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 1.8T 0 disk
├─sda1 8:1 0 1M 0 part
├─sda2 8:2 0 256M 0 part
└─sda3 8:3 0 1.8T 0 part
├─pve-root 251:0 0 96G 0 lvm /
├─pve-swap 251:1 0 8G 0 lvm [SWAP]
├─pve-data_tmeta 251:2 0 112M 0 lvm
│ └─pve-data 251:4 0 1.7T 0 lvm /var/lib/vz
└─pve-data_tdata 251:3 0 1.7T 0 lvm
└─pve-data 251:4 0 1.7T 0 lvm /var/lib/vz
sr0 11:0 1 1024M 0 rom

 

[aPollO]

Did you used ZFS maybe? I don't know in which case this meta data volume will be created. But searched a bit and every time i found this volume i see something with ZFS was in use.
Maybe you can do the file command on the meta colume, too. If it is not be in use i think you can remove this volume.

 

[Ivan Gersi]

There is a little mistake...I have 2 VM in /var/lib/vz and now I mounted /var/lib/vz to /dev/pve/data and lost this machine (one running still runnin, offline can`t start).
I have to umount this partition, copy machines to backups and remount one more.

 

[aPollO]

• You can unmount the data Volume

• Mount it to a temporary location like /mnt

• Copy data from root Volume to data Volume

• then unmount in /mnt and mount data Volume back to /var/lib/vz

 

[Ivan Gersi]

I did it via nfs (freenas) but now there are both server online again and I`m trying to convert win physical machine to VM 1st time;o).