really slow proxmox and problem with pve/data

[bubbleaegis]

hello friends, i am new here in the world of proxmox, have patience.
I have a very particular problem, I'll tell you all about it:

I noticed a big slowdown in the operations of the VMs I use, I thought there was a problem inside them, instead I think there is something inside proxmox that is not working.

this evening i did a server reboot, i closed very slowly the 2 VMs that i use.

when it restarted the VMs were not running, it gave this error:
activating LV 'pve/data' failed: Activation of logical volume pve/data is prohibited while logical volume pve/data_tmeta is active.

I partially solved it with this thread:
https://forum.proxmox.com/threads/u...ivating-lv-pve-data-failed.101353/post-437338

cd /etc/lvm
cp lvm.conf lvm.backup
nano lvm.conf
added: thin_check_options = [ "-q", "--skip-mappings" ]
update-initramfs -u
reboot

It took a really long time to boot up as well as the previous time, I think at least 5 minutes, maybe more.

Now the VMs have restarted at least.
But everything is really slow.
I've noticed this problem after the last updates, before it was really fine.
as you can see IO delay is really high



# pvs
PV VG Fmt Attr PSize PFree
/dev/sdb3 pve lvm2 a-- <3.27t 576.00m

# vgs
VG #PV #LV #SN Attr VSize VFree
pve 1 8 0 wz--n- <3.27t 576.00m

# lvs
LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert
data pve twi-aotz-- <3.12t 18.19 2.00
lvol0_pmspare pve -wi-a----- 15.81g
lvol1 pve -wi-a----- 15.81g
root pve -wi-ao---- 96.00g
swap pve -wi-ao---- 8.00g
vm-100-disk-0 pve Vwi-aotz-- 1.17t data 45.42
vm-101-disk-0 pve Vwi-a-tz-- 64.00g date 49.91
vm-102-disk-0 pve Vwi-a-tz-- 10,00g date 41,43

Reading here on the forum, always related to the problem I tried to give these commands:
# lvchange -an pve/data_tmeta
Device pve-data_tmeta (253:2) is used by another device.

# lvchange -an pve/data_tdata
Device pve-data_tdata (253:3) is used by another device.

# pveversion -v
proxmox-ve: 7.1-1 (running kernel: 5.13.19-2-pve)
pve-manager: 7.1-8 (running version: 7.1-8/5b267f33)

If it helps, I purchased still months subscription with proxmox, so I have the enterprise repositories.

 

[bobmc]

I would suspect disk failure, what does drive health status look like?

 

[bubbleaegis]

I would suspect disk failure, what does drive health status look like?

I am doing some tests on the disks and actually one seems to be not working perfectly, I think I will replace it soon.

Don't you find anything strange in my thread?

 

[krikey]

Oddly I had a disk failure today and have swapped out one of the 4 disks in the RAID5 array, hence why i find myself on this thread as I have a similar error:

activating LV 'pve/data' failed:   Activation of logical volume pve/data is prohibited while logical volume pve/data_tmeta is active.

The RAID array is still currently rebuilding, so should I wait until this has finished before carrying out any remedial work to fix this?

 

[bubbleaegis]

Oddly I had a disk failure today and have swapped out one of the 4 disks in the RAID5 array, hence why i find myself on this thread as I have a similar error:

activating LV 'pve/data' failed:   Activation of logical volume pve/data is prohibited while logical volume pve/data_tmeta is active.

The RAID array is still currently rebuilding, so should I wait until this has finished before carrying out any remedial work to fix this?

if you want an opinion yes, wait.
my problem i think depends on disk error. I have a raid 5 on megaraid card (hardware raid)
My server is also in rebuild

 

[krikey]

So after a rebuild of the RAID array and a restart of Proxmox 7.1-7, I followed the instructions above to modify the lvm.conf file. After a reboot, all seems to be workimg ok.