no such logical volume pve/data (500)

F

fuyufoxconn

New Member
Proxmox Subscriber
Aug 25, 2025
4
0
1
I have a Proxmox VE node server with version 8.4.9.
Code: 
pveversion: pve-manager/8.4.9/649acf70aab54798
The running virtual machines (VMs) are normally accessible; however, once they are shut down, they cannot be started. Moreover, neither the running nor the shut-down VMs can be backup or migrated.
Backup Error Log:
Code: 
INFO: trying to get global lock - waiting...
INFO: got global lock
INFO: starting new backup job: vzdump 145 --node pve20 --notification-mode auto --storage pbs29 --mode snapshot --notes-template '{{guestname}}' --remove 0
INFO: Starting Backup of VM 145 (qemu)
INFO: Backup started at 2025-09-03 13:46:08
INFO: status = stopped
INFO: backup mode: stop
INFO: ionice priority: 7
INFO: VM Name: UbuPGZabbix32.190
INFO: include disk 'scsi0' 'local-lvm:vm-145-disk-0' 160G
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
ERROR: Backup of VM 145 failed - no such logical volume pve/data
INFO: Failed at 2025-09-03 13:46:09
INFO: Backup job finished with errors
INFO: notified via target `mail-to-root`
TASK ERROR: job errors

Migrate Error Log:
Code: 
2025-09-03 13:46:54 starting migration of VM 145 to node 'pve21' (10.64.32.21)
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
  Volume group "pve" not found
2025-09-03 13:46:55 found local disk 'local-lvm:vm-145-disk-0' (attached)
2025-09-03 13:46:55 can't migrate local disk 'local-lvm:vm-145-disk-0': can't get size of '/dev/pve/vm-145-disk-0':   Cannot process volume group pve
2025-09-03 13:46:55 ERROR: Problem found while scanning volumes - can't migrate VM - check log
2025-09-03 13:46:55 aborting phase 1 - cleanup resources
2025-09-03 13:46:55 ERROR: migration aborted (duration 00:00:01): Problem found while scanning volumes - can't migrate VM - check log
TASK ERROR: migration aborted

Destory(Remove) Error Log:
Code: 
Header
Proxmox
Virtual Environment 8.4.9
Search
Virtual Machine 145 (UbuPGZabbix32.190) on node 'pve20'
No Tags
local
Filter VMID
Server View
Logs
()
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
Could not remove disk 'local-lvm:vm-145-disk-0', check manually: no such logical volume pve/data
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
TASK ERROR: no such logical volume pve/data

Start Error Log:
Code: 
WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
TASK ERROR: no such logical volume pve/data

The reason for this is that the lvm-thin disk has run out of space, and it shows "Unknown" in the web management interface.
Below are the results of the executed commands and screenshots.
System Log:
SystemLog.png

Local-Lvm Status:unknown
UnKnow.png

pvs& vgs &lvs &lvm lvscan Log:
Code: 
root@pve20:~# pvs
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
  WARNING: PV /dev/sda3 is marked in use but no VG was found using it.
  WARNING: PV /dev/sda3 might need repairing.
  PV         VG        Fmt  Attr PSize  PFree
  /dev/sda3  [unknown] lvm2 u--  <5.46t    0
root@pve20:~# vgs
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
root@pve20:~# lvs
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
root@pve20:~# lvm lvscan
  WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv

Could you please advise on how to resolve this issue and the points that should be noted?
Thank you
 
Add Some Info:
df -h
Code: 
root@pve20:~# df -h
df: /run/pve/import/esxi/ESXi227/mnt: Transport endpoint is not connected
Filesystem            Size  Used Avail Use% Mounted on
udev                  126G     0  126G   0% /dev
tmpfs                  26G  6.1M   26G   1% /run
/dev/mapper/pve-root   94G  5.5G   84G   7% /
tmpfs                 126G   60M  126G   1% /dev/shm
tmpfs                 5.0M     0  5.0M   0% /run/lock
efivarfs              176K   71K  101K  42% /sys/firmware/efi/efivars
/dev/sda2            1022M   12M 1011M   2% /boot/efi
tmpfs                  26G  4.0K   26G   1% /run/user/0
/dev/fuse             128M   68K  128M   1% /etc/pve
lsblk
Code: 
root@pve20:~# lsblk
NAME                         MAJ:MIN RM  SIZE RO TYPE MOUNTPOINTS
sda                            8:0    0  5.5T  0 disk
├─sda1                         8:1    0 1007K  0 part
├─sda2                         8:2    0    1G  0 part /boot/efi
└─sda3                         8:3    0  5.5T  0 part
  ├─pve-swap                 252:0    0    8G  0 lvm  [SWAP]
  ├─pve-root                 252:1    0   96G  0 lvm  /
  ├─pve-data_tmeta           252:2    0 15.9G  0 lvm
  │ └─pve-data-tpool         252:4    0  5.3T  0 lvm
  │   ├─pve-data             252:5    0  5.3T  1 lvm
  │   ├─pve-vm--158--disk--0 252:6    0  200G  0 lvm
  │   ├─pve-vm--117--disk--0 252:7    0  100G  0 lvm
  │   ├─pve-vm--117--disk--1 252:8    0  500G  0 lvm
  │   ├─pve-vm--117--disk--2 252:9    0   50G  0 lvm
  │   ├─pve-vm--117--disk--3 252:10   0  100G  0 lvm
      ├─ ...
  │   ├─pve-vm--169--disk--0 252:135  0    4M  0 lvm
  │   ├─pve-vm--169--disk--1 252:136  0  120G  0 lvm
  │   ├─pve-vm--169--disk--2 252:137  0    4M  0 lvm
  │   └─pve-vm--169--disk--3 252:138  0  600G  0 lvm
  └─pve-data_tdata           252:3    0  5.3T  0 lvm
    └─pve-data-tpool         252:4    0  5.3T  0 lvm
      ├─pve-data             252:5    0  5.3T  1 lvm
      ├─pve-vm--158--disk--0 252:6    0  200G  0 lvm
      ├─pve-vm--117--disk--0 252:7    0  100G  0 lvm
      ├─pve-vm--117--disk--1 252:8    0  500G  0 lvm
      ├─pve-vm--117--disk--2 252:9    0   50G  0 lvm
      ├─pve-vm--117--disk--3 252:10   0  100G  0 lvm
      ├─  ...
      ├─pve-vm--169--disk--0 252:135  0    4M  0 lvm
      ├─pve-vm--169--disk--1 252:136  0  120G  0 lvm
      ├─pve-vm--169--disk--2 252:137  0    4M  0 lvm
      └─pve-vm--169--disk--3 252:138  0  600G  0 lvm

Parted /dev/sda3 print
Code: 
parted /dev/sda print
Error: The primary GPT table is corrupt, but the backup appears OK, so that will be used.
OK/Cancel? cancel
Model: HP LOGICAL VOLUME (scsi)
Disk /dev/sda: 6001GB
Sector size (logical/physical): 512B/4096B
Partition Table: unknown
Disk Flags:
root@pve20:~# parted /dev/sda print
Error: The primary GPT table is corrupt, but the backup appears OK, so that will be used.
OK/Cancel? OK
Model: HP LOGICAL VOLUME (scsi)
Disk /dev/sda: 6001GB
Sector size (logical/physical): 512B/4096B
Partition Table: gpt
Disk Flags:

Number  Start   End     Size    File system  Name  Flags
 1      17.4kB  1049kB  1031kB                     bios_grub
 2      1049kB  1075MB  1074MB  fat32              boot, esp
 3      1075MB  6001GB  6000GB                     lvm
 
pvscan

Code: 
 WARNING: wrong checksum b16a7000 in mda header on /dev/sda3 at 4096
  WARNING: wrong magic number in mda header on /dev/sda3 at 4096
  WARNING: wrong version 2299849034 in mda header on /dev/sda3 at 4096
  WARNING: wrong start sector 10314045957594327968 in mda header on /dev/sda3 at 4096
  WARNING: bad metadata header on /dev/sda3 at 4096.
  WARNING: scanning /dev/sda3 mda1 failed to read metadata summary.
  WARNING: repair VG metadata on /dev/sda3 with vgck --updatemetadata.
  WARNING: scan failed to get metadata summary from /dev/sda3 PVID yctMMIgpB6SGdp2UCJpNScR5obUyK8Lv
  WARNING: PV /dev/sda3 is marked in use but no VG was found using it.
  WARNING: PV /dev/sda3 might need repairing.
  PV /dev/sda3                      lvm2 [<5.46 TiB]
  Total: 1 [<5.46 TiB] / in use: 0 [0   ] / in no VG: 1 [<5.46 TiB]
 
sgdisk -p /dev/sda

Code: 
Caution! After loading partitions, the CRC doesn't check out!
Warning! Main partition table CRC mismatch! Loaded backup partition table
instead of main partition table!

Warning! One or more CRCs don't match. You should repair the disk!
Main header: OK
Backup header: OK
Main partition table: ERROR
Backup partition table: OK

****************************************************************************
Caution: Found protective or hybrid MBR and corrupt GPT. Using GPT, but disk
verification and recovery are STRONGLY recommended.
****************************************************************************
Disk /dev/sda: 11720750512 sectors, 5.5 TiB
Model: LOGICAL VOLUME
Sector size (logical/physical): 512/4096 bytes
Disk identifier (GUID): C0A2B3B0-304B-4400-8AA5-CC66B18B1CFA
Partition table holds up to 128 entries
Main partition table begins at sector 2 and ends at sector 33
First usable sector is 34, last usable sector is 11720750478
Partitions will be aligned on 8-sector boundaries
Total free space is 0 sectors (0 bytes)

Number  Start (sector)    End (sector)  Size       Code  Name
   1              34            2047   1007.0 KiB  EF02
   2            2048         2099199   1024.0 MiB  EF00
   3         2099200     11720750478   5.5 TiB     8E00
Code:
 
You must log in or register to reply here.
Top Bottom