[SOLVED] LVMs Not Active Upon Reboot Of System

ensall · Feb 26, 2023

I have an install running 4 different LVMs across 4 different drives 2 are SSDs and 2 are spinning disks. Upon reboot my system will have my SSD LVMs loaded and ready to go but my spinning disk all show a ? mark and are unavailable.

To get them back I typically have to run something like

Code:

vgchange -an Backup_Storage

then after a while

Code:

vgchange -ay Backup_Storage

and it will come up. Where would I look to try and figure out what's causing this since I've not seen anything in /var/log/messages or /var/log/syslog that would give me any information. The spinning disk drives are roughly 8 months old and both work without issue once the LVMs are loaded. I was able to get my Media_Data LVM loaded which is the other spinning disk but my Backup_Storage LVM is being annoying about it at the moment.

Let me know what additional information is needed from me on this one and I'll be happy to provide it.

fiona · Feb 27, 2023

Hi,
if this is a thin pool, have a look here: https://forum.proxmox.com/threads/97406/post-430860

Otherwise, please share the output of pveversion -v and, after the issue occurs:

Code:

pvs
vgs
lvs

as well as your /etc/lvm/lvm.conf.

ensall · Feb 28, 2023

I'll gather that information next time it occurs. I may try rebooting this weekend so I can gather the output of those LVM cmds for you. For the moment though I'll post the rest of the requested information.

Code:

root@proxmox:~# pveversion -v
proxmox-ve: 7.3-1 (running kernel: 5.15.83-1-pve)
pve-manager: 7.3-4 (running version: 7.3-4/d69b70d4)
pve-kernel-helper: 7.3-2
pve-kernel-5.15: 7.3-1
pve-kernel-5.15.83-1-pve: 5.15.83-1
pve-kernel-5.15.74-1-pve: 5.15.74-1
pve-kernel-5.15.53-1-pve: 5.15.53-1
pve-kernel-5.15.39-3-pve: 5.15.39-3
pve-kernel-5.15.39-1-pve: 5.15.39-1
pve-kernel-5.15.30-2-pve: 5.15.30-3
ceph-fuse: 15.2.16-pve1
corosync: 3.1.7-pve1
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown2: 3.1.0-1+pmx3
ksm-control-daemon: 1.4-1
libjs-extjs: 7.0.0-1
libknet1: 1.24-pve2
libproxmox-acme-perl: 1.4.3
libproxmox-backup-qemu0: 1.3.1-1
libpve-access-control: 7.3-1
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.3-1
libpve-guest-common-perl: 4.2-3
libpve-http-server-perl: 4.1-5
libpve-storage-perl: 7.3-1
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 5.0.0-3
lxcfs: 4.0.12-pve1
novnc-pve: 1.3.0-3
proxmox-backup-client: 2.3.2-1
proxmox-backup-file-restore: 2.3.2-1
proxmox-mini-journalreader: 1.3-1
proxmox-offline-mirror-helper: 0.5.0-1
proxmox-widget-toolkit: 3.5.3
pve-cluster: 7.3-2
pve-container: 4.4-2
pve-docs: 7.3-1
pve-edk2-firmware: 3.20220526-1
pve-firewall: 4.2-7
pve-firmware: 3.6-2
pve-ha-manager: 3.5.1
pve-i18n: 2.8-1
pve-qemu-kvm: 7.1.0-4
pve-xtermjs: 4.16.0-1
qemu-server: 7.3-2
smartmontools: 7.2-pve3
spiceterm: 3.2-2
swtpm: 0.8.0~bpo11+2
vncterm: 1.7-1
zfsutils-linux: 2.1.7-pve3

fiona · Mar 1, 2023

The lvm.conf looks exactly the same as on my system, so the issue shouldn't be there at least.

ensall · Mar 1, 2023

I'm glad to hear that. I know on a previous install of Proxmox I started to experience this exact issue but it was with a multi-drive LVM that was running some ancient drives. All of the hardware minus the drives is the exact same since I had a boot drive die and replaced the others. So hoping it's not related to the underlying PC hardware itself but time will tell

ensall · Mar 6, 2023

Life got in the way and I completely forgot to do a reboot this weekend. My goal is to try and do it sometime throughout the week so that I can get you the info you're asking for.

ensall · Mar 6, 2023

A random reboot got me the info much sooner than expected so here's the outputs that you asked for

pvs

Code:

root@proxmox:~# pvs
  PV             VG             Fmt  Attr PSize    PFree 
  /dev/nvme0n1p3 pve            lvm2 a--  <465.26g <16.00g
  /dev/sda       Backup_Storage lvm2 a--    <3.64t 512.00m
  /dev/sdb       Media_Data     lvm2 a--    14.55t 512.00m
  /dev/sdc       ContainerSpace lvm2 a--  <111.79g 124.00m

vgs

Code:

root@proxmox:~# vgs
  PV             VG             Fmt  Attr PSize    PFree 
  /dev/nvme0n1p3 pve            lvm2 a--  <465.26g <16.00g
  /dev/sda       Backup_Storage lvm2 a--    <3.64t 512.00m
  /dev/sdb       Media_Data     lvm2 a--    14.55t 512.00m
  /dev/sdc       ContainerSpace lvm2 a--  <111.79g 124.00m

lvs

Code:

root@proxmox:~# lvs
  LV                                    VG             Attr       LSize    Pool           Origin                                Data%  Meta%  Move Log Cpy%Sync Convert
  Backup_Storage                        Backup_Storage twi---tz--   <3.61t                                                                                             
  vm-120-disk-0                         Backup_Storage Vwi---tz--   <3.81t Backup_Storage                                                                             
  ContainerSpace                        ContainerSpace twi-aotz--  109.43g                                                      45.35  3.08                           
  snap_vm-101-disk-0_PreShowImport      ContainerSpace Vri---tz-k    8.00g ContainerSpace vm-101-disk-0                                                               
  snap_vm-101-disk-0_PreSonarrInstall   ContainerSpace Vri---tz-k    8.00g ContainerSpace vm-101-disk-0                                                               
  snap_vm-102-disk-0_PreRadarrInstall   ContainerSpace Vri---tz-k    8.00g ContainerSpace vm-102-disk-0                                                               
  snap_vm-111-disk-0_PreDistupgrade     ContainerSpace Vri---tz-k    8.00g ContainerSpace vm-111-disk-0                                                               
  snap_vm-115-disk-0_PreRtinstReinstall ContainerSpace Vri---tz-k    8.00g ContainerSpace                                                                             
  snap_vm-118-disk-1_PreUpgrades        ContainerSpace Vri---tz-k    8.00g ContainerSpace                                                                             
  vm-101-disk-0                         ContainerSpace Vwi-a-tz--    8.00g ContainerSpace                                       23.72                                 
  vm-102-disk-0                         ContainerSpace Vwi-a-tz--    8.00g ContainerSpace                                       17.36                                 
  vm-103-disk-0                         ContainerSpace Vwi-a-tz--    8.00g ContainerSpace                                       29.47                                 
  vm-111-disk-0                         ContainerSpace Vwi-aotz--    8.00g ContainerSpace                                       33.86                                 
  vm-114-disk-1                         ContainerSpace Vwi-aotz--    8.00g ContainerSpace                                       44.99                                 
  vm-115-disk-0                         ContainerSpace Vwi-aotz--    8.00g ContainerSpace snap_vm-115-disk-0_PreRtinstReinstall 69.98                                 
  vm-116-disk-1                         ContainerSpace Vwi-aotz--    8.00g ContainerSpace                                       80.68                                 
  vm-117-disk-1                         ContainerSpace Vwi-aotz--    8.00g ContainerSpace                                       83.62                                 
  vm-118-disk-1                         ContainerSpace Vwi-aotz--    8.00g ContainerSpace snap_vm-118-disk-1_PreUpgrades        81.14                                 
  vm-121-disk-0                         ContainerSpace Vwi-a-tz--    8.00g ContainerSpace                                       48.31                                 
  vm-601-disk-0                         ContainerSpace Vwi-a-tz--    8.00g ContainerSpace                                       35.60                                 
  vm-602-disk-0                         ContainerSpace Vwi-a-tz--    8.00g ContainerSpace                                       22.39                                 
  Media_Data                            Media_Data     twi---tz--   14.52t                                                                                             
  snap_vm-110-disk-0_PreDistUpgrade     Media_Data     Vri---tz-k  500.00g Media_Data                                                                                 
  vm-100-disk-0                         Media_Data     Vwi---tz--  <12.70t Media_Data                                                                                 
  vm-110-disk-0                         Media_Data     Vwi---tz--  500.00g Media_Data     snap_vm-110-disk-0_PreDistUpgrade                                           
  vm-110-state-PreDistUpgrade           Media_Data     Vwi---tz--   <8.49g Media_Data                                                                                 
  data                                  pve            twi-aotz-- <338.36g                                                      37.35  1.61                           
  root                                  pve            -wi-ao----   96.00g                                                                                             
  snap_vm-110-disk-2_PreDistUpgrade     pve            Vri---tz-k    4.00m data                                                                                       
  snap_vm-110-disk-3_PreDistUpgrade     pve            Vri---tz-k   30.00g data                                                                                       
  swap                                  pve            -wi-ao----    8.00g                                                                                             
  vm-100-disk-0                         pve            Vwi-a-tz--   32.00g data                                                 98.38                                 
  vm-110-disk-2                         pve            Vwi-a-tz--    4.00m data           snap_vm-110-disk-2_PreDistUpgrade     3.12                                   
  vm-110-disk-3                         pve            Vwi-a-tz--   30.00g data           snap_vm-110-disk-3_PreDistUpgrade     61.64                                 
  vm-119-disk-0                         pve            Vwi-aotz--    4.00m data                                                 14.06                                 
  vm-119-disk-1                         pve            Vwi-aotz--   32.00g data                                                 40.04                                 
  vm-120-disk-1                         pve            Vwi-a-tz--   32.00g data                                                 48.72                                 
  vm-300-disk-0                         pve            Vwi-a-tz--    4.00m data                                                 14.06                                 
  vm-300-disk-1                         pve            Vwi-a-tz--   32.00g data                                                 45.57                                 
  vm-500-disk-0                         pve            Vwi-a-tz--   32.00g data                                                 85.52

ensall · Mar 6, 2023

Currently working on getting it restored now since the LVMs are down

ensall · Mar 7, 2023

I'm slowly starting to lean towards hardware at this point. I had another crash just a moment ago. Though now I'm just trying to get things up and running since it's getting late-ish. I'll be curious to see if anything jumps out at you though

fiona · Mar 7, 2023

fiona said:
if this is a thin pool, have a look here: https://forum.proxmox.com/threads/97406/post-430860

ensall said:

Code:

  LV                                    VG             Attr       LSize    Pool           Origin                                Data%  Meta%  Move Log Cpy%Sync Convert
  Backup_Storage                        Backup_Storage twi---tz--   <3.61t

ensall · Mar 7, 2023

They're all thin pools built on top of standard LVMs. Assuming I'm using the terms correctly. All my LVM dealings/learnings have come from Proxmox.
So to outline when I select LVM under Disks I get

Then when selecting LVM-Thin I get

So if this lines up with that fix then I'll get that added in. Just wanting to make sure before I throw that into my config for it

ensall · Mar 7, 2023

Went ahead and added that fix and if nothing else I'll just revert back to my copy of the lvm.conf next time I reboot or it crashes

ensall · Mar 16, 2023

I can confirm that this last reboot my LVMs came up immediately instead of me having to fight them. So this fixed that issue though now I'll be opening a new thread to see if I can get some help investigating to see if I have hardware problems in general.

Thanks for the fix @fiona

Search

Search

[SOLVED] LVMs Not Active Upon Reboot Of System

ensall

Member

fiona

Proxmox Staff Member

ensall

Member

Attachments

fiona

Proxmox Staff Member

ensall

Member

ensall

Member

ensall

Member

ensall

Member

ensall

Member

fiona

Proxmox Staff Member

ensall

Member

ensall

Member

ensall

Member