Recovering VM's

[Astronaut]

I have a standalone Proxmox 8.4 server that I use to run a bunch of VM's and LXC's on. About a week ago the server started freezing (still power on but no response to activity on the network, keyboard, screen). It would run for about one hour and then freeze (so it seemed, never timed it exactly). I ran memory test for about 24 hour. Memory was okay and no crashes while running the test.

I suspected hardware issues since no changes had been made to the system. Thus I moved the SSD and peripherals to another computer hoping it would run okay there. It didn't. Now it would freeze after about 60 seconds. I then moved everything back to the old hardware. Now it also freezes after about 60 seconds.

Thus, I now suspect something wrong with the software: Proxmox + the Google Coral PCIE driver. However due to it freezing up very quickly I gave up finding the problem.

So I bought a new (larger) SSD and installed Proxmox 8.4 on it. I then took the old SSD and attached it using a NVME-USB adapter.

However I do I find the old VM files? I added the old LVM to the data center (Datacenter -> Storage -> Add LVM) but I cannot see anything on it. I can see that some space is used on the drive but that's it.

PS: Did setup backup of my VM's and containers on a NAS. Unfortunately something went wrong there about 6 months ago and there are no recent backups.

 

[LnxBil]

Thus, I now suspect something wrong with the software:

it could still be the hardware. The disk can just fail.

However I do I find the old VM files?

That depends on how you set everything up. Please provide the output of lsblk in CODE tags.

 

[Astronaut]

it could still be the hardware. The disk can just fail.

True. I checked the SMART stats and it looked okay. However I know that there could still be issues.

That depends on how you set everything up. Please provide the output of lsblk in CODE tags.

The nvme drive is the new drive that I am running promox on right now. sdb is the old drive that I put in a USB adaptor.

NAME          SIZE TYPE FSTYPE      FSVER    VENDOR   MODEL                      PARTTYPENAME             TRAN
sdb         931.5G disk                      Realtek  RTL9210B-CG                                         usb
├─sdb1       1007K part                                                          BIOS boot
├─sdb2        512M part vfat        FAT32                                        EFI System
└─sdb3      916.1G part LVM2_member LVM2 001                                     Linux LVM
nvme0n1       1.8T disk                               KIOXIA-EXCERIA PLUS G3 SSD                          nvme
├─nvme0n1p1  1007K part                                                          BIOS boot                nvme
├─nvme0n1p2     1G part vfat        FAT32                                        EFI System               nvme
└─nvme0n1p3   1.8T part zfs_member  5000                                         Solaris /usr & Apple ZFS nvme

Here is the storage screen for the datacenter:


And here is the summary screen for the LVM store on the node. It shows that the LVM partition contains 643 GB of data that I cannot see.

 

[Impact]

Use lvs -a to see that.