VMs won't start - No such file or directory

[SantaMaria]

Hello,

I had my pve host shutdown for a few weeks while I was on vacation.
After starting it again I am unable to start any of my VMs.
This is the error message I get:
Could not open '/dev/pve/vm-101-disk-1': No such file or directory

The odd thing is when I click on "local-lvm" on the summary page I see Usage: 0.00%
But when I go to the content page, I still see my four virtual disks and their sizes.

Happy to provide any log files you might require.

I appreciate any help on this.

Thank you,
SantaMaria

 

[dcsapak]

what does 'lvs' say?

 

[SantaMaria]

Thanks for your reply. This is what I get:

root@pve:~# lvs
  LV            VG  Attr       LSize   Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  data          pve twi---tz-- 812.26g
  root          pve -wi-ao----  96.00g
  swap          pve -wi-ao----   7.00g
  vm-100-disk-1 pve Vwi---tz-- 480.00g data
  vm-101-disk-1 pve Vwi---tz-- 320.00g data
  vm-102-disk-1 pve Vwi---tz-- 480.00g data
  vm-103-disk-1 pve Vwi---tz-- 480.00g data

 

[dcsapak]

it seems your data thinpool is not activated (the attr should be twi-aotz--)
maybe search your syslog/dmesg what went wrong

 

[SantaMaria]

I see the following in syslog during boot:

Oct  3 13:29:17 pve kernel: [   70.636727] ata1: hard resetting link
Oct  3 13:29:17 pve kernel: [   71.108272] ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
Oct  3 13:29:17 pve kernel: [   71.121270] ata1.00: configured for UDMA/133
Oct  3 13:29:17 pve kernel: [   71.121276] ata1.00: device reported invalid CHS sector 0
Oct  3 13:29:17 pve kernel: [   71.121278] ata1.00: device reported invalid CHS sector 0
Oct  3 13:29:17 pve kernel: [   71.121279] ata1.00: device reported invalid CHS sector 0
Oct  3 13:29:17 pve kernel: [   71.121289] ata1: EH complete
Oct  3 13:29:17 pve kernel: [   76.734072] ata1.00: configured for UDMA/133
Oct  3 13:29:17 pve kernel: [   76.734095] sd 0:0:0:0: [sda] tag#14 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Oct  3 13:29:17 pve kernel: [   76.734098] sd 0:0:0:0: [sda] tag#14 Sense Key : Medium Error [current]
Oct  3 13:29:17 pve kernel: [   76.734100] sd 0:0:0:0: [sda] tag#14 Add. Sense: Unrecovered read error - auto reallocate failed
Oct  3 13:29:17 pve kernel: [   76.734103] sd 0:0:0:0: [sda] tag#14 CDB: Read(10) 28 00 72 70 78 00 00 00 20 00
Oct  3 13:29:17 pve kernel: [   76.734199] ata1: EH complete
Oct  3 13:29:17 pve kernel: [   82.347118] ata1.00: configured for UDMA/133
Oct  3 13:29:17 pve kernel: [   82.347152] sd 0:0:0:0: [sda] tag#4 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Oct  3 13:29:17 pve kernel: [   82.347159] sd 0:0:0:0: [sda] tag#4 Sense Key : Medium Error [current]
Oct  3 13:29:17 pve kernel: [   82.347164] sd 0:0:0:0: [sda] tag#4 Add. Sense: Unrecovered read error - auto reallocate failed
Oct  3 13:29:17 pve kernel: [   82.347171] sd 0:0:0:0: [sda] tag#4 CDB: Read(10) 28 00 72 70 78 00 00 00 08 00
Oct  3 13:29:17 pve kernel: [   82.347319] ata1: EH complete
Oct  3 13:29:17 pve kernel: [   87.987671] ata1.00: configured for UDMA/133
Oct  3 13:29:17 pve kernel: [   87.987690] sd 0:0:0:0: [sda] tag#10 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Oct  3 13:29:17 pve kernel: [   87.987692] sd 0:0:0:0: [sda] tag#10 Sense Key : Medium Error [current]
Oct  3 13:29:17 pve kernel: [   87.987694] sd 0:0:0:0: [sda] tag#10 Add. Sense: Unrecovered read error - auto reallocate failed
Oct  3 13:29:17 pve kernel: [   87.987698] sd 0:0:0:0: [sda] tag#10 CDB: Read(10) 28 00 72 70 78 00 00 00 20 00
Oct  3 13:29:17 pve kernel: [   87.988724] ata1: EH complete
Oct  3 13:29:17 pve kernel: [   93.592376] ata1.00: configured for UDMA/133
Oct  3 13:29:17 pve kernel: [   93.592410] sd 0:0:0:0: [sda] tag#14 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Oct  3 13:29:17 pve kernel: [   93.592417] sd 0:0:0:0: [sda] tag#14 Sense Key : Medium Error [current]
Oct  3 13:29:17 pve kernel: [   93.592422] sd 0:0:0:0: [sda] tag#14 Add. Sense: Unrecovered read error - auto reallocate failed
Oct  3 13:29:17 pve kernel: [   93.592429] sd 0:0:0:0: [sda] tag#14 CDB: Read(10) 28 00 72 70 78 00 00 00 08 00
Oct  3 13:29:17 pve kernel: [   93.594380] ata1: EH complete
Oct  3 13:29:17 pve kernel: [   99.239142] ata1.00: configured for UDMA/133
Oct  3 13:29:17 pve kernel: [   99.239165] sd 0:0:0:0: [sda] tag#17 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Oct  3 13:29:17 pve kernel: [   99.239167] sd 0:0:0:0: [sda] tag#17 Sense Key : Medium Error [current]
Oct  3 13:29:17 pve kernel: [   99.239170] sd 0:0:0:0: [sda] tag#17 Add. Sense: Unrecovered read error - auto reallocate failed
Oct  3 13:29:17 pve kernel: [   99.239173] sd 0:0:0:0: [sda] tag#17 CDB: Read(10) 28 00 72 70 78 00 00 00 20 00
Oct  3 13:29:17 pve kernel: [   99.240255] ata1: EH complete

Is that indicating a hard drive error?

Thank you

 

[dcsapak]

Is that indicating a hard drive error?

seems so

 

[SantaMaria]

I didn't want to hear that. But thanks for looking into it.