[SOLVED] After removed disk from rpool, system can't boot anymore

[fireon]

Hello,

pve-manager/5.1-43/bdb08029 (running kernel: 4.10.17-5-pve)

i have here some CRC-Errors on an ssd in the rpool. So i switched the disk offline an detached it, because the warrantyprcess takes some weeks. After i have done someting with the cables in the rack, for that i shutdown the server.
After i swiched it on, the server was not able to boot any more. Grub is there, and a nice message that the kernel should boot first... really funny.
During this bootprocess i observe that an other disk from an other pool the light was blinking and flashing. So the system would have this disk for mount the rootfilesystem or what? Really strange.

Then i removed all other disk from the server. After that the machine was able to boot only with this one disk from the rpool. Why? Here are the pools:

zpool status
  pool: backup007
 state: ONLINE
  scan: none requested
config:

        NAME                                        STATE     READ WRITE CKSUM
        backup007                                   ONLINE       0     0     0
          ata-WDC_WD20EURS-63S48Y0_WD-WMAZA9381012  ONLINE       0     0     0
          ata-WDC_WD10EAVS-00M4B0_WD-WCAV56355671   ONLINE       0     0     0

errors: No known data errors

  pool: rpool
 state: ONLINE
  scan: resilvered 1.88G in 0h0m with 0 errors on Mon Feb 19 21:21:04 2018
config:

        NAME        STATE     READ WRITE CKSUM
        rpool       ONLINE       0     0     0
          mirror-0  ONLINE       0     0     0
            sdh2    ONLINE       0     0     0
            sdb2    ONLINE       0     0     0

errors: No known data errors

  pool: v-machines
 state: ONLINE
  scan: scrub repaired 0B in 10h35m with 0 errors on Sun Feb 11 10:59:40 2018
config:

        NAME                                          STATE     READ WRITE CKSUM
        v-machines                                    ONLINE       0     0     0
          raidz1-0                                    ONLINE       0     0     0
            ata-WDC_WD20EARX-00ZUDB0_WD-WCC1H0343538  ONLINE       0     0     0
            ata-WDC_WD20EARX-00ZUDB0_WD-WCC1H0369015  ONLINE       0     0     0
            ata-WDC_WD20EZRX-32D8PB0_WD-WCC4N7UHY6VC  ONLINE       0     0     0
            ata-WDC_WD20EZRX-32SPEB0_WD-WCC4E7NTND7L  ONLINE       0     0     0

errors: No known data errors

I see the rpool is with "/dev/sdX" but that should not matter.

Thanks

 

[dietmar]

Maybe BIOS selected the wrong boot disk?

 

[fireon]

Maybe BIOS selected the wrong boot disk?

If that were true, then no grub would be found, or? But Grub is found, only the rootfilesystem can't mount, no kernel loaded.

 

[dietmar]

If that were true, then no grub would be found, or? But Grub is found, only the rootfilesystem can't mount, no kernel loaded.

Maybe there was a grub on the other disk...

 

[fireon]

Maybe there was a grub on the other disk...

Hmm, ok is there a way that i can check this?

 

[dietmar]

Hmm, ok is there a way that i can check this?

Yes, you can check/view the partition table on those disks (gdisk, parted, ...). You should be able to see the grub partition if it is there.

 

[fireon]

Ok, no grub on the other disks.