ZFS RAIDZ1 pool UNAVAIL after reboot – multiple disks show “invalid label”, pool cannot be imported

[rishabmalla]

Problem Description​

After applying updates and rebooting the node, the ZFS pool z1_ssd does not come online and shows UNAVAIL state.


Running zpool import shows:

state: UNAVAIL
status: One or more devices contains corrupted data.
action: The pool cannot be imported due to damaged devices or data.


Current Pool Status:

root@node:~# zpool import -d /dev/disk/by-id

pool: z1_ssd
id: 11145749890691256309
state: UNAVAIL
status: One or more devices contains corrupted data.

raidz1-0 UNAVAIL insufficient replicas
scsi-35002538b49141f70 ONLINE
scsi-35002538b49141fe0 ONLINE
wwn-0x5002538b491422b0 UNAVAIL invalid label
wwn-0x5002538b491423a0 UNAVAIL invalid label
wwn-0x5002538b49141e80 UNAVAIL invalid label
scsi-35002538b49141ea0-part1 ONLINE
scsi-35002538b49141f40-part1 ONLINE
scsi-35002538b491422d0-part1 ONLINE

Recovery Attempts (All Failed)​

I have already tried:

• zpool import -f z1_ssd
• zpool import -d /dev/disk/by-id -f z1_ssd
• zpool import -f -m z1_ssd
• Read-only import attempts
• Ignoring cachefile and rescanning devices. None of the above allow the pool to import.

• Current Status​

  • Pool is not destroyed yet
  • No destructive actions taken after discovering label corruption
  • Any confirmation, insights, or similar experiences would be greatly appreciated.
    
    

 

[UdoB]

Just a few ideas, this is not a comprehensive list by far:

• turn power off / shutdown
• pull the power cord - yes, I mean it
• check all cabling: pull and reseat all connectors - on both ends
• turn on...

Only if lsblk lists all devices (except one single device because RaidZ1) there is any chance to import that pool.

You've already found "import -f". Did you read man zpool-import for more hints? Try "-nF" etc. first. Then search for a tutorial on how to use "-T Specify the txg to use for rollback." This is the last resort, it includes partial data loss.

Good luck!

Disclaimer: I have not much experience with this...