ZFS mirror issue

Aug 24, 2021
26
5
8
58
Hi,
I set up 2x NVMe drives as a ZFS mirror.
Sometime last month, there was an issue that seems to have killed one of my VMs-

Code:
root@pve01:~# zpool status -v rpool
  pool: rpool
 state: DEGRADED
status: One or more devices has experienced an error resulting in data
        corruption.  Applications may be affected.
action: Restore the file in question if possible.  Otherwise restore the
        entire pool from backup.
   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-8A
  scan: scrub repaired 0B in 00:08:13 with 0 errors on Sun Apr 10 00:32:14 2022
config:

        NAME                                                 STATE     READ WRITE CKSUM
        rpool                                                DEGRADED     0     0     0
          mirror-0                                           DEGRADED     0     0     0
            nvme-eui.0000000001000000e4d25cb59df55201-part3  DEGRADED     0     0    64  too many errors
            nvme-eui.0000000001000000e4d25cb39df55201-part3  DEGRADED     0     0    64  too many errors

errors: Permanent errors have been detected in the following files:

        //usr/sbin/zed
        <0x21e>:<0x1>
        rpool/data/vm-103-disk-0:<0x1>
        <0x38f>:<0x1>

There are no SMART errors, and I can easily clear this message, but due to the corruption I am unable to backup, migrate or snapshot the VM.
I have added a second node, created a cluster and migrated all the other VMs, but this one is stuck.
It still boots and works fine, but I want to migrate to the other node, add a 3rd disk for more redundancy and migrate back...

What can I do please?