ZFS nightmare

em3034

Member
Nov 11, 2021
11
10
8
47
I have a single disk pool for all my VMs called "storage". The nvme 2TB disk gives errors, so I bought long ago a SATA 4TB disk to replace it.
I added the disk to the pool to create a mirror. But the pool was still in degraded mode. So I bought the same 4TB disk to make it a mirror and replace the faulty 2TB, to finally have a proper 4TB mirrored pool.
It didn't go as planned and I'm now with this situation where I had to unplugged all the new disks to get my Proxmox back:

Code:
root@pve:~# zpool status -v storage
  pool: storage
 state: DEGRADED
status: One or more devices has experienced an error resulting in data
    corruption.  Applications may be affected.
action: Restore the file in question if possible.  Otherwise restore the
    entire pool from backup.
   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-8A
  scan: resilvered 0B in 00:27:02 with 5 errors on Fri Sep 29 19:52:30 2023
config:

    NAME                        STATE     READ WRITE CKSUM
    storage                     DEGRADED     0     0     0
      mirror-0                  DEGRADED    17     0     0
        replacing-0             DEGRADED    17     0     0
          nvme1n1               DEGRADED    18     0     5  too many errors
          13263678074942122905  UNAVAIL      0     0     0  was /dev/disk/by-id/ata-CT4000MX500SSD1_2247E689BA0E-part1
        6174270007834866697     UNAVAIL      0     0     0  was /dev/disk/by-id/ata-CT4000MX500SSD1_2245E6836E78-part1

errors: Permanent errors have been detected in the following files:

        storage/vms/vm-102-disk-1@__replicate_102-0_1670976008__:<0x1>
        storage/vms/vm-705-disk-0:<0x1>
        storage/vms/vm-504-disk-0@StartDemo:<0x1>
        storage/vms/vm-701-disk-0:<0x1>
root@pve:~#


What would be the best way for me to get out of this nightmare?
- New pool with the 2 new disks and copy the data?
- try again to include the disk in original pool?

Thanks for your help,

Eric
 
Last edited: