ZFS nightmare

em3034

New Member
Nov 11, 2021
6
9
3
46
I have a single disk pool for all my VMs called "storage". The nvme 2TB disk gives errors, so I bought long ago a SATA 4TB disk to replace it.
I added the disk to the pool to create a mirror. But the pool was still in degraded mode. So I bought the same 4TB disk to make it a mirror and replace the faulty 2TB, to finally have a proper 4TB mirrored pool.
It didn't go as planned and I'm now with this situation where I had to unplugged all the new disks to get my Proxmox back:

Code:
root@pve:~# zpool status -v storage
  pool: storage
 state: DEGRADED
status: One or more devices has experienced an error resulting in data
    corruption.  Applications may be affected.
action: Restore the file in question if possible.  Otherwise restore the
    entire pool from backup.
   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-8A
  scan: resilvered 0B in 00:27:02 with 5 errors on Fri Sep 29 19:52:30 2023
config:

    NAME                        STATE     READ WRITE CKSUM
    storage                     DEGRADED     0     0     0
      mirror-0                  DEGRADED    17     0     0
        replacing-0             DEGRADED    17     0     0
          nvme1n1               DEGRADED    18     0     5  too many errors
          13263678074942122905  UNAVAIL      0     0     0  was /dev/disk/by-id/ata-CT4000MX500SSD1_2247E689BA0E-part1
        6174270007834866697     UNAVAIL      0     0     0  was /dev/disk/by-id/ata-CT4000MX500SSD1_2245E6836E78-part1

errors: Permanent errors have been detected in the following files:

        storage/vms/vm-102-disk-1@__replicate_102-0_1670976008__:<0x1>
        storage/vms/vm-705-disk-0:<0x1>
        storage/vms/vm-504-disk-0@StartDemo:<0x1>
        storage/vms/vm-701-disk-0:<0x1>
root@pve:~#


What would be the best way for me to get out of this nightmare?
- New pool with the 2 new disks and copy the data?
- try again to include the disk in original pool?

Thanks for your help,

Eric
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!