[FAILED] Faile dto start zfs-import@pool.service - Import ZFS poolf pool (power got cut)

S

Someyoung Guy

Active Member
Dec 23, 2018
18
1
43
48
ProxMox: 8.4.0
Linux 6.8.12-9-pve (2025-03-16T19:18Z)

I'm getting this upon boot up of PVE 8.4.0 and it seems to be a thing in prior versions also.

Code: 
[FAILED] Faile dto start zfs-import@pool.service - Import ZFS poolf pool

I've found a few threads but nothing is helping. The disks are marked as "OK" in the pve01 > Disks:

When typing this out I noticed on the screen shot that the disks aren't mounted, that's probably the issue but why wouldn't they mount? I created a ZFS pool and had stuff running swimmingly until we lost power and perhaps that's the clue. We lost power > battery backup got sucked dry and now this problem.

1747610909627.png

Uh oh...again, when filling this out and checking more things in the threads about this issue one person said go through the journal log and in so doing I found this:

Bash: 
May 18 19:19:02 pve01 systemd[1]: Finished systemd-udev-settle.service - Wait for udev To Complete Device Initialization.

May 18 19:19:02 pve01 systemd[1]: Starting systemd-sysctl.service - Apply Kernel Variables...

May 18 19:19:02 pve01 systemd[1]: Starting zfs-import@VMs.service - Import ZFS pool VMs...

May 18 19:19:02 pve01 systemd[1]: Finished systemd-sysctl.service - Apply Kernel Variables.

May 18 19:19:03 pve01 kernel: sd 6:0:2:0: [sdc] tag#415 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=0s

May 18 19:19:03 pve01 kernel: sd 6:0:2:0: [sdc] tag#415 Sense Key : Aborted Command [current] [descriptor]

May 18 19:19:03 pve01 kernel: sd 6:0:2:0: [sdc] tag#415 Add. Sense: Logical block guard check failed

May 18 19:19:03 pve01 kernel: sd 6:0:2:0: [sdc] tag#415 CDB: Read(32)

May 18 19:19:03 pve01 kernel: sd 6:0:2:0: [sdc] tag#415 CDB[00]: 7f 00 00 00 00 00 00 18 00 09 20 00 00 00 00 00

May 18 19:19:03 pve01 kernel: sd 6:0:2:0: [sdc] tag#415 CDB[10]: 00 e8 28 c8 00 e8 28 c8 00 00 00 00 00 00 00 18

May 18 19:19:03 pve01 kernel: protection error, dev sdc, sector 15214792 op 0x0:(READ) flags 0x0 phys_seg 2 prio class 0

May 18 19:19:03 pve01 kernel: zio pool=VMs vdev=/dev/disk/by-id/scsi-35000c5009408131f-part1 error=84 type=1 offset=7788924928 size=12288 flags=1573264

May 18 19:19:03 pve01 kernel: sd 6:0:1:0: [sdb] tag#8525 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=0s

May 18 19:19:03 pve01 kernel: sd 6:0:1:0: [sdb] tag#8525 Sense Key : Aborted Command [current] [descriptor]

May 18 19:19:03 pve01 kernel: sd 6:0:1:0: [sdb] tag#8525 Add. Sense: Logical block guard check failed

May 18 19:19:03 pve01 kernel: sd 6:0:1:0: [sdb] tag#8525 CDB: Read(32)

May 18 19:19:03 pve01 kernel: sd 6:0:1:0: [sdb] tag#8525 CDB[00]: 7f 00 00 00 00 00 00 18 00 09 20 00 00 00 00 00

May 18 19:19:03 pve01 kernel: sd 6:0:1:0: [sdb] tag#8525 CDB[10]: 01 02 6a 28 01 02 6a 28 00 00 00 00 00 00 00 18

May 18 19:19:03 pve01 kernel: protection error, dev sdb, sector 16935464 op 0x0:(READ) flags 0x0 phys_seg 2 prio class 0

May 18 19:19:03 pve01 kernel: zio pool=VMs vdev=/dev/disk/by-id/scsi-35000c50094089717-part1 error=84 type=1 offset=8669908992 size=12288 flags=1573264

May 18 19:19:03 pve01 kernel: sd 6:0:1:0: [sdb] tag#4330 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_OK cmd_age=0s


Our server lost power abruptly so, is it possible each disk needs to be scanned and marked "fixed" or something?

Any help would be appreciated. I think herein lies the problem but I'm unsure of what to do.

They're in a ZFS raid10 config.

Thank you!
 
Hi all, and anyone who can help. I've tried doing some more research and after a power failure this seems to be a problem for others. From what I can tell the disks are online but I hesitate to force anything. Perhaps some guidance with someone experienced in zfs would be wise. Here's additional output from some zfs information commands.

Code: 
root@pve01:~# zdb
VMs:
    version: 5000
    name: 'VMs'
    state: 0
    txg: 4
    pool_guid: 4107244048732260727
    errata: 0
    hostid: 2098829460
    hostname: 'pve01'
    com.delphix:has_per_vdev_zaps
    vdev_children: 2
    vdev_tree:
        type: 'root'
        id: 0
        guid: 4107244048732260727
        create_txg: 4
        com.klarasystems:vdev_zap_root: 129
        children[0]:
            type: 'mirror'
            id: 0
            guid: 11474006333906117045
            metaslab_array: 266
            metaslab_shift: 34
            ashift: 12
            asize: 8001548713984
            is_log: 0
            create_txg: 4
            com.delphix:vdev_zap_top: 130
            children[0]:
                type: 'disk'
                id: 0
                guid: 7297764656939327676
                path: '/dev/disk/by-id/scsi-35000039c6823ed8d-part1'
                devid: 'scsi-35000039c6823ed8d-part1'
                phys_path: 'pci-0000:17:00.0-sas-phy0-lun-0'
                whole_disk: 1
                create_txg: 4
                com.delphix:vdev_zap_leaf: 131
            children[1]:
                type: 'disk'
                id: 1
                guid: 15970748688722508299
                path: '/dev/disk/by-id/scsi-35000c50094089717-part1'
                devid: 'scsi-35000c50094089717-part1'
                phys_path: 'pci-0000:17:00.0-sas-phy2-lun-0'
                whole_disk: 1
                create_txg: 4
                com.delphix:vdev_zap_leaf: 132
        children[1]:
            type: 'mirror'
            id: 1
            guid: 7418412346239572526
            metaslab_array: 256
            metaslab_shift: 34
            ashift: 12
            asize: 8001548713984
            is_log: 0
            create_txg: 4
            com.delphix:vdev_zap_top: 133
            children[0]:
                type: 'disk'
                id: 0
                guid: 11063709733121148500
                path: '/dev/disk/by-id/scsi-35000c5009408131f-part1'
                devid: 'scsi-35000c5009408131f-part1'
                phys_path: 'pci-0000:17:00.0-sas-phy4-lun-0'
                whole_disk: 1
                create_txg: 4
                com.delphix:vdev_zap_leaf: 134
            children[1]:
                type: 'disk'
                id: 1
                guid: 2094271549977896265
                path: '/dev/disk/by-id/scsi-35000039c6823ed95-part1'
                devid: 'scsi-35000039c6823ed95-part1'
                phys_path: 'pci-0000:17:00.0-sas-phy6-lun-0'
                whole_disk: 1
                create_txg: 4
                com.delphix:vdev_zap_leaf: 135
    features_for_read:
        com.delphix:hole_birth
        com.delphix:embedded_data
        com.klarasystems:vdev_zaps_v2


root@pve01:~# ls -lah /dev/disk/by-id/
total 0
drwxr-xr-x 2 root root 700 May 18 19:19 .
drwxr-xr-x 9 root root 180 May 18 19:18 ..
lrwxrwxrwx 1 root root   9 May 18 19:19 ata-DELLBOSS_VD_40a01b74fcfd0010 -> ../../sde
lrwxrwxrwx 1 root root  10 May 18 19:19 ata-DELLBOSS_VD_40a01b74fcfd0010-part1 -> ../../sde1
lrwxrwxrwx 1 root root  10 May 18 19:19 ata-DELLBOSS_VD_40a01b74fcfd0010-part2 -> ../../sde2
lrwxrwxrwx 1 root root  10 May 18 19:19 ata-DELLBOSS_VD_40a01b74fcfd0010-part3 -> ../../sde3
lrwxrwxrwx 1 root root  10 May 18 19:19 dm-name-pve-root -> ../../dm-1
lrwxrwxrwx 1 root root  10 May 18 19:19 dm-name-pve-swap -> ../../dm-0
lrwxrwxrwx 1 root root  10 May 18 19:19 dm-uuid-LVM-lz45TjdDZaXvBTT9F6f9Kn5nX1vh1zG25Jf0mm5QwSuZ4evfA2zgF3hwAj2EqRZI -> ../../dm-0
lrwxrwxrwx 1 root root  10 May 18 19:19 dm-uuid-LVM-lz45TjdDZaXvBTT9F6f9Kn5nX1vh1zG29WPb2OQTQ0hZ31D2xetkaEPvbzK6YwGc -> ../../dm-1
lrwxrwxrwx 1 root root  10 May 18 19:19 lvm-pv-uuid-aVai1S-dyFn-2GY2-Hqao-BsFl-h3Cv-ugkwef -> ../../sde3
lrwxrwxrwx 1 root root   9 May 18 19:19 scsi-35000039c6823ed8d -> ../../sda
lrwxrwxrwx 1 root root  10 May 18 19:19 scsi-35000039c6823ed8d-part1 -> ../../sda1
lrwxrwxrwx 1 root root  10 May 18 19:19 scsi-35000039c6823ed8d-part9 -> ../../sda9
lrwxrwxrwx 1 root root   9 May 18 19:19 scsi-35000039c6823ed95 -> ../../sdd
lrwxrwxrwx 1 root root  10 May 18 19:19 scsi-35000039c6823ed95-part1 -> ../../sdd1
lrwxrwxrwx 1 root root  10 May 18 19:19 scsi-35000039c6823ed95-part9 -> ../../sdd9
lrwxrwxrwx 1 root root   9 May 18 19:19 scsi-35000c5009408131f -> ../../sdc
lrwxrwxrwx 1 root root  10 May 18 19:19 scsi-35000c5009408131f-part1 -> ../../sdc1
lrwxrwxrwx 1 root root  10 May 18 19:19 scsi-35000c5009408131f-part9 -> ../../sdc9
lrwxrwxrwx 1 root root   9 May 18 19:19 scsi-35000c50094089717 -> ../../sdb
lrwxrwxrwx 1 root root  10 May 18 19:19 scsi-35000c50094089717-part1 -> ../../sdb1
lrwxrwxrwx 1 root root  10 May 18 19:19 scsi-35000c50094089717-part9 -> ../../sdb9
lrwxrwxrwx 1 root root   9 May 18 19:19 wwn-0x5000039c6823ed8d -> ../../sda
lrwxrwxrwx 1 root root  10 May 18 19:19 wwn-0x5000039c6823ed8d-part1 -> ../../sda1
lrwxrwxrwx 1 root root  10 May 18 19:19 wwn-0x5000039c6823ed8d-part9 -> ../../sda9
lrwxrwxrwx 1 root root   9 May 18 19:19 wwn-0x5000039c6823ed95 -> ../../sdd
lrwxrwxrwx 1 root root  10 May 18 19:19 wwn-0x5000039c6823ed95-part1 -> ../../sdd1
lrwxrwxrwx 1 root root  10 May 18 19:19 wwn-0x5000039c6823ed95-part9 -> ../../sdd9
lrwxrwxrwx 1 root root   9 May 18 19:19 wwn-0x5000c5009408131f -> ../../sdc
lrwxrwxrwx 1 root root  10 May 18 19:19 wwn-0x5000c5009408131f-part1 -> ../../sdc1
lrwxrwxrwx 1 root root  10 May 18 19:19 wwn-0x5000c5009408131f-part9 -> ../../sdc9
lrwxrwxrwx 1 root root   9 May 18 19:19 wwn-0x5000c50094089717 -> ../../sdb
lrwxrwxrwx 1 root root  10 May 18 19:19 wwn-0x5000c50094089717-part1 -> ../../sdb1
lrwxrwxrwx 1 root root  10 May 18 19:19 wwn-0x5000c50094089717-part9 -> ../../sdb9


root@pve01:~# zpool import
   pool: VMs
     id: 4107244048732260727
  state: ONLINE
 action: The pool can be imported using its name or numeric identifier.
 config:

        VMs                         ONLINE
          mirror-0                  ONLINE
            scsi-35000039c6823ed8d  ONLINE
            scsi-35000c50094089717  ONLINE
          mirror-1                  ONLINE
            scsi-35000c5009408131f  ONLINE
            scsi-35000039c6823ed95  ONLINE




root@pve01:~# zdb -e VMs

Configuration for import:
        vdev_children: 2
        version: 5000
        pool_guid: 4107244048732260727
        name: 'VMs'
        state: 0
        hostid: 2098829460
        hostname: 'pve01'
        vdev_tree:
            type: 'root'
            id: 0
            guid: 4107244048732260727
            children[0]:
                type: 'mirror'
                id: 0
                guid: 11474006333906117045
                metaslab_array: 266
                metaslab_shift: 34
                ashift: 12
                asize: 8001548713984
                is_log: 0
                create_txg: 4
                children[0]:
                    type: 'disk'
                    id: 0
                    guid: 7297764656939327676
                    whole_disk: 1
                    create_txg: 4
                    path: '/dev/disk/by-id/scsi-35000039c6823ed8d-part1'
                    devid: 'scsi-35000039c6823ed8d-part1'
                    phys_path: 'pci-0000:17:00.0-sas-phy0-lun-0'
                children[1]:
                    type: 'disk'
                    id: 1
                    guid: 15970748688722508299
                    whole_disk: 1
                    create_txg: 4
                    path: '/dev/disk/by-id/scsi-35000c50094089717-part1'
                    devid: 'scsi-35000c50094089717-part1'
                    phys_path: 'pci-0000:17:00.0-sas-phy2-lun-0'
            children[1]:
                type: 'mirror'
                id: 1
                guid: 7418412346239572526
                metaslab_array: 256
                metaslab_shift: 34
                ashift: 12
                asize: 8001548713984
                is_log: 0
                create_txg: 4
                children[0]:
                    type: 'disk'
                    id: 0
                    guid: 11063709733121148500
                    whole_disk: 1
                    create_txg: 4
                    path: '/dev/disk/by-id/scsi-35000c5009408131f-part1'
                    devid: 'scsi-35000c5009408131f-part1'
                    phys_path: 'pci-0000:17:00.0-sas-phy4-lun-0'
                children[1]:
                    type: 'disk'
                    id: 1
                    guid: 2094271549977896265
                    whole_disk: 1
                    create_txg: 4
                    path: '/dev/disk/by-id/scsi-35000039c6823ed95-part1'
                    devid: 'scsi-35000039c6823ed95-part1'
                    phys_path: 'pci-0000:17:00.0-sas-phy6-lun-0'
        load-policy:
            load-request-txg: 18446744073709551615
            load-rewind-policy: 2
zdb: can't open 'VMs': File exists

ZFS_DBGMSG(zdb) START:
ZFS_DBGMSG(zdb) END

At the very end the "zdb: can't open 'VMs': File exists" seems telling. I almost think I can rename that file and maybe rebuild it? Maybe it's trying to do that but can't because it "exists".

I'm really struggling here.

Thanks in advance!
 
You must log in or register to reply here.
Top Bottom