Failed to start Import ZFS pool SAN\x2dpxmx

[Veeh]

Dear Proxmox Community,

I have a slight issue with one of my zfs pool.
The SAN ZFS pool fail to import at boot. But once the node finished its boot sequence. The SAN pool is 100% working fine.

This is what I get

  UNIT                           LOAD   ACTIVE SUB    DESCRIPTION
● zfs-import@SAN\x2dpxmx.service loaded failed failed Import ZFS pool SAN\>


Oct 21 08:45:47 pxmx systemd[1]: Finished Helper to synchronize boot up for ifupdown.
Oct 21 08:45:47 pxmx systemd[1]: Finished Wait for udev To Complete Device Initialization.
Oct 21 08:45:47 pxmx systemd[1]: Starting Import ZFS pools by cache file...
Oct 21 08:45:47 pxmx systemd[1]: Starting Import ZFS pool M2\x2dpxmx...
Oct 21 08:45:47 pxmx systemd[1]: Starting Import ZFS pool SAN\x2dpxmx...
Oct 21 08:45:47 pxmx zpool[2547]: cannot import 'SAN-pxmx': no such pool available
Oct 21 08:45:47 pxmx systemd[1]: zfs-import@SAN\x2dpxmx.service: Main process exited, code=exited, status=1/FAILURE
Oct 21 08:45:47 pxmx systemd[1]: zfs-import@SAN\x2dpxmx.service: Failed with result 'exit-code'.
Oct 21 08:45:47 pxmx systemd[1]: Failed to start Import ZFS pool SAN\x2dpxmx.
Oct 21 08:45:48 pxmx systemd[1]: systemd-rfkill.service: Succeeded.

And it also look like my drives are coming up 5 sec prior to the ZFS import

Oct 21 08:45:42 pxmx kernel: scsi 1:0:0:0: Direct-Access     ATA      ST2000DM006-2DM1 CC26 PQ: 0 ANSI: 5
Oct 21 08:45:42 pxmx kernel: scsi 2:0:0:0: Direct-Access     ATA      ST2000DM001-1ER1 CC26 PQ: 0 ANSI: 5
Oct 21 08:45:42 pxmx kernel: scsi 3:0:0:0: Direct-Access     ATA      ST2000DM006-2DM1 CC26 PQ: 0 ANSI: 5
Oct 21 08:45:42 pxmx kernel: scsi 4:0:0:0: Direct-Access     ATA      SanDisk SD7TB3Q- 0306 PQ: 0 ANSI: 5
Oct 21 08:45:42 pxmx kernel: scsi 5:0:0:0: Direct-Access     ATA      SAMSUNG MZ7LN256 1H3Q PQ: 0 ANSI: 5
Oct 21 08:45:42 pxmx kernel: scsi 8:0:0:0: Direct-Access     ATA      ST2000DM006-2DM1 CC26 PQ: 0 ANSI: 5
Oct 21 08:45:42 pxmx kernel: scsi 9:0:0:0: Direct-Access     ATA      ST2000DM001-9YN1 CC4B PQ: 0 ANSI: 5

So as you can see the other pool M2 has no problem, the SAN pool is composed of 5 SATA 7.2k drive (ST2000...).
I thought because it's a bunch of 7.2k drive and after I have no issue it's just a delay issue. But then the drive are comming up before the zfs import.

I tried to add rootdelay in /etc/kernel/cmdline,
also included the delay in /etc/defaults/zfs, but didn't change a thing.

I think I'm setting up a delay for the root ZFS and not the other ones.
Does anyone know how to delay a particular zfs pool import?

And let me know if my issue is not one at all, because after all once the node is up, everything is working fine!!
thanks

Veeh

 

[AngryAdm]

add rootdelay=20 to either grub.cfg in etc/default/grub run update-grub or
add it to etc/kernel/cmdline run pve-efitool-boot-whatever refresh.

It is apparantly a new feature to have to do this upon fresh install in version 7

 

[Veeh]

No changes.... :/
I'm not even sure it does something because as you can see below. I still have the same delay between the drive coming on and the zfs import. (around 4/5s)

Oct 21 14:28:15 pxmx kernel: scsi 1:0:0:0: Direct-Access     ATA      ST2000DM006-2DM1 CC26 PQ: 0 ANSI: 5
Oct 21 14:28:15 pxmx kernel: scsi 2:0:0:0: Direct-Access     ATA      ST2000DM001-1ER1 CC26 PQ: 0 ANSI: 5
Oct 21 14:28:15 pxmx kernel: scsi 3:0:0:0: Direct-Access     ATA      ST2000DM006-2DM1 CC26 PQ: 0 ANSI: 5
Oct 21 14:28:15 pxmx kernel: scsi 4:0:0:0: Direct-Access     ATA      SanDisk SD7TB3Q- 0306 PQ: 0 ANSI: 5
Oct 21 14:28:15 pxmx kernel: scsi 5:0:0:0: Direct-Access     ATA      SAMSUNG MZ7LN256 1H3Q PQ: 0 ANSI: 5
Oct 21 14:28:15 pxmx kernel: scsi 8:0:0:0: Direct-Access     ATA      ST2000DM006-2DM1 CC26 PQ: 0 ANSI: 5
Oct 21 14:28:15 pxmx kernel: scsi 9:0:0:0: Direct-Access     ATA      ST2000DM001-9YN1 CC4B PQ: 0 ANSI: 5


Oct 21 14:28:14 pxmx kernel: Command line: initrd=\EFI\proxmox\5.11.22-1-pve\initrd.img-5.11.22-1-pve root=ZFS=rpool/ROOT/pve-1 boot=zfs rootdelay=20 amd_iommu=on iommu=pt pcie_acs_override=downstream,multifunction video=vesafb:off video=efifb:off
Oct 21 14:28:14 pxmx kernel: Kernel command line: initrd=\EFI\proxmox\5.11.22-1-pve\initrd.img-5.11.22-1-pve root=ZFS=rpool/ROOT/pve-1 boot=zfs rootdelay=20 amd_iommu=on iommu=pt pcie_acs_override=downstream,multifunction video=vesafb:off video=efifb:off
Oct 21 14:28:15 pxmx kernel: ZFS: Loaded module v2.0.4-pve1, ZFS pool version 5000, ZFS filesystem version 5
Oct 21 14:28:19 pxmx systemd[1]: Starting Import ZFS pools by cache file...
Oct 21 14:28:19 pxmx systemd[1]: Starting Import ZFS pool M2\x2dpxmx...
Oct 21 14:28:19 pxmx systemd[1]: Starting Import ZFS pool SAN\x2dpxmx...
Oct 21 14:28:19 pxmx systemd[1]: Failed to start Import ZFS pool SAN\x2dpxmx.