[SOLVED] Failed To Import Pool 'rpool'

what does "/sbin/zpool import" show? is it any different than "/sbin/zpool/import -d /dev/disk/by-id" ? (both only scan for pools that can be imported, but don't import anything)
 
wAiP3dQ.jpg
 
updated everything to latest versions, still failing. :(


Code:
root@pmx1:~# pveversion -v
proxmox-ve: 4.3-71 (running kernel: 4.4.21-1-pve)
pve-manager: 4.3-10 (running version: 4.3-10/7230e60f)
pve-kernel-4.4.21-1-pve: 4.4.21-71
pve-kernel-4.4.19-1-pve: 4.4.19-66
lvm2: 2.02.116-pve3
corosync-pve: 2.4.0-1
libqb0: 1.0-1
pve-cluster: 4.0-47
qemu-server: 4.0-94
pve-firmware: 1.1-10
libpve-common-perl: 4.0-80
libpve-access-control: 4.0-19
libpve-storage-perl: 4.0-68
pve-libspice-server1: 0.12.8-1
vncterm: 1.2-1
pve-docs: 4.3-14
pve-qemu-kvm: 2.7.0-6
pve-container: 1.0-81
pve-firewall: 2.0-31
pve-ha-manager: 1.0-35
ksm-control-daemon: 1.2-1
glusterfs-client: 3.5.2-2+deb8u2
lxc-pve: 2.0.5-1
lxcfs: 2.0.4-pve2
criu: 1.6.0-1
novnc-pve: 0.5-8
smartmontools: 6.5+svn4324-1~pve80
zfsutils: 0.6.5.8-pve13~bpo80
 
okay, that seems rather strange.. usually it's the opposite way (disk-by-id not working because of missing links). could you post the output of
"ls -l /dev/disk/by-id" and "ls -l /dev/" when dropped to the initramfs shell? note that since you are able to import the pool and boot afterwards, you should be able to save the output by redirecting it to a file in /run/... which will stay around until rebooting (so no need for screenshots or photos ;)).

another thing that I'd like to check is whether a cachefile exists in the initramfs and/or the host (check for "/etc/zfs/zpool.cache" in the initramfs shell and when booted).

finally, did you already try regenerating the initramfs with "update-intiramfs -u" ?
 
As requested:

Code:
root@pmx1:/run# more by.id.txt

total 0

lrwxrwxrwx  1 0  0  9 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX -> ../../sdd

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX-part1 -> ../../sdd1

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX-part2 -> ../../sdd2

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX-part9 -> ../../sdd9

lrwxrwxrwx  1 0  0  9 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX -> ../../sdc

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX-part1 -> ../../sdc1

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX-part2 -> ../../sdc2

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX-part9 -> ../../sdc9

lrwxrwxrwx  1 0  0  9 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX -> ../../sdb

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX-part1 -> ../../sdb1

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX-part2 -> ../../sdb2

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX-part9 -> ../../sdb9

lrwxrwxrwx  1 0  0  9 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX -> ../../sda

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX-part1 -> ../../sda1

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX-part2 -> ../../sda2

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 ata-ST3500418AS_XXXXXXXX-part9 -> ../../sda9

lrwxrwxrwx  1 0  0  9 Nov 28 15:55 wwn-0x5000c5002022c6ae -> ../../sdc

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 wwn-0x5000c5002022c6ae-part1 -> ../../sdc1

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 wwn-0x5000c5002022c6ae-part2 -> ../../sdc2

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 wwn-0x5000c5002022c6ae-part9 -> ../../sdc9

lrwxrwxrwx  1 0  0  9 Nov 28 15:55 wwn-0x5000c50022379f0c -> ../../sdd

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 wwn-0x5000c50022379f0c-part1 -> ../../sdd1

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 wwn-0x5000c50022379f0c-part2 -> ../../sdd2

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 wwn-0x5000c50022379f0c-part9 -> ../../sdd9

lrwxrwxrwx  1 0  0  9 Nov 28 15:55 wwn-0x5000c50026c72baf -> ../../sdb

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 wwn-0x5000c50026c72baf-part1 -> ../../sdb1

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 wwn-0x5000c50026c72baf-part2 -> ../../sdb2

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 wwn-0x5000c50026c72baf-part9 -> ../../sdb9

lrwxrwxrwx  1 0  0  9 Nov 28 15:55 wwn-0x5000c5003fa3b51f -> ../../sda

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 wwn-0x5000c5003fa3b51f-part1 -> ../../sda1

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 wwn-0x5000c5003fa3b51f-part2 -> ../../sda2

lrwxrwxrwx  1 0  0  10 Nov 28 15:55 wwn-0x5000c5003fa3b51f-part9 -> ../../sda9
 
Last edited:
and..

Code:
root@pmx1:/run# more dev.txt
total 0
drwxr-xr-x  2 0  0  840 Nov 28 15:55 block
drwxr-xr-x  2 0  0  120 Nov 28 15:55 bsg
crw-------  1 0  0  10, 234 Nov 28 15:55 btrfs-control
drwxr-xr-x  3 0  0  60 Nov 28 15:54 bus
drwxr-xr-x  2 0  0  3200 Nov 28 15:55 char
crw-------  1 0  0  5,  1 Nov 28 15:54 console
lrwxrwxrwx  1 0  0  11 Nov 28 15:54 core -> /proc/kcore
drwxr-xr-x  2 0  0  60 Nov 28 15:54 cpu
crw-------  1 0  0  10,  59 Nov 28 15:54 cpu_dma_latency
drwxr-xr-x  5 0  0  100 Nov 28 15:55 disk
crw-------  1 0  0  10,  61 Nov 28 15:54 ecryptfs
lrwxrwxrwx  1 0  0  13 Nov 28 15:54 fd -> /proc/self/fd
crw-rw-rw-  1 0  0  1,  7 Nov 28 15:54 full
crw-rw-rw-  1 0  0  10, 229 Nov 28 15:54 fuse
crw-------  1 0  0  247,  0 Nov 28 15:54 hidraw0
crw-------  1 0  0  247,  1 Nov 28 15:54 hidraw1
crw-------  1 0  0  10, 228 Nov 28 15:54 hpet
crw-------  1 0  0  10, 183 Nov 28 15:54 hwrng
drwxr-xr-x  2 0  0  160 Nov 28 15:54 input
crw-r--r--  1 0  0  1,  11 Nov 28 15:54 kmsg
drwxr-xr-x  2 0  0  60 Nov 28 15:54 lightnvm
crw-------  1 0  0  10, 237 Nov 28 15:54 loop-control
brw-------  1 0  0  7,  0 Nov 28 15:54 loop0
brw-------  1 0  0  7,  1 Nov 28 15:54 loop1
brw-------  1 0  0  7,  2 Nov 28 15:54 loop2
brw-------  1 0  0  7,  3 Nov 28 15:54 loop3
brw-------  1 0  0  7,  4 Nov 28 15:54 loop4
brw-------  1 0  0  7,  5 Nov 28 15:54 loop5
brw-------  1 0  0  7,  6 Nov 28 15:54 loop6
brw-------  1 0  0  7,  7 Nov 28 15:54 loop7
drwxr-xr-x  2 0  0  60 Nov 28 15:54 mapper
crw-------  1 0  0  10, 227 Nov 28 15:54 mcelog
crw-r-----  1 0  0  1,  1 Nov 28 15:54 mem
crw-------  1 0  0  10,  56 Nov 28 15:54 memory_bandwidth
drwxr-xr-x  2 0  0  60 Nov 28 15:54 net
crw-------  1 0  0  10,  58 Nov 28 15:54 network_latency
crw-------  1 0  0  10,  57 Nov 28 15:54 network_throughput
crw-rw-rw-  1 0  0  1,  3 Nov 28 15:54 null
crw-r-----  1 0  0  1,  4 Nov 28 15:54 port
crw-------  1 0  0  108,  0 Nov 28 15:54 ppp
crw-------  1 0  0  10,  1 Nov 28 15:54 psaux
crw-rw-rw-  1 0  0  5,  2 Nov 28 15:54 ptmx
drwxr-xr-x  2 0  0  0 Nov 28 15:54 pts
brw-------  1 0  0  1,  0 Nov 28 15:54 ram0
brw-------  1 0  0  1,  1 Nov 28 15:54 ram1
brw-------  1 0  0  1,  10 Nov 28 15:54 ram10
brw-------  1 0  0  1,  11 Nov 28 15:54 ram11
brw-------  1 0  0  1,  12 Nov 28 15:54 ram12
brw-------  1 0  0  1,  13 Nov 28 15:54 ram13
brw-------  1 0  0  1,  14 Nov 28 15:54 ram14
brw-------  1 0  0  1,  15 Nov 28 15:54 ram15
brw-------  1 0  0  1,  2 Nov 28 15:54 ram2
brw-------  1 0  0  1,  3 Nov 28 15:54 ram3
brw-------  1 0  0  1,  4 Nov 28 15:54 ram4
brw-------  1 0  0  1,  5 Nov 28 15:54 ram5
brw-------  1 0  0  1,  6 Nov 28 15:54 ram6
brw-------  1 0  0  1,  7 Nov 28 15:54 ram7
brw-------  1 0  0  1,  8 Nov 28 15:54 ram8
brw-------  1 0  0  1,  9 Nov 28 15:54 ram9
crw-rw-rw-  1 0  0  1,  8 Nov 28 15:54 random
crw-rw-r--  1 0  0  10,  62 Nov 28 15:54 rfkill
lrwxrwxrwx  1 0  0  4 Nov 28 15:54 rtc -> rtc0
crw-------  1 0  0  251,  0 Nov 28 15:54 rtc0
brw-------  1 0  0  8,  0 Nov 28 15:55 sda
brw-------  1 0  0  8,  1 Nov 28 15:55 sda1
brw-------  1 0  0  8,  2 Nov 28 15:55 sda2
brw-------  1 0  0  8,  9 Nov 28 15:55 sda9
brw-------  1 0  0  8,  16 Nov 28 15:55 sdb
brw-------  1 0  0  8,  17 Nov 28 15:55 sdb1
brw-------  1 0  0  8,  18 Nov 28 15:55 sdb2
brw-------  1 0  0  8,  25 Nov 28 15:55 sdb9
brw-------  1 0  0  8,  32 Nov 28 15:55 sdc
brw-------  1 0  0  8,  33 Nov 28 15:55 sdc1
brw-------  1 0  0  8,  34 Nov 28 15:55 sdc2
brw-------  1 0  0  8,  41 Nov 28 15:55 sdc9
brw-------  1 0  0  8,  48 Nov 28 15:55 sdd
brw-------  1 0  0  8,  49 Nov 28 15:55 sdd1
brw-------  1 0  0  8,  50 Nov 28 15:55 sdd2
brw-------  1 0  0  8,  57 Nov 28 15:55 sdd9
crw-------  1 0  0  21,  0 Nov 28 15:55 sg0
crw-------  1 0  0  21,  1 Nov 28 15:55 sg1
crw-------  1 0  0  21,  2 Nov 28 15:54 sg2
crw-------  1 0  0  21,  3 Nov 28 15:55 sg3
crw-------  1 0  0  10, 231 Nov 28 15:54 snapshot
lrwxrwxrwx  1 0  0  15 Nov 28 15:54 stderr -> /proc/self/fd/2
lrwxrwxrwx  1 0  0  15 Nov 28 15:54 stdin -> /proc/self/fd/0
lrwxrwxrwx  1 0  0  15 Nov 28 15:54 stdout -> /proc/self/fd/1
crw-rw-rw-  1 0  0  5,  0 Nov 28 15:54 tty
crw--w----  1 0  0  4,  0 Nov 28 15:54 tty0
crw--w----  1 0  0  4,  1 Nov 28 15:54 tty1
crw--w----  1 0  0  4,  10 Nov 28 15:54 tty10
crw--w----  1 0  0  4,  11 Nov 28 15:54 tty11
crw--w----  1 0  0  4,  12 Nov 28 15:54 tty12
crw--w----  1 0  0  4,  13 Nov 28 15:54 tty13
crw--w----  1 0  0  4,  14 Nov 28 15:54 tty14
crw--w----  1 0  0  4,  15 Nov 28 15:54 tty15
crw--w----  1 0  0  4,  16 Nov 28 15:54 tty16
crw--w----  1 0  0  4,  17 Nov 28 15:54 tty17
crw--w----  1 0  0  4,  18 Nov 28 15:54 tty18
crw--w----  1 0  0  4,  19 Nov 28 15:54 tty19
crw--w----  1 0  0  4,  2 Nov 28 15:54 tty2
crw--w----  1 0  0  4,  20 Nov 28 15:54 tty20
crw--w----  1 0  0  4,  21 Nov 28 15:54 tty21
crw--w----  1 0  0  4,  22 Nov 28 15:54 tty22
crw--w----  1 0  0  4,  23 Nov 28 15:54 tty23
crw--w----  1 0  0  4,  24 Nov 28 15:54 tty24
crw--w----  1 0  0  4,  25 Nov 28 15:54 tty25
crw--w----  1 0  0  4,  26 Nov 28 15:54 tty26
crw--w----  1 0  0  4,  27 Nov 28 15:54 tty27
crw--w----  1 0  0  4,  28 Nov 28 15:54 tty28
crw--w----  1 0  0  4,  29 Nov 28 15:54 tty29
crw--w----  1 0  0  4,  3 Nov 28 15:54 tty3
crw--w----  1 0  0  4,  30 Nov 28 15:54 tty30
crw--w----  1 0  0  4,  31 Nov 28 15:54 tty31
crw--w----  1 0  0  4,  32 Nov 28 15:54 tty32
crw--w----  1 0  0  4,  33 Nov 28 15:54 tty33
crw--w----  1 0  0  4,  34 Nov 28 15:54 tty34
crw--w----  1 0  0  4,  35 Nov 28 15:54 tty35
crw--w----  1 0  0  4,  36 Nov 28 15:54 tty36
crw--w----  1 0  0  4,  37 Nov 28 15:54 tty37
crw--w----  1 0  0  4,  38 Nov 28 15:54 tty38
crw--w----  1 0  0  4,  39 Nov 28 15:54 tty39
crw--w----  1 0  0  4,  4 Nov 28 15:54 tty4
crw--w----  1 0  0  4,  40 Nov 28 15:54 tty40
crw--w----  1 0  0  4,  41 Nov 28 15:54 tty41
crw--w----  1 0  0  4,  42 Nov 28 15:54 tty42
crw--w----  1 0  0  4,  43 Nov 28 15:54 tty43
crw--w----  1 0  0  4,  44 Nov 28 15:54 tty44
crw--w----  1 0  0  4,  45 Nov 28 15:54 tty45
crw--w----  1 0  0  4,  46 Nov 28 15:54 tty46
crw--w----  1 0  0  4,  47 Nov 28 15:54 tty47
crw--w----  1 0  0  4,  48 Nov 28 15:54 tty48
crw--w----  1 0  0  4,  49 Nov 28 15:54 tty49
crw--w----  1 0  0  4,  5 Nov 28 15:54 tty5
crw--w----  1 0  0  4,  50 Nov 28 15:54 tty50
crw--w----  1 0  0  4,  51 Nov 28 15:54 tty51
crw--w----  1 0  0  4,  52 Nov 28 15:54 tty52
crw--w----  1 0  0  4,  53 Nov 28 15:54 tty53
crw--w----  1 0  0  4,  54 Nov 28 15:54 tty54
crw--w----  1 0  0  4,  55 Nov 28 15:54 tty55
crw--w----  1 0  0  4,  56 Nov 28 15:54 tty56
crw--w----  1 0  0  4,  57 Nov 28 15:54 tty57
crw--w----  1 0  0  4,  58 Nov 28 15:54 tty58
crw--w----  1 0  0  4,  59 Nov 28 15:54 tty59
crw--w----  1 0  0  4,  6 Nov 28 15:54 tty6
crw--w----  1 0  0  4,  60 Nov 28 15:54 tty60
crw--w----  1 0  0  4,  61 Nov 28 15:54 tty61
crw--w----  1 0  0  4,  62 Nov 28 15:54 tty62
crw--w----  1 0  0  4,  63 Nov 28 15:54 tty63
crw--w----  1 0  0  4,  7 Nov 28 15:54 tty7
crw--w----  1 0  0  4,  8 Nov 28 15:54 tty8
crw--w----  1 0  0  4,  9 Nov 28 15:54 tty9
crw-------  1 0  0  4,  64 Nov 28 15:54 ttyS0
crw-------  1 0  0  4,  65 Nov 28 15:54 ttyS1
crw-------  1 0  0  4,  74 Nov 28 15:54 ttyS10
crw-------  1 0  0  4,  75 Nov 28 15:54 ttyS11
crw-------  1 0  0  4,  76 Nov 28 15:54 ttyS12
crw-------  1 0  0  4,  77 Nov 28 15:54 ttyS13
crw-------  1 0  0  4,  78 Nov 28 15:54 ttyS14
crw-------  1 0  0  4,  79 Nov 28 15:54 ttyS15
crw-------  1 0  0  4,  80 Nov 28 15:54 ttyS16
crw-------  1 0  0  4,  81 Nov 28 15:54 ttyS17
crw-------  1 0  0  4,  82 Nov 28 15:54 ttyS18
crw-------  1 0  0  4,  83 Nov 28 15:54 ttyS19
crw-------  1 0  0  4,  66 Nov 28 15:54 ttyS2
crw-------  1 0  0  4,  84 Nov 28 15:54 ttyS20
crw-------  1 0  0  4,  85 Nov 28 15:54 ttyS21
crw-------  1 0  0  4,  86 Nov 28 15:54 ttyS22
crw-------  1 0  0  4,  87 Nov 28 15:54 ttyS23
crw-------  1 0  0  4,  88 Nov 28 15:54 ttyS24
crw-------  1 0  0  4,  89 Nov 28 15:54 ttyS25
crw-------  1 0  0  4,  90 Nov 28 15:54 ttyS26
crw-------  1 0  0  4,  91 Nov 28 15:54 ttyS27
crw-------  1 0  0  4,  92 Nov 28 15:54 ttyS28
crw-------  1 0  0  4,  93 Nov 28 15:54 ttyS29
crw-------  1 0  0  4,  67 Nov 28 15:54 ttyS3
crw-------  1 0  0  4,  94 Nov 28 15:54 ttyS30
crw-------  1 0  0  4,  95 Nov 28 15:54 ttyS31
crw-------  1 0  0  4,  68 Nov 28 15:54 ttyS4
crw-------  1 0  0  4,  69 Nov 28 15:54 ttyS5
crw-------  1 0  0  4,  70 Nov 28 15:54 ttyS6
crw-------  1 0  0  4,  71 Nov 28 15:54 ttyS7
crw-------  1 0  0  4,  72 Nov 28 15:54 ttyS8
crw-------  1 0  0  4,  73 Nov 28 15:54 ttyS9
crw-------  1 0  0  5,  3 Nov 28 15:54 ttyprintk
crw-------  1 0  0  10, 223 Nov 28 15:54 uinput
crw-rw-rw-  1 0  0  1,  9 Nov 28 15:54 urandom
crw-------  1 0  0  7,  0 Nov 28 15:54 vcs
crw-------  1 0  0  7,  1 Nov 28 15:54 vcs1
crw-------  1 0  0  7, 128 Nov 28 15:54 vcsa
crw-------  1 0  0  7, 129 Nov 28 15:54 vcsa1
crw-------  1 0  0  10,  63 Nov 28 15:54 vga_arbiter
crw-rw-rw-  1 0  0  1,  5 Nov 28 15:54 zero
crw-------  1 0  0  10,  55 Nov 28 15:55 zfs
 
and..

Code:
root@pmx1:/run# more zfs.txt
/etc/zfs
total 12
drwxr-xr-x  3 0  0  0 Nov  2 16:19 .
drwxr-xr-x  8 0  0  0 Nov  2 16:32 ..
drwxr-xr-x  2 0  0  0 Nov  2 16:19 zed.d
-rw-r--r--  1 0  0  9510 Oct 27 09:27 zfs-functions
 
if you are willing to try some more stuff, although now it's more or less stabbing in the dark, you could try to scan for the pool using "zpool import -d /dev"? and could you post the kernel commandline ("cat /proc/cmdline")

two more things that might be interesting:
  • booting with the kernel parameter "zfsdebug=1" (e.g., by editing the boot entry in the grub menu and adding the parameter to the line starting with "linux" and pressing the key combination shown on the bottom in order to boot it)
  • setting "ZPOOL_IMPORT_PATH" in /etc/default/zfs to "/dev/disk/by-vdev:/dev/disk/by-id" and regenerating the initramfs with "update-initramfs -u" to force mounting with IDs
 
I was getting the same error.
Clean install Proxmox VE 4.4 ZFS RAID0 with 1 disk (made this so I can upgrade to RAID1 later by adding another disk)

Was fixed by:
setting "ZPOOL_IMPORT_PATH" in /etc/default/zfs to "/dev/disk/by-vdev:/dev/disk/by-id" and regenerating the initramfs with "update-initramfs -u" to force mounting with IDs
 
I put this here to be found by a guy that might have the problem I faced (server have 3 disks - dedibox PRO 2016.

I faced the same issue with one server : busybox / rpool cannot be imported, zpool import shows nothing, zpool detect nothing even with a live CD etc.

Solution :
My server was previously configured with Linux RAID (mdadm etc.) ! I thought that the installer was reseting the disk but that was not the case !
Linux was detecting the raid, using it, and blocking zfs operation.

"mdadm --zero-superblock " all the disk, and everything run smooth.
 
that is strange - it's the only setup where I could reproduce this issue so far..



"zfs get mountpoint" only shows you the value of the mountpoint property (i.e., where it should be mounted, relative to the "altroot" property if set). if you import the pool with "-N", it won't be mounted (this makes sense in the service, where first all pools are imported, and then a separate service mounts them, and yet another service shares them (if configured).

given your first screenshot, you should be able to do the following:
  • boot into emergency mode (in the grub menu, hit "e", and add " emergency" to the end of the line starting with "linux", then press ctrl+x)
  • if needed, manually import your rpool in the initramfs prompt like you did in your first post ("zpool import -N rpool" followed by "exit")
  • enter your root password when prompted to enter maintenance/emergency mode
  • disable the zfs-import-scan.service ("systemctl disable zfs-import-scan")
  • continue the boot ("exit" or ctrl+d)
now you should be able to install the update with the fix, and then re-enable the zfs-import-scan service ("systemctl enable zfs-import-scan") and reboot the host. I would recommend regenerating the initramfs ("update-initramfs -u"). if you are still dropped into the initramfs prompt after that, I would be very interested in your "pveversion -v" output and your grub config ("/boot/grub/grub.cfg").

I tried this but dont work.
I mean, when i boot in emergency the zpool import -aN /dev.... works, but when I boot again without emergency mode, it dont work.
I´ve tried the rootdelay option too, but still failing.
The zfsutils version is the 0.6.5.9-pve15 bpo80

¿What is going wrong?
 
that is strange - it's the only setup where I could reproduce this issue so far..



"zfs get mountpoint" only shows you the value of the mountpoint property (i.e., where it should be mounted, relative to the "altroot" property if set). if you import the pool with "-N", it won't be mounted (this makes sense in the service, where first all pools are imported, and then a separate service mounts them, and yet another service shares them (if configured).

given your first screenshot, you should be able to do the following:
  • boot into emergency mode (in the grub menu, hit "e", and add " emergency" to the end of the line starting with "linux", then press ctrl+x)
  • if needed, manually import your rpool in the initramfs prompt like you did in your first post ("zpool import -N rpool" followed by "exit")
  • enter your root password when prompted to enter maintenance/emergency mode
  • disable the zfs-import-scan.service ("systemctl disable zfs-import-scan")
  • continue the boot ("exit" or ctrl+d)
now you should be able to install the update with the fix, and then re-enable the zfs-import-scan service ("systemctl enable zfs-import-scan") and reboot the host. I would recommend regenerating the initramfs ("update-initramfs -u"). if you are still dropped into the initramfs prompt after that, I would be very interested in your "pveversion -v" output and your grub config ("/boot/grub/grub.cfg").
hi
I got 'kernel panic' after reboot and i have regenerated the initramfs ("update-initramfs -u")
"[ end Kernel panic - not syncing: VFS: Unable to mount root fs
on unknown-block(0,0)"
need help
thanks
 
I am having the exact same issue since updating recently. I always keep my system up to date and was notified of an update. I ran the update and didn't think anything about it. I tried to add a new CT and was getting an error saying it could not save dso I rebooted and ended up with the "Failed to import pool 'rpool'" error.

For me, I am able to run this command:

Code:
zpool import -aN -d /dev/disk/by-id -o cachefile=none

I follow this by exit and the system boots as normal.

I tried adding the "ZPOOL_IMPORT_PATH" in /etc/default/zfs to "/dev/disk/by-vdev:/dev/disk/by-id" and regenerating the initramfs with "update-initramfs -u" to force mounting with IDs, but it still fails forcing me to manually do the zpool import command above every boot.

Setting a boot delay at boot (e at the Grub prompt, adding bootdelay=30 to the linux line) did not help either.

I AM NOT running any ZFS enabled VMs (like FreeNAS). The system was running (and rebooting) fine until the last update.

Looking for ideas.

Thanks

Code:
root@proxmox:~# pveversion -v
proxmox-ve: 5.1-25 (running kernel: 4.13.4-1-pve)
pve-manager: 5.1-36 (running version: 5.1-36/131401db)
pve-kernel-4.13.4-1-pve: 4.13.4-25
pve-kernel-4.10.17-4-pve: 4.10.17-24
pve-kernel-4.10.17-2-pve: 4.10.17-20
pve-kernel-4.10.15-1-pve: 4.10.15-15
pve-kernel-4.10.17-3-pve: 4.10.17-23
libpve-http-server-perl: 2.0-6
lvm2: 2.02.168-pve6
corosync: 2.4.2-pve3
libqb0: 1.0.1-1
pve-cluster: 5.0-15
qemu-server: 5.0-17
pve-firmware: 2.0-3
libpve-common-perl: 5.0-20
libpve-guest-common-perl: 2.0-13
libpve-access-control: 5.0-7
libpve-storage-perl: 5.0-16
pve-libspice-server1: 0.12.8-3
vncterm: 1.5-2
pve-docs: 5.1-12
pve-qemu-kvm: 2.9.1-2
pve-container: 2.0-17
pve-firewall: 3.0-3
pve-ha-manager: 2.0-3
ksm-control-daemon: 1.2-2
glusterfs-client: 3.8.8-1
lxc-pve: 2.1.0-2
lxcfs: 2.0.7-pve4
criu: 2.11.1-1~bpo90
novnc-pve: 0.6-4
smartmontools: 6.5+svn4324-1
zfsutils-linux: 0.7.2-pve1~bpo90

Code:
#
# DO NOT EDIT THIS FILE
#
# It is automatically generated by grub-mkconfig using templates
# from /etc/grub.d and settings from /etc/default/grub
#

### BEGIN /etc/grub.d/00_header ###
if [ -s $prefix/grubenv ]; then
  set have_grubenv=true
  load_env
fi
if [ "${next_entry}" ] ; then
   set default="${next_entry}"
   set next_entry=
   save_env next_entry
   set boot_once=true
else
   set default="0"
fi

if [ x"${feature_menuentry_id}" = xy ]; then
  menuentry_id_option="--id"
else
  menuentry_id_option=""
fi

export menuentry_id_option

if [ "${prev_saved_entry}" ]; then
  set saved_entry="${prev_saved_entry}"
  save_env saved_entry
  set prev_saved_entry=
  save_env prev_saved_entry
  set boot_once=true
fi

function savedefault {
  if [ -z "${boot_once}" ]; then
    saved_entry="${chosen}"
    save_env saved_entry
  fi
}
function load_video {
  if [ x$feature_all_video_module = xy ]; then
    insmod all_video
  else
    insmod efi_gop
    insmod efi_uga
    insmod ieee1275_fb
    insmod vbe
    insmod vga
    insmod video_bochs
    insmod video_cirrus
  fi
}

if [ x$feature_default_font_path = xy ] ; then
   font=unicode
else
insmod part_gpt
insmod part_gpt
insmod zfs
set root='hd0,gpt2'
if [ x$feature_platform_search_hint = xy ]; then
  search --no-floppy --fs-uuid --set=root --hint-bios=hd0,gpt2 --hint-efi=hd0,gpt2 --hint-baremetal=ahci0,gpt2  --hint-bios=hd1,gpt2 --hint-efi=hd1,gpt2 --hint-baremetal=ahci1,gpt2  f9e591d1b3cbfa85
else
  search --no-floppy --fs-uuid --set=root f9e591d1b3cbfa85
fi
    font="/ROOT/pve-1@/usr/share/grub/unicode.pf2"
fi

if loadfont $font ; then
  set gfxmode=auto
  load_video
  insmod gfxterm
  set locale_dir=$prefix/locale
  set lang=en_US
  insmod gettext
fi
terminal_output gfxterm
if [ "${recordfail}" = 1 ] ; then
  set timeout=30
else
  if [ x$feature_timeout_style = xy ] ; then
    set timeout_style=menu
    set timeout=5
  # Fallback normal timeout code in case the timeout_style feature is
  # unavailable.
  else
    set timeout=5
  fi
fi
### END /etc/grub.d/00_header ###

### BEGIN /etc/grub.d/05_debian_theme ###
set menu_color_normal=cyan/blue
set menu_color_highlight=white/blue
### END /etc/grub.d/05_debian_theme ###

### BEGIN /etc/grub.d/10_linux ###
function gfxmode {
    set gfxpayload="${1}"
}
set linux_gfx_mode=
export linux_gfx_mode
menuentry 'Proxmox Virtual Environment GNU/Linux' --class proxmox --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-simple-f9e591d1b3cbfa85' {
    load_video
    insmod gzio
    if [ x$grub_platform = xxen ]; then insmod xzio; insmod lzopio; fi
    insmod part_gpt
    insmod part_gpt
    insmod zfs
    set root='hd0,gpt2'
    if [ x$feature_platform_search_hint = xy ]; then
      search --no-floppy --fs-uuid --set=root --hint-bios=hd0,gpt2 --hint-efi=hd0,gpt2 --hint-baremetal=ahci0,gpt2  --hint-bios=hd1,gpt2 --hint-efi=hd1,gpt2 --hint-baremetal=ahci1,gpt2  f9e591d1b3cbfa85
    else
      search --no-floppy --fs-uuid --set=root f9e591d1b3cbfa85
    fi
    echo    'Loading Linux 4.13.4-1-pve ...'
    linux    /ROOT/pve-1@/boot/vmlinuz-4.13.4-1-pve root=ZFS=rpool/ROOT/pve-1 ro root=ZFS=rpool/ROOT/pve-1 boot=zfs quiet
    echo    'Loading initial ramdisk ...'
    initrd    /ROOT/pve-1@/boot/initrd.img-4.13.4-1-pve
}
submenu 'Advanced options for Proxmox Virtual Environment GNU/Linux' $menuentry_id_option 'gnulinux-advanced-f9e591d1b3cbfa85' {
    menuentry 'Proxmox Virtual Environment GNU/Linux, with Linux 4.13.4-1-pve' --class proxmox --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.13.4-1-pve-advanced-f9e591d1b3cbfa85' {
        load_video
        insmod gzio
        if [ x$grub_platform = xxen ]; then insmod xzio; insmod lzopio; fi
        insmod part_gpt
        insmod part_gpt
        insmod zfs
        set root='hd0,gpt2'
        if [ x$feature_platform_search_hint = xy ]; then
          search --no-floppy --fs-uuid --set=root --hint-bios=hd0,gpt2 --hint-efi=hd0,gpt2 --hint-baremetal=ahci0,gpt2  --hint-bios=hd1,gpt2 --hint-efi=hd1,gpt2 --hint-baremetal=ahci1,gpt2  f9e591d1b3cbfa85
        else
          search --no-floppy --fs-uuid --set=root f9e591d1b3cbfa85
        fi
        echo    'Loading Linux 4.13.4-1-pve ...'
        linux    /ROOT/pve-1@/boot/vmlinuz-4.13.4-1-pve root=ZFS=rpool/ROOT/pve-1 ro root=ZFS=rpool/ROOT/pve-1 boot=zfs quiet
        echo    'Loading initial ramdisk ...'
        initrd    /ROOT/pve-1@/boot/initrd.img-4.13.4-1-pve
    }
    menuentry 'Proxmox Virtual Environment GNU/Linux, with Linux 4.10.17-4-pve' --class proxmox --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.10.17-4-pve-advanced-f9e591d1b3cbfa85' {
        load_video
        insmod gzio
        if [ x$grub_platform = xxen ]; then insmod xzio; insmod lzopio; fi
        insmod part_gpt
        insmod part_gpt
        insmod zfs
        set root='hd0,gpt2'
        if [ x$feature_platform_search_hint = xy ]; then
          search --no-floppy --fs-uuid --set=root --hint-bios=hd0,gpt2 --hint-efi=hd0,gpt2 --hint-baremetal=ahci0,gpt2  --hint-bios=hd1,gpt2 --hint-efi=hd1,gpt2 --hint-baremetal=ahci1,gpt2  f9e591d1b3cbfa85
        else
          search --no-floppy --fs-uuid --set=root f9e591d1b3cbfa85
        fi
        echo    'Loading Linux 4.10.17-4-pve ...'
        linux    /ROOT/pve-1@/boot/vmlinuz-4.10.17-4-pve root=ZFS=rpool/ROOT/pve-1 ro root=ZFS=rpool/ROOT/pve-1 boot=zfs quiet
        echo    'Loading initial ramdisk ...'
        initrd    /ROOT/pve-1@/boot/initrd.img-4.10.17-4-pve
    }
    menuentry 'Proxmox Virtual Environment GNU/Linux, with Linux 4.10.17-3-pve' --class proxmox --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.10.17-3-pve-advanced-f9e591d1b3cbfa85' {
        load_video
        insmod gzio
        if [ x$grub_platform = xxen ]; then insmod xzio; insmod lzopio; fi
        insmod part_gpt
        insmod part_gpt
        insmod zfs
        set root='hd0,gpt2'
        if [ x$feature_platform_search_hint = xy ]; then
          search --no-floppy --fs-uuid --set=root --hint-bios=hd0,gpt2 --hint-efi=hd0,gpt2 --hint-baremetal=ahci0,gpt2  --hint-bios=hd1,gpt2 --hint-efi=hd1,gpt2 --hint-baremetal=ahci1,gpt2  f9e591d1b3cbfa85
        else
          search --no-floppy --fs-uuid --set=root f9e591d1b3cbfa85
        fi
        echo    'Loading Linux 4.10.17-3-pve ...'
        linux    /ROOT/pve-1@/boot/vmlinuz-4.10.17-3-pve root=ZFS=rpool/ROOT/pve-1 ro root=ZFS=rpool/ROOT/pve-1 boot=zfs quiet
        echo    'Loading initial ramdisk ...'
        initrd    /ROOT/pve-1@/boot/initrd.img-4.10.17-3-pve
    }
    menuentry 'Proxmox Virtual Environment GNU/Linux, with Linux 4.10.17-2-pve' --class proxmox --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.10.17-2-pve-advanced-f9e591d1b3cbfa85' {
        load_video
        insmod gzio
        if [ x$grub_platform = xxen ]; then insmod xzio; insmod lzopio; fi
        insmod part_gpt
        insmod part_gpt
        insmod zfs
        set root='hd0,gpt2'
        if [ x$feature_platform_search_hint = xy ]; then
          search --no-floppy --fs-uuid --set=root --hint-bios=hd0,gpt2 --hint-efi=hd0,gpt2 --hint-baremetal=ahci0,gpt2  --hint-bios=hd1,gpt2 --hint-efi=hd1,gpt2 --hint-baremetal=ahci1,gpt2  f9e591d1b3cbfa85
        else
          search --no-floppy --fs-uuid --set=root f9e591d1b3cbfa85
        fi
        echo    'Loading Linux 4.10.17-2-pve ...'
        linux    /ROOT/pve-1@/boot/vmlinuz-4.10.17-2-pve root=ZFS=rpool/ROOT/pve-1 ro root=ZFS=rpool/ROOT/pve-1 boot=zfs quiet
        echo    'Loading initial ramdisk ...'
        initrd    /ROOT/pve-1@/boot/initrd.img-4.10.17-2-pve
    }
    menuentry 'Proxmox Virtual Environment GNU/Linux, with Linux 4.10.15-1-pve' --class proxmox --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.10.15-1-pve-advanced-f9e591d1b3cbfa85' {
        load_video
        insmod gzio
        if [ x$grub_platform = xxen ]; then insmod xzio; insmod lzopio; fi
        insmod part_gpt
        insmod part_gpt
        insmod zfs
        set root='hd0,gpt2'
        if [ x$feature_platform_search_hint = xy ]; then
          search --no-floppy --fs-uuid --set=root --hint-bios=hd0,gpt2 --hint-efi=hd0,gpt2 --hint-baremetal=ahci0,gpt2  --hint-bios=hd1,gpt2 --hint-efi=hd1,gpt2 --hint-baremetal=ahci1,gpt2  f9e591d1b3cbfa85
        else
          search --no-floppy --fs-uuid --set=root f9e591d1b3cbfa85
        fi
        echo    'Loading Linux 4.10.15-1-pve ...'
        linux    /ROOT/pve-1@/boot/vmlinuz-4.10.15-1-pve root=ZFS=rpool/ROOT/pve-1 ro root=ZFS=rpool/ROOT/pve-1 boot=zfs quiet
        echo    'Loading initial ramdisk ...'
        initrd    /ROOT/pve-1@/boot/initrd.img-4.10.15-1-pve
    }
}

### END /etc/grub.d/10_linux ###

### BEGIN /etc/grub.d/20_linux_xen ###

### END /etc/grub.d/20_linux_xen ###

### BEGIN /etc/grub.d/20_memtest86+ ###
menuentry "Memory test (memtest86+)" {
    insmod part_gpt
    insmod part_gpt
    insmod zfs
    set root='hd0,gpt2'
    if [ x$feature_platform_search_hint = xy ]; then
      search --no-floppy --fs-uuid --set=root --hint-bios=hd0,gpt2 --hint-efi=hd0,gpt2 --hint-baremetal=ahci0,gpt2  --hint-bios=hd1,gpt2 --hint-efi=hd1,gpt2 --hint-baremetal=ahci1,gpt2  f9e591d1b3cbfa85
    else
      search --no-floppy --fs-uuid --set=root f9e591d1b3cbfa85
    fi
    linux16    /ROOT/pve-1@/boot/memtest86+.bin
}
menuentry "Memory test (memtest86+, serial console 115200)" {
    insmod part_gpt
    insmod part_gpt
    insmod zfs
    set root='hd0,gpt2'
    if [ x$feature_platform_search_hint = xy ]; then
      search --no-floppy --fs-uuid --set=root --hint-bios=hd0,gpt2 --hint-efi=hd0,gpt2 --hint-baremetal=ahci0,gpt2  --hint-bios=hd1,gpt2 --hint-efi=hd1,gpt2 --hint-baremetal=ahci1,gpt2  f9e591d1b3cbfa85
    else
      search --no-floppy --fs-uuid --set=root f9e591d1b3cbfa85
    fi
    linux16    /ROOT/pve-1@/boot/memtest86+.bin console=ttyS0,115200n8
}
menuentry "Memory test (memtest86+, experimental multiboot)" {
    insmod part_gpt
    insmod part_gpt
    insmod zfs
    set root='hd0,gpt2'
    if [ x$feature_platform_search_hint = xy ]; then
      search --no-floppy --fs-uuid --set=root --hint-bios=hd0,gpt2 --hint-efi=hd0,gpt2 --hint-baremetal=ahci0,gpt2  --hint-bios=hd1,gpt2 --hint-efi=hd1,gpt2 --hint-baremetal=ahci1,gpt2  f9e591d1b3cbfa85
    else
      search --no-floppy --fs-uuid --set=root f9e591d1b3cbfa85
    fi
    multiboot    /ROOT/pve-1@/boot/memtest86+_multiboot.bin
}
menuentry "Memory test (memtest86+, serial console 115200, experimental multiboot)" {
    insmod part_gpt
    insmod part_gpt
    insmod zfs
    set root='hd0,gpt2'
    if [ x$feature_platform_search_hint = xy ]; then
      search --no-floppy --fs-uuid --set=root --hint-bios=hd0,gpt2 --hint-efi=hd0,gpt2 --hint-baremetal=ahci0,gpt2  --hint-bios=hd1,gpt2 --hint-efi=hd1,gpt2 --hint-baremetal=ahci1,gpt2  f9e591d1b3cbfa85
    else
      search --no-floppy --fs-uuid --set=root f9e591d1b3cbfa85
    fi
    multiboot    /ROOT/pve-1@/boot/memtest86+_multiboot.bin console=ttyS0,115200n8
}
### END /etc/grub.d/20_memtest86+ ###

### BEGIN /etc/grub.d/30_os-prober ###
### END /etc/grub.d/30_os-prober ###

### BEGIN /etc/grub.d/30_uefi-firmware ###
### END /etc/grub.d/30_uefi-firmware ###

### BEGIN /etc/grub.d/40_custom ###
# This file provides an easy way to add custom menu entries.  Simply type the
# menu entries you want to add after this comment.  Be careful not to change
# the 'exec tail' line above.
### END /etc/grub.d/40_custom ###

### BEGIN /etc/grub.d/41_custom ###
if [ -f  ${config_directory}/custom.cfg ]; then
  source ${config_directory}/custom.cfg
elif [ -z "${config_directory}" -a -f  $prefix/custom.cfg ]; then
  source $prefix/custom.cfg;
fi
### END /etc/grub.d/41_custom ###
 
Anyone from Prox Staff? I need to address this and that is why I purchased a support contract.

Thanks!!

Hello,

You will find many hints in this thread and forum, try all all of them instead of posting "me too" in an thread which is already marked as solved.
This will be just confusing for other readers.
 
Hello,

You will find many hints in this thread and forum, try all all of them instead of posting "me too" in an thread which is already marked as solved.
This will be just confusing for other readers.


Why thank you, Tom, for your meaningless advice. I did try the advice listed in this thread and opted to post here again instead of opening yet another thread with the exact same thread title. What worked for the person that marked this as solved did not work for me.

Since I actually took the time to buy a support contract, maybe you can actually help me instead of posting a completely worthless and usless comment that does nothing to help anyone reading it at all.

Thank You
 
You did not get the point. A should not add new issues to a solved thread.

Read the docs, search the forum. If you cannot find any useful hint and you think you have a new problem, please open a new thread.
 
My apologies if I missed your point Tom and my apologies for not understanding the etiquette on this forum. On other forums it is very much frowned upon to open a duplicate thread to the exact same problem word-for-word. Additionally, I counted three or four other people that posted right before me whose problem was also not solved yet so while the thread was marked solved, it clearly was not actually solved for everyone.

I will open a new thread for my problem.
 
Today I ran in to a similar issue where Proxmox hang at
Importing pool 'rpool' using defaults
during boot.

Syslog statet:
Sep 22 07:30:25 hostname systemd-udevd[1765]: sr0: Worker [1815] processing SEQNUM=18888 is taking a long time
Sep 22 07:30:25 hostname systemd[1]: systemd-udev-settle.service: Main process exited, code=exited, status=1/FAILURE
Sep 22 07:30:25 hostname systemd[1]: systemd-udev-settle.service: Failed with result 'exit-code'.
Sep 22 07:30:25 hostname systemd[1]: Failed to start udev Wait for Complete Device Initialization.
Sep 22 07:30:25 hostname systemd[1]: Dependency failed for Import ZFS pools by cache file.
Sep 22 07:30:25 hostname systemd[1]: zfs-import-cache.service: Job zfs-import-cache.service/start failed with result 'dependency'.
Sep 22 07:30:25 hostname systemd[1]: ifupdown2-pre.service: Main process exited, code=exited, status=1/FAILURE
Sep 22 07:30:25 hostname systemd[1]: ifupdown2-pre.service: Failed with result 'exit-code'.
Sep 22 07:30:25 hostname systemd[1]: Failed to start Helper to synchronize boot up for ifupdown.
Sep 22 07:30:25 hostname systemd[1]: Dependency failed for Network initialization.
Sep 22 07:30:25 hostname systemd[1]: networking.service: Job networking.service/start failed with result 'dependency'.

Since this is a supermicro server-board with IPMI, sr0 is the remote-media virtual drive where I forgot to unmount the image. I had mounted the remote media from a temporary cifs server wich wasn't reachable anymore, so the bmc didn't respond to the kernel trying to gather partition information.

Unmounting the dead remote media solved the hanging import and the server now boots up again.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!