Cannot acces subvolumes on ZFS storage

[tghd]

Dear all,

I had some issues updating to Proxmox 6 recently. So I installed again from scratch and copied the configuration files in /etc/pve. Proxmox is located on a 256 Mb SSD and data is organized on a raidz ZFS-pool containing 3 HDD.

In the web-GUI the virtual machines are shown, however proxmox cannot access the data of the ZFS-pool. Hence the conainers cannot access their HDD. I assume there is a mounting problem with the new proxmox install and the ZFS-Volume?

Result of zfs list:

NAME                                USED  AVAIL     REFER  MOUNTPOINT

tank                               3.21T  3.80T      139G  /tank
tank/BACKUPS                        128K  3.80T      128K  /tank/BACKUPS
tank/CONTAINERS                   98.9G  3.80T      149K  /tank/CONTAINERS
tank/CONTAINERS/basevol-100-disk-0  128K  8.00G      128K  /tank/CONTAINERS/basevol-100-disk-0
tank/CONTAINERS/basevol-100-disk-1 1.53G  30.5G     1.53G  /tank/CONTAINERS/basevol-100-disk-1
tank/CONTAINERS/subvol-101-disk-1   884M  79.1G      884M  /tank/CONTAINERS/subvol-101-disk-1
tank/CONTAINERS/subvol-102-disk-0   936M  31.1G      936M  /tank/CONTAINERS/subvol-102-disk-0
tank/CONTAINERS/subvol-103-disk-1  66.6G   157G     66.6G  /tank/CONTAINERS/subvol-103-disk-1
tank/CONTAINERS/subvol-104-disk-1  3.09G  28.9G     3.09G  /tank/CONTAINERS/subvol-104-disk-1
tank/CONTAINERS/subvol-105-disk-1  1.86G  30.1G     1.86G  /tank/CONTAINERS/subvol-105-disk-1
tank/CONTAINERS/subvol-106-disk-0  2.47G  13.5G     2.47G  /tank/CONTAINERS/subvol-106-disk-0
tank/CONTAINERS/subvol-107-disk-1  1.34G  30.7G     1.34G  /tank/CONTAINERS/subvol-107-disk-1
tank/CONTAINERS/subvol-137-disk-0  20.2G  43.8G     20.2G  /tank/CONTAINERS/subvol-137-disk-0
tank/IMAGES                        128K  3.80T      128K  /tank/IMAGES
tank/ISO                           1.94G  3.80T     1.94G  /tank/ISO
tank/STORAGE                       2.98T  3.80T      128K  /tank/STORAGE
tank/STORAGE/subvol-101-disk-1     2.98T  1.90T     2.98T  /tank/STORAGE/subvol-101-disk-1

Result of pvesm status:

Name             Type     Status           Total            Used       Available       %

BACKUP             dir     active        60890972         1975084        55793100   3.24%
CONTAINER     zfspool     active      4186360720       103702234      4082658486   2.48%
ZFSISO             dir     active        60890972         1975084        55793100   3.24%
ZFSSTORAGE     zfspool     active      7282607547      3199949061      4082658486   43.94%
local             dir     active        60890972         1975084        55793100   3.24%
local-lvm         lvm     active       249532416       232763392        16769024   93.28%
nas-server         nfs   inactive

Content of /etc/pve/storage.cfg:

dir: local
    path /var/lib/vz
    content backup
    maxfiles 5
    shared 0

dir: ZFSISO
    path /tank/ISO
    content vztmpl,iso
    maxfiles 1
    shared 0

lvm: local-lvm
    vgname pve
    content rootdir,images
    shared 0

zfspool: ZFSSTORAGE
    pool tank/STORAGE
    content rootdir,images
    sparse 0

dir: BACKUP
    path /tank/BACKUP
    content backup,images
    maxfiles 3
    shared 0

zfspool: CONTAINER
    pool tank/CONTAINERS
    content rootdir
    sparse 0

nfs: nas-server
    export /i-data/5YD5QV7Z/nfs/NFS
    path /mnt/pve/nas-server
    server 192.168.2.203
    content images,backup
    maxfiles 5
    options vers=3

Thanks in advance for any hints or ideas,

greetings,
Thorsten

 

[tghd]

Sorry, I forgot. Additional information:

systemctl status zfs-mount.service says:

 zfs-mount.service - Mount ZFS filesystems
   Loaded: loaded (/lib/systemd/system/zfs-mount.service; enabled; vendor preset: enabled)
   Active: failed (Result: exit-code) since Tue 2020-09-15 18:32:47 CEST; 2h 59min ago
     Docs: man:zfs(8)
  Process: 842 ExecStart=/sbin/zfs mount -a (code=exited, status=1/FAILURE)
 Main PID: 842 (code=exited, status=1/FAILURE)

Sep 15 18:32:47 pve systemd[1]: Starting Mount ZFS filesystems...
Sep 15 18:32:47 pve zfs[842]: cannot mount '/tank': directory is not empty
Sep 15 18:32:47 pve systemd[1]: zfs-mount.service: Main process exited, code=exited, status=1/FAILURE
Sep 15 18:32:47 pve systemd[1]: zfs-mount.service: Failed with result 'exit-code'.
Sep 15 18:32:47 pve systemd[1]: Failed to start Mount ZFS filesystems.

 

[tghd]

Dear all,

I got got working again by

zfs mount -O -a

as mentioned in this thread: https://forum.proxmox.com/threads/n...rs-dont-mount-automatically-after-boot.58167/

however, I had to repeat this after every reboot. I try to use a workaround as suggested.

best wishes,
Thorsten