ZFS dataset empty after reboot

[alex3025]

Hello, I've updated to Proxmox 8.0.3 some days ago and yesterday after rebooting the server using the reboot command, one of my zfs datasets is now empty (the other dataset on the same pool are fine).

NAME               USED  AVAIL  REFER  MOUNTPOINT 
ssd-raid/storage   705G   732G   704G  /mnt/ssd-raid/storage

It seems that the files are still there but I cannot access them, the mountpoint directory is empty.

If I try to unmount that folder I get:

root@proxmox:/mnt/ssd-raid# zfs unmount -f ssd-raid/storage 
cannot unmount '/mnt/ssd-raid/storage': unmount failed

And if I try to mount it:

root@proxmox:/mnt/ssd-raid# zfs mount ssd-raid/storage
cannot mount 'ssd-raid/storage': filesystem already mounted

Now, I have disabled the auto mount of the dataset with zfs set canmount=noauto ssd-raid/storage and then restarted the server.
After mounting the dataset manually with zfs mount ssd-raid/storage, all my files where there again.

Is this an issue with the new Proxmox version? It never happened before...

 

[alex3025]

anyone?

 

[alex3025]

Hello Please show:
zpool list -v
zfs list -r -t filesystem

zpool list -v

NAME                               SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
hdd-raid                          7.27T  4.97T  2.29T        -         -     0%    68%  1.00x    ONLINE  -
  raidz1-0                        7.27T  4.97T  2.29T        -         -     0%  68.4%      -    ONLINE
    scsi-35000c50084200c5f        1.82T      -      -        -         -      -      -      -    ONLINE
    scsi-35000c50058aaeb9b        1.82T      -      -        -         -      -      -      -    ONLINE
    scsi-35000c50094693cdf        1.82T      -      -        -         -      -      -      -    ONLINE
    scsi-35000c500aecf54b7        1.82T      -      -        -         -      -      -      -    ONLINE
rpool                              370G   113G   257G        -         -     3%    30%  1.00x    ONLINE  -
  mirror-0                         370G   113G   257G        -         -     3%  30.6%      -    ONLINE
    scsi-350011731015e6354-part3   371G      -      -        -         -      -      -      -    ONLINE
    scsi-350011731015cf2cc-part3   371G      -      -        -         -      -      -      -    ONLINE
ssd-raid                          1.73T   882G   894G        -         -    20%    49%  1.00x    ONLINE  -
  sde                              894G   440G   448G        -         -    21%  49.5%      -    ONLINE
  sdg                              894G   442G   446G        -         -    20%  49.8%      -    ONLINE

zfs list -r -t filesystem

NAME                                    USED  AVAIL  REFER  MOUNTPOINT
hdd-raid                               3.61T  1.54T   163K  /mnt/hdd-raid
hdd-raid/backups                       2.83T  1.54T  2.83T  /mnt/hdd-raid/backups
hdd-raid/storage                        801G  1.54T   800G  /mnt/hdd-raid/storage
rpool                                   113G   245G    96K  /rpool
rpool/ROOT                             4.99G   245G    96K  /rpool/ROOT
rpool/ROOT/pve-1                       4.99G   245G  4.99G  /
rpool/var-lib-vz                        108G   245G   108G  /var/lib/vz
ssd-raid                                882G   839G   128K  /mnt/ssd-raid/
ssd-raid/storage                        781G   839G   778G  /mnt/ssd-raid/storage
ssd-raid/v-data                        26.8G   839G    96K  /mnt/ssd-raid/v-data
ssd-raid/v-data/subvol-152-disk-2       138M  9.87G   138M  /mnt/ssd-raid/v-data/subvol-152-disk-2
ssd-raid/v-machines                    74.3G   839G   128K  /mnt/ssd-raid/v-machines
ssd-raid/v-machines/subvol-151-disk-0  1.05G  3.95G  1.05G  /mnt/ssd-raid/v-machines/subvol-151-disk-0
ssd-raid/v-machines/subvol-152-disk-0  1.27G  1.73G  1.27G  /mnt/ssd-raid/v-machines/subvol-152-disk-0
ssd-raid/v-machines/subvol-154-disk-0   718M  1.30G   718M  /mnt/ssd-raid/v-machines/subvol-154-disk-0
ssd-raid/v-machines/subvol-200-disk-0  1.76G   757M  1.76G  /mnt/ssd-raid/v-machines/subvol-200-disk-0

 

[RolandK]

do you have snapshots in that dataset ?

you should try cd into the last snapshot and have a look what's listed there

 

[alex3025]

do you have snapshots in that dataset ?

you should try cd into the last snapshot and have a look what's listed there

yes I do, and all of my files are there.

as I said earlier, if I mount the dataset manually, it works without problems.

seems to be an issue only when proxmox boots.

 

[alex3025]

The current workaround I'm using is to disable automatic mounting with zfs set canmount=noauto ssd-raid/storage and then using a crontab to mount the dataset @reboot.