Disk size much smaller than allocated space

[garmandendo]

I have a proxmox installation with a few VMs and LXCs, in a ZFS pool. I assigned to an installation of immich 2TB, but proxmox is only detecting 1.19TiB of space. I am missing a whole 800GiB. I have no snapshots and no backups, so no idea where that is gone.

 

[Impact]

What does zfs list and zpool list say on the node? I'd also check zfs list -ospace,refquota,refreservation.

 

[garmandendo]

root@proxmox:~# zfs list
NAME                     USED  AVAIL  REFER  MOUNTPOINT
Data                    6.24T   917G   149K  /Data
Data/subvol-100-disk-0   299G   917G   299G  /Data/subvol-100-disk-0
Data/subvol-105-disk-0  5.53G  4.47G  5.53G  /Data/subvol-105-disk-0
Data/subvol-106-disk-0  5.95T   917G  5.95T  /Data/subvol-106-disk-0
root@proxmox:~# zpool list
NAME   SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
Data  10.9T  9.37T  1.53T        -         -    28%    85%  1.00x    ONLINE  -

 

[Impact]

Can you also share the last command above and cat /etc/pve/storage.cfg. I'm guessing you don't use thin provisioning so you might have a quota of 2T but not that much space to give. Or perhaps I'm misunderstanding ZFS' quota/reservation system.

 

[garmandendo]

root@proxmox:~# cat /etc/pve/storage.cfg
dir: local
        path /var/lib/vz
        content backup,iso,vztmpl

lvmthin: local-lvm
        thinpool data
        vgname pve
        content rootdir,images

zfspool: Data
        pool Data
        content rootdir,images
        mountpoint /Data
        nodes proxmox

If I understand what you are saying correctly, proxmox does not pre-allocate that space, so if I have 8TB disk space with 2 VMs, all of them with (let's say, for the sake of my understanding) 8TB, but as one fills up, the other one will shrink, correct?