Wrong Backup Sizes / Mismatch / Display problem

[Trulli]

I did some initial backups and found some strange display (?) issues.


- The CT has a max. disk size of 25GB
- The normal vzdump gzip size is ~9GB.

The displayed VZDUMP size with the Proxmox Backup is … 43GiB! (format pbs-ct). Both shown @ at the PVE Hosts as well as on the backup server (also based on PVE, but different hardware). The datastore shows 43GiB.

The Dashboard for PBS says 12GiB used, which is correct (or what i would expect).

Any ideas ?

/Trulli

 

[t.lamprecht]

I mean, we do not report the sizes for Container backups on PBS in vzdump job mails in any released package version (change is still only in git), but such a wrong size in the content overview is new to me.

Both shown @ at the PVE Hosts as well as on the backup server (also based on PVE, but different hardware).

Proxmox VE takes it from the Proxmox Backup Server, so it makes sense they are in sync. Doesn't explains why your PBS got it wrong though. My CT backups here show their compressed size, so they seem OK.

Can you post a CTs config? Does it manually mounts some NFS or the like inside? (I mean we exclude those, but still)

 

[Trulli]

No manual mounts within the CT etc.; on the PVE host, NFS Share (but not referenced by CT101!).


arch: i386
cmode: shell
cores: 2
cpulimit: 1
hostname: iminlove.withmy.car
memory: 2048
net0: name=veth2,bridge=vmbr0,gw=1.1.1.1,hwaddr=02:FF:93:FF:6A:AC,ip=8.8.8.8/32,type=veth
onboot: 1
ostype: debian
rootfs: local-zfs:subvol-101-disk-0,size=25G
swap: 0

------------

Filesystem 1K-blocks Used Available Use% Mounted on
rpool/data/subvol-101-disk-0 26214400 12430848 13783552 48% /
none 492 0 492 0% /dev
tmpfs 16444012 0 16444012 0% /dev/shm
tmpfs 16444012 16528 16427484 1% /run
tmpfs 5120 0 5120 0% /run/lock
tmpfs 16444012 0 16444012 0% /sys/fs/cgroup
-------------------

 

[fabian]

what does zfs get all rpool/data/subvol-101-disk-0 report?

 

[Trulli]

Gotcha. "Logical used" is 43GB. but.... Anyhow, its somewhat correct and on the other side its not due to compression ;-).
Maybe need to display both values somehow. Size of Backup, and uncompressed size or so..

NAME PROPERTY VALUE SOURCE
rpool/data/subvol-101-disk-0 type filesystem -
rpool/data/subvol-101-disk-0 creation Mon Sep 30 12:09 2019 -
rpool/data/subvol-101-disk-0 used 11.9G -
rpool/data/subvol-101-disk-0 available 13.1G -
rpool/data/subvol-101-disk-0 referenced 11.9G -
rpool/data/subvol-101-disk-0 compressratio 3.72x -
rpool/data/subvol-101-disk-0 mounted yes -
rpool/data/subvol-101-disk-0 quota none default
rpool/data/subvol-101-disk-0 reservation none default
rpool/data/subvol-101-disk-0 recordsize 128K default
rpool/data/subvol-101-disk-0 mountpoint /rpool/data/subvol-101-disk-0 default
rpool/data/subvol-101-disk-0 sharenfs off default
rpool/data/subvol-101-disk-0 checksum on default
rpool/data/subvol-101-disk-0 compression on inherited from rpool
rpool/data/subvol-101-disk-0 atime off inherited from rpool
rpool/data/subvol-101-disk-0 devices on default
rpool/data/subvol-101-disk-0 exec on default
rpool/data/subvol-101-disk-0 setuid on default
rpool/data/subvol-101-disk-0 readonly off default
rpool/data/subvol-101-disk-0 zoned off default
rpool/data/subvol-101-disk-0 snapdir hidden default
rpool/data/subvol-101-disk-0 aclinherit restricted default
rpool/data/subvol-101-disk-0 createtxg 1853 -
rpool/data/subvol-101-disk-0 canmount on default
rpool/data/subvol-101-disk-0 xattr sa local
rpool/data/subvol-101-disk-0 copies 1 default
rpool/data/subvol-101-disk-0 version 5 -
rpool/data/subvol-101-disk-0 utf8only off -
rpool/data/subvol-101-disk-0 normalization none -
rpool/data/subvol-101-disk-0 casesensitivity sensitive -
rpool/data/subvol-101-disk-0 vscan off default
rpool/data/subvol-101-disk-0 nbmand off default
rpool/data/subvol-101-disk-0 sharesmb off default
rpool/data/subvol-101-disk-0 refquota 25G local
rpool/data/subvol-101-disk-0 refreservation none default
rpool/data/subvol-101-disk-0 guid 6773584453232161162 -
rpool/data/subvol-101-disk-0 primarycache all default
rpool/data/subvol-101-disk-0 secondarycache all default
rpool/data/subvol-101-disk-0 usedbysnapshots 0B -
rpool/data/subvol-101-disk-0 usedbydataset 11.9G -
rpool/data/subvol-101-disk-0 usedbychildren 0B -
rpool/data/subvol-101-disk-0 usedbyrefreservation 0B -
rpool/data/subvol-101-disk-0 logbias latency default
rpool/data/subvol-101-disk-0 objsetid 522 -
rpool/data/subvol-101-disk-0 dedup off default
rpool/data/subvol-101-disk-0 mlslabel none default
rpool/data/subvol-101-disk-0 sync standard inherited from rpool
rpool/data/subvol-101-disk-0 dnodesize legacy default
rpool/data/subvol-101-disk-0 refcompressratio 3.72x -
rpool/data/subvol-101-disk-0 written 11.9G -
rpool/data/subvol-101-disk-0 logicalused 43.4G -
rpool/data/subvol-101-disk-0 logicalreferenced 43.4G -
rpool/data/subvol-101-disk-0 volmode default default
rpool/data/subvol-101-disk-0 filesystem_limit none default
rpool/data/subvol-101-disk-0 snapshot_limit none default
rpool/data/subvol-101-disk-0 filesystem_count none default
rpool/data/subvol-101-disk-0 snapshot_count none default
rpool/data/subvol-101-disk-0 snapdev hidden default
rpool/data/subvol-101-disk-0 acltype posixacl local
rpool/data/subvol-101-disk-0 context none default
rpool/data/subvol-101-disk-0 fscontext none default
rpool/data/subvol-101-disk-0 defcontext none default
rpool/data/subvol-101-disk-0 rootcontext none default
rpool/data/subvol-101-disk-0 relatime off default
rpool/data/subvol-101-disk-0 redundant_metadata all default
rpool/data/subvol-101-disk-0 overlay off default
rpool/data/subvol-101-disk-0 encryption off default
rpool/data/subvol-101-disk-0 keylocation none default
rpool/data/subvol-101-disk-0 keyformat none default
rpool/data/subvol-101-disk-0 pbkdf2iters 0 default
rpool/data/subvol-101-disk-0 special_small_blocks 0 default


zpool list:

NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
rpool 556G 86.3G 470G - - 24% 15% 1.00x ONLINE -

zfs list

rpool 86.3G 452G 96K /rpool
rpool/ROOT 17.2G 452G 96K /rpool/ROOT
rpool/ROOT/pve-1 17.2G 452G 17.2G /
rpool/data 69.0G 452G 128K /rpool/data
rpool/data/subvol-101-disk-0 11.9G 13.1G 11.9G /rpool/data/subvol-101-disk-0
--------------
zfs list -t snapshot
no datasets available

 

[fabian]

yes, PBS currently displays the logical size, while the quota on the source/ZFS side is physical/compressed size. I'd like for PBS to also show sum(sizeof(chunk)) for all referenced chunks in a backup, but we need to find and implement a way to do this cheaply enough to scale across tens or hundreds of backup chunk indices