[SOLVED] odd issue with storage

[killmasta93]

Hi,
I was wondering if someone could explain to me howcome when i installed proxmox it shows the total amount space then after few months shows another total amount of storage see picture
currently have ZFS raid 10 with 6 disks 1tb i should get 3tb

root@prometheus2:~# df -h
Filesystem        Size  Used Avail Use% Mounted on
udev               24G     0   24G   0% /dev
tmpfs             4.8G   82M  4.7G   2% /run
rpool/ROOT/pve-1  1.7T  1.2T  546G  68% /
tmpfs              24G   43M   24G   1% /dev/shm
tmpfs             5.0M     0  5.0M   0% /run/lock
tmpfs              24G     0   24G   0% /sys/fs/cgroup
rpool             546G     0  546G   0% /rpool
rpool/ROOT        546G     0  546G   0% /rpool/ROOT
rpool/data        546G     0  546G   0% /rpool/data
/dev/fuse          30M   16K   30M   1% /etc/pve
/dev/sda2         3.7T  988G  2.7T  27% /media/usb

root@prometheus2:~# zfs list -o space
NAME                      AVAIL   USED  USEDSNAP  USEDDS  USEDREFRESERV  USEDCHILD
rpool                      546G  2.10T        0B    104K             0B      2.10T
rpool/ROOT                 546G  1.11T        0B     96K             0B      1.11T
rpool/ROOT/pve-1           546G  1.11T        0B   1.11T             0B         0B
rpool/data                 546G  1010G        0B     96K             0B      1010G
rpool/data/vm-100-disk-0   546G   213G        0B    213G             0B         0B
rpool/data/vm-102-disk-1   546G   101G        0B    101G             0B         0B
rpool/data/vm-104-disk-0   546G  70.0G        0B   70.0G             0B         0B
rpool/data/vm-104-disk-1   546G   627G        0B    627G             0B         0B

https://ibb.co/0hGLPGD


Thank you

 

[Chris]

This is because all datasets might use the available space in the pool (see df output).
I think this blog post nicely explains on what you need to know about the ZFS outputs and how to correctly interpret them https://oshogbo.vexillium.org/blog/65/

 

[killmasta93]

Thanks for the reply, in theory its normal after reading the document the datasets are using the same pool so im using on vm 2021gigs which is 2.0tb. So the total size decreases from the graph when it starts using more from the pool? its kinda odd its like saying a disk has 4tb then i start using it and it starts saying that capacity is not 4tb its not 2tb because i used 2tb

 

[Chris]

So the total size decreases from the graph when it starts using more from the pool?

It's more like if one filesystem uses resouces, it will reduce the available space for other filesystems. So e.g. when ROOT allocates space, data will have less space available.

 

[killmasta93]

Thanks for the reply, so its not an issue with the host that i have?

 

[Chris]

Thanks for the reply, so its not an issue with the host that i have?

No this is expected. This is simply caused by how ZFS allocates resources in the pool.