After sharing local hard disks in a cluster, the available capacity is different in each server

[Will Smith]

This is a strange question, I have three PVE hosts and I have combined them into a cluster. One of the nodes in the cluster has a 2TB hard drive, and it shows the correct capacity on its own node.
By using the storage feature, I allowed the other two nodes to access this 2TB hard drive, but the available space displayed on each of them is different.

How should I troubleshoot this issue?

root@pve120:~# df -T
Filesystem                Type      1K-blocks       Used Available Use% Mounted on
udev                      devtmpfs    3965956          0   3965956   0% /dev
tmpfs                     tmpfs        799932       1312    798620   1% /run
/dev/mapper/pve-root      ext4      113846468   49232436  59550308  46% /
tmpfs                     tmpfs       3999644      64368   3935276   2% /dev/shm
tmpfs                     tmpfs          5120          0      5120   0% /run/lock
/dev/sdb1                 ext4            960         28       862   4% /mnt/sdb1
/dev/sdb2                 vfat        1046508        344   1046164   1% /boot/efi
/dev/sda1                 ext4      229640100         56 217902160   1% /mnt/sda1
192.168.10.100:/share/pve nfs      1908848352 1095804704 813043648  58% /mnt/pve/N3-NAS
/dev/fuse                 fuse         131072         32    131040   1% /etc/pve
tmpfs                     tmpfs        799928          0    799928   0% /run/user/0

 

[Neobin]

By using the storage feature, I allowed the other two nodes to access this 2TB hard drive, but the available space displayed on each of them is different.

This is not how it works.
Marking a storage as shared only tells PVE that this storage is actually shared and accessible from the chosen nodes, but it does not magically share (local) storage within the cluster.

 

[Will Smith]

This is not how it works.
Marking a storage as shared only tells PVE that this storage is actually shared and accessible from the chosen nodes, but it does not magically share (local) storage within the cluster.

Thank you for your reply. If I want to achieve the way I envisioned, is there any good solution?

 

[bryanpedini]

This is not how it works.
Marking a storage as shared only tells PVE that this storage is actually shared and accessible from the chosen nodes, but it does not magically share (local) storage within the cluster.

as neobin stated, the "shared" flag on a storage means that the storage will be available to all hosts as configuration, but you have to mount it first on the host system.

Thank you for your reply. If I want to achieve the way I envisioned, is there any good solution?

this can be achieved in several different ways, from the easiest to the hardest. you can

• create a NAS vm on that host with a big local drive and expose that via network to the other nodes
• share the drive directly via CIFS/NFS/iSCSI from the host, meaning you don't use a VM but use the host directly as a share
• use CEPH HA storage, the disks are still local as in not in a separate storage appliance, and they're shared between all hosts, but they're also replicated and in HA