WARNING: Sum of all thin volume sizes exceeds the size of thin pool pve/data

TonioO · 2025-05-12T15:23:45+0200

Hello, when I migrate a VM from one node to another, I don't understand why I have this warning?

WARNING: Sum of all thin volume sizes (<8.42 TiB) exceeds the size of thin pool pve/data and the amount of free space in volume group (111.85 GiB

root@saturne:~# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 19.2T 0 disk
├─sda1 8:1 0 1007K 0 part
├─sda2 8:2 0 1G 0 part /boot/efi
└─sda3 8:3 0 19.2T 0 part
├─pve-swap 252:0 0 8G 0 lvm [SWAP]
├─pve-root 252:1 0 150G 0 lvm /
├─pve-data_tmeta 252:2 0 132M 0 lvm
│ └─pve-data-tpool 252:4 0 8.2T 0 lvm
│ ├─pve-data 252:5 0 8.2T 1 lvm
│ ├─pve-vm--127--disk--3 252:6 0 1000G 0 lvm
│ ├─pve-vm--127--disk--1 252:7 0 32G 0 lvm
│ ├─pve-vm--127--disk--0 252:8 0 4M 0 lvm
│ ├─pve-vm--127--disk--2 252:9 0 32G 0 lvm
│ ├─pve-vm--127--disk--4 252:10 0 4M 0 lvm
│ ├─pve-vm--127--disk--5 252:11 0 1000G 0 lvm
│ ├─pve-vm--127--disk--6 252:12 0 2.4T 0 lvm
│ ├─pve-vm--117--disk--0 252:13 0 4M 0 lvm
│ ├─pve-vm--117--cloudinit 252:14 0 4M 0 lvm
│ ├─pve-vm--117--disk--1 252:15 0 100G 0 lvm
│ ├─pve-vm--150--disk--1 252:16 0 32G 0 lvm
│ ├─pve-vm--113--disk--2 252:18 0 32G 0 lvm
│ ├─pve-vm--107--disk--0 252:21 0 16G 0 lvm
│ ├─pve-vm--104--disk--1 252:22 0 4M 0 lvm
│ ├─pve-vm--104--disk--2 252:23 0 80G 0 lvm
│ ├─pve-vm--150--disk--0 252:24 0 4M 0 lvm
│ ├─pve-vm--150--disk--2 252:25 0 32G 0 lvm
│ ├─pve-vm--150--disk--3 252:26 0 4M 0 lvm
│ ├─pve-vm--127--state--SRV--C--DATA 252:27 0 16.3G 0 lvm
│ ├─pve-vm--120--disk--0 252:28 0 4M 0 lvm
│ ├─pve-vm--120--disk--1 252:29 0 20G 0 lvm
│ ├─pve-vm--119--disk--0 252:30 0 4M 0 lvm
│ ├─pve-vm--119--disk--1 252:31 0 32G 0 lvm
│ ├─pve-vm--112--disk--1 252:32 0 200G 0 lvm
│ ├─pve-vm--140--disk--2 252:33 0 4M 0 lvm
│ ├─pve-vm--140--disk--0 252:34 0 4M 0 lvm
│ ├─pve-vm--120--disk--2 252:35 0 4M 0 lvm
│ ├─pve-vm--119--disk--2 252:36 0 4M 0 lvm
│ ├─pve-vm--140--disk--1 252:37 0 80G 0 lvm
│ ├─pve-base--121--disk--0 252:38 0 4M 1 lvm
│ ├─pve-base--121--disk--1 252:39 0 80G 1 lvm
│ ├─pve-base--121--disk--2 252:40 0 4M 1 lvm
│ ├─pve-vm--141--disk--2 252:41 0 4M 0 lvm
│ ├─pve-vm--141--disk--0 252:42 0 4M 0 lvm
│ ├─pve-vm--141--disk--1 252:43 0 80G 0 lvm
│ ├─pve-vm--142--disk--2 252:44 0 4M 0 lvm
│ ├─pve-vm--142--disk--0 252:45 0 4M 0 lvm
│ ├─pve-vm--142--disk--1 252:46 0 80G 0 lvm
│ ├─pve-vm--135--disk--3 252:47 0 240G 0 lvm
│ ├─pve-vm--135--disk--0 252:48 0 4M 0 lvm
│ ├─pve-vm--135--disk--1 252:49 0 180G 0 lvm
│ ├─pve-vm--113--disk--1 252:50 0 32G 0 lvm
│ └─pve-vm--113--disk--0 252:51 0 32G 0 lvm
├─pve-data_tdata 252:3 0 8.2T 0 lvm
│ └─pve-data-tpool 252:4 0 8.2T 0 lvm
│ ├─pve-data 252:5 0 8.2T 1 lvm
│ ├─pve-vm--127--disk--3 252:6 0 1000G 0 lvm
│ ├─pve-vm--127--disk--1 252:7 0 32G 0 lvm
│ ├─pve-vm--127--disk--0 252:8 0 4M 0 lvm
│ ├─pve-vm--127--disk--2 252:9 0 32G 0 lvm
│ ├─pve-vm--127--disk--4 252:10 0 4M 0 lvm
│ ├─pve-vm--127--disk--5 252:11 0 1000G 0 lvm
│ ├─pve-vm--127--disk--6 252:12 0 2.4T 0 lvm
│ ├─pve-vm--117--disk--0 252:13 0 4M 0 lvm
│ ├─pve-vm--117--cloudinit 252:14 0 4M 0 lvm
│ ├─pve-vm--117--disk--1 252:15 0 100G 0 lvm
│ ├─pve-vm--150--disk--1 252:16 0 32G 0 lvm
│ ├─pve-vm--113--disk--2 252:18 0 32G 0 lvm
│ ├─pve-vm--107--disk--0 252:21 0 16G 0 lvm
│ ├─pve-vm--104--disk--1 252:22 0 4M 0 lvm
│ ├─pve-vm--104--disk--2 252:23 0 80G 0 lvm
│ ├─pve-vm--150--disk--0 252:24 0 4M 0 lvm
│ ├─pve-vm--150--disk--2 252:25 0 32G 0 lvm
│ ├─pve-vm--150--disk--3 252:26 0 4M 0 lvm
│ ├─pve-vm--127--state--SRV--C--DATA 252:27 0 16.3G 0 lvm
│ ├─pve-vm--120--disk--0 252:28 0 4M 0 lvm
│ ├─pve-vm--120--disk--1 252:29 0 20G 0 lvm
│ ├─pve-vm--119--disk--0 252:30 0 4M 0 lvm
│ ├─pve-vm--119--disk--1 252:31 0 32G 0 lvm
│ ├─pve-vm--112--disk--1 252:32 0 200G 0 lvm
│ ├─pve-vm--140--disk--2 252:33 0 4M 0 lvm
│ ├─pve-vm--140--disk--0 252:34 0 4M 0 lvm
│ ├─pve-vm--120--disk--2 252:35 0 4M 0 lvm
│ ├─pve-vm--119--disk--2 252:36 0 4M 0 lvm
│ ├─pve-vm--140--disk--1 252:37 0 80G 0 lvm
│ ├─pve-base--121--disk--0 252:38 0 4M 1 lvm
│ ├─pve-base--121--disk--1 252:39 0 80G 1 lvm
│ ├─pve-base--121--disk--2 252:40 0 4M 1 lvm
│ ├─pve-vm--141--disk--2 252:41 0 4M 0 lvm
│ ├─pve-vm--141--disk--0 252:42 0 4M 0 lvm
│ ├─pve-vm--141--disk--1 252:43 0 80G 0 lvm
│ ├─pve-vm--142--disk--2 252:44 0 4M 0 lvm
│ ├─pve-vm--142--disk--0 252:45 0 4M 0 lvm
│ ├─pve-vm--142--disk--1 252:46 0 80G 0 lvm
│ ├─pve-vm--135--disk--3 252:47 0 240G 0 lvm
│ ├─pve-vm--135--disk--0 252:48 0 4M 0 lvm
│ ├─pve-vm--135--disk--1 252:49 0 180G 0 lvm
│ ├─pve-vm--113--disk--1 252:50 0 32G 0 lvm
│ └─pve-vm--113--disk--0 252:51 0 32G 0 lvm
└─pve-backups 252:17 0 8T 0 lvm /mnt/backups

thank you for your help

bbgeek17 · 2025-05-12T16:08:08+0200

TonioO said:
WARNING: Sum of all thin volume sizes (<8.42 TiB) exceeds the size of thin pool pve/data and the amount of free space in volume group (111.85 GiB

It means that you highly overprovisioned your LVM and if you try to write 100% of capacity of every volume you have created, you will run out of space and likely cause some sort of data corruption/loss.

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

TonioO · 2025-05-12T16:17:54+0200

Ok but i have :

sda 8:0 0 19.2T 0 disk

pve-root 252:1 0 150G
pve-data 252:5 0 8.2T 1 lvm
pve-backups 252:17 0 8T 0 lvm /mnt/backups

~16.4T used for 19.2T

What i must do now ? thank

bbgeek17 · 2025-05-12T16:27:22+0200

TonioO said:
pve-data 252:5 0 8.2T 1 lvm

This is the location where all your VM disks are stored.

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

TonioO · 2025-05-12T16:45:16+0200

Yes i know

What am I supposed to do now to fix the problem?

TonioO · 2025-05-12T16:50:59+0200

I extend the thin pool pve/data 8.2 --> 8.3To
I reduce pve-backups 12 --> 8To to have free space

but same warning :
WARNING: Sum of all thin volume sizes (8.59 TiB) exceeds the size of thin pool pve/data and the amount of free space in volume group (<2.81 TiB).

I try this too in order to understand :
root@saturne:~# lvs --noheadings --units t --nosuffix -o lv_name,lv_size | awk '$1 ~ /^(vm|base|snap)/ {gsub(",", ".", $2); sum += $2} END {printf "%.2f TiB\n", sum}'
8.58 TiB

root@saturne:~# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 19.2T 0 disk
├─sda1 8:1 0 1007K 0 part
├─sda2 8:2 0 1G 0 part /boot/efi
└─sda3 8:3 0 19.2T 0 part
├─pve-swap 252:0 0 8G 0 lvm [SWAP]
├─pve-root 252:1 0 150G 0 lvm /
├─pve-data_tmeta 252:2 0 132M 0 lvm
│ └─pve-data-tpool 252:4 0 8.3T 0 lvm
│ ├─pve-data 252:5 0 8.3T 1 lvm
│ ├─pve-vm--127--disk--3 252:6 0 1000G 0 lvm
│ ├─pve-vm--127--disk--1 252:7 0 32G 0 lvm
│ ├─pve-vm--127--disk--0 252:8 0 4M 0 lvm
│ ├─pve-vm--127--disk--2 252:9 0 32G 0 lvm
│ ├─pve-vm--127--disk--4 252:10 0 4M 0 lvm
│ ├─pve-vm--127--disk--5 252:11 0 1000G 0 lvm
│ ├─pve-vm--127--disk--6 252:12 0 2.4T 0 lvm
│ ├─pve-vm--117--disk--0 252:13 0 4M 0 lvm
│ ├─pve-vm--117--cloudinit 252:14 0 4M 0 lvm
│ ├─pve-vm--117--disk--1 252:15 0 100G 0 lvm
│ ├─pve-vm--150--disk--1 252:16 0 32G 0 lvm
│ ├─pve-vm--113--disk--2 252:18 0 32G 0 lvm
│ ├─pve-vm--111--disk--0 252:19 0 4M 0 lvm
│ ├─pve-vm--111--disk--1 252:20 0 80G 0 lvm
│ ├─pve-vm--107--disk--0 252:21 0 16G 0 lvm
│ ├─pve-vm--104--disk--1 252:22 0 4M 0 lvm
│ ├─pve-vm--104--disk--2 252:23 0 80G 0 lvm
│ ├─pve-vm--150--disk--0 252:24 0 4M 0 lvm
│ ├─pve-vm--150--disk--2 252:25 0 32G 0 lvm
│ ├─pve-vm--150--disk--3 252:26 0 4M 0 lvm
│ ├─pve-vm--127--state--SRV--C--DATA 252:27 0 16.3G 0 lvm
│ ├─pve-vm--120--disk--0 252:28 0 4M 0 lvm
│ ├─pve-vm--120--disk--1 252:29 0 20G 0 lvm
│ ├─pve-vm--119--disk--0 252:30 0 4M 0 lvm
│ ├─pve-vm--119--disk--1 252:31 0 80G 0 lvm
│ ├─pve-vm--112--disk--1 252:32 0 200G 0 lvm
│ ├─pve-vm--140--disk--2 252:33 0 4M 0 lvm
│ ├─pve-vm--140--disk--0 252:34 0 4M 0 lvm
│ ├─pve-vm--120--disk--2 252:35 0 4M 0 lvm
│ ├─pve-vm--140--disk--1 252:37 0 80G 0 lvm
│ ├─pve-base--121--disk--0 252:38 0 4M 1 lvm
│ ├─pve-base--121--disk--1 252:39 0 80G 1 lvm
│ ├─pve-base--121--disk--2 252:40 0 4M 1 lvm
│ ├─pve-vm--141--disk--2 252:41 0 4M 0 lvm
│ ├─pve-vm--141--disk--0 252:42 0 4M 0 lvm
│ ├─pve-vm--141--disk--1 252:43 0 80G 0 lvm
│ ├─pve-vm--142--disk--2 252:44 0 4M 0 lvm
│ ├─pve-vm--142--disk--0 252:45 0 4M 0 lvm
│ ├─pve-vm--142--disk--1 252:46 0 80G 0 lvm
│ ├─pve-vm--135--disk--3 252:47 0 240G 0 lvm
│ ├─pve-vm--135--disk--0 252:48 0 4M 0 lvm
│ ├─pve-vm--135--disk--1 252:49 0 180G 0 lvm
│ ├─pve-vm--113--disk--1 252:50 0 32G 0 lvm
│ ├─pve-vm--113--disk--0 252:51 0 32G 0 lvm
│ ├─pve-vm--111--disk--2 252:52 0 4M 0 lvm
│ ├─pve-vm--113--disk--3 252:53 0 32G 0 lvm
│ └─pve-vm--113--disk--4 252:54 0 32G 0 lvm
├─pve-data_tdata 252:3 0 8.3T 0 lvm
│ └─pve-data-tpool 252:4 0 8.3T 0 lvm
│ ├─pve-data 252:5 0 8.3T 1 lvm
│ ├─pve-vm--127--disk--3 252:6 0 1000G 0 lvm
│ ├─pve-vm--127--disk--1 252:7 0 32G 0 lvm
│ ├─pve-vm--127--disk--0 252:8 0 4M 0 lvm
│ ├─pve-vm--127--disk--2 252:9 0 32G 0 lvm
│ ├─pve-vm--127--disk--4 252:10 0 4M 0 lvm
│ ├─pve-vm--127--disk--5 252:11 0 1000G 0 lvm
│ ├─pve-vm--127--disk--6 252:12 0 2.4T 0 lvm
│ ├─pve-vm--117--disk--0 252:13 0 4M 0 lvm
│ ├─pve-vm--117--cloudinit 252:14 0 4M 0 lvm
│ ├─pve-vm--117--disk--1 252:15 0 100G 0 lvm
│ ├─pve-vm--150--disk--1 252:16 0 32G 0 lvm
│ ├─pve-vm--113--disk--2 252:18 0 32G 0 lvm
│ ├─pve-vm--111--disk--0 252:19 0 4M 0 lvm
│ ├─pve-vm--111--disk--1 252:20 0 80G 0 lvm
│ ├─pve-vm--107--disk--0 252:21 0 16G 0 lvm
│ ├─pve-vm--104--disk--1 252:22 0 4M 0 lvm
│ ├─pve-vm--104--disk--2 252:23 0 80G 0 lvm
│ ├─pve-vm--150--disk--0 252:24 0 4M 0 lvm
│ ├─pve-vm--150--disk--2 252:25 0 32G 0 lvm
│ ├─pve-vm--150--disk--3 252:26 0 4M 0 lvm
│ ├─pve-vm--127--state--SRV--C--DATA 252:27 0 16.3G 0 lvm
│ ├─pve-vm--120--disk--0 252:28 0 4M 0 lvm
│ ├─pve-vm--120--disk--1 252:29 0 20G 0 lvm
│ ├─pve-vm--119--disk--0 252:30 0 4M 0 lvm
│ ├─pve-vm--119--disk--1 252:31 0 80G 0 lvm
│ ├─pve-vm--112--disk--1 252:32 0 200G 0 lvm
│ ├─pve-vm--140--disk--2 252:33 0 4M 0 lvm
│ ├─pve-vm--140--disk--0 252:34 0 4M 0 lvm
│ ├─pve-vm--120--disk--2 252:35 0 4M 0 lvm
│ ├─pve-vm--140--disk--1 252:37 0 80G 0 lvm
│ ├─pve-base--121--disk--0 252:38 0 4M 1 lvm
│ ├─pve-base--121--disk--1 252:39 0 80G 1 lvm
│ ├─pve-base--121--disk--2 252:40 0 4M 1 lvm
│ ├─pve-vm--141--disk--2 252:41 0 4M 0 lvm
│ ├─pve-vm--141--disk--0 252:42 0 4M 0 lvm
│ ├─pve-vm--141--disk--1 252:43 0 80G 0 lvm
│ ├─pve-vm--142--disk--2 252:44 0 4M 0 lvm
│ ├─pve-vm--142--disk--0 252:45 0 4M 0 lvm
│ ├─pve-vm--142--disk--1 252:46 0 80G 0 lvm
│ ├─pve-vm--135--disk--3 252:47 0 240G 0 lvm
│ ├─pve-vm--135--disk--0 252:48 0 4M 0 lvm
│ ├─pve-vm--135--disk--1 252:49 0 180G 0 lvm
│ ├─pve-vm--113--disk--1 252:50 0 32G 0 lvm
│ ├─pve-vm--113--disk--0 252:51 0 32G 0 lvm
│ ├─pve-vm--111--disk--2 252:52 0 4M 0 lvm
│ ├─pve-vm--113--disk--3 252:53 0 32G 0 lvm
│ └─pve-vm--113--disk--4 252:54 0 32G 0 lvm
└─pve-backups 252:17 0 8T 0 lvm /mnt/backups

thank

bbgeek17 · 2025-05-12T16:53:13+0200

You just need to be aware of this and don't fill all your VM disks to 100% capacity.
It is ok to operate in overprovisioned state.

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

TonioO · 2025-05-12T16:57:38+0200

Okay, so there's no configuration error? The warning still intrigues me.

bbgeek17 · 2025-05-12T17:00:52+0200

It is a warning, not an error. If you want to avoid it - remove enough volumes so that the sum of 100% of provisioned capacity is not larger than available capacity.

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

TonioO · 2025-05-13T08:26:03+0200

Hello and thank you for your feedback

This is exactly what I can't understand :
"remove enough volumes so that the sum of 100% of provisioned capacity is not larger than available capacity"
But I extend the thin pool pve/data and i have the same warning ?
I want to start again on a good basis and redo the storage properly

the desired goal :

(disk capacity) :

bbgeek17 · 2025-05-13T17:46:14+0200

TonioO said:
─pve-data 252:5 0 8.3T 1 lvm

This is your last presented data. The pool appears to be 8.3T. Perhaps you did not expand all the layers.
There are many guides out there: https://www.redhat.com/en/blog/resize-lvm-simple. You, perhaps, expanded the VG but not the LV pool portion.

You need to carefully examine your system and see what steps have been missed:
lsscsi -ss
lsblk
pvs
vgs
lvs

Good luck

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

Search

Search

WARNING: Sum of all thin volume sizes exceeds the size of thin pool pve/data

TonioO

New Member

bbgeek17

Distinguished Member

TonioO

New Member

bbgeek17

Distinguished Member

TonioO

New Member

TonioO

New Member

bbgeek17

Distinguished Member

TonioO

New Member

bbgeek17

Distinguished Member

TonioO

New Member

bbgeek17

Distinguished Member

We value your privacy