Is the following a known bug in Ceph Nautilus v14.2.9?
Running kernel RBD guest with partitions aligned to 1 MiB boundaries. If I create a 10 GiB file in a VM, delete it and then issue fstrim I get inconsistent feedback on the image space allocation:
After having run 'dd if=/dev/urandom of=/root/bigfile bs=10G count=1':
I then delete the file in the guest and retrim manually:
Ceph's 'rbd du' command appears to only report the high water mark whereas running a diff shows less space having been consumed:
Host:
Running kernel RBD guest with partitions aligned to 1 MiB boundaries. If I create a 10 GiB file in a VM, delete it and then issue fstrim I get inconsistent feedback on the image space allocation:
After having run 'dd if=/dev/urandom of=/root/bigfile bs=10G count=1':
Code:
[root@kvm5h ~]# rbd du rbd_ssd/vm-361-disk-0
NAME PROVISIONED USED
vm-361-disk-0 40 GiB 11 GiB
[root@kvm5h ~]# rbd diff rbd_ssd/vm-361-disk-0 | awk '{ SUM += $2 } END { print SUM/1024/1024 " MiB" }'
12407.3 MiBI then delete the file in the guest and retrim manually:
Code:
Linux:
fstrim -v /;
Windows:
optimize-volume -driveletter c -retrim -verboseCeph's 'rbd du' command appears to only report the high water mark whereas running a diff shows less space having been consumed:
Code:
[root@kvm5h ~]# rbd du rbd_ssd/vm-361-disk-0
NAME PROVISIONED USED
vm-361-disk-0 40 GiB 11 GiB
[root@kvm5h ~]# rbd diff rbd_ssd/vm-361-disk-0 | awk '{ SUM += $2 } END { print SUM/1024/1024 " MiB" }'
2136.86 MiBHost:
Code:
[root@kvm5h ~]# pveversion -v
proxmox-ve: 6.2-1 (running kernel: 5.4.41-1-pve)
pve-manager: 6.2-4 (running version: 6.2-4/9824574a)
pve-kernel-5.4: 6.2-2
pve-kernel-helper: 6.2-2
pve-kernel-5.4.41-1-pve: 5.4.41-1
ceph: 14.2.9-pve1
ceph-fuse: 14.2.9-pve1
corosync: 3.0.3-pve1
criu: 3.11-3
glusterfs-client: 5.5-3
ifupdown: 0.8.35+pve1
ksm-control-daemon: 1.3-1
libjs-extjs: 6.0.1-10
libknet1: 1.15-pve1
libproxmox-acme-perl: 1.0.4
libpve-access-control: 6.1-1
libpve-apiclient-perl: 3.0-3
libpve-common-perl: 6.1-2
libpve-guest-common-perl: 3.0-10
libpve-http-server-perl: 3.0-5
libpve-storage-perl: 6.1-8
libqb0: 1.0.5-1
libspice-server1: 0.14.2-4~pve6+1
lvm2: 2.03.02-pve4
lxc-pve: 4.0.2-1
lxcfs: 4.0.3-pve2
novnc-pve: 1.1.0-1
openvswitch-switch: 2.12.0-1
proxmox-mini-journalreader: 1.1-1
proxmox-widget-toolkit: 2.2-1
pve-cluster: 6.1-8
pve-container: 3.1-6
pve-docs: 6.2-4
pve-edk2-firmware: 2.20200229-1
pve-firewall: 4.1-2
pve-firmware: 3.1-1
pve-ha-manager: 3.0-9
pve-i18n: 2.1-2
pve-qemu-kvm: 5.0.0-2
pve-xtermjs: 4.3.0-1
qemu-server: 6.2-2
smartmontools: 7.1-pve2
spiceterm: 3.1-1
vncterm: 1.6-1
zfsutils-linux: 0.8.4-pve1
Last edited:
