Node Disk got full. Now All OpenVZ VM's shows Full/Incorrect free space

deffe

New Member
Aug 9, 2013
3
0
1
Hello everyone.

During a backup of one of the bigger KVM machines I accidently filled the Server (baremetal) with the result that all the OpenVZ containers was unable to write to the disc. Big misstake I know.

Sadly i have been unable to fix this problem/situation I am in now. This is one example of one of my smaller VZ machines:
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/simfs 8388608 5139416 0 100% /
none 524288 4 524284 1% /dev
none 524288 0 524288 0% /dev/shm

As you can see the / shows 100%.

The Server/node has been cleaned up and now have about 100GB Free disk space. And all nodes have higher qoutas then needed.
I have tried to run "vzquota drop ID" without success.

I have also removed about 1-20gb of data from all VM's (logs, tmp files and such) which did not work either. The "Used" decreased though but the Free/Available continued to stay at 100%.

This is how it looks like on the baremetal:

df
Filesystem 1K-blocks Used Available Use% Mounted on
udev 10240 0 10240 0% /dev
tmpfs 6600544 332 6600212 1% /run
/dev/mapper/vg0-root 1911492164 1863620568 0 100% /
tmpfs 5120 0 5120 0% /run/lock
tmpfs 14459360 15540 14443820 1% /run/shm
/dev/md0 507428 40932 440298 9% /boot
tmpfs 14459360 0 14459360 0% /tmp
/dev/fuse 30720 24 30696 1% /etc/pve
/var/lib/vz/private/108 16777216 5082928 0 100% /var/lib/vz/root/108
none 524288 4 524284 1% /var/lib/vz/root/108/dev
none 524288 0 524288 0% /var/lib/vz/root/108/dev/shm
/var/lib/vz/private/103 8388608 5150856 0 100% /var/lib/vz/root/103
none 524288 4 524284 1% /var/lib/vz/root/103/dev
none 524288 0 524288 0% /var/lib/vz/root/103/dev/shm
/var/lib/vz/private/104 8388608 5143596 0 100% /var/lib/vz/root/104
none 524288 4 524284 1% /var/lib/vz/root/104/dev
none 524288 0 524288 0% /var/lib/vz/root/104/dev/shm
/var/lib/vz/private/107 8388608 5109752 0 100% /var/lib/vz/root/107
none 524288 4 524284 1% /var/lib/vz/root/107/dev
none 524288 0 524288 0% /var/lib/vz/root/107/dev/shm
/var/lib/vz/private/112 47185920 29752768 0 100% /var/lib/vz/root/112
none 8388608 4 8388604 1% /var/lib/vz/root/112/dev
none 8388608 0 8388608 0% /var/lib/vz/root/112/dev/shm




How can I solve this?
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!