9.2TB raw file on a 1TB SSD? - Proxmox VM Servers

Sanjay852

New Member
Jul 3, 2020
1
0
1
34
Hello,

I have a VM of 25GB set in the config with 9.2TB raw file in a 1TB SSD. how is that even possible?

And on top of that, I still have 300gb available - https://prnt.sc/u159wq

I am moving my VM from one server to another and this 9.2TB is being downloaded from scratch, is there any way to compress it or something?

If i run ls -lh it shows 9.2TB too but in du -sh it shows only 25GB.

https://prnt.sc/u15aze

Because 9.2TB is a lot of bandwidth for 25GB file while moving the VM from one server to another.

Also this is not the only file or server i have seen this issue, i have seen it across many, why is it like this?

another server, 268gb actual size but 876gb apparent size, however while downloading it downloads 876GB via sftp.

Edit: Solution for this pointed out by redditors -

Run this on Source server - rsync --sparse --compress-level=1 -rt /var/lib/vz/images/ root@Destination:/var/lib/vz/images

Just running --sparse wont work, you gotta compress it a little too.


https://jiofi-localhtml.gen.in/

https://19216881.link

https://router-network.uno
 
Last edited:
Hi,
I have a VM of 25GB set in the config with 9.2TB raw file in a 1TB SSD. how is that even possible?
This called "thin allocation" where data are allocated when they are written.
I am moving my VM from one server to another and this 9.2TB is being downloaded from scratch, is there any way to compress it or something?
You could shrink the image. But be careful if something goes wrong the image is broken.
If you do this try it in a test VM before to ensure you know what you do.
Also this is not the only file or server i have seen this issue, i have seen it across many, why is it like this?
Because the metadata of the files say that the file has this size and unwritten data are send as zeros.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!