qcow2 file size error

[informant]

Hi all, we would create a 3TB qcow2 disc, but we have this error:

Formatting '/var/lib/vz/images/5532/vm-5532-disk-1.qcow2', fmt=qcow2  size=3298534883328 encryption=off cluster_size=65536  preallocation='metadata' lazy_refcounts=off 
TASK ERROR: create  failed - unable to create image: qemu-img:  /var/lib/vz/images/5532/vm-5532-disk-1.qcow2: The image size is too  large for file format 'qcow2' (try using a larger cluster size)

It´s a bug or what we can do here?

regards

 

[mir]

I think the file size limit of qcow2 is 2 TB

 

[informant]

hi mir,

thanks for answer. ok, i have found this info: http://rwmj.wordpress.com/2011/10/03/maximum-qcow2-disk-size/
but not information of qemu site.

regards

 

[udo]

I think the file size limit of qcow2 is 2 TB

Hi,
i think not - there must be something else...

If I createn an image at home (3.12-8.towo-siduction-amd64) it's work wit 3TB:

udo@arktis:~$ qemu-img create -f qcow2 test.qcow2 3T
Formatting 'test.qcow2', fmt=qcow2 size=3298534883328 encryption=off cluster_size=65536 lazy_refcounts=off 
udo@arktis:~$ file test.qcow2 
test.qcow2: QEMU QCOW Image (v3), 3298534883328 bytes

on a pve-node I can also create such an big file

root@proxmox:~# qemu-img create -f qcow2 test.qcow2 3T
Formatting 'test.qcow2', fmt=qcow2 size=3298534883328 encryption=off cluster_size=65536 lazy_refcounts=off 
root@proxmox:~# file test.qcow2
test.qcow2: QEMU QCOW Image (unknown version)

Udo

 

[informant]

Hi udo,

ok - it works also only on command line, not on gui of proxmox - right.

regards

 

[udo]

Hi,
I don't use qcow2 - so I don't have experience with such vm-disks, esp. not with this size.

But if you test such big disk, post the results here.

Udo

 

[informant]

HI,

ok i would do it. which format do you use for which size?

regards

 

[udo]

Hi,
on a filesystem I use normaly raw. On lvm and ceph it's the same (there must be raw).

The most VM-disks are on lvm and ceph in my case.

Udo

 

[informant]

Hi,

thanks, and whats is the advantage of raw? Speed, Backupspeed, Snapshots, Handling?

regards

 

[mir]

Hi,

thanks, and whats is the advantage of raw? Speed, Backupspeed, Snapshots, Handling?

regards

speed and portability.

 

[informant]

Hi, but if we use raw, we have the same error message:

Formatting '/var/lib/vz/images/5532/vm-5532-disk-1.raw', fmt=raw size=3298534883328 
TASK  ERROR: create failed - unable to create image: qemu-img:  /var/lib/vz/images/5532/vm-5532-disk-1.raw: The image size is too large  for file format 'raw'

only with vmdk it´s works on this size?

normal?

regards

 

[mir]

Maybe a hard limit in Proxmox?

 

[informant]

In which configuration file can we change it? we use the image of proxmox.com website with last online update.

regards

 

[dietmar]

Maybe a hard limit in Proxmox?

Why should we limit that? I tested, and it works for me:

# qemu-img create -f qcow2 test.img 3T

so what is the output of:

# qemu-img --version

 

[informant]

Hi dietmar,

following output come:

qemu-img --version
qemu-img version 1.7.1, Copyright (c) 2004-2008 Fabrice Bellard
usage: qemu-img command[command options]
QEMU disk image utility
...
Supported formats: vvfat vpc vmdk vhdx vdi ssh sheepdog sheepdog sheepdog rbd raw host_cdrom host_floppy host_device file qed qcow2 qcow parallels nbd nbd nbd iscsi gluster gluster gluster gluster dmg tftp ftps ftp https http cow cloop bochs blkverify blkdebug

We have create the disc in gui manager of proxmox, not on ssh.

regards

 

[pmxpain]

Same error here. qemu-img is version 2.1.2.

Dec  8 09:06:26 paul pvedaemon[5637]: create failed - unable to create image: qemu-img: /var/lib/vz/images/104/vm-104-disk-1.qcow2: The image size is too large for file format 'qcow2' (try using a larger cluster size)
Dec  8 09:06:26 paul pvedaemon[3006]: <root@pam> end task UPID:paul:00001605:00032A3F:54855BFF:qmcreate:104:root@pam: create failed - unable to create image: qemu-img: /var/lib/vz/images/104/vm-104-disk-1.qcow2: The image size is too large for file format 'qcow2' (try using a larger cluster size)

Even if I try raw it doesn't work.

Dec  8 09:13:15 paul pvedaemon[5982]: create failed - unable to create image: qemu-img: /var/lib/vz/images/104/vm-104-disk-1.raw: The image size is too large for file format 'raw'
Dec  8 09:13:15 paul pvedaemon[3006]: <root@pam> end task UPID:paul:0000175E:0003CB37:54855D9B:qmcreate:104:root@pam: create failed - unable to create image: qemu-img: /var/lib/vz/images/104/vm-104-disk-1.raw: The image size is too large for file format 'raw'

When I create a qcow image manually it works:

# qemu-img create -f qcow2 test1.img 6T
Formatting 'test1.img', fmt=qcow2 size=6597069766656 encryption=off cluster_size=65536 lazy_refcounts=off

Maybe a wrong cluster size is used? But if I use the GUI I can't tell Proxmox to use a different cluster size?

BTW - I find it horrible that the GUI simply fails to create the VM, giving no error message and leaves vm files on the disk I have to remove manually.

 

[dietmar]

Maybe a wrong cluster size is used? But if I use the GUI I can't tell Proxmox to use a different cluster size?

Maybe you do not have enought free space under /var/lib/vz/?

BTW - I find it horrible that the GUI simply fails to create the VM, giving no error message and leaves vm files on the disk I have to remove manually.

Oh, looks like a qemu-img bug - will try to fix that.

 

[felipe]

hi,

i can run "qemu-img create -f qcow2 test.qcow2 6T"
but "qemu-img create -f qcow2 -o preallocation=metadata test.qcow2 6T" fails with the error above. so the question for me is: what happens if the thin provisoned image reaches more than 2TB??? will it fail?

 

[felipe]

isnt the max filesize of ext3/4 2TB?

 

[dietmar]

AFAIK Ext3 file size limit is 2TB (http://en.wikipedia.org/wiki/Ext3), but there is no such limit on Ext4.