Unable to restore vm - TASK ERROR: zfs error: cannot create 'rz2pool/vm/vm-104-disk-2': out of space , but there is more than enough

[gerfloim]

I'm trying to do a full restore from our PBS. Unfortunately only after a few seconds I get errors:


Task viewer: VM 104 - Restore

Warning: volblocksize (4096) is less than the default minimum block size (8192).
To reduce wasted space a volblocksize of 16384 is recommended.
new volume ID is 'local-zfs-vms:vm-104-disk-0'
Warning: volblocksize (4096) is less than the default minimum block size (8192).
To reduce wasted space a volblocksize of 16384 is recommended.
new volume ID is 'local-zfs-vms:vm-104-disk-1'
Warning: volblocksize (4096) is less than the default minimum block size (8192).
To reduce wasted space a volblocksize of 16384 is recommended.
temporary volume 'local-zfs-vms:vm-104-disk-0' sucessfuly removed
temporary volume 'local-zfs-vms:vm-104-disk-1' sucessfuly removed
error before or during data restore, some or all disks were not completely restored. VM 104 state is NOT cleaned up.
TASK ERROR: zfs error: cannot create 'rz2pool/vm/vm-104-disk-2': out of space

The size of the vm is about 6 TB

the r2zpool volume is about 12 TB and has following state:

Enabled Yes
Active Yes
Content Disk image
Type ZFS
Usage 13.97% (1.58 TB of 11.32 TB)

zpool status:
pool: rz2pool
state: ONLINE
scan: scrub repaired 0B in 17:50:20 with 0 errors on Mon May 6 00:37:28 2024
config:

NAME STATE READ WRITE CKSUM
rz2pool ONLINE 0 0 0
raidz2-0 ONLINE 0 0 0
scsi-35000cca01a834670 ONLINE 0 0 0
scsi-35000cca01a791e24 ONLINE 0 0 0
scsi-35000cca03e57d8a8 ONLINE 0 0 0
scsi-35000cca01a83cd30 ONLINE 0 0 0
raidz2-1 ONLINE 0 0 0
scsi-35000cca01a841db0 ONLINE 0 0 0
scsi-35000cca01a832f30 ONLINE 0 0 0
scsi-35000cca01a69f22c ONLINE 0 0 0
scsi-35000c50041ca84ab ONLINE 0 0 0
logs
mirror-4 ONLINE 0 0 0
nvme-INTEL_MEMPEK1W016GA_PHBT720000Z7016D ONLINE 0 0 0
nvme-INTEL_MEMPEK1W016GA_PHBT7195026S016D ONLINE 0 0 0
cache
nvme-Samsung_SSD_970_PRO_1TB_S462NF0MA06799D-part3 ONLINE 0 0 0
nvme-Samsung_SSD_970_PRO_1TB_S462NF0MA06145Z-part4 ONLINE 0 0 0


I rebooted the whole server a couple of times, nothing helped. I'm out of ideas and currently my colleagues are not able to work. I would really appreciate any help.

Thanks!

 

[gerfloim]

got it - I had to delete all replication disks from another server. Now it start the restore process