Downloaded on PVE.
Code:
pveversion -v
proxmox-ve: 7.1-1 (running kernel: 5.13.19-3-pve)
pve-manager: 7.1-10 (running version: 7.1-10/6ddebafe)
pve-kernel-helper: 7.1-8
pve-kernel-5.13: 7.1-6
pve-kernel-5.13.19-3-pve: 5.13.19-7
pve-kernel-5.13.19-2-pve: 5.13.19-4
ceph-fuse: 14.2.21-1
corosync: 3.1.5-pve2
criu: 3.15-1+pve-1
glusterfs-client: 9.2-1
ifupdown: residual config
ifupdown2: 3.1.0-1+pmx3
libjs-extjs: 7.0.0-1
libknet1: 1.22-pve2
libproxmox-acme-perl: 1.4.1
libproxmox-backup-qemu0: 1.2.0-1
libpve-access-control: 7.1-6
libpve-apiclient-perl: 3.2-1
libpve-common-perl: 7.1-2
libpve-guest-common-perl: 4.0-3
libpve-http-server-perl: 4.1-1
libpve-storage-perl: 7.0-15
libspice-server1: 0.14.3-2.1
lvm2: 2.03.11-2.1
lxc-pve: 4.0.11-1
lxcfs: 4.0.11-pve1
novnc-pve: 1.3.0-1
proxmox-backup-client: 2.1.4-1
proxmox-backup-file-restore: 2.1.4-1
proxmox-mini-journalreader: 1.3-1
proxmox-widget-toolkit: 3.4-5
pve-cluster: 7.1-3
pve-container: 4.1-3
pve-docs: 7.1-2
pve-edk2-firmware: 3.20210831-2
pve-firewall: 4.2-5
pve-firmware: 3.3-4
pve-ha-manager: 3.3-3
pve-i18n: 2.6-2
pve-qemu-kvm: 6.1.0-3
pve-xtermjs: 4.12.0-1
qemu-server: 7.1-4
smartmontools: 7.2-1
spiceterm: 3.2-2
swtpm: 0.7.0~rc1+2
vncterm: 1.7-1
zfsutils-linux: 2.1.2-pve1
Code:
proxmox-backup-manager versions --verbose
proxmox-backup 2.1-1 running kernel: 5.13.19-3-pve
proxmox-backup-server 2.1.4-1 running version: 2.1.4
pve-kernel-helper 7.1-8
pve-kernel-5.13 7.1-6
pve-kernel-5.13.19-3-pve 5.13.19-7
pve-kernel-5.13.19-2-pve 5.13.19-4
ifupdown2 3.1.0-1+pmx3
libjs-extjs 7.0.0-1
proxmox-backup-docs 2.1.4-1
proxmox-backup-client 2.1.4-1
proxmox-mini-journalreader 1.3-1
proxmox-widget-toolkit 3.4-5
pve-xtermjs 4.16.0-1
smartmontools 7.2-1
zfsutils-linux 2.1.2-pve1
Access via Google Chrome Version 98.0.4758.74 running Windows 11 Pro, Version 21H2 (OS Build 22000.469). Intel Core i7-6770HQ. 32GB RAM. 1TB nvme, Raid1. Used built-in Extract function (via Explorer). 7zip 21.07 (x64). Windows built-in tar (bsdtar, 3.5.2).
I have not had time to run statistically significant testing. I will share what I have done so far:
- Three datasets
- data1 3.01 GB
- data2 21.50 GB
- data3 105.00 GB
- data1
- No issues: Windows extract; 7zip; Windows tar -xvzf.
- WinDiff was used to verify the extracts.
- data2
- Windows extract and tar: no problem.
- 7zip issued 1 error, and continued the extract:
- WinDiff showed all three extracts are a match!
- Do not know what the 7zip error means, but it seemed to have no impact on the extract.
- data3
- Just kicked off the testing.
- It will run for several hours.
On the surface, it appears that the smaller zip files seem to work consistently. I see erratic results with some of the larger downloads. Sorry, I am unable to send samples due to the sensitive nature of the content. I can share that on Linux a 625MiB file showed several of these errors with unzip -t:
Code:
error: invalid compressed data to inflate
testing: 2002/2002_05/2002_05_13/
error: invalid compressed data to inflate
testing: 2002/2002_05/2002_05_04/
error: invalid compressed data to inflate
testing: 2002/2002_05/2002_05_03/
error: invalid compressed data to inflate
testing: 2002/2002_05/2002_05_07/
error: invalid compressed data to inflate
testing: 2002/2002_12/
error: invalid compressed data to inflate
testing: 2002/2002_12/2002_12_28/
error: invalid compressed data to inflate
zip -F and zip -FF seemed not to repair the downloaded zip. tar -xzvf bombed:
Code:
gzip: stdin: invalid compressed data--format violated
tar: Child returned status 1
tar: Error is not recoverable: exiting now
As I said, probably statistically invalid results at this point, but inconsistency remains as valid.