File restore failing from a directory with thousands of files

[resoli]

Hello, our pve 7.2-4 cluster is running backups of a file server with some huge directories (one of these contains more than 75000 subdirectories). File restore from gui fails while trying to list content of these dirs. Atm the only way I found to restore contents from these dirs is to point to single files or subdirs using REST API.

Backups are being done on a separate dedicated hardware with pbs v2.2-1.

Any hint?

 

[resoli]

A workaround: use proxmox-backup-client map command for mapping the remote (encrypted) snapshot to /dev/loop0 and mounting it as a local device.

proxmox-backup-client map "my_snapshot_name" "my_drive_image" --repository my_pbshost:my_datastore_name --ns my_namespace --keyfile /etc/pve/priv/storage/my_pbs_storage_id.enc

 

[dcsapak]

File restore from gui fails while trying to list content of these dirs.

what's the error message? is it just a timeout?

 

[resoli]

what's the error message? is it just a timeout?

I prepared a little screencast: https://www.resolutions.it/nextcloud/index.php/s/PGydmnnTTMsCMPF

The error text says: "Connection closed before message completed (500)"

 

[dcsapak]

mhmm.. can you post the log of the pbs from that time?
and the log from /var/log/proxmox-backup/file-restore/qemu.log ?

 

[resoli]

Here's the log. I guess the salient part is this OOM:
Out of memory: Killed process 53 (proxmox-restore) total-vm:434868kB, anon-rss:49756kB, file-rss:5000kB, shmem-rss:0kB, UID:0 pgtables:224kB oom_score_adj:0

 

[dcsapak]

yeah it seems the directory listing uses too much memory... i'll see how we can improve that... until then, you could restore the vm to a different vmid and use any livecd to restore the files

 

[resoli]

yeah it seems the directory listing uses too much memory... i'll see how we can improve that...

Thank you

until then, you could restore the vm to a different vmid and use any livecd to restore the files

Imho, use of `proxmox-backup-client map` as detaild in #2 is much more practical (and really great for large restores, in general).

rob

 

[dcsapak]

Thank you

no problem, i sent a patch to pbs-devel that should fix that issue, but no timeline as to when it'll be included... https://lists.proxmox.com/pipermail/pbs-devel/2022-June/005253.html

Imho, use of `proxmox-backup-client map` as detaild in #2 is much more practical (and really great for large restores, in general).

sure whatever works for you, i just wanted to give you an alternative

 

[resoli]

no problem, i sent a patch to pbs-devel that should fix that issue, but no timeline as to when it'll be included... https://lists.proxmox.com/pipermail/pbs-devel/2022-June/005253.html

Great!

sure whatever works for you, i just wanted to give you an alternative

thank you.

rob