[SOLVED] PVE - PBS and File Restore

D

DrSlump_Ins

Member
Oct 28, 2022
6
0
6
Hi everyone, I'm encountering an anomaly in Proxmox Backup.
I have a PVE cluster hooked up to a physical PBS with a 4 disk zfs pool.
Today I went to check the backup to look for a file and I discover that the affected folder is not there in the File Restore view.
Reposted the example screen.
PVE is updated to 8.1.4 and PBS to 3.1.4.
Could anyone give me some help?

PBS - Anomalia.png

Thank you
 
DrSlump_Ins said:
Hi everyone, I'm encountering an anomaly in Proxmox Backup.
I have a PVE cluster hooked up to a physical PBS with a 4 disk zfs pool.
Today I went to check the backup to look for a file and I discover that the affected folder is not there in the File Restore view.
Reposted the example screen.
PVE is updated to 8.1.4 and PBS to 3.1.4.
Could anyone give me some help?

View attachment 63500

Thank you
Click to expand...
Hi,
could you please verify if the folder is just not present when using the file restore browser or if it is not present in the backed up VM disk at all. To do this, please restore the VM to a different VMID and start it up to check the contents from within the VM.

Please also:
  • Check for errors in the systemd journal on the PVE and PBS host, journalctl -r -b gives you a paginated view since the last boot in reverse chronology
  • Post the backup task log related to this snapshot, check for errors and hints
  • Check other snapshots which should contain the folder if there are such
 
I did an entire restore of the vm from the last backup made and the folder exists.

PVE journalctl
Code: 
Feb 20 21:37:04 pve-ins-002 pvescheduler[3449602]: INFO: Finished Backup of VM 109 (00:19:36)
Feb 20 21:29:34 pve-ins-002 pmxcfs[1172]: [dcdb] notice: data verification successful
Feb 20 21:17:28 pve-ins-002 pvescheduler[3449602]: INFO: Starting Backup of VM 109 (qemu)

PBS log backup
Code: 
109: 2024-02-20 21:17:28 INFO: Starting Backup of VM 109 (qemu)
109: 2024-02-20 21:17:28 INFO: status = running
109: 2024-02-20 21:17:28 INFO: VM Name: srv-dati
109: 2024-02-20 21:17:28 INFO: include disk 'scsi0' 'nas-vm:109/vm-109-disk-0.raw' 512G
109: 2024-02-20 21:17:28 INFO: exclude disk 'scsi1' 'nas-vm:109/vm-109-disk-1.raw' (backup=no)
109: 2024-02-20 21:17:28 INFO: include disk 'efidisk0' 'nas-vm:109/vm-109-disk-1.qcow2' 528K
109: 2024-02-20 21:17:28 INFO: backup mode: snapshot
109: 2024-02-20 21:17:28 INFO: ionice priority: 7
109: 2024-02-20 21:17:28 INFO: creating Proxmox Backup Server archive 'vm/109/2024-02-20T20:17:28Z'
109: 2024-02-20 21:17:28 INFO: issuing guest-agent 'fs-freeze' command
109: 2024-02-20 21:17:37 INFO: issuing guest-agent 'fs-thaw' command
109: 2024-02-20 21:17:39 INFO: started backup task '8f015d89-e547-46bf-afdf-0d8a2ad50b67'
109: 2024-02-20 21:17:39 INFO: resuming VM again
109: 2024-02-20 21:17:39 INFO: efidisk0: dirty-bitmap status: OK (drive clean)
109: 2024-02-20 21:17:39 INFO: scsi0: dirty-bitmap status: OK (66.4 GiB of 512.0 GiB dirty)
109: 2024-02-20 21:17:39 INFO: using fast incremental mode (dirty-bitmap), 66.4 GiB dirty of 512.0 GiB total
109: 2024-02-20 21:17:42 INFO:   0% (280.0 MiB of 66.4 GiB) in 3s, read: 93.3 MiB/s, write: 92.0 MiB/s
109: 2024-02-20 21:17:50 INFO:   1% (704.0 MiB of 66.4 GiB) in 11s, read: 53.0 MiB/s, write: 53.0 MiB/s
109: 2024-02-20 21:18:03 INFO:   2% (1.4 GiB of 66.4 GiB) in 24s, read: 53.2 MiB/s, write: 52.9 MiB/s
109: 2024-02-20 21:18:15 INFO:   3% (2.0 GiB of 66.4 GiB) in 36s, read: 54.7 MiB/s, write: 54.7 MiB/s
109: 2024-02-20 21:18:30 INFO:   4% (2.7 GiB of 66.4 GiB) in 51s, read: 47.5 MiB/s, write: 47.5 MiB/s
109: 2024-02-20 21:18:43 INFO:   5% (3.3 GiB of 66.4 GiB) in 1m 4s, read: 49.5 MiB/s, write: 49.5 MiB/s
109: 2024-02-20 21:18:57 INFO:   6% (4.0 GiB of 66.4 GiB) in 1m 18s, read: 49.7 MiB/s, write: 49.7 MiB/s
109: 2024-02-20 21:19:12 INFO:   7% (4.7 GiB of 66.4 GiB) in 1m 33s, read: 46.4 MiB/s, write: 46.4 MiB/s
109: 2024-02-20 21:19:26 INFO:   8% (5.4 GiB of 66.4 GiB) in 1m 47s, read: 48.9 MiB/s, write: 48.9 MiB/s
109: 2024-02-20 21:19:40 INFO:   9% (6.0 GiB of 66.4 GiB) in 2m 1s, read: 48.9 MiB/s, write: 48.9 MiB/s
109: 2024-02-20 21:19:53 INFO:  10% (6.6 GiB of 66.4 GiB) in 2m 14s, read: 48.9 MiB/s, write: 48.9 MiB/s
109: 2024-02-20 21:20:07 INFO:  11% (7.3 GiB of 66.4 GiB) in 2m 28s, read: 48.9 MiB/s, write: 48.9 MiB/s
109: 2024-02-20 21:20:21 INFO:  12% (8.0 GiB of 66.4 GiB) in 2m 42s, read: 48.9 MiB/s, write: 48.9 MiB/s
109: 2024-02-20 21:20:37 INFO:  13% (8.7 GiB of 66.4 GiB) in 2m 58s, read: 44.0 MiB/s, write: 44.0 MiB/s
109: 2024-02-20 21:20:50 INFO:  14% (9.3 GiB of 66.4 GiB) in 3m 11s, read: 50.2 MiB/s, write: 50.2 MiB/s
109: 2024-02-20 21:21:04 INFO:  15% (10.0 GiB of 66.4 GiB) in 3m 25s, read: 50.9 MiB/s, write: 50.9 MiB/s
109: 2024-02-20 21:21:18 INFO:  16% (10.7 GiB of 66.4 GiB) in 3m 39s, read: 49.7 MiB/s, write: 49.4 MiB/s
109: 2024-02-20 21:21:31 INFO:  17% (11.3 GiB of 66.4 GiB) in 3m 52s, read: 50.2 MiB/s, write: 50.2 MiB/s
109: 2024-02-20 21:21:44 INFO:  18% (12.0 GiB of 66.4 GiB) in 4m 5s, read: 52.0 MiB/s, write: 51.4 MiB/s
109: 2024-02-20 21:21:59 INFO:  19% (12.6 GiB of 66.4 GiB) in 4m 20s, read: 45.3 MiB/s, write: 45.3 MiB/s
109: 2024-02-20 21:22:11 INFO:  20% (13.3 GiB of 66.4 GiB) in 4m 32s, read: 57.7 MiB/s, write: 56.7 MiB/s
109: 2024-02-20 21:22:25 INFO:  21% (14.0 GiB of 66.4 GiB) in 4m 46s, read: 48.3 MiB/s, write: 48.3 MiB/s
109: 2024-02-20 21:22:39 INFO:  22% (14.6 GiB of 66.4 GiB) in 5m, read: 48.0 MiB/s, write: 48.0 MiB/s
109: 2024-02-20 21:22:52 INFO:  23% (15.3 GiB of 66.4 GiB) in 5m 13s, read: 52.6 MiB/s, write: 52.6 MiB/s
109: 2024-02-20 21:23:04 INFO:  24% (16.0 GiB of 66.4 GiB) in 5m 25s, read: 56.0 MiB/s, write: 56.0 MiB/s
109: 2024-02-20 21:23:13 INFO:  25% (16.7 GiB of 66.4 GiB) in 5m 34s, read: 79.1 MiB/s, write: 79.1 MiB/s
109: 2024-02-20 21:23:24 INFO:  26% (17.3 GiB of 66.4 GiB) in 5m 45s, read: 60.4 MiB/s, write: 60.4 MiB/s
109: 2024-02-20 21:23:36 INFO:  27% (17.9 GiB of 66.4 GiB) in 5m 57s, read: 55.0 MiB/s, write: 55.0 MiB/s
109: 2024-02-20 21:23:50 INFO:  28% (18.6 GiB of 66.4 GiB) in 6m 11s, read: 50.6 MiB/s, write: 50.6 MiB/s
109: 2024-02-20 21:24:02 INFO:  29% (19.3 GiB of 66.4 GiB) in 6m 23s, read: 56.3 MiB/s, write: 56.3 MiB/s
109: 2024-02-20 21:24:14 INFO:  30% (20.0 GiB of 66.4 GiB) in 6m 35s, read: 56.3 MiB/s, write: 56.3 MiB/s
109: 2024-02-20 21:24:27 INFO:  31% (20.6 GiB of 66.4 GiB) in 6m 48s, read: 53.2 MiB/s, write: 53.2 MiB/s
109: 2024-02-20 21:24:40 INFO:  32% (21.3 GiB of 66.4 GiB) in 7m 1s, read: 52.3 MiB/s, write: 52.0 MiB/s
109: 2024-02-20 21:24:52 INFO:  33% (21.9 GiB of 66.4 GiB) in 7m 13s, read: 53.7 MiB/s, write: 53.7 MiB/s
109: 2024-02-20 21:25:05 INFO:  34% (22.6 GiB of 66.4 GiB) in 7m 26s, read: 52.3 MiB/s, write: 52.3 MiB/s
109: 2024-02-20 21:25:15 INFO:  35% (23.3 GiB of 66.4 GiB) in 7m 36s, read: 75.2 MiB/s, write: 75.2 MiB/s
109: 2024-02-20 21:25:25 INFO:  36% (24.0 GiB of 66.4 GiB) in 7m 46s, read: 66.4 MiB/s, write: 66.4 MiB/s
109: 2024-02-20 21:25:35 INFO:  37% (24.6 GiB of 66.4 GiB) in 7m 56s, read: 62.8 MiB/s, write: 62.8 MiB/s
109: 2024-02-20 21:25:46 INFO:  38% (25.3 GiB of 66.4 GiB) in 8m 7s, read: 66.9 MiB/s, write: 66.9 MiB/s
109: 2024-02-20 21:25:55 INFO:  39% (25.9 GiB of 66.4 GiB) in 8m 16s, read: 69.8 MiB/s, write: 69.8 MiB/s
109: 2024-02-20 21:26:06 INFO:  40% (26.6 GiB of 66.4 GiB) in 8m 27s, read: 65.1 MiB/s, write: 65.1 MiB/s
109: 2024-02-20 21:26:17 INFO:  41% (27.3 GiB of 66.4 GiB) in 8m 38s, read: 59.6 MiB/s, write: 59.6 MiB/s
109: 2024-02-20 21:26:29 INFO:  42% (27.9 GiB of 66.4 GiB) in 8m 50s, read: 56.3 MiB/s, write: 56.0 MiB/s
109: 2024-02-20 21:26:43 INFO:  43% (28.6 GiB of 66.4 GiB) in 9m 4s, read: 48.3 MiB/s, write: 48.3 MiB/s
109: 2024-02-20 21:26:56 INFO:  44% (29.2 GiB of 66.4 GiB) in 9m 17s, read: 52.6 MiB/s, write: 52.6 MiB/s
109: 2024-02-20 21:27:07 INFO:  45% (29.9 GiB of 66.4 GiB) in 9m 28s, read: 62.2 MiB/s, write: 62.2 MiB/s
109: 2024-02-20 21:27:18 INFO:  46% (30.6 GiB of 66.4 GiB) in 9m 39s, read: 65.5 MiB/s, write: 65.5 MiB/s
109: 2024-02-20 21:27:28 INFO:  47% (31.3 GiB of 66.4 GiB) in 9m 49s, read: 66.4 MiB/s, write: 66.4 MiB/s
109: 2024-02-20 21:27:38 INFO:  48% (31.9 GiB of 66.4 GiB) in 9m 59s, read: 66.4 MiB/s, write: 66.4 MiB/s
109: 2024-02-20 21:27:48 INFO:  49% (32.6 GiB of 66.4 GiB) in 10m 9s, read: 66.0 MiB/s, write: 66.0 MiB/s
109: 2024-02-20 21:27:59 INFO:  50% (33.3 GiB of 66.4 GiB) in 10m 20s, read: 65.5 MiB/s, write: 65.5 MiB/s
109: 2024-02-20 21:28:09 INFO:  51% (33.9 GiB of 66.4 GiB) in 10m 30s, read: 66.4 MiB/s, write: 66.4 MiB/s
109: 2024-02-20 21:28:20 INFO:  52% (34.6 GiB of 66.4 GiB) in 10m 41s, read: 64.7 MiB/s, write: 64.7 MiB/s
109: 2024-02-20 21:28:29 INFO:  53% (35.3 GiB of 66.4 GiB) in 10m 50s, read: 74.7 MiB/s, write: 74.7 MiB/s
109: 2024-02-20 21:28:38 INFO:  54% (35.9 GiB of 66.4 GiB) in 10m 59s, read: 73.3 MiB/s, write: 73.3 MiB/s
109: 2024-02-20 21:28:49 INFO:  55% (36.6 GiB of 66.4 GiB) in 11m 10s, read: 63.6 MiB/s, write: 63.6 MiB/s
109: 2024-02-20 21:29:00 INFO:  56% (37.2 GiB of 66.4 GiB) in 11m 21s, read: 57.8 MiB/s, write: 57.1 MiB/s
109: 2024-02-20 21:29:13 INFO:  57% (37.9 GiB of 66.4 GiB) in 11m 34s, read: 54.5 MiB/s, write: 54.5 MiB/s
109: 2024-02-20 21:29:25 INFO:  58% (38.6 GiB of 66.4 GiB) in 11m 46s, read: 57.0 MiB/s, write: 57.0 MiB/s
109: 2024-02-20 21:29:37 INFO:  59% (39.2 GiB of 66.4 GiB) in 11m 58s, read: 54.0 MiB/s, write: 53.7 MiB/s
109: 2024-02-20 21:29:50 INFO:  60% (39.9 GiB of 66.4 GiB) in 12m 11s, read: 55.1 MiB/s, write: 55.1 MiB/s
109: 2024-02-20 21:30:04 INFO:  61% (40.5 GiB of 66.4 GiB) in 12m 25s, read: 47.1 MiB/s, write: 47.1 MiB/s
109: 2024-02-20 21:30:17 INFO:  62% (41.2 GiB of 66.4 GiB) in 12m 38s, read: 51.7 MiB/s, write: 51.7 MiB/s
109: 2024-02-20 21:30:30 INFO:  63% (41.9 GiB of 66.4 GiB) in 12m 51s, read: 53.5 MiB/s, write: 53.5 MiB/s
109: 2024-02-20 21:30:43 INFO:  64% (42.5 GiB of 66.4 GiB) in 13m 4s, read: 50.5 MiB/s, write: 50.5 MiB/s
109: 2024-02-20 21:30:55 INFO:  65% (43.2 GiB of 66.4 GiB) in 13m 16s, read: 61.0 MiB/s, write: 61.0 MiB/s
109: 2024-02-20 21:31:05 INFO:  66% (43.9 GiB of 66.4 GiB) in 13m 26s, read: 68.0 MiB/s, write: 68.0 MiB/s
109: 2024-02-20 21:31:16 INFO:  67% (44.6 GiB of 66.4 GiB) in 13m 37s, read: 61.8 MiB/s, write: 61.8 MiB/s
109: 2024-02-20 21:31:27 INFO:  68% (45.2 GiB of 66.4 GiB) in 13m 48s, read: 57.1 MiB/s, write: 57.1 MiB/s
109: 2024-02-20 21:31:39 INFO:  69% (45.9 GiB of 66.4 GiB) in 14m, read: 61.7 MiB/s, write: 61.7 MiB/s
109: 2024-02-20 21:31:48 INFO:  70% (46.6 GiB of 66.4 GiB) in 14m 9s, read: 75.1 MiB/s, write: 75.1 MiB/s
109: 2024-02-20 21:31:56 INFO:  71% (47.2 GiB of 66.4 GiB) in 14m 17s, read: 78.0 MiB/s, write: 78.0 MiB/s
109: 2024-02-20 21:32:05 INFO:  72% (47.8 GiB of 66.4 GiB) in 14m 26s, read: 76.0 MiB/s, write: 76.0 MiB/s
109: 2024-02-20 21:32:15 INFO:  73% (48.6 GiB of 66.4 GiB) in 14m 36s, read: 73.2 MiB/s, write: 73.2 MiB/s
109: 2024-02-20 21:32:24 INFO:  74% (49.2 GiB of 66.4 GiB) in 14m 45s, read: 74.7 MiB/s, write: 74.7 MiB/s
109: 2024-02-20 21:32:33 INFO:  75% (49.9 GiB of 66.4 GiB) in 14m 54s, read: 73.8 MiB/s, write: 73.8 MiB/s
109: 2024-02-20 21:32:43 INFO:  76% (50.5 GiB of 66.4 GiB) in 15m 4s, read: 65.6 MiB/s, write: 65.6 MiB/s
109: 2024-02-20 21:32:56 INFO:  77% (51.2 GiB of 66.4 GiB) in 15m 17s, read: 55.7 MiB/s, write: 55.7 MiB/s
109: 2024-02-20 21:33:06 INFO:  78% (51.8 GiB of 66.4 GiB) in 15m 27s, read: 65.2 MiB/s, write: 65.2 MiB/s
109: 2024-02-20 21:33:16 INFO:  79% (52.5 GiB of 66.4 GiB) in 15m 37s, read: 72.0 MiB/s, write: 72.0 MiB/s
109: 2024-02-20 21:33:26 INFO:  80% (53.2 GiB of 66.4 GiB) in 15m 47s, read: 66.4 MiB/s, write: 66.4 MiB/s
109: 2024-02-20 21:33:34 INFO:  81% (53.8 GiB of 66.4 GiB) in 15m 55s, read: 80.0 MiB/s, write: 80.0 MiB/s
109: 2024-02-20 21:33:44 INFO:  82% (54.5 GiB of 66.4 GiB) in 16m 5s, read: 68.0 MiB/s, write: 68.0 MiB/s
109: 2024-02-20 21:33:55 INFO:  83% (55.2 GiB of 66.4 GiB) in 16m 16s, read: 65.8 MiB/s, write: 65.8 MiB/s
109: 2024-02-20 21:34:05 INFO:  84% (55.8 GiB of 66.4 GiB) in 16m 26s, read: 64.0 MiB/s, write: 64.0 MiB/s
109: 2024-02-20 21:34:18 INFO:  85% (56.5 GiB of 66.4 GiB) in 16m 39s, read: 54.5 MiB/s, write: 54.5 MiB/s
109: 2024-02-20 21:34:28 INFO:  86% (57.2 GiB of 66.4 GiB) in 16m 49s, read: 66.4 MiB/s, write: 66.4 MiB/s
109: 2024-02-20 21:34:38 INFO:  87% (57.8 GiB of 66.4 GiB) in 16m 59s, read: 66.4 MiB/s, write: 66.4 MiB/s
109: 2024-02-20 21:34:50 INFO:  88% (58.5 GiB of 66.4 GiB) in 17m 11s, read: 60.0 MiB/s, write: 60.0 MiB/s
109: 2024-02-20 21:35:00 INFO:  89% (59.1 GiB of 66.4 GiB) in 17m 21s, read: 65.2 MiB/s, write: 65.2 MiB/s
109: 2024-02-20 21:35:11 INFO:  90% (59.8 GiB of 66.4 GiB) in 17m 32s, read: 65.1 MiB/s, write: 65.1 MiB/s
109: 2024-02-20 21:35:21 INFO:  91% (60.5 GiB of 66.4 GiB) in 17m 42s, read: 66.0 MiB/s, write: 66.0 MiB/s
109: 2024-02-20 21:35:33 INFO:  92% (61.2 GiB of 66.4 GiB) in 17m 54s, read: 58.0 MiB/s, write: 58.0 MiB/s
109: 2024-02-20 21:35:43 INFO:  93% (61.8 GiB of 66.4 GiB) in 18m 4s, read: 65.2 MiB/s, write: 65.2 MiB/s
109: 2024-02-20 21:35:53 INFO:  94% (62.5 GiB of 66.4 GiB) in 18m 14s, read: 66.4 MiB/s, write: 66.4 MiB/s
109: 2024-02-20 21:36:04 INFO:  95% (63.2 GiB of 66.4 GiB) in 18m 25s, read: 65.5 MiB/s, write: 65.5 MiB/s
109: 2024-02-20 21:36:14 INFO:  96% (63.8 GiB of 66.4 GiB) in 18m 35s, read: 66.0 MiB/s, write: 66.0 MiB/s
109: 2024-02-20 21:36:25 INFO:  97% (64.5 GiB of 66.4 GiB) in 18m 46s, read: 65.1 MiB/s, write: 65.1 MiB/s
109: 2024-02-20 21:36:35 INFO:  98% (65.1 GiB of 66.4 GiB) in 18m 56s, read: 65.2 MiB/s, write: 65.2 MiB/s
109: 2024-02-20 21:36:47 INFO:  99% (65.8 GiB of 66.4 GiB) in 19m 8s, read: 59.3 MiB/s, write: 59.3 MiB/s
109: 2024-02-20 21:36:59 INFO: 100% (66.4 GiB of 66.4 GiB) in 19m 20s, read: 51.7 MiB/s, write: 51.7 MiB/s
109: 2024-02-20 21:37:04 INFO: backup was done incrementally, reused 445.61 GiB (87%)
109: 2024-02-20 21:37:04 INFO: transferred 66.44 GiB in 1165 seconds (58.4 MiB/s)
109: 2024-02-20 21:37:04 INFO: adding notes to backup
109: 2024-02-20 21:37:04 INFO: prune older backups with retention: keep-daily=14, keep-monthly=12, keep-weekly=4, keep-yearly=1
109: 2024-02-20 21:37:04 INFO: running 'proxmox-backup-client prune' for 'vm/109'
109: 2024-02-20 21:37:04 INFO: pruned 1 backup(s) not covered by keep-retention policy
109: 2024-02-20 21:37:04 INFO: Finished Backup of VM 109 (00:19:36)

The folder in File Restore GUI is not present in any snapshot except in the first backup of the chain.
 
Okay, this is odd: Could be an issue with the ntfs driver which is used to access the filesystem for restore via the singe file restore UI. Does this happen to other folder having the read only flag set as well? Does this folder have additional access control list or other attributes set, which might limit read access?
 
Last edited:
The folder is a corporate network share on a Windows 2019 file server with profiled access for each account, both reading and writing.
The folder has full access for domain administrators, but users can only access some of the folders contained within it.
 
I did a test using the CLI command "proxmox-file-restore" and the result on the "Dati" folder is correct, but when I look for the "Dati\Backup" folder list, I/O Error.
I confirm that in the complete restore of the VM the Backup folder is there and is OK.

Screenshot 2024-02-22 142528.png
 
DrSlump_Ins said:
I did a test using the CLI command "proxmox-file-restore" and the result on the "Dati" folder is correct, but when I look for the "Dati\Backup" folder list, I/O Error.
I confirm that in the complete restore of the VM the Backup folder is there and is OK.

View attachment 63596
Click to expand...
Then I am afraid this is indeed a shortcoming of the ntfs driver the file restore uses to access Windows NTFS partitions, please open a bug report at https://bugzilla.proxmox.com/ including as much information about the additional ACLs, attributes, ecc. currently set on this folder.

Edit: ntfs, not ntfs-3g is used in the VM, updated post accordingly
 
Last edited:
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom