Second/First backup never finishing

M

mjoconr

Renowned Member
Dec 5, 2009
88
1
73
Hi All
I'm trying to test PBS, and I have an issue.

The first time around I was able to get the first backup to finish but the second did not complete for a couple of days.

So I cleaned out all the backups and tried again now the first backup has been going for well over two days and the last update indicated it has been running for just over 4 hours and was 99% complete.

Where do I look to get more information about the status and any errors/warnings?

Thanks
Mike
 
hi,

can you post the complete task log (up untiil now) ?

what do you try to backup? (directory/ ct/ vm ?)
 
Hi

Is this the task log you want:

It's a KVM image running windows.

INFO: starting new backup job: vzdump 100 --remove 0 --node proxmox2 --notes-template '{{guestname}}' --storage cbmp --mode snapshot
INFO: Starting Backup of VM 100 (qemu)
INFO: Backup started at 2022-07-12 17:06:50
INFO: status = stopped
INFO: backup mode: stop
INFO: ionice priority: 7
INFO: VM Name: 2012R2-RDS
INFO: include disk 'virtio0' 'lvm:vm-100-disk-0' 430G
INFO: include disk 'virtio1' 'lvm:vm-100-disk-1' 250G
INFO: creating Proxmox Backup Server archive 'vm/100/2022-07-12T07:36:50Z'
INFO: starting kvm to execute backup task
INFO: started backup task 'cb7caba7-d43c-4111-a90c-f6863c40e3da'
INFO: virtio0: dirty-bitmap status: created new
INFO: virtio1: dirty-bitmap status: created new
INFO: 0% (508.0 MiB of 680.0 GiB) in 3s, read: 169.3 MiB/s, write: 126.7 MiB/s
INFO: 1% (6.9 GiB of 680.0 GiB) in 1m 27s, read: 78.4 MiB/s, write: 75.6 MiB/s
INFO: 2% (13.6 GiB of 680.0 GiB) in 3m 5s, read: 69.9 MiB/s, write: 69.9 MiB/s
INFO: 3% (20.4 GiB of 680.0 GiB) in 6m 30s, read: 33.9 MiB/s, write: 33.9 MiB/s
INFO: 4% (27.2 GiB of 680.0 GiB) in 9m 10s, read: 43.7 MiB/s, write: 43.7 MiB/s
INFO: 5% (34.0 GiB of 680.0 GiB) in 10m 41s, read: 76.4 MiB/s, write: 76.4 MiB/s
INFO: 6% (40.8 GiB of 680.0 GiB) in 12m 47s, read: 55.4 MiB/s, write: 55.4 MiB/s
INFO: 7% (47.7 GiB of 680.0 GiB) in 16m 30s, read: 31.5 MiB/s, write: 31.5 MiB/s
INFO: 8% (54.4 GiB of 680.0 GiB) in 19m 20s, read: 40.5 MiB/s, write: 40.5 MiB/s
INFO: 9% (61.2 GiB of 680.0 GiB) in 22m 28s, read: 37.2 MiB/s, write: 37.2 MiB/s
INFO: 10% (68.0 GiB of 680.0 GiB) in 24m 27s, read: 58.4 MiB/s, write: 58.4 MiB/s
INFO: 11% (74.8 GiB of 680.0 GiB) in 27m 9s, read: 43.0 MiB/s, write: 43.0 MiB/s
INFO: 12% (81.6 GiB of 680.0 GiB) in 29m 39s, read: 46.3 MiB/s, write: 46.3 MiB/s
INFO: 13% (88.4 GiB of 680.0 GiB) in 33m 55s, read: 27.2 MiB/s, write: 27.2 MiB/s
INFO: 14% (95.2 GiB of 680.0 GiB) in 37m 12s, read: 35.4 MiB/s, write: 35.4 MiB/s
INFO: 15% (102.0 GiB of 680.0 GiB) in 39m 46s, read: 45.4 MiB/s, write: 45.4 MiB/s
INFO: 16% (108.8 GiB of 680.0 GiB) in 42m 18s, read: 45.6 MiB/s, write: 45.6 MiB/s
INFO: 17% (115.6 GiB of 680.0 GiB) in 45m 33s, read: 35.7 MiB/s, write: 35.7 MiB/s
INFO: 18% (122.4 GiB of 680.0 GiB) in 47m 12s, read: 70.6 MiB/s, write: 70.6 MiB/s
INFO: 19% (129.2 GiB of 680.0 GiB) in 48m 48s, read: 72.5 MiB/s, write: 72.5 MiB/s
INFO: 20% (136.0 GiB of 680.0 GiB) in 53m 14s, read: 26.1 MiB/s, write: 26.1 MiB/s
INFO: 21% (142.8 GiB of 680.0 GiB) in 55m 8s, read: 61.2 MiB/s, write: 61.2 MiB/s
INFO: 22% (149.6 GiB of 680.0 GiB) in 56m 43s, read: 73.1 MiB/s, write: 73.1 MiB/s
INFO: 23% (156.4 GiB of 680.0 GiB) in 1h 1m 23s, read: 24.9 MiB/s, write: 24.9 MiB/s
INFO: 24% (163.2 GiB of 680.0 GiB) in 1h 2m 38s, read: 92.5 MiB/s, write: 92.5 MiB/s
INFO: 25% (170.0 GiB of 680.0 GiB) in 1h 5m 4s, read: 47.7 MiB/s, write: 47.7 MiB/s
INFO: 26% (176.8 GiB of 680.0 GiB) in 1h 6m 57s, read: 62.0 MiB/s, write: 62.0 MiB/s
INFO: 27% (183.7 GiB of 680.0 GiB) in 1h 8m 6s, read: 101.5 MiB/s, write: 101.5 MiB/s
INFO: 28% (190.5 GiB of 680.0 GiB) in 1h 9m 26s, read: 87.2 MiB/s, write: 87.2 MiB/s
INFO: 29% (197.2 GiB of 680.0 GiB) in 1h 11m 18s, read: 61.4 MiB/s, write: 61.4 MiB/s
INFO: 30% (204.0 GiB of 680.0 GiB) in 1h 14m 23s, read: 37.6 MiB/s, write: 37.6 MiB/s
INFO: 31% (210.8 GiB of 680.0 GiB) in 1h 16m 45s, read: 49.0 MiB/s, write: 49.0 MiB/s
INFO: 32% (217.6 GiB of 680.0 GiB) in 1h 20m 44s, read: 29.2 MiB/s, write: 29.2 MiB/s
INFO: 33% (224.5 GiB of 680.0 GiB) in 1h 22m 13s, read: 78.9 MiB/s, write: 78.9 MiB/s
INFO: 34% (231.2 GiB of 680.0 GiB) in 1h 24m 20s, read: 54.5 MiB/s, write: 54.5 MiB/s
INFO: 35% (238.0 GiB of 680.0 GiB) in 1h 27m 15s, read: 39.7 MiB/s, write: 39.7 MiB/s
INFO: 36% (244.9 GiB of 680.0 GiB) in 1h 28m 10s, read: 128.5 MiB/s, write: 128.5 MiB/s
INFO: 37% (251.6 GiB of 680.0 GiB) in 1h 31m 38s, read: 33.0 MiB/s, write: 32.6 MiB/s
INFO: 38% (258.5 GiB of 680.0 GiB) in 1h 33m 47s, read: 54.3 MiB/s, write: 54.0 MiB/s
INFO: 39% (265.2 GiB of 680.0 GiB) in 1h 35m 55s, read: 54.2 MiB/s, write: 53.6 MiB/s
INFO: 40% (272.0 GiB of 680.0 GiB) in 1h 37m 56s, read: 57.7 MiB/s, write: 57.6 MiB/s
INFO: 41% (278.8 GiB of 680.0 GiB) in 1h 40m 1s, read: 55.5 MiB/s, write: 55.3 MiB/s
INFO: 42% (285.6 GiB of 680.0 GiB) in 1h 41m 59s, read: 58.8 MiB/s, write: 58.5 MiB/s
INFO: 43% (292.5 GiB of 680.0 GiB) in 1h 43m 56s, read: 60.0 MiB/s, write: 59.8 MiB/s
INFO: 44% (299.3 GiB of 680.0 GiB) in 1h 45m 54s, read: 59.0 MiB/s, write: 59.0 MiB/s
INFO: 45% (306.0 GiB of 680.0 GiB) in 1h 47m 52s, read: 58.5 MiB/s, write: 58.4 MiB/s
INFO: 46% (312.8 GiB of 680.0 GiB) in 1h 50m 3s, read: 53.3 MiB/s, write: 53.0 MiB/s
INFO: 47% (319.7 GiB of 680.0 GiB) in 1h 52m 10s, read: 55.2 MiB/s, write: 55.1 MiB/s
INFO: 48% (326.4 GiB of 680.0 GiB) in 1h 55m 14s, read: 37.7 MiB/s, write: 37.6 MiB/s
INFO: 49% (333.3 GiB of 680.0 GiB) in 1h 58m 12s, read: 39.2 MiB/s, write: 39.1 MiB/s
INFO: 50% (340.0 GiB of 680.0 GiB) in 2h 1m 16s, read: 37.6 MiB/s, write: 37.5 MiB/s
INFO: 51% (346.8 GiB of 680.0 GiB) in 2h 4m 40s, read: 34.2 MiB/s, write: 34.1 MiB/s
INFO: 52% (353.6 GiB of 680.0 GiB) in 2h 7m 45s, read: 37.6 MiB/s, write: 37.4 MiB/s
INFO: 53% (360.4 GiB of 680.0 GiB) in 2h 10m 55s, read: 36.7 MiB/s, write: 36.6 MiB/s
INFO: 54% (367.2 GiB of 680.0 GiB) in 2h 14m 34s, read: 31.9 MiB/s, write: 31.7 MiB/s
INFO: 55% (374.0 GiB of 680.0 GiB) in 2h 17m 6s, read: 45.7 MiB/s, write: 45.5 MiB/s
INFO: 56% (380.8 GiB of 680.0 GiB) in 2h 20m 6s, read: 38.6 MiB/s, write: 38.4 MiB/s
INFO: 57% (387.7 GiB of 680.0 GiB) in 2h 23m 13s, read: 37.6 MiB/s, write: 37.4 MiB/s
INFO: 58% (394.4 GiB of 680.0 GiB) in 2h 26m 20s, read: 37.0 MiB/s, write: 36.8 MiB/s
INFO: 59% (401.2 GiB of 680.0 GiB) in 2h 29m 39s, read: 35.0 MiB/s, write: 34.9 MiB/s
INFO: 60% (408.0 GiB of 680.0 GiB) in 2h 32m 57s, read: 35.1 MiB/s, write: 34.9 MiB/s
INFO: 61% (414.8 GiB of 680.0 GiB) in 2h 35m 45s, read: 41.5 MiB/s, write: 40.9 MiB/s
INFO: 62% (421.6 GiB of 680.0 GiB) in 2h 39m 20s, read: 32.5 MiB/s, write: 32.3 MiB/s
INFO: 63% (428.4 GiB of 680.0 GiB) in 2h 42m 31s, read: 36.4 MiB/s, write: 36.3 MiB/s
INFO: 64% (435.2 GiB of 680.0 GiB) in 2h 45m 35s, read: 37.9 MiB/s, write: 37.7 MiB/s
INFO: 65% (442.0 GiB of 680.0 GiB) in 2h 48m 29s, read: 40.0 MiB/s, write: 39.8 MiB/s
INFO: 66% (448.8 GiB of 680.0 GiB) in 2h 50m 44s, read: 51.8 MiB/s, write: 51.1 MiB/s
INFO: 67% (455.6 GiB of 680.0 GiB) in 2h 53m 32s, read: 41.3 MiB/s, write: 41.2 MiB/s
INFO: 68% (462.4 GiB of 680.0 GiB) in 2h 56m 54s, read: 34.5 MiB/s, write: 34.4 MiB/s
INFO: 69% (469.2 GiB of 680.0 GiB) in 3h 9s, read: 35.6 MiB/s, write: 35.4 MiB/s
INFO: 70% (476.0 GiB of 680.0 GiB) in 3h 3m 3s, read: 40.3 MiB/s, write: 40.1 MiB/s
INFO: 71% (482.8 GiB of 680.0 GiB) in 3h 6m 43s, read: 31.5 MiB/s, write: 31.4 MiB/s
INFO: 72% (489.6 GiB of 680.0 GiB) in 3h 9m 46s, read: 38.1 MiB/s, write: 38.0 MiB/s
INFO: 73% (496.4 GiB of 680.0 GiB) in 3h 12m 23s, read: 44.2 MiB/s, write: 44.1 MiB/s
INFO: 74% (503.3 GiB of 680.0 GiB) in 3h 15m 2s, read: 44.1 MiB/s, write: 44.0 MiB/s
INFO: 75% (510.0 GiB of 680.0 GiB) in 3h 17m 10s, read: 54.3 MiB/s, write: 54.2 MiB/s
INFO: 76% (516.8 GiB of 680.0 GiB) in 3h 19m 28s, read: 50.2 MiB/s, write: 49.9 MiB/s
INFO: 77% (523.6 GiB of 680.0 GiB) in 3h 22m 22s, read: 40.0 MiB/s, write: 39.8 MiB/s
INFO: 78% (530.4 GiB of 680.0 GiB) in 3h 25m 43s, read: 34.7 MiB/s, write: 34.2 MiB/s
INFO: 79% (537.2 GiB of 680.0 GiB) in 3h 27m 50s, read: 55.0 MiB/s, write: 52.9 MiB/s
INFO: 80% (544.0 GiB of 680.0 GiB) in 3h 30m 30s, read: 43.4 MiB/s, write: 42.1 MiB/s
INFO: 81% (550.8 GiB of 680.0 GiB) in 3h 33m 36s, read: 37.4 MiB/s, write: 37.0 MiB/s
INFO: 82% (557.6 GiB of 680.0 GiB) in 3h 35m 59s, read: 48.6 MiB/s, write: 48.4 MiB/s
INFO: 83% (564.4 GiB of 680.0 GiB) in 3h 38m 17s, read: 50.4 MiB/s, write: 50.2 MiB/s
INFO: 84% (571.2 GiB of 680.0 GiB) in 3h 40m 39s, read: 49.2 MiB/s, write: 48.9 MiB/s
INFO: 85% (578.0 GiB of 680.0 GiB) in 3h 43m, read: 49.2 MiB/s, write: 49.1 MiB/s
INFO: 86% (584.8 GiB of 680.0 GiB) in 3h 45m 26s, read: 47.6 MiB/s, write: 47.5 MiB/s
INFO: 87% (591.7 GiB of 680.0 GiB) in 3h 47m 33s, read: 55.3 MiB/s, write: 55.2 MiB/s
INFO: 88% (598.4 GiB of 680.0 GiB) in 3h 49m 29s, read: 59.9 MiB/s, write: 59.9 MiB/s
INFO: 89% (605.2 GiB of 680.0 GiB) in 3h 51m 17s, read: 64.5 MiB/s, write: 64.5 MiB/s
INFO: 90% (612.1 GiB of 680.0 GiB) in 3h 53m 21s, read: 56.7 MiB/s, write: 56.6 MiB/s
INFO: 91% (618.9 GiB of 680.0 GiB) in 3h 54m 47s, read: 81.3 MiB/s, write: 81.3 MiB/s
INFO: 92% (625.6 GiB of 680.0 GiB) in 3h 56m 3s, read: 89.8 MiB/s, write: 89.8 MiB/s
INFO: 93% (632.4 GiB of 680.0 GiB) in 3h 58m 2s, read: 58.7 MiB/s, write: 58.7 MiB/s
INFO: 94% (639.2 GiB of 680.0 GiB) in 4h 1m 58s, read: 29.5 MiB/s, write: 29.4 MiB/s
INFO: 95% (646.1 GiB of 680.0 GiB) in 4h 5m 34s, read: 32.5 MiB/s, write: 31.9 MiB/s
INFO: 96% (652.8 GiB of 680.0 GiB) in 4h 8m 59s, read: 33.8 MiB/s, write: 32.1 MiB/s
INFO: 97% (659.6 GiB of 680.0 GiB) in 4h 12m 19s, read: 34.6 MiB/s, write: 34.4 MiB/s
INFO: 98% (666.4 GiB of 680.0 GiB) in 4h 15m 52s, read: 32.9 MiB/s, write: 32.4 MiB/s
INFO: 99% (673.2 GiB of 680.0 GiB) in 4h 19m 39s, read: 30.5 MiB/s, write: 25.9 MiB/s
 
is the task still running? also on the pbs side?
is there process still running (e.g. check with the 'ps' tool or 'top' or similar)
 
What is the process called? There is a vzdump process.

Code: 
root     66007  0.0  0.0      0     0 ?        I    17:30   0:00  \_ [kworker/u163:2-events_unbound]
root         1  0.0  0.0 165636  9888 ?        Ss   Jul05   1:00 /lib/systemd/systemd --system --deserialize 31
_rpc       990  0.0  0.0   6816  3492 ?        Ss   Jul05   0:01 /sbin/rpcbind -f -w
root      1007  0.0  0.0   2136   744 ?        Ss   Jul05   0:24 /usr/sbin/watchdog-mux
root      1008  0.0  0.0 150864  2020 ?        Ssl  Jul05   0:00 /usr/bin/lxcfs /var/lib/lxcfs
root      1010  0.0  0.0  19532  7424 ?        Ss   Jul05   0:05 /lib/systemd/systemd-logind
message+  1021  0.0  0.0   9196  4288 ?        Ss   Jul05   0:08 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --
root      1156  0.0  0.0   7304  2116 ?        Ss   Jul05   0:00 /usr/lib/x86_64-linux-gnu/lxc/lxc-monitord --daemon
root      1221  0.0  0.0   5604  1540 tty1     Ss+  Jul05   0:00 /sbin/agetty -o -p -- \u --noclear tty1 linux
root      1395  0.2  0.0 265704 93888 ?        Ss   Jul05  34:19 pve-firewall
root      1397  0.8  0.0 268964 97944 ?        Ss   Jul05 108:20 pvestatd
root      1424  0.0  0.0 347424 89972 ?        Ss   Jul05   0:13 pvedaemon
root     55090  0.0  0.0 357956 106328 ?       S    Jul08   0:19  \_ pvedaemon worker
root     18939  0.0  0.0 356160 101040 ?       S    Jul12   0:13  \_ pvedaemon worker
root     65968  0.0  0.0 356160 96248 ?        Ss   17:30   0:00  |   \_ task UPIDroxmox2:000101B0:0499139A:62CFCD26:vncshell::root@pam
root     65969  0.0  0.0  91180  8068 ?        S    17:30   0:00  |       \_ /usr/bin/termproxy 5900 --path /nodes/proxmox2 --perm Sys.Co
root     65973  0.0  0.0   7088  4432 pts/0    Ss   17:30   0:00  |           \_ /bin/login -f
root     66002  0.0  0.0   7852  4644 pts/0    S    17:30   0:00  |               \_ -bash
root     66762  0.0  0.0  10376  3948 pts/0    R+   17:31   0:00  |                   \_ ps axuf
root     48531  0.2  0.0 355880 97200 ?        S    17:03   0:03  \_ pvedaemon worker
www-data  1435  0.0  0.0 348936 148804 ?       Ss   Jul05   0:28 pveproxy
www-data 44677  0.1  0.0 362052 139660 ?       S    16:57   0:02  \_ pveproxy worker
www-data 55417  0.2  0.0 357452 133544 ?       S    17:14   0:02  \_ pveproxy worker
www-data 60851  0.0  0.0 357436 132324 ?       S    17:22   0:00  \_ pveproxy worker
www-data  1442  0.0  0.0  74304 60464 ?        Ss   Jul05   0:15 spiceproxy
www-data  3485  0.0  0.0  74556 53248 ?        S    Jul13   0:04  \_ spiceproxy worker
statd     1503  0.0  0.0  57896 43992 ?        Ss   Jul05   0:00 /sbin/rpc.statd --no-notify
root     48973  0.0  0.0 216348 158888 ?       Ss   Jul07   0:59 /lib/systemd/systemd-journald
root     55629  0.0  0.0  11036  4000 ?        Ss   Jul07   0:00 /usr/sbin/smartd -n
root     55710  0.0  0.0   6952  2308 ?        S    Jul07   0:19 /bin/bash /usr/sbin/ksmtuned
root     66335  0.0  0.0   5296   512 ?        S    17:31   0:00  \_ sleep 60
systemd+ 57417  0.0  0.0  88372  4964 ?        Ssl  Jul07   0:01 /lib/systemd/systemd-timesyncd
root     57460  0.0  0.0  21672  4648 ?        Ss   Jul07   0:02 /lib/systemd/systemd-udevd
root     57598  0.0  0.0 2712012 3252 ?        Ssl  Jul07   0:00 /usr/lib/x86_64-linux-gnu/pve-lxc-syscalld/pve-lxc-syscalld --system /ru
root     57818  0.0  0.0   6676  2644 ?        Ss   Jul07   0:02 /usr/sbin/cron -f
root     57882  0.0  0.0 220732  4428 ?        Ssl  Jul07   0:22 /usr/sbin/rsyslogd -n -iNONE
root     58203  0.0  0.0  11484   528 ?        Ss   Jul07   0:15 /sbin/iscsid
root     58204  0.0  0.0  11988 11856 ?        S<Ls Jul07   0:00 /sbin/iscsid
root     62501  0.0  0.0  39976  3164 ?        Ss   Jul07   0:03 /usr/lib/postfix/sbin/master -w
postfix  62503  0.0  0.0  40428  3800 ?        S    Jul07   0:00  \_ qmgr -l -t unix -u
postfix  40700  0.0  0.0  40240  6816 ?        S    16:51   0:00  \_ pickup -l -t unix -u -c
root      8966  0.0  0.0  13284  6224 ?        Ss   Jul07   0:00 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups
root     10968  0.0  0.0 726852  3684 ?        Ssl  Jul07   3:09 /usr/bin/rrdcached -B -b /var/lib/rrdcached/db/ -j /var/lib/rrdcached/jo
root     11132  0.0  0.0  98448  3604 ?        Ssl  Jul07   0:00 /usr/sbin/zed -F
root     11728  0.0  0.0  80368 33344 ?        SLsl Jul07   0:34 /sbin/dmeventd -f
root     11905  0.1  0.0 596752 68048 ?        Ssl  Jul07  10:21 /usr/bin/pmxcfs
root     12206  0.0  0.0   4196  1500 ?        Ss   Jul07   0:00 /usr/sbin/qmeventd /var/run/qmeventd.sock
root     12359  0.0  0.0 326872 80412 ?        Ss   Jul07   0:45 pvescheduler
root     20683  0.0  0.0 332052 57196 ?        Ss   Jul07   2:00 pve-ha-lrm
root     20691  0.0  0.0 332348 46504 ?        Ss   Jul07   1:09 pve-ha-crm
root     61014  0.1  0.0 365348 107656 ?       Ss   Jul12   5:19 task UPIDroxmox2:0000EE56:038F3998:62CD2491:vzdump:100:root@pam:
root     61038  4.7  0.1 208685524 260588 ?    Sl   Jul12 137:22 /usr/bin/kvm -id 100 -name 2012R2-RDS -no-shutdown -chardev socket,id=qm
root     38540  0.0  0.0  80132  2344 ?        Ssl  00:01   0:07 /usr/sbin/pvefw-logger
root     65985  0.2  0.0  15352  8332 ?        Ss   17:30   0:00 /lib/systemd/systemd --user
root     65987  0.0  0.0 168588  3640 ?        S    17:30   0:00  \_ (sd-pam)
root@proxmox2:~#
 
Last edited:
ok is the task still running on the pbs side?
also can you post the output of 'ps faxl' in 'code' tags? (otherwise it's really hard to read because of formatting)
 
Also keep in mind that backups jobs running longer than 24 hours can be problematic. I think I remember a thread where the GC removed chunks because they are only protected for 24 hours and 5 minutes and the GC job won't update the atime until the job is done with a complete index file. So the storage should be picked fast enough to finish in under 24h. But if just the initial backup takes that long it might be enough to just temporarily disable the GC jobs.
 
dcsapak said:
ok is the task still running on the pbs side?
also can you post the output of 'ps faxl' in 'code' tags? (otherwise it's really hard to read because of formatting)
Click to expand...
Code: 
4     0       1       0  20   0 165436 10740 do_epo Ss   ?          0:11 /sbin/init
4     0     341       1  20   0  48288 28264 do_epo Ss   ?          0:05 /lib/systemd/systemd-journald
4     0     361       1  20   0  22904  4832 do_epo Ss   ?          0:01 /lib/systemd/systemd-udevd
4   103     536       1  20   0   7840  3696 do_sys Ss   ?          0:01 /sbin/rpcbind -f -w
4   102     538       1  20   0   8172  4008 do_epo Ss   ?          0:03 /usr/bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activ
4     0     541       1  20   0  11044  5132 hrtime Ss   ?          0:00 /usr/sbin/smartd -n
4     0     542       1  20   0  22168  7008 do_epo Ss   ?          0:01 /lib/systemd/systemd-logind
4     0     544       1  20   0  98456  4276 cv_wai Ssl  ?          0:00 /usr/sbin/zed -F
1     0     641       1  20   0  11492   584 hrtime Ss   ?          0:37 /sbin/iscsid
5     0     642       1  10 -10  11996 11864 do_sys S<Ls ?          0:00 /sbin/iscsid
4     0     644       1  20   0  13292  7636 do_sel Ss   ?          0:00 sshd: /usr/sbin/sshd -D [listener] 0 of 10-100 startups
4     0     647       1  20   0   6684  2884 hrtime Ss   ?          0:01 /usr/sbin/cron -f
4     0     649       1  20   0   5784  1532 do_sel Ss+  tty1       0:00 /sbin/agetty -o -p -- \u --noclear tty1 linux
5   101     665       1  20   0  18972  3624 do_sel S    ?          0:01 /usr/sbin/chronyd -F 1
1   101     667     665  20   0  10780  3016 skb_wa S    ?          0:00  \_ /usr/sbin/chronyd -F 1
5     0     786       1  20   0  39988  5024 do_epo Ss   ?          0:05 /usr/lib/postfix/sbin/master -w
4   106     788     786  20   0  40432  6512 do_epo S    ?          0:01  \_ qmgr -l -t unix -u
4   106   99203     786  20   0  40244  6832 do_epo S    ?          0:00  \_ pickup -l -t unix -u -c
4     0   62105       1  20   0 220740  3856 do_sel Ssl  ?          0:00 /usr/sbin/rsyslogd -n -iNONE
4     0   70404       1  20   0 307308 22732 futex_ Ssl  ?         33:21 /usr/lib/x86_64-linux-gnu/proxmox-backup/proxmox-backup-api
0     0   99253   70404  20   0  91196  8008 -      S    ?          0:00  \_ /usr/bin/termproxy 19 --path /system --perm Sys.Console --authport 82 --port-as-f
4     0   99255   99253  20   0  10092  4748 do_wai Ss   pts/0      0:00      \_ login -f
4     0   99277   99255  20   0   7860  4640 do_wai S    pts/0      0:00          \_ -bash
4     0   99280   99277  20   0   9768  3256 -      R+   pts/0      0:00              \_ ps faxl
0    34   70405       1  20   0 2134684 59012 futex_ Ssl ?        232:50 /usr/lib/x86_64-linux-gnu/proxmox-backup/proxmox-backup-proxy
5     0   82745       1   0 -20   2316  1556 skb_wa S<   ?          0:04 /usr/sbin/atopacctd
4     0   95753       1   0 -20   9092  8468 do_sys S<Ls ?          0:03 /usr/bin/atop -R -w /var/log/atop/atop_20220714 600
4     0   99262       1  20   0  15248  8404 do_epo Ss   ?          0:00 /lib/systemd/systemd --user
5     0   99263   99262  20   0 168388  3420 do_sig S    ?          0:00  \_ (sd-pam)
 
Last edited:
Dunuin said:
Also keep in mind that backups jobs running longer than 24 hours can be problematic. I think I remember a thread where the GC removed chunks because they are only protected for 24 hours and 5 minutes and the GC job won't update the atime until the job is done with a complete index file. So the storage should be picked fast enough to finish in under 24h. But if just the initial backup takes that long it might be enough to just temporarily disable the GC jobs.
Click to expand...
It was on target to finish inside of 5 hours.
 
mjoconr said:
Hi

Is this the task log you want:

It's a KVM image running windows.

INFO: starting new backup job: vzdump 100 --remove 0 --node proxmox2 --notes-template '{{guestname}}' --storage cbmp --mode snapshot
INFO: Starting Backup of VM 100 (qemu)
INFO: Backup started at 2022-07-12 17:06:50
INFO: status = stopped
INFO: backup mode: stop
INFO: ionice priority: 7
INFO: VM Name: 2012R2-RDS
INFO: include disk 'virtio0' 'lvm:vm-100-disk-0' 430G
INFO: include disk 'virtio1' 'lvm:vm-100-disk-1' 250G
INFO: creating Proxmox Backup Server archive 'vm/100/2022-07-12T07:36:50Z'
INFO: starting kvm to execute backup task
INFO: started backup task 'cb7caba7-d43c-4111-a90c-f6863c40e3da'
INFO: virtio0: dirty-bitmap status: created new
INFO: virtio1: dirty-bitmap status: created new
INFO: 0% (508.0 MiB of 680.0 GiB) in 3s, read: 169.3 MiB/s, write: 126.7 MiB/s
INFO: 1% (6.9 GiB of 680.0 GiB) in 1m 27s, read: 78.4 MiB/s, write: 75.6 MiB/s
INFO: 2% (13.6 GiB of 680.0 GiB) in 3m 5s, read: 69.9 MiB/s, write: 69.9 MiB/s
INFO: 3% (20.4 GiB of 680.0 GiB) in 6m 30s, read: 33.9 MiB/s, write: 33.9 MiB/s
INFO: 4% (27.2 GiB of 680.0 GiB) in 9m 10s, read: 43.7 MiB/s, write: 43.7 MiB/s
INFO: 5% (34.0 GiB of 680.0 GiB) in 10m 41s, read: 76.4 MiB/s, write: 76.4 MiB/s
INFO: 6% (40.8 GiB of 680.0 GiB) in 12m 47s, read: 55.4 MiB/s, write: 55.4 MiB/s
INFO: 7% (47.7 GiB of 680.0 GiB) in 16m 30s, read: 31.5 MiB/s, write: 31.5 MiB/s
INFO: 8% (54.4 GiB of 680.0 GiB) in 19m 20s, read: 40.5 MiB/s, write: 40.5 MiB/s
INFO: 9% (61.2 GiB of 680.0 GiB) in 22m 28s, read: 37.2 MiB/s, write: 37.2 MiB/s
INFO: 10% (68.0 GiB of 680.0 GiB) in 24m 27s, read: 58.4 MiB/s, write: 58.4 MiB/s
INFO: 11% (74.8 GiB of 680.0 GiB) in 27m 9s, read: 43.0 MiB/s, write: 43.0 MiB/s
INFO: 12% (81.6 GiB of 680.0 GiB) in 29m 39s, read: 46.3 MiB/s, write: 46.3 MiB/s
INFO: 13% (88.4 GiB of 680.0 GiB) in 33m 55s, read: 27.2 MiB/s, write: 27.2 MiB/s
INFO: 14% (95.2 GiB of 680.0 GiB) in 37m 12s, read: 35.4 MiB/s, write: 35.4 MiB/s
INFO: 15% (102.0 GiB of 680.0 GiB) in 39m 46s, read: 45.4 MiB/s, write: 45.4 MiB/s
INFO: 16% (108.8 GiB of 680.0 GiB) in 42m 18s, read: 45.6 MiB/s, write: 45.6 MiB/s
INFO: 17% (115.6 GiB of 680.0 GiB) in 45m 33s, read: 35.7 MiB/s, write: 35.7 MiB/s
INFO: 18% (122.4 GiB of 680.0 GiB) in 47m 12s, read: 70.6 MiB/s, write: 70.6 MiB/s
INFO: 19% (129.2 GiB of 680.0 GiB) in 48m 48s, read: 72.5 MiB/s, write: 72.5 MiB/s
INFO: 20% (136.0 GiB of 680.0 GiB) in 53m 14s, read: 26.1 MiB/s, write: 26.1 MiB/s
INFO: 21% (142.8 GiB of 680.0 GiB) in 55m 8s, read: 61.2 MiB/s, write: 61.2 MiB/s
INFO: 22% (149.6 GiB of 680.0 GiB) in 56m 43s, read: 73.1 MiB/s, write: 73.1 MiB/s
INFO: 23% (156.4 GiB of 680.0 GiB) in 1h 1m 23s, read: 24.9 MiB/s, write: 24.9 MiB/s
INFO: 24% (163.2 GiB of 680.0 GiB) in 1h 2m 38s, read: 92.5 MiB/s, write: 92.5 MiB/s
INFO: 25% (170.0 GiB of 680.0 GiB) in 1h 5m 4s, read: 47.7 MiB/s, write: 47.7 MiB/s
INFO: 26% (176.8 GiB of 680.0 GiB) in 1h 6m 57s, read: 62.0 MiB/s, write: 62.0 MiB/s
INFO: 27% (183.7 GiB of 680.0 GiB) in 1h 8m 6s, read: 101.5 MiB/s, write: 101.5 MiB/s
INFO: 28% (190.5 GiB of 680.0 GiB) in 1h 9m 26s, read: 87.2 MiB/s, write: 87.2 MiB/s
INFO: 29% (197.2 GiB of 680.0 GiB) in 1h 11m 18s, read: 61.4 MiB/s, write: 61.4 MiB/s
INFO: 30% (204.0 GiB of 680.0 GiB) in 1h 14m 23s, read: 37.6 MiB/s, write: 37.6 MiB/s
INFO: 31% (210.8 GiB of 680.0 GiB) in 1h 16m 45s, read: 49.0 MiB/s, write: 49.0 MiB/s
INFO: 32% (217.6 GiB of 680.0 GiB) in 1h 20m 44s, read: 29.2 MiB/s, write: 29.2 MiB/s
INFO: 33% (224.5 GiB of 680.0 GiB) in 1h 22m 13s, read: 78.9 MiB/s, write: 78.9 MiB/s
INFO: 34% (231.2 GiB of 680.0 GiB) in 1h 24m 20s, read: 54.5 MiB/s, write: 54.5 MiB/s
INFO: 35% (238.0 GiB of 680.0 GiB) in 1h 27m 15s, read: 39.7 MiB/s, write: 39.7 MiB/s
INFO: 36% (244.9 GiB of 680.0 GiB) in 1h 28m 10s, read: 128.5 MiB/s, write: 128.5 MiB/s
INFO: 37% (251.6 GiB of 680.0 GiB) in 1h 31m 38s, read: 33.0 MiB/s, write: 32.6 MiB/s
INFO: 38% (258.5 GiB of 680.0 GiB) in 1h 33m 47s, read: 54.3 MiB/s, write: 54.0 MiB/s
INFO: 39% (265.2 GiB of 680.0 GiB) in 1h 35m 55s, read: 54.2 MiB/s, write: 53.6 MiB/s
INFO: 40% (272.0 GiB of 680.0 GiB) in 1h 37m 56s, read: 57.7 MiB/s, write: 57.6 MiB/s
INFO: 41% (278.8 GiB of 680.0 GiB) in 1h 40m 1s, read: 55.5 MiB/s, write: 55.3 MiB/s
INFO: 42% (285.6 GiB of 680.0 GiB) in 1h 41m 59s, read: 58.8 MiB/s, write: 58.5 MiB/s
INFO: 43% (292.5 GiB of 680.0 GiB) in 1h 43m 56s, read: 60.0 MiB/s, write: 59.8 MiB/s
INFO: 44% (299.3 GiB of 680.0 GiB) in 1h 45m 54s, read: 59.0 MiB/s, write: 59.0 MiB/s
INFO: 45% (306.0 GiB of 680.0 GiB) in 1h 47m 52s, read: 58.5 MiB/s, write: 58.4 MiB/s
INFO: 46% (312.8 GiB of 680.0 GiB) in 1h 50m 3s, read: 53.3 MiB/s, write: 53.0 MiB/s
INFO: 47% (319.7 GiB of 680.0 GiB) in 1h 52m 10s, read: 55.2 MiB/s, write: 55.1 MiB/s
INFO: 48% (326.4 GiB of 680.0 GiB) in 1h 55m 14s, read: 37.7 MiB/s, write: 37.6 MiB/s
INFO: 49% (333.3 GiB of 680.0 GiB) in 1h 58m 12s, read: 39.2 MiB/s, write: 39.1 MiB/s
INFO: 50% (340.0 GiB of 680.0 GiB) in 2h 1m 16s, read: 37.6 MiB/s, write: 37.5 MiB/s
INFO: 51% (346.8 GiB of 680.0 GiB) in 2h 4m 40s, read: 34.2 MiB/s, write: 34.1 MiB/s
INFO: 52% (353.6 GiB of 680.0 GiB) in 2h 7m 45s, read: 37.6 MiB/s, write: 37.4 MiB/s
INFO: 53% (360.4 GiB of 680.0 GiB) in 2h 10m 55s, read: 36.7 MiB/s, write: 36.6 MiB/s
INFO: 54% (367.2 GiB of 680.0 GiB) in 2h 14m 34s, read: 31.9 MiB/s, write: 31.7 MiB/s
INFO: 55% (374.0 GiB of 680.0 GiB) in 2h 17m 6s, read: 45.7 MiB/s, write: 45.5 MiB/s
INFO: 56% (380.8 GiB of 680.0 GiB) in 2h 20m 6s, read: 38.6 MiB/s, write: 38.4 MiB/s
INFO: 57% (387.7 GiB of 680.0 GiB) in 2h 23m 13s, read: 37.6 MiB/s, write: 37.4 MiB/s
INFO: 58% (394.4 GiB of 680.0 GiB) in 2h 26m 20s, read: 37.0 MiB/s, write: 36.8 MiB/s
INFO: 59% (401.2 GiB of 680.0 GiB) in 2h 29m 39s, read: 35.0 MiB/s, write: 34.9 MiB/s
INFO: 60% (408.0 GiB of 680.0 GiB) in 2h 32m 57s, read: 35.1 MiB/s, write: 34.9 MiB/s
INFO: 61% (414.8 GiB of 680.0 GiB) in 2h 35m 45s, read: 41.5 MiB/s, write: 40.9 MiB/s
INFO: 62% (421.6 GiB of 680.0 GiB) in 2h 39m 20s, read: 32.5 MiB/s, write: 32.3 MiB/s
INFO: 63% (428.4 GiB of 680.0 GiB) in 2h 42m 31s, read: 36.4 MiB/s, write: 36.3 MiB/s
INFO: 64% (435.2 GiB of 680.0 GiB) in 2h 45m 35s, read: 37.9 MiB/s, write: 37.7 MiB/s
INFO: 65% (442.0 GiB of 680.0 GiB) in 2h 48m 29s, read: 40.0 MiB/s, write: 39.8 MiB/s
INFO: 66% (448.8 GiB of 680.0 GiB) in 2h 50m 44s, read: 51.8 MiB/s, write: 51.1 MiB/s
INFO: 67% (455.6 GiB of 680.0 GiB) in 2h 53m 32s, read: 41.3 MiB/s, write: 41.2 MiB/s
INFO: 68% (462.4 GiB of 680.0 GiB) in 2h 56m 54s, read: 34.5 MiB/s, write: 34.4 MiB/s
INFO: 69% (469.2 GiB of 680.0 GiB) in 3h 9s, read: 35.6 MiB/s, write: 35.4 MiB/s
INFO: 70% (476.0 GiB of 680.0 GiB) in 3h 3m 3s, read: 40.3 MiB/s, write: 40.1 MiB/s
INFO: 71% (482.8 GiB of 680.0 GiB) in 3h 6m 43s, read: 31.5 MiB/s, write: 31.4 MiB/s
INFO: 72% (489.6 GiB of 680.0 GiB) in 3h 9m 46s, read: 38.1 MiB/s, write: 38.0 MiB/s
INFO: 73% (496.4 GiB of 680.0 GiB) in 3h 12m 23s, read: 44.2 MiB/s, write: 44.1 MiB/s
INFO: 74% (503.3 GiB of 680.0 GiB) in 3h 15m 2s, read: 44.1 MiB/s, write: 44.0 MiB/s
INFO: 75% (510.0 GiB of 680.0 GiB) in 3h 17m 10s, read: 54.3 MiB/s, write: 54.2 MiB/s
INFO: 76% (516.8 GiB of 680.0 GiB) in 3h 19m 28s, read: 50.2 MiB/s, write: 49.9 MiB/s
INFO: 77% (523.6 GiB of 680.0 GiB) in 3h 22m 22s, read: 40.0 MiB/s, write: 39.8 MiB/s
INFO: 78% (530.4 GiB of 680.0 GiB) in 3h 25m 43s, read: 34.7 MiB/s, write: 34.2 MiB/s
INFO: 79% (537.2 GiB of 680.0 GiB) in 3h 27m 50s, read: 55.0 MiB/s, write: 52.9 MiB/s
INFO: 80% (544.0 GiB of 680.0 GiB) in 3h 30m 30s, read: 43.4 MiB/s, write: 42.1 MiB/s
INFO: 81% (550.8 GiB of 680.0 GiB) in 3h 33m 36s, read: 37.4 MiB/s, write: 37.0 MiB/s
INFO: 82% (557.6 GiB of 680.0 GiB) in 3h 35m 59s, read: 48.6 MiB/s, write: 48.4 MiB/s
INFO: 83% (564.4 GiB of 680.0 GiB) in 3h 38m 17s, read: 50.4 MiB/s, write: 50.2 MiB/s
INFO: 84% (571.2 GiB of 680.0 GiB) in 3h 40m 39s, read: 49.2 MiB/s, write: 48.9 MiB/s
INFO: 85% (578.0 GiB of 680.0 GiB) in 3h 43m, read: 49.2 MiB/s, write: 49.1 MiB/s
INFO: 86% (584.8 GiB of 680.0 GiB) in 3h 45m 26s, read: 47.6 MiB/s, write: 47.5 MiB/s
INFO: 87% (591.7 GiB of 680.0 GiB) in 3h 47m 33s, read: 55.3 MiB/s, write: 55.2 MiB/s
INFO: 88% (598.4 GiB of 680.0 GiB) in 3h 49m 29s, read: 59.9 MiB/s, write: 59.9 MiB/s
INFO: 89% (605.2 GiB of 680.0 GiB) in 3h 51m 17s, read: 64.5 MiB/s, write: 64.5 MiB/s
INFO: 90% (612.1 GiB of 680.0 GiB) in 3h 53m 21s, read: 56.7 MiB/s, write: 56.6 MiB/s
INFO: 91% (618.9 GiB of 680.0 GiB) in 3h 54m 47s, read: 81.3 MiB/s, write: 81.3 MiB/s
INFO: 92% (625.6 GiB of 680.0 GiB) in 3h 56m 3s, read: 89.8 MiB/s, write: 89.8 MiB/s
INFO: 93% (632.4 GiB of 680.0 GiB) in 3h 58m 2s, read: 58.7 MiB/s, write: 58.7 MiB/s
INFO: 94% (639.2 GiB of 680.0 GiB) in 4h 1m 58s, read: 29.5 MiB/s, write: 29.4 MiB/s
INFO: 95% (646.1 GiB of 680.0 GiB) in 4h 5m 34s, read: 32.5 MiB/s, write: 31.9 MiB/s
INFO: 96% (652.8 GiB of 680.0 GiB) in 4h 8m 59s, read: 33.8 MiB/s, write: 32.1 MiB/s
INFO: 97% (659.6 GiB of 680.0 GiB) in 4h 12m 19s, read: 34.6 MiB/s, write: 34.4 MiB/s
INFO: 98% (666.4 GiB of 680.0 GiB) in 4h 15m 52s, read: 32.9 MiB/s, write: 32.4 MiB/s
INFO: 99% (673.2 GiB of 680.0 GiB) in 4h 19m 39s, read: 30.5 MiB/s, write: 25.9 MiB/s
Click to expand...
This is the job on the backup server

2022-07-12T17:06:53+09:30: starting new backup on datastore 'cbmp': "vm/100/2022-07-12T07:36:50Z"
2022-07-12T17:06:53+09:30: GET /previous: 400 Bad Request: no valid previous backup
2022-07-12T17:06:53+09:30: created new fixed index 1 ("vm/100/2022-07-12T07:36:50Z/drive-virtio0.img.fidx")
2022-07-12T17:06:53+09:30: created new fixed index 2 ("vm/100/2022-07-12T07:36:50Z/drive-virtio1.img.fidx")
2022-07-12T17:06:53+09:30: add blob "/media/vm/100/2022-07-12T07:36:50Z/qemu-server.conf.blob" (271 bytes, comp: 271)
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom