backup dauert lange und führt auf der VM zu Problemen.

[drnicolas]

Ich habe beim Backup einer bestimmten Maschine Schwierigkeiten. Auffällig ist, daß das Backup sehr viel länger dauert als bei den anderen Maschinen - knapp über 3h
Die Maschine beherbergt Exchange 2016 und hat an sich genug Disk-Speicher.
Es fällt auch auf, daß während des Backups Exchange Dienste neu gestartet werden und Events geloggt sind, die auf Performance-Probleme hindeuten - was zu dem langen Backup passen würde.
Es werden insgesamt ca. 115GB ge-backupt.




206: 2022-11-16 05:55:54 INFO: Starting Backup of VM 206 (qemu) 206: 2022-11-16 05:55:54 INFO: status = running 206: 2022-11-16 05:55:54 INFO: VM Name: Exchange2013 206: 2022-11-16 05:55:54 INFO: include disk 'scsi0' 'SSD:vm-206-disk-0' 115G 206: 2022-11-16 05:55:54 INFO: backup mode: snapshot 206: 2022-11-16 05:55:54 INFO: ionice priority: 7 206: 2022-11-16 05:55:54 INFO: skip unused drive 'hp-nas-nfs:206/vm-206-disk-0.qcow2' (not included into backup) 206: 2022-11-16 05:55:54 INFO: creating Proxmox Backup Server archive 'vm/206/2022-11-16T04:55:54Z' 206: 2022-11-16 05:55:54 INFO: issuing guest-agent 'fs-freeze' command 206: 2022-11-16 05:56:03 INFO: issuing guest-agent 'fs-thaw' command 206: 2022-11-16 05:56:06 INFO: started backup task 'a19cda70-5de6-415c-9736-b8aac0b8967c' 206: 2022-11-16 05:56:06 INFO: resuming VM again 206: 2022-11-16 05:56:06 INFO: scsi0: dirty-bitmap status: OK (69.7 GiB of 115.0 GiB dirty) 206: 2022-11-16 05:56:06 INFO: using fast incremental mode (dirty-bitmap), 69.7 GiB dirty of 115.0 GiB total 206: 2022-11-16 05:56:09 INFO: 0% (456.0 MiB of 69.7 GiB) in 3s, read: 152.0 MiB/s, write: 152.0 MiB/s 206: 2022-11-16 05:56:46 INFO: 1% (720.0 MiB of 69.7 GiB) in 40s, read: 7.1 MiB/s, write: 7.1 MiB/s 206: 2022-11-16 05:58:15 INFO: 2% (1.4 GiB of 69.7 GiB) in 2m 9s, read: 8.0 MiB/s, write: 8.0 MiB/s 206: 2022-11-16 05:59:44 INFO: 3% (2.1 GiB of 69.7 GiB) in 3m 38s, read: 8.0 MiB/s, write: 8.0 MiB/s 206: 2022-11-16 06:01:19 INFO: 4% (2.8 GiB of 69.7 GiB) in 5m 13s, read: 7.6 MiB/s, write: 7.6 MiB/s 206: 2022-11-16 06:02:41 INFO: 5% (3.5 GiB of 69.7 GiB) in 6m 35s, read: 8.7 MiB/s, write: 8.6 MiB/s 206: 2022-11-16 06:04:06 INFO: 6% (4.2 GiB of 69.7 GiB) in 8m, read: 8.3 MiB/s, write: 8.3 MiB/s 206: 2022-11-16 06:05:32 INFO: 7% (4.9 GiB of 69.7 GiB) in 9m 26s, read: 8.3 MiB/s, write: 8.3 MiB/s 206: 2022-11-16 06:07:01 INFO: 8% (5.6 GiB of 69.7 GiB) in 10m 55s, read: 8.1 MiB/s, write: 8.1 MiB/s 206: 2022-11-16 06:08:36 INFO: 9% (6.3 GiB of 69.7 GiB) in 12m 30s, read: 7.5 MiB/s, write: 7.5 MiB/s 206: 2022-11-16 06:10:21 INFO: 10% (7.0 GiB of 69.7 GiB) in 14m 15s, read: 6.8 MiB/s, write: 6.8 MiB/s 206: 2022-11-16 06:11:59 INFO: 11% (7.7 GiB of 69.7 GiB) in 15m 53s, read: 7.3 MiB/s, write: 7.3 MiB/s 206: 2022-11-16 06:13:42 INFO: 12% (8.4 GiB of 69.7 GiB) in 17m 36s, read: 7.0 MiB/s, write: 7.0 MiB/s 206: 2022-11-16 06:15:26 INFO: 13% (9.1 GiB of 69.7 GiB) in 19m 20s, read: 6.8 MiB/s, write: 6.8 MiB/s 206: 2022-11-16 06:17:16 INFO: 14% (9.8 GiB of 69.7 GiB) in 21m 10s, read: 6.4 MiB/s, write: 6.4 MiB/s 206: 2022-11-16 06:19:01 INFO: 15% (10.5 GiB of 69.7 GiB) in 22m 55s, read: 6.8 MiB/s, write: 6.7 MiB/s 206: 2022-11-16 06:21:14 INFO: 16% (11.2 GiB of 69.7 GiB) in 25m 8s, read: 5.4 MiB/s, write: 5.3 MiB/s 206: 2022-11-16 06:23:19 INFO: 17% (11.9 GiB of 69.7 GiB) in 27m 13s, read: 5.7 MiB/s, write: 5.6 MiB/s 206: 2022-11-16 06:25:28 INFO: 18% (12.6 GiB of 69.7 GiB) in 29m 22s, read: 5.5 MiB/s, write: 5.5 MiB/s 206: 2022-11-16 06:27:50 INFO: 19% (13.2 GiB of 69.7 GiB) in 31m 44s, read: 5.0 MiB/s, write: 5.0 MiB/s 206: 2022-11-16 06:30:42 INFO: 20% (13.9 GiB of 69.7 GiB) in 34m 36s, read: 4.1 MiB/s, write: 4.1 MiB/s 206: 2022-11-16 06:33:42 INFO: 21% (14.6 GiB of 69.7 GiB) in 37m 36s, read: 4.0 MiB/s, write: 4.0 MiB/s 206: 2022-11-16 06:36:40 INFO: 22% (15.3 GiB of 69.7 GiB) in 40m 34s, read: 4.0 MiB/s, write: 4.0 MiB/s 206: 2022-11-16 06:39:32 INFO: 23% (16.0 GiB of 69.7 GiB) in 43m 26s, read: 4.2 MiB/s, write: 4.2 MiB/s 206: 2022-11-16 06:42:15 INFO: 24% (16.7 GiB of 69.7 GiB) in 46m 9s, read: 4.4 MiB/s, write: 4.4 MiB/s 206: 2022-11-16 06:44:58 INFO: 25% (17.4 GiB of 69.7 GiB) in 48m 52s, read: 4.4 MiB/s, write: 4.4 MiB/s 206: 2022-11-16 06:47:56 INFO: 26% (18.1 GiB of 69.7 GiB) in 51m 50s, read: 4.0 MiB/s, write: 4.0 MiB/s 206: 2022-11-16 06:50:56 INFO: 27% (18.8 GiB of 69.7 GiB) in 54m 50s, read: 4.0 MiB/s, write: 4.0 MiB/s 206: 2022-11-16 06:54:36 INFO: 28% (19.5 GiB of 69.7 GiB) in 58m 30s, read: 3.2 MiB/s, write: 3.2 MiB/s 206: 2022-11-16 06:58:16 INFO: 29% (20.2 GiB of 69.7 GiB) in 1h 2m 10s, read: 3.3 MiB/s, write: 3.3 MiB/s 206: 2022-11-16 07:01:36 INFO: 30% (20.9 GiB of 69.7 GiB) in 1h 5m 30s, read: 3.6 MiB/s, write: 3.6 MiB/s 206: 2022-11-16 07:04:56 INFO: 31% (21.6 GiB of 69.7 GiB) in 1h 8m 50s, read: 3.6 MiB/s, write: 3.6 MiB/s 206: 2022-11-16 07:07:44 INFO: 32% (22.3 GiB of 69.7 GiB) in 1h 11m 38s, read: 4.3 MiB/s, write: 4.3 MiB/s 206: 2022-11-16 07:10:58 INFO: 33% (23.0 GiB of 69.7 GiB) in 1h 14m 52s, read: 3.7 MiB/s, write: 3.7 MiB/s 206: 2022-11-16 07:13:46 INFO: 34% (23.7 GiB of 69.7 GiB) in 1h 17m 40s, read: 4.2 MiB/s, write: 4.2 MiB/s 206: 2022-11-16 07:16:53 INFO: 35% (24.4 GiB of 69.7 GiB) in 1h 20m 47s, read: 3.9 MiB/s, write: 3.9 MiB/s 206: 2022-11-16 07:19:44 INFO: 36% (25.1 GiB of 69.7 GiB) in 1h 23m 38s, read: 4.1 MiB/s, write: 4.1 MiB/s 206: 2022-11-16 07:22:28 INFO: 37% (25.8 GiB of 69.7 GiB) in 1h 26m 22s, read: 4.4 MiB/s, write: 4.4 MiB/s 206: 2022-11-16 07:25:34 INFO: 38% (26.5 GiB of 69.7 GiB) in 1h 29m 28s, read: 3.8 MiB/s, write: 3.8 MiB/s 206: 2022-11-16 07:28:40 INFO: 39% (27.2 GiB of 69.7 GiB) in 1h 32m 34s, read: 3.8 MiB/s, write: 3.8 MiB/s 206: 2022-11-16 07:31:52 INFO: 40% (27.9 GiB of 69.7 GiB) in 1h 35m 46s, read: 3.7 MiB/s, write: 3.7 MiB/s 206: 2022-11-16 07:34:30 INFO: 41% (28.6 GiB of 69.7 GiB) in 1h 38m 24s, read: 4.5 MiB/s, write: 4.5 MiB/s 206: 2022-11-16 07:37:00 INFO: 42% (29.3 GiB of 69.7 GiB) in 1h 40m 54s, read: 4.7 MiB/s, write: 4.7 MiB/s 206: 2022-11-16 07:39:38 INFO: 43% (30.0 GiB of 69.7 GiB) in 1h 43m 32s, read: 4.6 MiB/s, write: 4.5 MiB/s 206: 2022-11-16 07:42:13 INFO: 44% (30.7 GiB of 69.7 GiB) in 1h 46m 7s, read: 4.6 MiB/s, write: 4.6 MiB/s 206: 2022-11-16 07:44:09 INFO: 45% (31.4 GiB of 69.7 GiB) in 1h 48m 3s, read: 6.2 MiB/s, write: 6.2 MiB/s 206: 2022-11-16 07:46:14 INFO: 46% (32.1 GiB of 69.7 GiB) in 1h 50m 8s, read: 5.7 MiB/s, write: 5.7 MiB/s 206: 2022-11-16 07:48:18 INFO: 47% (32.8 GiB of 69.7 GiB) in 1h 52m 12s, read: 5.8 MiB/s, write: 5.8 MiB/s 206: 2022-11-16 07:50:13 INFO: 48% (33.5 GiB of 69.7 GiB) in 1h 54m 7s, read: 6.2 MiB/s, write: 6.1 MiB/s 206: 2022-11-16 07:52:27 INFO: 49% (34.2 GiB of 69.7 GiB) in 1h 56m 21s, read: 5.3 MiB/s, write: 5.3 MiB/s 206: 2022-11-16 07:54:45 INFO: 50% (34.9 GiB of 69.7 GiB) in 1h 58m 39s, read: 5.2 MiB/s, write: 5.2 MiB/s 206: 2022-11-16 07:57:10 INFO: 51% (35.6 GiB of 69.7 GiB) in 2h 1m 4s, read: 4.9 MiB/s, write: 4.9 MiB/s 206: 2022-11-16 07:59:41 INFO: 52% (36.3 GiB of 69.7 GiB) in 2h 3m 35s, read: 4.7 MiB/s, write: 4.7 MiB/s 206: 2022-11-16 08:01:43 INFO: 53% (37.0 GiB of 69.7 GiB) in 2h 5m 37s, read: 5.9 MiB/s, write: 5.9 MiB/s 206: 2022-11-16 08:03:56 INFO: 54% (37.7 GiB of 69.7 GiB) in 2h 7m 50s, read: 5.4 MiB/s, write: 5.3 MiB/s 206: 2022-11-16 08:06:11 INFO: 55% (38.4 GiB of 69.7 GiB) in 2h 10m 5s, read: 5.3 MiB/s, write: 5.3 MiB/s 206: 2022-11-16 08:08:28 INFO: 56% (39.1 GiB of 69.7 GiB) in 2h 12m 22s, read: 5.2 MiB/s, write: 5.2 MiB/s 206: 2022-11-16 08:10:30 INFO: 57% (39.7 GiB of 69.7 GiB) in 2h 14m 24s, read: 5.8 MiB/s, write: 5.8 MiB/s 206: 2022-11-16 08:12:23 INFO: 58% (40.4 GiB of 69.7 GiB) in 2h 16m 17s, read: 6.3 MiB/s, write: 6.3 MiB/s 206: 2022-11-16 08:14:32 INFO: 59% (41.1 GiB of 69.7 GiB) in 2h 18m 26s, read: 5.6 MiB/s, write: 5.6 MiB/s 206: 2022-11-16 08:16:26 INFO: 60% (41.8 GiB of 69.7 GiB) in 2h 20m 20s, read: 6.2 MiB/s, write: 6.1 MiB/s 206: 2022-11-16 08:17:59 INFO: 61% (42.5 GiB of 69.7 GiB) in 2h 21m 53s, read: 7.8 MiB/s, write: 7.8 MiB/s 206: 2022-11-16 08:19:20 INFO: 62% (43.2 GiB of 69.7 GiB) in 2h 23m 14s, read: 8.7 MiB/s, write: 8.7 MiB/s 206: 2022-11-16 08:20:39 INFO: 63% (43.9 GiB of 69.7 GiB) in 2h 24m 33s, read: 9.1 MiB/s, write: 9.1 MiB/s 206: 2022-11-16 08:21:59 INFO: 64% (44.6 GiB of 69.7 GiB) in 2h 25m 53s, read: 8.9 MiB/s, write: 8.8 MiB/s 206: 2022-11-16 08:23:19 INFO: 65% (45.3 GiB of 69.7 GiB) in 2h 27m 13s, read: 8.9 MiB/s, write: 8.9 MiB/s 206: 2022-11-16 08:24:40 INFO: 66% (46.0 GiB of 69.7 GiB) in 2h 28m 34s, read: 8.8 MiB/s, write: 8.7 MiB/s 206: 2022-11-16 08:26:01 INFO: 67% (46.7 GiB of 69.7 GiB) in 2h 29m 55s, read: 8.8 MiB/s, write: 8.8 MiB/s 206: 2022-11-16 08:27:12 INFO: 68% (47.4 GiB of 69.7 GiB) in 2h 31m 6s, read: 10.0 MiB/s, write: 9.9 MiB/s 206: 2022-11-16 08:28:18 INFO: 69% (48.1 GiB of 69.7 GiB) in 2h 32m 12s, read: 10.9 MiB/s, write: 10.9 MiB/s 206: 2022-11-16 08:29:24 INFO: 70% (48.8 GiB of 69.7 GiB) in 2h 33m 18s, read: 10.7 MiB/s, write: 10.7 MiB/s 206: 2022-11-16 08:30:37 INFO: 71% (49.5 GiB of 69.7 GiB) in 2h 34m 31s, read: 9.9 MiB/s, write: 9.9 MiB/s 206: 2022-11-16 08:31:53 INFO: 72% (50.2 GiB of 69.7 GiB) in 2h 35m 47s, read: 9.4 MiB/s, write: 9.4 MiB/s 206: 2022-11-16 08:33:08 INFO: 73% (50.9 GiB of 69.7 GiB) in 2h 37m 2s, read: 9.5 MiB/s, write: 9.5 MiB/s 206: 2022-11-16 08:34:21 INFO: 74% (51.6 GiB of 69.7 GiB) in 2h 38m 15s, read: 9.8 MiB/s, write: 9.8 MiB/s 206: 2022-11-16 08:35:31 INFO: 75% (52.3 GiB of 69.7 GiB) in 2h 39m 25s, read: 10.2 MiB/s, write: 10.2 MiB/s 206: 2022-11-16 08:36:44 INFO: 76% (53.0 GiB of 69.7 GiB) in 2h 40m 38s, read: 9.8 MiB/s, write: 9.8 MiB/s 206: 2022-11-16 08:38:03 INFO: 77% (53.7 GiB of 69.7 GiB) in 2h 41m 57s, read: 9.0 MiB/s, write: 9.0 MiB/s 206: 2022-11-16 08:39:12 INFO: 78% (54.4 GiB of 69.7 GiB) in 2h 43m 6s, read: 10.3 MiB/s, write: 10.3 MiB/s 206: 2022-11-16 08:40:23 INFO: 79% (55.1 GiB of 69.7 GiB) in 2h 44m 17s, read: 10.1 MiB/s, write: 10.1 MiB/s 206: 2022-11-16 08:41:37 INFO: 80% (55.8 GiB of 69.7 GiB) in 2h 45m 31s, read: 9.7 MiB/s, write: 9.7 MiB/s 206: 2022-11-16 08:42:47 INFO: 81% (56.5 GiB of 69.7 GiB) in 2h 46m 41s, read: 10.1 MiB/s, write: 10.1 MiB/s 206: 2022-11-16 08:43:54 INFO: 82% (57.2 GiB of 69.7 GiB) in 2h 47m 48s, read: 10.7 MiB/s, write: 10.7 MiB/s 206: 2022-11-16 08:45:02 INFO: 83% (57.9 GiB of 69.7 GiB) in 2h 48m 56s, read: 10.4 MiB/s, write: 10.4 MiB/s 206: 2022-11-16 08:46:10 INFO: 84% (58.6 GiB of 69.7 GiB) in 2h 50m 4s, read: 10.5 MiB/s, write: 10.5 MiB/s 206: 2022-11-16 08:47:09 INFO: 85% (59.3 GiB of 69.7 GiB) in 2h 51m 3s, read: 12.3 MiB/s, write: 12.3 MiB/s 206: 2022-11-16 08:48:07 INFO: 86% (60.0 GiB of 69.7 GiB) in 2h 52m 1s, read: 12.1 MiB/s, write: 12.1 MiB/s 206: 2022-11-16 08:49:13 INFO: 87% (60.7 GiB of 69.7 GiB) in 2h 53m 7s, read: 10.8 MiB/s, write: 10.8 MiB/s 206: 2022-11-16 08:50:31 INFO: 88% (61.4 GiB of 69.7 GiB) in 2h 54m 25s, read: 9.2 MiB/s, write: 9.2 MiB/s 206: 2022-11-16 08:51:40 INFO: 89% (62.1 GiB of 69.7 GiB) in 2h 55m 34s, read: 10.5 MiB/s, write: 10.5 MiB/s 206: 2022-11-16 08:52:49 INFO: 90% (62.8 GiB of 69.7 GiB) in 2h 56m 43s, read: 10.3 MiB/s, write: 10.3 MiB/s 206: 2022-11-16 08:53:59 INFO: 91% (63.5 GiB of 69.7 GiB) in 2h 57m 53s, read: 10.1 MiB/s, write: 10.1 MiB/s 206: 2022-11-16 08:55:08 INFO: 92% (64.2 GiB of 69.7 GiB) in 2h 59m 2s, read: 10.4 MiB/s, write: 10.4 MiB/s 206: 2022-11-16 08:56:01 INFO: 93% (64.9 GiB of 69.7 GiB) in 2h 59m 55s, read: 13.5 MiB/s, write: 13.5 MiB/s 206: 2022-11-16 08:56:55 INFO: 94% (65.5 GiB of 69.7 GiB) in 3h 49s, read: 13.1 MiB/s, write: 13.1 MiB/s 206: 2022-11-16 08:57:46 INFO: 95% (66.2 GiB of 69.7 GiB) in 3h 1m 40s, read: 14.0 MiB/s, write: 14.0 MiB/s 206: 2022-11-16 08:58:36 INFO: 96% (66.9 GiB of 69.7 GiB) in 3h 2m 30s, read: 14.3 MiB/s, write: 14.3 MiB/s 206: 2022-11-16 08:59:27 INFO: 97% (67.6 GiB of 69.7 GiB) in 3h 3m 21s, read: 14.0 MiB/s, write: 14.0 MiB/s 206: 2022-11-16 09:00:23 INFO: 98% (68.3 GiB of 69.7 GiB) in 3h 4m 17s, read: 12.8 MiB/s, write: 11.7 MiB/s 206: 2022-11-16 09:01:11 INFO: 99% (69.0 GiB of 69.7 GiB) in 3h 5m 5s, read: 15.1 MiB/s, write: 13.8 MiB/s 206: 2022-11-16 09:02:01 INFO: 100% (69.7 GiB of 69.7 GiB) in 3h 5m 55s, read: 14.0 MiB/s, write: 13.9 MiB/s 206: 2022-11-16 09:02:31 INFO: backup is sparse: 12.00 MiB (0%) total zero data 206: 2022-11-16 09:02:31 INFO: backup was done incrementally, reused 45.50 GiB (39%) 206: 2022-11-16 09:02:31 INFO: transferred 69.73 GiB in 11185 seconds (6.4 MiB/s) 206: 2022-11-16 09:02:31 INFO: adding notes to backup 206: 2022-11-16 09:02:31 INFO: Finished Backup of VM 206 (03:06:37)

 

[Lukas Wagner]

Hallo,

kannst du vielleicht noch ein paar mehr Infos liefern:

• Wo werden die Backups gespeichert?
• Ist die Übertragungsrate für die anderen Backups auch in einem ähnlichen Bereich von avg. 6.4 MiB/s?

Die Zeile scsi0: dirty-bitmap status: OK (69.7 GiB of 115.0 GiB dirty) sagt mir, dass sich dann doch sehr viele Daten geändert haben. Wie oft machst du Backups? Wie aktiv ist der Exchange Server?

 

[drnicolas]

Die Backups gehen komplett auf ein NFS-share.
Die GEschwindigkeiten schwanken: 2 VMS liegen heute bei 220 und 140 MiB; andere meist wzischen 13 und 25.
An sich sollte der Exchange wenig aktiv sein; war aber definitiv mit wenig RAM konfiguriert (jetzt 8GB)

Heute waren es dann schonmal weniger: 2:20 und 13.9 Mib/s
Die Backups passieren täglich.

 

[Lukas Wagner]

Okay, also die Unterschiede bei der Übertragungsgeschwindigkeit sind auf jeden Fall interessant. Laufen die Backups zur gleichen Tageszeit, bzw. kannst du während den Backups irgendwelche Unterschiede in der Systemauslastung beobachten? Welchen Storage-Type verwendest du für die VMs, und ist dieser ident für alle VMs?

Wie ich jetzt gerade erst sehe, scheinst du das Backup zu einem Proxmox-Backup-Server zu machen. Wie ist da dein Setup? Läuft PBS auf der gleichen Maschine wie PVE oder gibts da einen eigenen Host? Siehst du im Web-UI von PBS irgendwelche Unterschiede bei der Auslastung zwischen langsamen und schnellen Backups?