leider wiedermal PBS Performance

[fpausp]

Hier das komplette Log vom Backup auf den Hardware Raid PBS mit 1Gbit/s LINK:
Wirklich nicht gut und in dem Segment mich nicht einsetzbar.


vzdump 128 --mode snapshot --remove 0 --node pve09 --storage pbs03


128: 2021-02-02 19:36:25 INFO: Starting Backup of VM 128 (qemu)
128: 2021-02-02 19:36:25 INFO: status = running
128: 2021-02-02 19:36:25 INFO: VM Name:
128: 2021-02-02 19:36:25 INFO: include disk 'scsi0' 'nasomv7-ZFS-SSD1:vm-128-disk-0' 470G
128: 2021-02-02 19:36:25 INFO: include disk 'scsi1' 'nasomv7-ZFS-SSD1:vm-128-disk-1' 120G
128: 2021-02-02 19:36:26 INFO: backup mode: snapshot
128: 2021-02-02 19:36:26 INFO: ionice priority: 7
128: 2021-02-02 19:36:26 INFO: snapshots found (not included into backup)
128: 2021-02-02 19:36:26 INFO: creating Proxmox Backup Server archive 'vm/128/2021-02-02T18:36:25Z'
128: 2021-02-02 19:36:26 INFO: issuing guest-agent 'fs-freeze' command
128: 2021-02-02 19:36:28 INFO: issuing guest-agent 'fs-thaw' command
128: 2021-02-02 19:36:29 INFO: started backup task '0f5f02dc-4d56-4938-9d88-8e91dd9dc8c0'
128: 2021-02-02 19:36:29 INFO: resuming VM again
128: 2021-02-02 19:36:29 INFO: scsi0: dirty-bitmap status: existing bitmap was invalid and has been cleared
128: 2021-02-02 19:36:29 INFO: scsi1: dirty-bitmap status: existing bitmap was invalid and has been cleared
128: 2021-02-02 19:36:32 INFO: 0% (252.0 MiB of 590.0 GiB) in 3s, read: 84.0 MiB/s, write: 84.0 MiB/s
128: 2021-02-02 19:38:09 INFO: 1% (5.9 GiB of 590.0 GiB) in 1m 40s, read: 60.2 MiB/s, write: 58.1 MiB/s
128: 2021-02-02 19:39:52 INFO: 2% (11.8 GiB of 590.0 GiB) in 3m 23s, read: 58.3 MiB/s, write: 58.3 MiB/s
128: 2021-02-02 19:41:33 INFO: 3% (17.8 GiB of 590.0 GiB) in 5m 4s, read: 60.2 MiB/s, write: 60.2 MiB/s
128: 2021-02-02 19:43:14 INFO: 4% (23.7 GiB of 590.0 GiB) in 6m 45s, read: 59.8 MiB/s, write: 59.8 MiB/s
128: 2021-02-02 19:44:52 INFO: 5% (29.5 GiB of 590.0 GiB) in 8m 23s, read: 61.4 MiB/s, write: 61.4 MiB/s
128: 2021-02-02 19:46:31 INFO: 6% (35.4 GiB of 590.0 GiB) in 10m 2s, read: 61.3 MiB/s, write: 61.3 MiB/s
128: 2021-02-02 19:48:06 INFO: 7% (41.3 GiB of 590.0 GiB) in 11m 37s, read: 63.4 MiB/s, write: 63.3 MiB/s
128: 2021-02-02 19:49:43 INFO: 8% (47.2 GiB of 590.0 GiB) in 13m 14s, read: 62.4 MiB/s, write: 62.4 MiB/s
128: 2021-02-02 19:51:03 INFO: 9% (53.2 GiB of 590.0 GiB) in 14m 34s, read: 75.8 MiB/s, write: 24.4 MiB/s
128: 2021-02-02 19:52:27 INFO: 10% (59.0 GiB of 590.0 GiB) in 15m 58s, read: 71.8 MiB/s, write: 30.9 MiB/s
128: 2021-02-02 19:53:44 INFO: 11% (64.9 GiB of 590.0 GiB) in 17m 15s, read: 77.9 MiB/s, write: 17.9 MiB/s
128: 2021-02-02 19:54:53 INFO: 12% (70.8 GiB of 590.0 GiB) in 18m 24s, read: 87.9 MiB/s, write: 118.7 KiB/s
128: 2021-02-02 19:56:05 INFO: 13% (76.8 GiB of 590.0 GiB) in 19m 36s, read: 84.7 MiB/s, write: 0 B/s
128: 2021-02-02 19:57:16 INFO: 14% (82.7 GiB of 590.0 GiB) in 20m 47s, read: 84.7 MiB/s, write: 0 B/s
128: 2021-02-02 19:58:27 INFO: 15% (88.5 GiB of 590.0 GiB) in 21m 58s, read: 84.8 MiB/s, write: 0 B/s
128: 2021-02-02 19:59:38 INFO: 16% (94.4 GiB of 590.0 GiB) in 23m 9s, read: 85.1 MiB/s, write: 0 B/s
128: 2021-02-02 20:00:49 INFO: 17% (100.3 GiB of 590.0 GiB) in 24m 20s, read: 84.6 MiB/s, write: 0 B/s
128: 2021-02-02 20:02:02 INFO: 18% (106.2 GiB of 590.0 GiB) in 25m 33s, read: 83.2 MiB/s, write: 0 B/s
128: 2021-02-02 20:03:13 INFO: 19% (112.1 GiB of 590.0 GiB) in 26m 44s, read: 84.6 MiB/s, write: 0 B/s
128: 2021-02-02 20:04:25 INFO: 20% (118.1 GiB of 590.0 GiB) in 27m 56s, read: 84.7 MiB/s, write: 0 B/s
128: 2021-02-02 20:05:53 INFO: 21% (123.9 GiB of 590.0 GiB) in 29m 24s, read: 68.1 MiB/s, write: 37.4 MiB/s
128: 2021-02-02 20:07:34 INFO: 22% (129.8 GiB of 590.0 GiB) in 31m 5s, read: 60.0 MiB/s, write: 58.8 MiB/s
128: 2021-02-02 20:09:13 INFO: 23% (135.7 GiB of 590.0 GiB) in 32m 44s, read: 60.9 MiB/s, write: 58.7 MiB/s
128: 2021-02-02 20:10:54 INFO: 24% (141.6 GiB of 590.0 GiB) in 34m 25s, read: 59.8 MiB/s, write: 58.9 MiB/s
128: 2021-02-02 20:12:34 INFO: 25% (147.5 GiB of 590.0 GiB) in 36m 5s, read: 60.4 MiB/s, write: 58.6 MiB/s
128: 2021-02-02 20:14:11 INFO: 26% (153.4 GiB of 590.0 GiB) in 37m 42s, read: 62.6 MiB/s, write: 60.0 MiB/s
128: 2021-02-02 20:15:49 INFO: 27% (159.4 GiB of 590.0 GiB) in 39m 20s, read: 61.9 MiB/s, write: 60.7 MiB/s
128: 2021-02-02 20:17:26 INFO: 28% (165.2 GiB of 590.0 GiB) in 40m 57s, read: 62.0 MiB/s, write: 60.4 MiB/s
128: 2021-02-02 20:19:02 INFO: 29% (171.2 GiB of 590.0 GiB) in 42m 33s, read: 63.2 MiB/s, write: 60.0 MiB/s
128: 2021-02-02 20:20:39 INFO: 30% (177.0 GiB of 590.0 GiB) in 44m 10s, read: 62.0 MiB/s, write: 57.8 MiB/s
128: 2021-02-02 20:22:18 INFO: 31% (182.9 GiB of 590.0 GiB) in 45m 49s, read: 61.0 MiB/s, write: 55.8 MiB/s
128: 2021-02-02 20:23:52 INFO: 32% (188.8 GiB of 590.0 GiB) in 47m 23s, read: 64.3 MiB/s, write: 56.1 MiB/s
128: 2021-02-02 20:25:25 INFO: 33% (194.8 GiB of 590.0 GiB) in 48m 56s, read: 65.3 MiB/s, write: 54.2 MiB/s
128: 2021-02-02 20:26:57 INFO: 34% (200.6 GiB of 590.0 GiB) in 50m 28s, read: 65.2 MiB/s, write: 57.1 MiB/s
128: 2021-02-02 20:28:30 INFO: 35% (206.5 GiB of 590.0 GiB) in 52m 1s, read: 64.9 MiB/s, write: 56.2 MiB/s
128: 2021-02-02 20:30:02 INFO: 36% (212.4 GiB of 590.0 GiB) in 53m 33s, read: 65.8 MiB/s, write: 53.8 MiB/s
128: 2021-02-02 20:31:37 INFO: 37% (218.4 GiB of 590.0 GiB) in 55m 8s, read: 64.0 MiB/s, write: 54.5 MiB/s
128: 2021-02-02 20:33:08 INFO: 38% (224.2 GiB of 590.0 GiB) in 56m 39s, read: 66.0 MiB/s, write: 53.8 MiB/s
128: 2021-02-02 20:34:37 INFO: 39% (230.1 GiB of 590.0 GiB) in 58m 8s, read: 67.7 MiB/s, write: 50.8 MiB/s
128: 2021-02-02 20:36:09 INFO: 40% (236.1 GiB of 590.0 GiB) in 59m 40s, read: 66.2 MiB/s, write: 53.0 MiB/s
128: 2021-02-02 20:37:38 INFO: 41% (241.9 GiB of 590.0 GiB) in 1h 1m 9s, read: 67.5 MiB/s, write: 50.9 MiB/s
128: 2021-02-02 20:39:10 INFO: 42% (247.8 GiB of 590.0 GiB) in 1h 2m 41s, read: 66.0 MiB/s, write: 51.8 MiB/s
128: 2021-02-02 20:40:40 INFO: 43% (253.7 GiB of 590.0 GiB) in 1h 4m 11s, read: 66.9 MiB/s, write: 51.2 MiB/s
128: 2021-02-02 20:42:11 INFO: 44% (259.7 GiB of 590.0 GiB) in 1h 5m 42s, read: 66.8 MiB/s, write: 47.4 MiB/s
128: 2021-02-02 20:43:38 INFO: 45% (265.5 GiB of 590.0 GiB) in 1h 7m 9s, read: 68.8 MiB/s, write: 47.1 MiB/s
128: 2021-02-02 20:45:06 INFO: 46% (271.4 GiB of 590.0 GiB) in 1h 8m 37s, read: 68.6 MiB/s, write: 47.6 MiB/s
128: 2021-02-02 20:46:37 INFO: 47% (277.4 GiB of 590.0 GiB) in 1h 10m 8s, read: 66.9 MiB/s, write: 50.0 MiB/s
128: 2021-02-02 20:48:05 INFO: 48% (283.2 GiB of 590.0 GiB) in 1h 11m 36s, read: 68.4 MiB/s, write: 47.6 MiB/s
128: 2021-02-02 20:49:31 INFO: 49% (289.2 GiB of 590.0 GiB) in 1h 13m 2s, read: 70.5 MiB/s, write: 40.4 MiB/s
128: 2021-02-02 20:51:00 INFO: 50% (295.0 GiB of 590.0 GiB) in 1h 14m 31s, read: 67.8 MiB/s, write: 47.8 MiB/s
128: 2021-02-02 20:52:31 INFO: 51% (300.9 GiB of 590.0 GiB) in 1h 16m 2s, read: 66.0 MiB/s, write: 51.4 MiB/s
128: 2021-02-02 20:54:02 INFO: 52% (306.9 GiB of 590.0 GiB) in 1h 17m 33s, read: 66.9 MiB/s, write: 49.8 MiB/s
128: 2021-02-02 20:55:30 INFO: 53% (312.8 GiB of 590.0 GiB) in 1h 19m 1s, read: 68.6 MiB/s, write: 45.3 MiB/s
128: 2021-02-02 20:56:53 INFO: 54% (318.6 GiB of 590.0 GiB) in 1h 20m 24s, read: 72.7 MiB/s, write: 35.0 MiB/s
128: 2021-02-02 20:58:21 INFO: 55% (324.5 GiB of 590.0 GiB) in 1h 21m 52s, read: 68.4 MiB/s, write: 46.0 MiB/s
128: 2021-02-02 20:59:38 INFO: 56% (330.4 GiB of 590.0 GiB) in 1h 23m 9s, read: 78.8 MiB/s, write: 34.3 MiB/s
128: 2021-02-02 21:01:07 INFO: 57% (336.3 GiB of 590.0 GiB) in 1h 24m 38s, read: 67.7 MiB/s, write: 48.8 MiB/s
128: 2021-02-02 21:02:41 INFO: 58% (342.2 GiB of 590.0 GiB) in 1h 26m 12s, read: 64.3 MiB/s, write: 54.2 MiB/s
128: 2021-02-02 21:04:12 INFO: 59% (348.1 GiB of 590.0 GiB) in 1h 27m 43s, read: 66.2 MiB/s, write: 49.9 MiB/s
128: 2021-02-02 21:05:40 INFO: 60% (354.1 GiB of 590.0 GiB) in 1h 29m 11s, read: 69.1 MiB/s, write: 45.2 MiB/s
128: 2021-02-02 21:07:05 INFO: 61% (360.0 GiB of 590.0 GiB) in 1h 30m 36s, read: 71.2 MiB/s, write: 38.7 MiB/s
128: 2021-02-02 21:08:31 INFO: 62% (365.8 GiB of 590.0 GiB) in 1h 32m 2s, read: 69.9 MiB/s, write: 42.7 MiB/s
128: 2021-02-02 21:09:56 INFO: 63% (371.7 GiB of 590.0 GiB) in 1h 33m 27s, read: 70.9 MiB/s, write: 42.1 MiB/s
128: 2021-02-02 21:11:26 INFO: 64% (377.7 GiB of 590.0 GiB) in 1h 34m 57s, read: 67.6 MiB/s, write: 50.8 MiB/s
128: 2021-02-02 21:12:56 INFO: 65% (383.6 GiB of 590.0 GiB) in 1h 36m 27s, read: 67.0 MiB/s, write: 48.4 MiB/s
128: 2021-02-02 21:14:25 INFO: 66% (389.4 GiB of 590.0 GiB) in 1h 37m 56s, read: 67.6 MiB/s, write: 47.1 MiB/s
128: 2021-02-02 21:15:56 INFO: 67% (395.3 GiB of 590.0 GiB) in 1h 39m 27s, read: 66.2 MiB/s, write: 48.4 MiB/s
128: 2021-02-02 21:17:26 INFO: 68% (401.2 GiB of 590.0 GiB) in 1h 40m 57s, read: 67.2 MiB/s, write: 44.3 MiB/s
128: 2021-02-02 21:18:57 INFO: 69% (407.1 GiB of 590.0 GiB) in 1h 42m 28s, read: 66.5 MiB/s, write: 40.6 MiB/s
128: 2021-02-02 21:20:26 INFO: 70% (413.0 GiB of 590.0 GiB) in 1h 43m 57s, read: 67.5 MiB/s, write: 42.6 MiB/s
128: 2021-02-02 21:21:51 INFO: 71% (419.0 GiB of 590.0 GiB) in 1h 45m 22s, read: 71.9 MiB/s, write: 44.0 MiB/s
128: 2021-02-02 21:23:27 INFO: 72% (424.8 GiB of 590.0 GiB) in 1h 46m 58s, read: 62.2 MiB/s, write: 58.6 MiB/s
128: 2021-02-02 21:24:55 INFO: 73% (430.8 GiB of 590.0 GiB) in 1h 48m 26s, read: 69.2 MiB/s, write: 43.5 MiB/s
128: 2021-02-02 21:26:13 INFO: 74% (436.6 GiB of 590.0 GiB) in 1h 49m 44s, read: 77.0 MiB/s, write: 19.6 MiB/s
128: 2021-02-02 21:27:42 INFO: 75% (442.5 GiB of 590.0 GiB) in 1h 51m 13s, read: 68.0 MiB/s, write: 42.2 MiB/s
128: 2021-02-02 21:28:56 INFO: 76% (448.6 GiB of 590.0 GiB) in 1h 52m 27s, read: 84.3 MiB/s, write: 20.3 MiB/s
128: 2021-02-02 21:29:54 INFO: 77% (454.3 GiB of 590.0 GiB) in 1h 53m 25s, read: 100.8 MiB/s, write: 12.3 MiB/s
128: 2021-02-02 21:31:07 INFO: 78% (460.2 GiB of 590.0 GiB) in 1h 54m 38s, read: 82.9 MiB/s, write: 8.0 MiB/s
128: 2021-02-02 21:32:23 INFO: 79% (466.2 GiB of 590.0 GiB) in 1h 55m 54s, read: 79.8 MiB/s, write: 37.7 MiB/s
128: 2021-02-02 21:33:35 INFO: 80% (472.0 GiB of 590.0 GiB) in 1h 57m 6s, read: 83.0 MiB/s, write: 3.4 MiB/s
128: 2021-02-02 21:34:47 INFO: 81% (477.9 GiB of 590.0 GiB) in 1h 58m 18s, read: 84.1 MiB/s, write: 0 B/s
128: 2021-02-02 21:35:59 INFO: 82% (483.9 GiB of 590.0 GiB) in 1h 59m 30s, read: 84.6 MiB/s, write: 0 B/s
128: 2021-02-02 21:37:06 INFO: 83% (489.7 GiB of 590.0 GiB) in 2h 0m 37s, read: 89.5 MiB/s, write: 0 B/s
128: 2021-02-02 21:38:18 INFO: 84% (495.7 GiB of 590.0 GiB) in 2h 1m 49s, read: 84.3 MiB/s, write: 0 B/s
128: 2021-02-02 21:39:37 INFO: 85% (501.5 GiB of 590.0 GiB) in 2h 3m 8s, read: 76.4 MiB/s, write: 22.2 MiB/s
128: 2021-02-02 21:40:59 INFO: 86% (507.4 GiB of 590.0 GiB) in 2h 4m 30s, read: 73.7 MiB/s, write: 28.5 MiB/s
128: 2021-02-02 21:42:12 INFO: 87% (513.4 GiB of 590.0 GiB) in 2h 5m 43s, read: 83.1 MiB/s, write: 0 B/s
128: 2021-02-02 21:43:20 INFO: 88% (519.2 GiB of 590.0 GiB) in 2h 6m 51s, read: 88.2 MiB/s, write: 0 B/s
128: 2021-02-02 21:44:32 INFO: 89% (525.2 GiB of 590.0 GiB) in 2h 8m 3s, read: 84.4 MiB/s, write: 0 B/s
128: 2021-02-02 21:45:42 INFO: 90% (531.1 GiB of 590.0 GiB) in 2h 9m 13s, read: 86.4 MiB/s, write: 0 B/s
128: 2021-02-02 21:46:53 INFO: 91% (536.9 GiB of 590.0 GiB) in 2h 10m 24s, read: 84.5 MiB/s, write: 0 B/s
128: 2021-02-02 21:48:01 INFO: 92% (542.9 GiB of 590.0 GiB) in 2h 11m 32s, read: 89.4 MiB/s, write: 0 B/s
128: 2021-02-02 21:48:56 INFO: 93% (548.7 GiB of 590.0 GiB) in 2h 12m 27s, read: 109.4 MiB/s, write: 0 B/s
128: 2021-02-02 21:50:08 INFO: 94% (554.7 GiB of 590.0 GiB) in 2h 13m 39s, read: 84.4 MiB/s, write: 0 B/s
128: 2021-02-02 21:51:17 INFO: 95% (560.6 GiB of 590.0 GiB) in 2h 14m 48s, read: 87.5 MiB/s, write: 0 B/s
128: 2021-02-02 21:51:56 INFO: 96% (566.4 GiB of 590.0 GiB) in 2h 15m 27s, read: 153.9 MiB/s, write: 0 B/s
128: 2021-02-02 21:52:56 INFO: 97% (572.4 GiB of 590.0 GiB) in 2h 16m 27s, read: 101.5 MiB/s, write: 0 B/s
128: 2021-02-02 21:54:07 INFO: 98% (578.2 GiB of 590.0 GiB) in 2h 17m 38s, read: 84.3 MiB/s, write: 0 B/s
128: 2021-02-02 21:55:19 INFO: 99% (584.1 GiB of 590.0 GiB) in 2h 18m 50s, read: 84.1 MiB/s, write: 0 B/s
128: 2021-02-02 21:56:33 INFO: 100% (590.0 GiB of 590.0 GiB) in 2h 20m 4s, read: 81.1 MiB/s, write: 6.1 MiB/s
128: 2021-02-02 21:56:34 INFO: backup is sparse: 284.16 GiB (48%) total zero data
128: 2021-02-02 21:56:34 INFO: backup was done incrementally, reused 284.45 GiB (48%)
128: 2021-02-02 21:56:34 INFO: transferred 590.00 GiB in 8405 seconds (71.9 MiB/s)
128: 2021-02-02 21:56:34 INFO: Finished Backup of VM 128 (02:20:09)

Ich verwende einen HP Microserver Gen10 mit 4 x Ironwolf NAS Festplatten im Raidz1 als Backupserver, nix besonderes...

 

[crmspezi]

Habe auf host umgestellt und es funktioniert etwas schneller. Könnte aber auch vielleicht die Netzwerkauslastung daran Schuld sein?

()
INFO: starting new backup job: vzdump 105 --node pve01 --remove 0 --storage pvestor01 --compress zstd --mode snapshot
INFO: Starting Backup of VM 105 (qemu)
INFO: Backup started at 2021-02-02 21:08:16
INFO: status = running
INFO: VM Name: xxx
INFO: include disk 'scsi0' 'local-lvm:vm-105-disk-0' 1000G
  /dev/sdc: open failed: No medium found
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: snapshots found (not included into backup)
INFO: creating vzdump archive '/mnt/pve/pvestor01/dump/vzdump-qemu-105-2021_02_02-21_08_16.vma.zst'
INFO: started backup task '79bba088-f42c-4f87-80b3-724bdfb55c45'
INFO: resuming VM again
INFO:   0% (165.4 MiB of 1000.0 GiB) in  3s, read: 55.1 MiB/s, write: 44.1 MiB/s
INFO:   1% (10.4 GiB of 1000.0 GiB) in  1m 44s, read: 103.4 MiB/s, write: 76.0 MiB/s
INFO:   2% (20.1 GiB of 1000.0 GiB) in  3m 31s, read: 93.3 MiB/s, write: 89.8 MiB/s
INFO:   3% (30.0 GiB of 1000.0 GiB) in  5m 25s, read: 89.0 MiB/s, write: 89.0 MiB/s
INFO:   4% (40.0 GiB of 1000.0 GiB) in  7m 10s, read: 97.3 MiB/s, write: 83.4 MiB/s
INFO:   5% (50.6 GiB of 1000.0 GiB) in  8m 31s, read: 133.8 MiB/s, write: 65.5 MiB/s
INFO:   6% (61.3 GiB of 1000.0 GiB) in  8m 38s, read: 1.5 GiB/s, write: 82.3 KiB/s
INFO:   7% (71.2 GiB of 1000.0 GiB) in  8m 45s, read: 1.4 GiB/s, write: 65.7 KiB/s
INFO:   8% (81.4 GiB of 1000.0 GiB) in  8m 52s, read: 1.5 GiB/s, write: 91.4 KiB/s
INFO:   9% (91.2 GiB of 1000.0 GiB) in  8m 58s, read: 1.6 GiB/s, write: 106.7 KiB/s
INFO:  10% (101.0 GiB of 1000.0 GiB) in  9m  4s, read: 1.6 GiB/s, write: 106.7 KiB/s
INFO:  11% (111.0 GiB of 1000.0 GiB) in  9m 10s, read: 1.7 GiB/s, write: 64.0 KiB/s
INFO:  12% (120.2 GiB of 1000.0 GiB) in  9m 15s, read: 1.8 GiB/s, write: 0 B/s
INFO:  13% (131.1 GiB of 1000.0 GiB) in  9m 21s, read: 1.8 GiB/s, write: 0 B/s
INFO:  14% (141.8 GiB of 1000.0 GiB) in  9m 27s, read: 1.8 GiB/s, write: 0 B/s
INFO:  15% (150.8 GiB of 1000.0 GiB) in  9m 32s, read: 1.8 GiB/s, write: 0 B/s
INFO:  16% (161.3 GiB of 1000.0 GiB) in  9m 38s, read: 1.8 GiB/s, write: 0 B/s
INFO:  17% (171.7 GiB of 1000.0 GiB) in  9m 44s, read: 1.7 GiB/s, write: 34.7 KiB/s
INFO:  18% (180.8 GiB of 1000.0 GiB) in  9m 49s, read: 1.8 GiB/s, write: 0 B/s
INFO:  19% (190.3 GiB of 1000.0 GiB) in  9m 54s, read: 1.9 GiB/s, write: 0 B/s
INFO:  20% (201.7 GiB of 1000.0 GiB) in 10m  1s, read: 1.6 GiB/s, write: 0 B/s
INFO:  21% (210.8 GiB of 1000.0 GiB) in 10m  6s, read: 1.8 GiB/s, write: 0 B/s
INFO:  22% (220.1 GiB of 1000.0 GiB) in 10m 11s, read: 1.8 GiB/s, write: 0 B/s
INFO:  23% (230.9 GiB of 1000.0 GiB) in 10m 17s, read: 1.8 GiB/s, write: 0 B/s
INFO:  24% (240.2 GiB of 1000.0 GiB) in 10m 22s, read: 1.9 GiB/s, write: 0 B/s
INFO:  25% (250.3 GiB of 1000.0 GiB) in 10m 28s, read: 1.7 GiB/s, write: 1.6 MiB/s
INFO:  26% (260.1 GiB of 1000.0 GiB) in 12m 50s, read: 70.3 MiB/s, write: 68.7 MiB/s
INFO:  27% (270.0 GiB of 1000.0 GiB) in 14m 42s, read: 91.1 MiB/s, write: 91.1 MiB/s
INFO:  28% (280.9 GiB of 1000.0 GiB) in 15m 16s, read: 327.2 MiB/s, write: 70.0 MiB/s
INFO:  29% (291.2 GiB of 1000.0 GiB) in 15m 23s, read: 1.5 GiB/s, write: 1.2 MiB/s
INFO:  30% (301.3 GiB of 1000.0 GiB) in 15m 29s, read: 1.7 GiB/s, write: 106.7 KiB/s
INFO:  31% (310.3 GiB of 1000.0 GiB) in 15m 34s, read: 1.8 GiB/s, write: 76.8 KiB/s
INFO:  32% (321.0 GiB of 1000.0 GiB) in 15m 40s, read: 1.8 GiB/s, write: 100.0 KiB/s
INFO:  33% (331.4 GiB of 1000.0 GiB) in 15m 46s, read: 1.7 GiB/s, write: 117.3 KiB/s
INFO:  34% (340.6 GiB of 1000.0 GiB) in 15m 51s, read: 1.8 GiB/s, write: 25.6 KiB/s
INFO:  35% (350.2 GiB of 1000.0 GiB) in 15m 56s, read: 1.9 GiB/s, write: 0 B/s
INFO:  36% (361.8 GiB of 1000.0 GiB) in 16m  2s, read: 1.9 GiB/s, write: 0 B/s
INFO:  37% (371.3 GiB of 1000.0 GiB) in 16m  7s, read: 1.9 GiB/s, write: 0 B/s
INFO:  38% (380.8 GiB of 1000.0 GiB) in 16m 13s, read: 1.6 GiB/s, write: 0 B/s
INFO:  39% (390.5 GiB of 1000.0 GiB) in 16m 18s, read: 1.9 GiB/s, write: 0 B/s
INFO:  40% (400.0 GiB of 1000.0 GiB) in 16m 23s, read: 1.9 GiB/s, write: 0 B/s
INFO:  41% (411.5 GiB of 1000.0 GiB) in 16m 29s, read: 1.9 GiB/s, write: 0 B/s
INFO:  42% (420.9 GiB of 1000.0 GiB) in 16m 34s, read: 1.9 GiB/s, write: 0 B/s
INFO:  43% (430.5 GiB of 1000.0 GiB) in 16m 39s, read: 1.9 GiB/s, write: 0 B/s
INFO:  44% (441.2 GiB of 1000.0 GiB) in 16m 45s, read: 1.8 GiB/s, write: 10.7 KiB/s
INFO:  45% (450.5 GiB of 1000.0 GiB) in 16m 50s, read: 1.9 GiB/s, write: 0 B/s
INFO:  46% (461.8 GiB of 1000.0 GiB) in 16m 56s, read: 1.9 GiB/s, write: 0 B/s
INFO:  47% (471.7 GiB of 1000.0 GiB) in 17m  1s, read: 2.0 GiB/s, write: 0 B/s
INFO:  48% (481.3 GiB of 1000.0 GiB) in 17m  6s, read: 1.9 GiB/s, write: 0 B/s
INFO:  49% (490.8 GiB of 1000.0 GiB) in 17m 11s, read: 1.9 GiB/s, write: 0 B/s
INFO:  50% (500.0 GiB of 1000.0 GiB) in 17m 35s, read: 394.9 MiB/s, write: 21.3 MiB/s
INFO:  51% (511.3 GiB of 1000.0 GiB) in 18m 15s, read: 289.8 MiB/s, write: 39.5 MiB/s
INFO:  52% (521.1 GiB of 1000.0 GiB) in 18m 20s, read: 2.0 GiB/s, write: 0 B/s
INFO:  53% (530.6 GiB of 1000.0 GiB) in 18m 25s, read: 1.9 GiB/s, write: 0 B/s
INFO:  54% (541.1 GiB of 1000.0 GiB) in 18m 32s, read: 1.5 GiB/s, write: 1.4 MiB/s
INFO:  55% (551.0 GiB of 1000.0 GiB) in 18m 38s, read: 1.6 GiB/s, write: 106.7 KiB/s
INFO:  56% (561.1 GiB of 1000.0 GiB) in 18m 44s, read: 1.7 GiB/s, write: 106.7 KiB/s
INFO:  57% (571.5 GiB of 1000.0 GiB) in 18m 50s, read: 1.7 GiB/s, write: 84.0 KiB/s
INFO:  58% (581.7 GiB of 1000.0 GiB) in 18m 56s, read: 1.7 GiB/s, write: 106.7 KiB/s
INFO:  59% (590.3 GiB of 1000.0 GiB) in 19m  1s, read: 1.7 GiB/s, write: 115.2 KiB/s
INFO:  60% (601.0 GiB of 1000.0 GiB) in 19m  7s, read: 1.8 GiB/s, write: 106.7 KiB/s
INFO:  61% (610.4 GiB of 1000.0 GiB) in 19m 12s, read: 1.9 GiB/s, write: 12.8 KiB/s
INFO:  62% (621.8 GiB of 1000.0 GiB) in 19m 18s, read: 1.9 GiB/s, write: 0 B/s
INFO:  63% (631.4 GiB of 1000.0 GiB) in 19m 23s, read: 1.9 GiB/s, write: 0 B/s
INFO:  64% (640.9 GiB of 1000.0 GiB) in 19m 28s, read: 1.9 GiB/s, write: 0 B/s
INFO:  65% (650.5 GiB of 1000.0 GiB) in 19m 33s, read: 1.9 GiB/s, write: 0 B/s
INFO:  66% (661.6 GiB of 1000.0 GiB) in 19m 39s, read: 1.9 GiB/s, write: 0 B/s
INFO:  67% (670.7 GiB of 1000.0 GiB) in 19m 44s, read: 1.8 GiB/s, write: 0 B/s
INFO:  68% (680.2 GiB of 1000.0 GiB) in 19m 49s, read: 1.9 GiB/s, write: 0 B/s
INFO:  69% (691.6 GiB of 1000.0 GiB) in 19m 55s, read: 1.9 GiB/s, write: 0 B/s
INFO:  70% (700.8 GiB of 1000.0 GiB) in 20m  0s, read: 1.8 GiB/s, write: 0 B/s
INFO:  71% (710.3 GiB of 1000.0 GiB) in 20m  5s, read: 1.9 GiB/s, write: 0 B/s
INFO:  72% (721.8 GiB of 1000.0 GiB) in 20m 11s, read: 1.9 GiB/s, write: 0 B/s
INFO:  73% (731.3 GiB of 1000.0 GiB) in 20m 16s, read: 1.9 GiB/s, write: 0 B/s
INFO:  74% (740.9 GiB of 1000.0 GiB) in 20m 21s, read: 1.9 GiB/s, write: 0 B/s
INFO:  75% (750.1 GiB of 1000.0 GiB) in 20m 56s, read: 268.7 MiB/s, write: 31.9 MiB/s
INFO:  76% (760.1 GiB of 1000.0 GiB) in 22m 52s, read: 88.3 MiB/s, write: 87.9 MiB/s
INFO:  77% (770.3 GiB of 1000.0 GiB) in 24m 28s, read: 108.9 MiB/s, write: 86.4 MiB/s
INFO:  78% (780.2 GiB of 1000.0 GiB) in 24m 34s, read: 1.6 GiB/s, write: 1.1 MiB/s
INFO:  79% (791.0 GiB of 1000.0 GiB) in 24m 41s, read: 1.5 GiB/s, write: 797.7 KiB/s
INFO:  80% (801.1 GiB of 1000.0 GiB) in 24m 47s, read: 1.7 GiB/s, write: 106.7 KiB/s
INFO:  81% (811.5 GiB of 1000.0 GiB) in 24m 53s, read: 1.7 GiB/s, write: 96.0 KiB/s
INFO:  82% (820.3 GiB of 1000.0 GiB) in 24m 58s, read: 1.8 GiB/s, write: 97.6 KiB/s
INFO:  83% (830.8 GiB of 1000.0 GiB) in 25m  4s, read: 1.7 GiB/s, write: 42.7 KiB/s
INFO:  84% (840.4 GiB of 1000.0 GiB) in 25m  9s, read: 1.9 GiB/s, write: 0 B/s
INFO:  85% (851.6 GiB of 1000.0 GiB) in 25m 15s, read: 1.9 GiB/s, write: 0 B/s
INFO:  86% (861.2 GiB of 1000.0 GiB) in 25m 20s, read: 1.9 GiB/s, write: 0 B/s
INFO:  87% (871.3 GiB of 1000.0 GiB) in 25m 26s, read: 1.7 GiB/s, write: 0 B/s
INFO:  88% (880.8 GiB of 1000.0 GiB) in 25m 31s, read: 1.9 GiB/s, write: 0 B/s
INFO:  89% (890.1 GiB of 1000.0 GiB) in 25m 36s, read: 1.9 GiB/s, write: 0 B/s
INFO:  90% (901.5 GiB of 1000.0 GiB) in 25m 42s, read: 1.9 GiB/s, write: 0 B/s
INFO:  91% (911.0 GiB of 1000.0 GiB) in 25m 47s, read: 1.9 GiB/s, write: 0 B/s
INFO:  92% (920.6 GiB of 1000.0 GiB) in 25m 52s, read: 1.9 GiB/s, write: 0 B/s
INFO:  93% (930.4 GiB of 1000.0 GiB) in 25m 57s, read: 2.0 GiB/s, write: 0 B/s
INFO:  94% (940.1 GiB of 1000.0 GiB) in 26m  2s, read: 1.9 GiB/s, write: 0 B/s
INFO:  95% (951.8 GiB of 1000.0 GiB) in 26m  8s, read: 2.0 GiB/s, write: 0 B/s
INFO:  96% (960.2 GiB of 1000.0 GiB) in 26m 14s, read: 1.4 GiB/s, write: 0 B/s
INFO:  97% (971.3 GiB of 1000.0 GiB) in 26m 20s, read: 1.8 GiB/s, write: 0 B/s
INFO:  98% (980.9 GiB of 1000.0 GiB) in 26m 25s, read: 1.9 GiB/s, write: 0 B/s
INFO:  99% (990.7 GiB of 1000.0 GiB) in 26m 30s, read: 2.0 GiB/s, write: 0 B/s
INFO: 100% (1000.0 GiB of 1000.0 GiB) in 27m  5s, read: 272.2 MiB/s, write: 44.7 MiB/s
INFO: backup is sparse: 914.76 GiB (91%) total zero data
INFO: transferred 1000.00 GiB in 1625 seconds (630.2 MiB/s)
INFO: archive file size: 79.25GB
INFO: Finished Backup of VM 105 (00:27:09)
INFO: Backup finished at 2021-02-02 21:35:25
INFO: Backup job finished successfully
TASK OK

Trotzdem sind das für mich traumhafte Werte. Ich probiere das auch mit "host" später. Aber was hat die VM Emulation damit zu tun?

 

[Alwin Antreich]

Das waren mehr als 1GByte/s ??? = 60GByte/min ? Wie geht das?

Es ist näher an ~10GB/s. Das Image ist aber zu 91.5% sparse, also Nullen.

128: 2021-02-02 19:36:29 INFO: scsi0: dirty-bitmap status: existing bitmap was invalid and has been cleared
128: 2021-02-02 19:36:29 INFO: scsi1: dirty-bitmap status: existing bitmap was invalid and has been cleared

Also ein neuer PBS? Bei der VM muss das ganze Image gelesen werden, das verlängert natürlich das Backup.

128: 2021-02-02 21:51:56 INFO: 96% (566.4 GiB of 590.0 GiB) in 2h 15m 27s, read: 153.9 MiB/s, write: 0 B/s

Da nicht schneller als ~150 MB/s gelesen werden konnte und im Schnitt nur um die ~70 MB/s, ist die Frage, ob es beim VM Storage einen Engpass gibt. Mit einem FIO Benchmark lässt sich das Storage Performance herausfinden. Die Test lassen sich aus dem ZFS Benchmark Paper entnehmen.
https://forum.proxmox.com/threads/proxmox-ve-zfs-benchmark-with-nvme.80744/

 

[crmspezi]

Es ist näher an ~10GB/s. Das Image ist aber zu 91.5% sparse, also Nullen.

Also ein neuer PBS? Bei der VM muss das ganze Image gelesen werden, das verlängert natürlich das Backup.


Da nicht schneller als ~150 MB/s gelesen werden konnte und im Schnitt nur um die ~70 MB/s, ist die Frage, ob es beim VM Storage einen Engpass gibt. Mit einem FIO Benchmark lässt sich das Storage Performance herausfinden. Die Test lassen sich aus dem ZFS Benchmark Paper entnehmen.
https://forum.proxmox.com/threads/proxmox-ve-zfs-benchmark-with-nvme.80744/

Naja 10Gbit/s sind ca. 1,2GByte/s. Also das gleiche. Ich habe aber heute viele Test gemacht und neue Erkenntnisse. Ich bereite diese heute noch auf.

 

[Alwin Antreich]

Naja 10Gbit/s sind ca. 1,2GByte/s.

Genau. Ich meine das Delta im Restore Log von @fpausp, von einer Sekunde auf die Nächste. Das Delta ist ~10 GB/s = ~85 GbE/s, was bei einem HP Microserver Gen10 mit 4 x Ironwolf NAS wohl eher unwahrscheinlich ist. Sofern nicht gerade eine 100 GbE Karte eingebaut und alles von RAM gelesen werden konnte.

Ich habe aber heute viele Test gemacht und neue Erkenntnisse. Ich bereite diese heute noch auf.

Da bin ich mal gespannt.

 

[crmspezi]

Erste Ergebnisse des Tests.

bisher:
- PBS mit Bond 10G/1G (Active-Backup) ohne VLAN
- PVE mit Bond 10G/1G (Active-Backup) VLAN getagt 1 für die Verwaltungsseite, mehrere Brigdes
- Openmediavault NAS für entfernte Dateisysteme für CIFS und ZFS over iSCSI mit Bond LACP 2x 10G ohne VLAN, mal 8x SATA Exos oder 8x SSD, alle im ZFS Raid10
- Test PBS mit Bond 10G/1G (Active-Backup) ohne VLAN, Hardware Raid, EXT4

Alle Backups mit PBS und auch vzdump brachten mal ca. 100MByte/s, seit 2 Wochen meist nur die Hälfte. Wie ich hier allerdings im Forum sehe, läuft das bei euch um den Faktor 10 oder mehr schneller. Ich habe nun ein paar Testumbauten gemacht, nachdem ich Bond Probleme im Internet mit Timeouts gelesen habe, die ich aber erst seit Debian 10 vereinzelt auch feststellte.

1. Ich habe also Bond aufgelöst beim PVE und PBS (VLAN blieb am PVE) und ein Backup Test zum neuen PBS03 (ausgeschaltete VM mit qcow2 HDD) gemacht (siehe Anlage) hier stellt sich plötzlich der 10-fache Wert ein, nur eine Cache Sache im ZFS bei qcow2?
2. den gleichen Test Backuptest (ausgeschaltete ähnliche VM mit ZFS over iSCSI HDD, gleicher SSD Storage), wieder die gleichen schlechten Werte


Auf VLAN kann ich nicht verzichten, auf Bond schon eher. Bisher hatte ich noch keine Erfahrung mit OVS Bridge/Bound. Liegt evtl mein Problem an der älteren und komplexen Netzwerkkonfig? Aber wieso zeigt NetIo keine großen Unterschiede zwischen der bisherigen Konfig (Bond/VLAN wie gestern:

PVE11 zu PBS02 Netio
TCP connection established.
Packet size 1k bytes: 710.61 MByte/s Tx, 734.35 MByte/s Rx.
Packet size 2k bytes: 738.12 MByte/s Tx, 727.64 MByte/s Rx.
Packet size 4k bytes: 742.36 MByte/s Tx, 699.52 MByte/s Rx.
Packet size 8k bytes: 727.66 MByte/s Tx, 661.68 MByte/s Rx.
Packet size 16k bytes: 738.34 MByte/s Tx, 668.28 MByte/s Rx.
Packet size 32k bytes: 744.71 MByte/s Tx, 762.40 MByte/s Rx.
Done.

Schlechte Backupwerte hier, weniger als 10%.

###########################
PVE09 zu PBS03 (Test PBS mit HW Raid) Netio

NETIO - Network Throughput Benchmark, Version 1.31
(C) 1997-2010 Kai Uwe Rommel

TCP connection established.
Packet size 1k bytes: 660.24 MByte/s Tx, 603.47 MByte/s Rx.
Packet size 2k bytes: 652.06 MByte/s Tx, 644.54 MByte/s Rx.
Packet size 4k bytes: 649.42 MByte/s Tx, 624.20 MByte/s Rx.
Packet size 8k bytes: 642.50 MByte/s Tx, 649.12 MByte/s Rx.
Packet size 16k bytes: 660.93 MByte/s Tx, 624.27 MByte/s Rx.
Packet size 32k bytes: 666.65 MByte/s Tx, 611.77 MByte/s Rx.
Done.

Sehr gute 10-fache Backupwerte hier (ca. 50%), aber nur mit qcow2.

PVE Netzwerk bisher:
auto lo
iface lo inet loopback

iface eno1 inet manual #OnBoard fuer pfSense
iface enp3s0 inet manual #Dual-GBit Failover Port unten
iface enp4s0 inet manual #Dual-GBit frei Port oben
iface enp5s0 inet manual #Mellanox3 10G

auto bond0
iface bond0 inet manual
bond-slaves enp5s0 enp3s0
bond-miimon 100
bond-mode active-backup
bond-primary enp5s0

iface bond0.1 inet manual
vlan-raw-device bond0

auto vmbr0 # für VM's
iface vmbr0 inet manual
bridge-ports bond0
bridge-stp off
bridge-fd 0
# bridge-vlan-aware yes
bridge-vids 1-4094

auto vmbr0v1 # fuer Host
iface vmbr0v1 inet static
address 192.168.190.62
netmask 255.255.255.0
gateway 192.168.190.10
bridge_ports bond0.1
bridge_stp off
bridge_fd 0
pre-down ethtool -s $IFACE wol g
# vlan-raw-device bond0

auto vmbr1 # nur fuer pfSense
iface vmbr1 inet manual
bridge-ports eno1
bridge-stp off
bridge-fd 0

###

PVE Netzwerk zum Test umgebaut:
auto lo
iface lo inet loopback

iface enp5s0 inet manual #Mellanox3 10G
iface eno1 inet manual #OnBoard fuer pfSense
iface enp3s0 inet manual #Dual-GBit Failover Port unten
iface enp4s0 inet manual #Dual-GBit frei Port oben

iface enp5s0.1 inet manual
vlan-raw-device enp5s0




auto vmbr0 # nur fuer VMs
iface vmbr0 inet manual
bridge-ports enp5s0
bridge-stp off
bridge-fd 0
# bridge-vlan-aware yes
bridge-vids 1-4094

auto vmbr0v1 # fuer Host
iface vmbr0v1 inet static
address 192.168.190.62
netmask 255.255.255.0
gateway 192.168.190.10
bridge_ports enp5s0.1
bridge_stp off
bridge_fd 0


auto vmbr1 # nur fuer pfSense
iface vmbr1 inet manual
bridge-ports eno1
bridge-stp off
bridge-fd 0

#########################
Anlage: Backup zweier VM's.

 

[crmspezi]

Eben nochmals verglichen. Das Backup einer VM mit qcow2 bringt ca. 20% Auslastung auf dem Host, das Backup einer VM mit zfs over iscsi ca. 2%, aber eben auch nur 10% der Backup-Leistung. Beide im ausgeschalteten Zustand.

Warum?

 

[crmspezi]

Kann mir bitte mal jemand ein Backup Log senden, von einer seiner VM's die per "zfs over iSCSI" oder direkt per local zfs angebunden ist?

Per CIFS mit RAW und qcow2 erreiche ich auf den Test-VM's auch über 500MByte/s. Mit Local zfs und zfs over iSCSI nur ca. 10%, obwohl die gefühlte Performance in den VM's sehr gut ist. NFS teste ich morgen, nutzt nur im Ergebnis dann wenig, da alles bei mir ZFS ist und der tägliche Betrieb NIE an irgendwelche Engpässe kommt. Soll heißen, nur das Backup per PBS und vzdump ist sehr schlecht.

Ich komme hier nicht wirklich weiter.

 

[H4R0]

Kann mir bitte mal jemand ein Backup Log senden, von einer seiner VM's die per "zfs over iSCSI" oder direkt per local zfs angebunden ist?

Per CIFS mit RAW und qcow2 erreiche ich auf den Test-VM's auch über 500MByte/s. Mit Local zfs und zfs over iSCSI nur ca. 10%, obwohl die gefühlte Performance in den VM's sehr gut ist. NFS teste ich morgen, nutzt nur im Ergebnis dann wenig, da alles bei mir ZFS ist und der tägliche Betrieb NIE an irgendwelche Engpässe kommt. Soll heißen, nur das Backup per PBS und vzdump ist sehr schlecht.

Ich komme hier nicht wirklich weiter.

ssd mirror mit zfs über 1gb nic auf pbs zfs hdd.

  105: 2021-02-04 01:03:19 INFO: Starting Backup of VM 105 (qemu)
  105: 2021-02-04 01:03:19 INFO: status = running
  105: 2021-02-04 01:03:19 INFO: VM Name: xxxxx
  105: 2021-02-04 01:03:19 INFO: include disk 'scsi0' 'local-zfs:base-102-disk-0/vm-105-disk-0' 256G
  105: 2021-02-04 01:03:19 INFO: include disk 'efidisk0' 'local-zfs:base-102-disk-1/vm-105-disk-1' 1M
  105: 2021-02-04 01:03:19 INFO: backup mode: snapshot
  105: 2021-02-04 01:03:19 INFO: ionice priority: 7
  105: 2021-02-04 01:03:19 INFO: creating Proxmox Backup Server archive 'vm/105/2021-02-04T01:03:19Z'
  105: 2021-02-04 01:03:19 INFO: issuing guest-agent 'fs-freeze' command
  105: 2021-02-04 01:03:19 INFO: enabling encryption
  105: 2021-02-04 01:03:20 INFO: issuing guest-agent 'fs-thaw' command
  105: 2021-02-04 01:03:20 INFO: started backup task 'bb94ae8b-f6b9-4abe-91e8-ec352757bd8b'
  105: 2021-02-04 01:03:20 INFO: resuming VM again
  105: 2021-02-04 01:03:20 INFO: efidisk0: dirty-bitmap status: OK (128.0 KiB of 128.0 KiB dirty)
  105: 2021-02-04 01:03:20 INFO: scsi0: dirty-bitmap status: OK (5.5 GiB of 256.0 GiB dirty)
  105: 2021-02-04 01:03:20 INFO: using fast incremental mode (dirty-bitmap), 5.5 GiB dirty of 256.0 GiB total
  105: 2021-02-04 01:03:23 INFO:   9% (520.0 MiB of 5.5 GiB) in  3s, read: 173.3 MiB/s, write: 144.0 MiB/s
  105: 2021-02-04 01:03:26 INFO:  18% (1012.0 MiB of 5.5 GiB) in  6s, read: 164.0 MiB/s, write: 96.0 MiB/s
  105: 2021-02-04 01:03:29 INFO:  27% (1.5 GiB of 5.5 GiB) in  9s, read: 174.7 MiB/s, write: 169.3 MiB/s
  105: 2021-02-04 01:03:32 INFO:  34% (1.9 GiB of 5.5 GiB) in 12s, read: 136.0 MiB/s, write: 136.0 MiB/s
  105: 2021-02-04 01:03:35 INFO:  37% (2.1 GiB of 5.5 GiB) in 15s, read: 57.3 MiB/s, write: 57.3 MiB/s
  105: 2021-02-04 01:03:38 INFO:  38% (2.1 GiB of 5.5 GiB) in 18s, read: 16.0 MiB/s, write: 16.0 MiB/s
  105: 2021-02-04 01:03:41 INFO:  39% (2.1 GiB of 5.5 GiB) in 21s, read: 12.0 MiB/s, write: 5.3 MiB/s
  105: 2021-02-04 01:03:44 INFO:  41% (2.3 GiB of 5.5 GiB) in 24s, read: 45.3 MiB/s, write: 41.3 MiB/s
  105: 2021-02-04 01:03:47 INFO:  48% (2.6 GiB of 5.5 GiB) in 27s, read: 125.3 MiB/s, write: 108.0 MiB/s
  105: 2021-02-04 01:03:50 INFO:  54% (3.0 GiB of 5.5 GiB) in 30s, read: 106.7 MiB/s, write: 58.7 MiB/s
  105: 2021-02-04 01:03:53 INFO:  62% (3.4 GiB of 5.5 GiB) in 33s, read: 150.7 MiB/s, write: 64.0 MiB/s
  105: 2021-02-04 01:03:56 INFO:  72% (3.9 GiB of 5.5 GiB) in 36s, read: 185.3 MiB/s, write: 158.7 MiB/s
  105: 2021-02-04 01:03:59 INFO:  78% (4.3 GiB of 5.5 GiB) in 39s, read: 113.3 MiB/s, write: 97.3 MiB/s
  105: 2021-02-04 01:04:02 INFO:  84% (4.6 GiB of 5.5 GiB) in 42s, read: 116.0 MiB/s, write: 108.0 MiB/s
  105: 2021-02-04 01:04:05 INFO:  89% (4.9 GiB of 5.5 GiB) in 45s, read: 98.7 MiB/s, write: 89.3 MiB/s
  105: 2021-02-04 01:04:08 INFO:  94% (5.2 GiB of 5.5 GiB) in 48s, read: 92.0 MiB/s, write: 86.7 MiB/s
  105: 2021-02-04 01:04:11 INFO: 100% (5.5 GiB of 5.5 GiB) in 51s, read: 101.4 MiB/s, write: 101.4 MiB/s
  105: 2021-02-04 01:04:16 INFO: backup is sparse: 636.00 MiB (11%) total zero data
  105: 2021-02-04 01:04:16 INFO: backup was done incrementally, reused 251.50 GiB (98%)
  105: 2021-02-04 01:04:16 INFO: transferred 5.47 GiB in 56 seconds (100.1 MiB/s)
  105: 2021-02-04 01:04:16 INFO: Finished Backup of VM 105 (00:00:57)

 

[Dunuin]

Backup (LZO Kompression) einer VM von lokalem ZFS Pool (5x SATA SSDs raidz1 mit lz4 Kompression) über 10Gbit NIC zum NAS (4x SATA HDDs raidz1 mit lz4 Kompression):

()
INFO: starting new backup job: vzdump 106 --compress lzo --node Hypervisor --storage PVE_Dump2 --remove 0 --mode stop
INFO: Starting Backup of VM 106 (qemu)
INFO: Backup started at 2021-02-05 03:37:28
INFO: status = running
INFO: backup mode: stop
INFO: ionice priority: 7
INFO: VM Name: Emby
INFO: include disk 'scsi1' 'VMpool8_VM:vm-106-disk-0' 2G
INFO: stopping vm
INFO: snapshots found (not included into backup)
INFO: creating vzdump archive '/mnt/pve/PVE_Dump2/dump/vzdump-qemu-106-2021_02_05-03_37_28.vma.lzo'
INFO: starting kvm to execute backup task
INFO: started backup task '6aca37cd-f4af-4f81-8463-29a69eb55b9a'
INFO: resuming VM again after 5 seconds
INFO:   0% (623.5 MiB of 66.0 GiB) in  3s, read: 207.8 MiB/s, write: 25.8 MiB/s
INFO:   2% (1.4 GiB of 66.0 GiB) in  6s, read: 257.0 MiB/s, write: 12.1 MiB/s
INFO:   3% (2.2 GiB of 66.0 GiB) in  9s, read: 288.6 MiB/s, write: 15.2 MiB/s
INFO:   4% (2.9 GiB of 66.0 GiB) in 12s, read: 247.8 MiB/s, write: 78.5 MiB/s
INFO:   5% (3.5 GiB of 66.0 GiB) in 16s, read: 151.0 MiB/s, write: 67.2 MiB/s
INFO:   6% (4.1 GiB of 66.0 GiB) in 20s, read: 155.1 MiB/s, write: 107.6 MiB/s
INFO:   8% (5.3 GiB of 66.0 GiB) in 23s, read: 415.8 MiB/s, write: 10.9 MiB/s
INFO:   9% (6.5 GiB of 66.0 GiB) in 26s, read: 404.6 MiB/s, write: 7.8 MiB/s
INFO:  11% (7.8 GiB of 66.0 GiB) in 29s, read: 421.3 MiB/s, write: 3.1 MiB/s
INFO:  13% (8.8 GiB of 66.0 GiB) in 32s, read: 366.2 MiB/s, write: 5.6 MiB/s
INFO:  14% (9.3 GiB of 66.0 GiB) in 35s, read: 157.1 MiB/s, write: 74.1 MiB/s
INFO:  15% (10.3 GiB of 66.0 GiB) in 38s, read: 335.0 MiB/s, write: 7.7 MiB/s
INFO:  17% (11.3 GiB of 66.0 GiB) in 41s, read: 363.5 MiB/s, write: 153.3 KiB/s
INFO:  18% (12.4 GiB of 66.0 GiB) in 44s, read: 345.4 MiB/s, write: 1.2 MiB/s
INFO:  20% (13.4 GiB of 66.0 GiB) in 47s, read: 352.2 MiB/s, write: 480.0 KiB/s
INFO:  21% (14.5 GiB of 66.0 GiB) in 50s, read: 377.5 MiB/s, write: 213.3 KiB/s
INFO:  22% (14.9 GiB of 66.0 GiB) in 53s, read: 151.1 MiB/s, write: 70.1 MiB/s
INFO:  23% (15.7 GiB of 66.0 GiB) in 56s, read: 265.9 MiB/s, write: 29.1 MiB/s
INFO:  25% (16.7 GiB of 66.0 GiB) in 59s, read: 336.1 MiB/s, write: 10.4 MiB/s
INFO:  26% (17.5 GiB of 66.0 GiB) in  1m  2s, read: 285.2 MiB/s, write: 30.3 MiB/s
INFO:  28% (18.6 GiB of 66.0 GiB) in  1m  5s, read: 375.7 MiB/s, write: 3.6 MiB/s
INFO:  29% (19.4 GiB of 66.0 GiB) in  1m  9s, read: 196.5 MiB/s, write: 81.9 MiB/s
INFO:  30% (20.2 GiB of 66.0 GiB) in  1m 12s, read: 268.7 MiB/s, write: 105.9 MiB/s
INFO:  31% (20.8 GiB of 66.0 GiB) in  1m 15s, read: 223.0 MiB/s, write: 101.2 MiB/s
INFO:  32% (21.4 GiB of 66.0 GiB) in  1m 18s, read: 201.4 MiB/s, write: 107.2 MiB/s
INFO:  33% (22.2 GiB of 66.0 GiB) in  1m 21s, read: 243.6 MiB/s, write: 96.9 MiB/s
INFO:  34% (22.8 GiB of 66.0 GiB) in  1m 24s, read: 226.0 MiB/s, write: 85.6 MiB/s
INFO:  35% (23.4 GiB of 66.0 GiB) in  1m 27s, read: 194.5 MiB/s, write: 130.0 MiB/s
INFO:  36% (24.3 GiB of 66.0 GiB) in  1m 30s, read: 304.2 MiB/s, write: 122.7 MiB/s
INFO:  37% (24.9 GiB of 66.0 GiB) in  1m 33s, read: 224.2 MiB/s, write: 112.0 MiB/s
INFO:  38% (25.5 GiB of 66.0 GiB) in  1m 36s, read: 194.5 MiB/s, write: 116.9 MiB/s
INFO:  39% (26.3 GiB of 66.0 GiB) in  1m 39s, read: 266.4 MiB/s, write: 71.2 MiB/s
INFO:  40% (26.9 GiB of 66.0 GiB) in  1m 42s, read: 219.1 MiB/s, write: 112.1 MiB/s
INFO:  41% (27.5 GiB of 66.0 GiB) in  1m 45s, read: 192.7 MiB/s, write: 117.2 MiB/s
INFO:  42% (28.2 GiB of 66.0 GiB) in  1m 48s, read: 230.5 MiB/s, write: 90.4 MiB/s
INFO:  43% (28.9 GiB of 66.0 GiB) in  1m 51s, read: 240.2 MiB/s, write: 106.4 MiB/s
INFO:  44% (29.4 GiB of 66.0 GiB) in  1m 54s, read: 194.6 MiB/s, write: 129.1 MiB/s
INFO:  45% (30.2 GiB of 66.0 GiB) in  1m 57s, read: 249.2 MiB/s, write: 99.2 MiB/s
INFO:  46% (30.9 GiB of 66.0 GiB) in  2m  0s, read: 244.5 MiB/s, write: 111.1 MiB/s
INFO:  47% (31.5 GiB of 66.0 GiB) in  2m  3s, read: 222.5 MiB/s, write: 117.7 MiB/s
INFO:  48% (32.2 GiB of 66.0 GiB) in  2m  6s, read: 230.1 MiB/s, write: 92.8 MiB/s
INFO:  49% (32.8 GiB of 66.0 GiB) in  2m  9s, read: 209.5 MiB/s, write: 107.0 MiB/s
INFO:  50% (33.3 GiB of 66.0 GiB) in  2m 12s, read: 175.7 MiB/s, write: 141.1 MiB/s
INFO:  51% (33.9 GiB of 66.0 GiB) in  2m 15s, read: 176.6 MiB/s, write: 95.0 MiB/s
INFO:  52% (34.6 GiB of 66.0 GiB) in  2m 19s, read: 190.7 MiB/s, write: 47.4 MiB/s
INFO:  53% (35.2 GiB of 66.0 GiB) in  2m 22s, read: 189.1 MiB/s, write: 144.2 MiB/s
INFO:  54% (36.0 GiB of 66.0 GiB) in  2m 25s, read: 300.5 MiB/s, write: 10.1 MiB/s
INFO:  55% (36.9 GiB of 66.0 GiB) in  2m 28s, read: 281.9 MiB/s, write: 63.4 MiB/s
INFO:  57% (37.6 GiB of 66.0 GiB) in  2m 31s, read: 264.2 MiB/s, write: 86.8 MiB/s
INFO:  58% (38.5 GiB of 66.0 GiB) in  2m 34s, read: 306.9 MiB/s, write: 321.3 KiB/s
INFO:  59% (39.1 GiB of 66.0 GiB) in  2m 37s, read: 189.1 MiB/s, write: 121.1 MiB/s
INFO:  60% (40.0 GiB of 66.0 GiB) in  2m 40s, read: 321.0 MiB/s, write: 21.7 MiB/s
INFO:  61% (40.8 GiB of 66.0 GiB) in  2m 43s, read: 272.6 MiB/s, write: 51.2 MiB/s
INFO:  62% (41.5 GiB of 66.0 GiB) in  2m 46s, read: 240.2 MiB/s, write: 109.5 MiB/s
INFO:  64% (42.6 GiB of 66.0 GiB) in  2m 49s, read: 375.6 MiB/s, write: 26.8 MiB/s
INFO:  65% (43.2 GiB of 66.0 GiB) in  2m 52s, read: 188.2 MiB/s, write: 135.8 MiB/s
INFO:  66% (43.9 GiB of 66.0 GiB) in  2m 55s, read: 234.7 MiB/s, write: 85.3 MiB/s
INFO:  67% (44.4 GiB of 66.0 GiB) in  2m 58s, read: 190.2 MiB/s, write: 113.7 MiB/s
INFO:  68% (45.0 GiB of 66.0 GiB) in  3m  1s, read: 210.7 MiB/s, write: 123.8 MiB/s
INFO:  69% (45.7 GiB of 66.0 GiB) in  3m  4s, read: 218.4 MiB/s, write: 100.5 MiB/s
INFO:  70% (46.3 GiB of 66.0 GiB) in  3m  8s, read: 164.5 MiB/s, write: 110.8 MiB/s
INFO:  71% (46.9 GiB of 66.0 GiB) in  3m 12s, read: 156.1 MiB/s, write: 92.7 MiB/s
INFO:  72% (47.6 GiB of 66.0 GiB) in  3m 16s, read: 181.9 MiB/s, write: 115.5 MiB/s
INFO:  73% (48.3 GiB of 66.0 GiB) in  3m 20s, read: 171.1 MiB/s, write: 136.1 MiB/s
INFO:  74% (48.9 GiB of 66.0 GiB) in  3m 23s, read: 191.8 MiB/s, write: 120.0 MiB/s
INFO:  75% (49.7 GiB of 66.0 GiB) in  3m 28s, read: 165.7 MiB/s, write: 133.9 MiB/s
INFO:  76% (50.3 GiB of 66.0 GiB) in  3m 31s, read: 195.6 MiB/s, write: 153.1 MiB/s
INFO:  77% (51.0 GiB of 66.0 GiB) in  3m 34s, read: 236.9 MiB/s, write: 88.0 MiB/s
INFO:  78% (51.7 GiB of 66.0 GiB) in  3m 38s, read: 192.3 MiB/s, write: 53.5 MiB/s
INFO:  79% (52.6 GiB of 66.0 GiB) in  3m 41s, read: 320.3 MiB/s, write: 6.4 MiB/s
INFO:  81% (53.6 GiB of 66.0 GiB) in  3m 44s, read: 326.1 MiB/s, write: 993.3 KiB/s
INFO:  82% (54.5 GiB of 66.0 GiB) in  3m 47s, read: 306.4 MiB/s, write: 816.0 KiB/s
INFO:  84% (55.4 GiB of 66.0 GiB) in  3m 50s, read: 324.5 MiB/s, write: 1.7 MiB/s
INFO:  85% (56.5 GiB of 66.0 GiB) in  3m 53s, read: 343.6 MiB/s, write: 725.3 KiB/s
INFO:  86% (57.4 GiB of 66.0 GiB) in  3m 56s, read: 307.3 MiB/s, write: 234.7 KiB/s
INFO:  88% (58.3 GiB of 66.0 GiB) in  3m 59s, read: 313.9 MiB/s, write: 170.7 KiB/s
INFO:  89% (59.2 GiB of 66.0 GiB) in  4m  2s, read: 319.6 MiB/s, write: 245.3 KiB/s
INFO:  91% (60.1 GiB of 66.0 GiB) in  4m  5s, read: 310.5 MiB/s, write: 0 B/s
INFO:  92% (61.1 GiB of 66.0 GiB) in  4m  8s, read: 320.8 MiB/s, write: 153.3 KiB/s
INFO:  94% (62.1 GiB of 66.0 GiB) in  4m 11s, read: 346.5 MiB/s, write: 1.3 MiB/s
INFO:  95% (63.1 GiB of 66.0 GiB) in  4m 14s, read: 347.1 MiB/s, write: 14.7 KiB/s
INFO:  97% (64.0 GiB of 66.0 GiB) in  4m 17s, read: 325.3 MiB/s, write: 0 B/s
INFO:  98% (65.1 GiB of 66.0 GiB) in  4m 20s, read: 364.4 MiB/s, write: 2.7 KiB/s
INFO: 100% (66.0 GiB of 66.0 GiB) in  4m 23s, read: 303.6 MiB/s, write: 2.7 KiB/s
INFO: backup is sparse: 49.51 GiB (75%) total zero data
INFO: transferred 66.00 GiB in 263 seconds (257.0 MiB/s)
INFO: archive file size: 14.54GB
INFO: Finished Backup of VM 106 (00:04:29)
INFO: Backup finished at 2021-02-05 03:41:57
INFO: Backup job finished successfully
TASK OK

 

[Dunuin]

Also bei mir bremst da immer die Kompression von vzdump. Hier ist noch einmal die gleiche VM aber diesmal ohne Kompression. Ist dann schneller fertig, auch wenn dafür mehr übertragen werden muss.
Hatte die Tests auch mit ZSTD und GZIP gemacht und dann ist es noch viel langsamer.

Hier der Log ohne Kompression:

()
INFO: starting new backup job: vzdump 106 --compress 0 --node Hypervisor --storage PVE_Dump2 --remove 0 --mode stop
INFO: Starting Backup of VM 106 (qemu)
INFO: Backup started at 2021-02-05 03:44:56
INFO: status = running
INFO: backup mode: stop
INFO: ionice priority: 7
INFO: VM Name: Emby
INFO: include disk 'scsi1' 'VMpool8_VM:vm-106-disk-0' 2G
INFO: stopping vm
INFO: snapshots found (not included into backup)
INFO: creating vzdump archive '/mnt/pve/PVE_Dump2/dump/vzdump-qemu-106-2021_02_05-03_44_56.vma'
INFO: starting kvm to execute backup task
INFO: started backup task 'a9671865-d7c6-4193-8c1b-b9422121fa6d'
INFO: resuming VM again after 5 seconds
INFO:   1% (685.4 MiB of 66.0 GiB) in  3s, read: 228.5 MiB/s, write: 26.6 MiB/s
INFO:   2% (1.3 GiB of 66.0 GiB) in  6s, read: 228.9 MiB/s, write: 11.3 MiB/s
INFO:   3% (2.2 GiB of 66.0 GiB) in  9s, read: 278.2 MiB/s, write: 5.1 MiB/s
INFO:   4% (3.2 GiB of 66.0 GiB) in 12s, read: 371.1 MiB/s, write: 162.5 MiB/s
INFO:   6% (4.2 GiB of 66.0 GiB) in 15s, read: 319.4 MiB/s, write: 158.7 MiB/s
INFO:   8% (5.4 GiB of 66.0 GiB) in 18s, read: 429.0 MiB/s, write: 12.7 MiB/s
INFO:  10% (6.6 GiB of 66.0 GiB) in 21s, read: 407.6 MiB/s, write: 8.3 MiB/s
INFO:  11% (7.7 GiB of 66.0 GiB) in 24s, read: 364.3 MiB/s, write: 1.4 MiB/s
INFO:  13% (8.7 GiB of 66.0 GiB) in 27s, read: 354.9 MiB/s, write: 452.0 KiB/s
INFO:  14% (9.6 GiB of 66.0 GiB) in 30s, read: 303.7 MiB/s, write: 87.0 MiB/s
INFO:  16% (10.7 GiB of 66.0 GiB) in 33s, read: 360.0 MiB/s, write: 54.7 KiB/s
INFO:  17% (11.7 GiB of 66.0 GiB) in 36s, read: 346.8 MiB/s, write: 576.0 KiB/s
INFO:  19% (12.7 GiB of 66.0 GiB) in 39s, read: 351.6 MiB/s, write: 714.7 KiB/s
INFO:  20% (13.7 GiB of 66.0 GiB) in 42s, read: 344.5 MiB/s, write: 486.7 KiB/s
INFO:  22% (14.7 GiB of 66.0 GiB) in 45s, read: 318.3 MiB/s, write: 13.5 MiB/s
INFO:  23% (15.5 GiB of 66.0 GiB) in 48s, read: 291.0 MiB/s, write: 85.9 MiB/s
INFO:  25% (16.6 GiB of 66.0 GiB) in 51s, read: 358.0 MiB/s, write: 2.4 MiB/s
INFO:  26% (17.2 GiB of 66.0 GiB) in 54s, read: 213.8 MiB/s, write: 38.4 MiB/s
INFO:  27% (18.3 GiB of 66.0 GiB) in 57s, read: 375.2 MiB/s, write: 12.0 KiB/s
INFO:  29% (19.3 GiB of 66.0 GiB) in  1m  0s, read: 336.5 MiB/s, write: 95.9 MiB/s
INFO:  30% (20.3 GiB of 66.0 GiB) in  1m  3s, read: 339.6 MiB/s, write: 133.8 MiB/s
INFO:  31% (21.1 GiB of 66.0 GiB) in  1m  6s, read: 273.9 MiB/s, write: 147.9 MiB/s
INFO:  33% (22.1 GiB of 66.0 GiB) in  1m  9s, read: 336.2 MiB/s, write: 135.2 MiB/s
INFO:  34% (23.0 GiB of 66.0 GiB) in  1m 12s, read: 324.9 MiB/s, write: 153.3 MiB/s
INFO:  36% (24.0 GiB of 66.0 GiB) in  1m 15s, read: 323.3 MiB/s, write: 154.0 MiB/s
INFO:  37% (24.9 GiB of 66.0 GiB) in  1m 18s, read: 306.9 MiB/s, write: 137.7 MiB/s
INFO:  38% (25.7 GiB of 66.0 GiB) in  1m 21s, read: 294.4 MiB/s, write: 162.4 MiB/s
INFO:  40% (26.7 GiB of 66.0 GiB) in  1m 24s, read: 336.0 MiB/s, write: 98.1 MiB/s
INFO:  41% (27.5 GiB of 66.0 GiB) in  1m 27s, read: 269.7 MiB/s, write: 175.2 MiB/s
INFO:  43% (28.4 GiB of 66.0 GiB) in  1m 30s, read: 310.2 MiB/s, write: 119.1 MiB/s
INFO:  44% (29.2 GiB of 66.0 GiB) in  1m 33s, read: 274.0 MiB/s, write: 171.5 MiB/s
INFO:  45% (30.1 GiB of 66.0 GiB) in  1m 36s, read: 309.2 MiB/s, write: 125.8 MiB/s
INFO:  47% (31.0 GiB of 66.0 GiB) in  1m 39s, read: 312.5 MiB/s, write: 156.4 MiB/s
INFO:  48% (32.1 GiB of 66.0 GiB) in  1m 42s, read: 350.6 MiB/s, write: 152.1 MiB/s
INFO:  49% (32.9 GiB of 66.0 GiB) in  1m 45s, read: 299.9 MiB/s, write: 161.4 MiB/s
INFO:  51% (33.7 GiB of 66.0 GiB) in  1m 48s, read: 274.0 MiB/s, write: 173.2 MiB/s
INFO:  52% (34.6 GiB of 66.0 GiB) in  1m 51s, read: 306.0 MiB/s, write: 93.5 MiB/s
INFO:  53% (35.4 GiB of 66.0 GiB) in  1m 54s, read: 248.0 MiB/s, write: 152.7 MiB/s
INFO:  54% (36.2 GiB of 66.0 GiB) in  1m 57s, read: 301.3 MiB/s, write: 0 B/s
INFO:  56% (37.1 GiB of 66.0 GiB) in  2m  0s, read: 285.6 MiB/s, write: 122.4 MiB/s
INFO:  57% (38.0 GiB of 66.0 GiB) in  2m  3s, read: 321.8 MiB/s, write: 27.9 MiB/s
INFO:  58% (38.8 GiB of 66.0 GiB) in  2m  6s, read: 276.4 MiB/s, write: 52.5 MiB/s
INFO:  60% (39.7 GiB of 66.0 GiB) in  2m  9s, read: 291.3 MiB/s, write: 90.6 MiB/s
INFO:  61% (40.7 GiB of 66.0 GiB) in  2m 12s, read: 332.9 MiB/s, write: 11.0 MiB/s
INFO:  62% (41.1 GiB of 66.0 GiB) in  2m 15s, read: 158.6 MiB/s, write: 115.9 MiB/s
INFO:  63% (42.1 GiB of 66.0 GiB) in  2m 18s, read: 347.8 MiB/s, write: 52.0 MiB/s
INFO:  65% (43.0 GiB of 66.0 GiB) in  2m 21s, read: 305.2 MiB/s, write: 112.9 MiB/s
INFO:  66% (43.9 GiB of 66.0 GiB) in  2m 24s, read: 287.1 MiB/s, write: 118.7 MiB/s
INFO:  67% (44.6 GiB of 66.0 GiB) in  2m 27s, read: 249.6 MiB/s, write: 134.6 MiB/s
INFO:  68% (45.3 GiB of 66.0 GiB) in  2m 30s, read: 243.5 MiB/s, write: 150.7 MiB/s
INFO:  69% (46.2 GiB of 66.0 GiB) in  2m 33s, read: 281.1 MiB/s, write: 154.8 MiB/s
INFO:  71% (46.9 GiB of 66.0 GiB) in  2m 36s, read: 259.8 MiB/s, write: 161.0 MiB/s
INFO:  72% (47.7 GiB of 66.0 GiB) in  2m 39s, read: 272.2 MiB/s, write: 178.4 MiB/s
INFO:  73% (48.5 GiB of 66.0 GiB) in  2m 42s, read: 264.6 MiB/s, write: 206.8 MiB/s
INFO:  74% (49.3 GiB of 66.0 GiB) in  2m 45s, read: 269.3 MiB/s, write: 186.3 MiB/s
INFO:  75% (50.0 GiB of 66.0 GiB) in  2m 48s, read: 243.9 MiB/s, write: 195.8 MiB/s
INFO:  77% (50.9 GiB of 66.0 GiB) in  2m 51s, read: 294.6 MiB/s, write: 155.7 MiB/s
INFO:  78% (51.7 GiB of 66.0 GiB) in  2m 54s, read: 288.7 MiB/s, write: 74.5 MiB/s
INFO:  79% (52.6 GiB of 66.0 GiB) in  2m 57s, read: 314.2 MiB/s, write: 6.4 MiB/s
INFO:  81% (53.7 GiB of 66.0 GiB) in  3m  0s, read: 382.2 MiB/s, write: 993.3 KiB/s
INFO:  83% (54.8 GiB of 66.0 GiB) in  3m  3s, read: 362.0 MiB/s, write: 2.4 MiB/s
INFO:  84% (55.7 GiB of 66.0 GiB) in  3m  6s, read: 307.4 MiB/s, write: 128.0 KiB/s
INFO:  85% (56.6 GiB of 66.0 GiB) in  3m  9s, read: 303.0 MiB/s, write: 960.0 KiB/s
INFO:  87% (57.6 GiB of 66.0 GiB) in  3m 12s, read: 334.4 MiB/s, write: 0 B/s
INFO:  88% (58.5 GiB of 66.0 GiB) in  3m 15s, read: 319.4 MiB/s, write: 170.7 KiB/s
INFO:  90% (59.5 GiB of 66.0 GiB) in  3m 18s, read: 346.6 MiB/s, write: 245.3 KiB/s
INFO:  91% (60.5 GiB of 66.0 GiB) in  3m 21s, read: 342.9 MiB/s, write: 132.0 KiB/s
INFO:  93% (61.5 GiB of 66.0 GiB) in  3m 24s, read: 318.6 MiB/s, write: 1.1 MiB/s
INFO:  94% (62.4 GiB of 66.0 GiB) in  3m 27s, read: 305.8 MiB/s, write: 224.0 KiB/s
INFO:  95% (63.2 GiB of 66.0 GiB) in  3m 30s, read: 305.1 MiB/s, write: 14.7 KiB/s
INFO:  97% (64.2 GiB of 66.0 GiB) in  3m 33s, read: 324.3 MiB/s, write: 0 B/s
INFO:  98% (65.1 GiB of 66.0 GiB) in  3m 36s, read: 315.5 MiB/s, write: 2.7 KiB/s
INFO:  99% (65.7 GiB of 66.0 GiB) in  3m 39s, read: 206.2 MiB/s, write: 0 B/s
INFO: 100% (66.0 GiB of 66.0 GiB) in  3m 40s, read: 283.9 MiB/s, write: 8.0 KiB/s
INFO: backup is sparse: 49.51 GiB (75%) total zero data
INFO: transferred 66.00 GiB in 220 seconds (307.2 MiB/s)
INFO: archive file size: 16.50GB
INFO: Finished Backup of VM 106 (00:03:47)
INFO: Backup finished at 2021-02-05 03:48:43
INFO: Backup job finished successfully
TASK OK

 

[crmspezi]

Vielen Dank euch beiden. Das sind Werte, die sehen normal (gut) aus. Gerade auch von Dunuin mit vzdump überrascht mich positiv. Ohne Kompression bei vzdump habe ich noch nie getestet. Mache ich aber am WE gern.

Was mir aufgefallen bei mir ist, habe ich einen PBS Job von nur einem Host komme ich auf ca. 70MByte/s (alle Backups mit entfernten oder lokalem ZFS, qcow2 HDD Dateien viel schneller). Habe ich 2 parallele Jobs (2x PVE, verschiedene VM's) ist die Summe auch nur 70, einzeln 35, habe ich 3 parallele Jobs (3x PVE) nur ein Drittel, die Summe ist immer bei ca. 70-80 MByte/s.

Sieht aus wie eine Limitierung. Die Datenübertragungsleitung ist aber gemessen über 500MByte/s vom PVE zum PBS mit NetIO und dem Benchmark-Tool vom PVE/PBS.

 

[Alwin Antreich]

2. den gleichen Test Backuptest (ausgeschaltete ähnliche VM mit ZFS over iSCSI HDD, gleicher SSD Storage), wieder die gleichen schlechten Werte

Wurde dieser Test auf die Openmediavault NAS gemacht? iSCSI heißt wieder Netzwerk, nur an einer anderen Stelle. Ich kann hier nochmals die FIO Tests, wie im Benchmark Paper zur Analyse empfehlen.