leider wiedermal PBS Performance

Wie viel Speicher ist auf dem pbs denn eigentlich belegt ?

Performance ist abhängig von IOPS, da alle chunks referenziert werden müssen.

Da du 300TB in verwendung hast sicherst du wahrscheinlich auch viel.


Die Anzahl der chunks kannst du mit "find .chunks -type f | wc -l" beim backup storage herausfinden.

Wie zuvor erwähnt atop busy und avio werte wären hilfreich um auszuschleißen, dass die festplatten das problem sind.
 
  • Like
Reactions: Alwin Antreich
Schelm. Du weißt das es ein LOG File nur in der Veeam DB so gibt oder über zig LOG's ohne Zeitangaben?
Nein, hatte Veeam noch nie in der Hand. Aber den 'Schelm' nehme ich gern an. o_O;)

Die gemessenen Werte beruhen auf dem direkten Vergleich im Verhältnis PBS von außen (zuerst), dann Veeam von innen. Die Durchschnittsberechnung ist einfach der Dreisatz. Du weißt was ich meine?
Kann jetzt nicht ganz folgen. Ich finde die Werte zu deinem Vergleich nicht. Generell wollte ich einmal sehen, wie viel Daten bei Veeam und in welcher Zeit gelesen + geschrieben werden.

Da Veeam sich ins Dateisystem einhängt, gehe ich davon aus, dass es mehr Informationen hat und besser entscheiden kann, was sich verändert hat. Das PBS hingegen sieht nur welche Blöcke sich geändert haben.
 
Hier der erste Vergleich mit einem neuen Test-PBS (i7 3930K, 64GB RAM, LSI 9271-CC HW-RAID5, 4x4TB HGST Server SATA 7200u/min, EXT4 Datei System), diesmal nur 1GBit/s, Backup von einem SSD ZFS-Mirror des PVE09/Windows VM, 128GB RAM, 4,1GHz Takt, im Grunde genommen auch nicht anders bei der Performance als mit dem 10G Links des PBS02 mit ZFS Raidz2

Backup mit nur 1GBit/s Link

INFO: starting new backup job: vzdump 128 --mode snapshot --remove 0 --node pve09 --storage pbs03
INFO: Starting Backup of VM 128 (qemu)
INFO: Backup started at 2021-02-02 19:36:25
INFO: status = running
INFO: VM Name:
INFO: include disk 'scsi0' 'nasomv7-ZFS-SSD1:vm-128-disk-0' 470G
INFO: include disk 'scsi1' 'nasomv7-ZFS-SSD1:vm-128-disk-1' 120G
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: snapshots found (not included into backup)
INFO: creating Proxmox Backup Server archive 'vm/128/2021-02-02T18:36:25Z'
INFO: issuing guest-agent 'fs-freeze' command
INFO: issuing guest-agent 'fs-thaw' command
INFO: started backup task '0f5f02dc-4d56-4938-9d88-8e91dd9dc8c0'
INFO: resuming VM again
INFO: scsi0: dirty-bitmap status: existing bitmap was invalid and has been cleared
INFO: scsi1: dirty-bitmap status: existing bitmap was invalid and has been cleared
INFO: 0% (252.0 MiB of 590.0 GiB) in 3s, read: 84.0 MiB/s, write: 84.0 MiB/s
INFO: 1% (5.9 GiB of 590.0 GiB) in 1m 40s, read: 60.2 MiB/s, write: 58.1 MiB/s
INFO: 2% (11.8 GiB of 590.0 GiB) in 3m 23s, read: 58.3 MiB/s, write: 58.3 MiB/s
INFO: 3% (17.8 GiB of 590.0 GiB) in 5m 4s, read: 60.2 MiB/s, write: 60.2 MiB/s
INFO: 4% (23.7 GiB of 590.0 GiB) in 6m 45s, read: 59.8 MiB/s, write: 59.8 MiB/s
INFO: 5% (29.5 GiB of 590.0 GiB) in 8m 23s, read: 61.4 MiB/s, write: 61.4 MiB/s

Ich messe morgen mit einem 10G Link und berichte.
 

Attachments

  • 2021-02-02 19_53_28-root@nasomv13.png
    2021-02-02 19_53_28-root@nasomv13.png
    29.8 KB · Views: 8
Last edited:
Hab mal kurz einen Vergleich angestellt. Auf meinen Backupserver kann ich via NFS ein Fullbackup (vzdump) machen oder via PBS inkrementell sichern. Folgende Zeiten hab ich jeweils bei backup und restore der vm105 rausbekommen:
1612295073662.png
 
Ich probiere das morgen. Danke für den Hinweis. Ein Versuch ist es wert.
Tatsächlich schein es mit Debian 10 und Bond Modi (10G/1G Kombi), Ausnahme LACP mit gleicher Geschwindigkeit, ein Problem zu geben (durch Zufall heute aufgefallen, bei Debian 9 war dies kein Problem). Das ändert an den gemessenen Werten beim vzdump/PBS Backup jedoch nicht's. Ich habe zum Test den Bond gelöscht und nativ auf das 10G Interface gestellt, ohne Änderung bei der Backupperformance.
Danke jedoch für den Hinweis, damit habe ich den Fehler bei einer OpenMediaVault v5 (die 10G Activ / 1G passiv) hat, gefunden. Danke sehr!
 
Bitte mal die MByte/s mit darstellen.
Backup via PBS:
Code:
INFO: starting new backup job: vzdump 105 --node pve01 --mode snapshot --storage pbs01 --remove 0
INFO: Starting Backup of VM 105 (qemu)
INFO: Backup started at 2021-02-01 18:44:17
INFO: status = running
INFO: VM Name: xxx
INFO: include disk 'scsi0' 'local-lvm:vm-105-disk-0' 1000G
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: snapshots found (not included into backup)
INFO: creating Proxmox Backup Server archive 'vm/105/2021-02-01T17:44:16Z'
INFO: started backup task 'cca66ec2-31a7-4f96-8304-0e5fe713be54'
INFO: resuming VM again
INFO: scsi0: dirty-bitmap status: created new
INFO:   0% (4.0 MiB of 1000.0 GiB) in  3s, read: 1.3 MiB/s, write: 1.3 MiB/s
INFO:   1% (10.5 GiB of 1000.0 GiB) in  1m 59s, read: 92.8 MiB/s, write: 26.8 MiB/s
INFO:   2% (20.1 GiB of 1000.0 GiB) in  3m 34s, read: 103.6 MiB/s, write: 21.3 MiB/s
INFO:   3% (30.0 GiB of 1000.0 GiB) in  4m 44s, read: 144.7 MiB/s, write: 16.5 MiB/s
INFO:   4% (40.0 GiB of 1000.0 GiB) in  8m 13s, read: 49.0 MiB/s, write: 41.6 MiB/s
INFO:   5% (51.4 GiB of 1000.0 GiB) in 10m 16s, read: 94.4 MiB/s, write: 44.7 MiB/s
INFO:   6% (65.0 GiB of 1000.0 GiB) in 10m 19s, read: 4.5 GiB/s, write: 13.3 MiB/s
INFO:   7% (78.8 GiB of 1000.0 GiB) in 10m 22s, read: 4.6 GiB/s, write: 18.7 MiB/s
INFO:   9% (91.5 GiB of 1000.0 GiB) in 10m 25s, read: 4.2 GiB/s, write: 16.0 MiB/s
INFO:  10% (105.4 GiB of 1000.0 GiB) in 10m 28s, read: 4.6 GiB/s, write: 18.7 MiB/s
INFO:  12% (120.2 GiB of 1000.0 GiB) in 10m 31s, read: 4.9 GiB/s, write: 2.7 MiB/s
INFO:  13% (137.3 GiB of 1000.0 GiB) in 10m 34s, read: 5.7 GiB/s, write: 0 B/s
INFO:  15% (154.2 GiB of 1000.0 GiB) in 10m 37s, read: 5.6 GiB/s, write: 0 B/s
INFO:  17% (170.9 GiB of 1000.0 GiB) in 10m 40s, read: 5.6 GiB/s, write: 0 B/s
INFO:  18% (184.2 GiB of 1000.0 GiB) in 10m 43s, read: 4.4 GiB/s, write: 0 B/s
INFO:  20% (200.5 GiB of 1000.0 GiB) in 10m 46s, read: 5.4 GiB/s, write: 0 B/s
INFO:  21% (216.9 GiB of 1000.0 GiB) in 10m 49s, read: 5.5 GiB/s, write: 0 B/s
INFO:  23% (233.8 GiB of 1000.0 GiB) in 10m 52s, read: 5.6 GiB/s, write: 0 B/s
INFO:  25% (250.5 GiB of 1000.0 GiB) in 10m 55s, read: 5.6 GiB/s, write: 0 B/s
INFO:  26% (260.1 GiB of 1000.0 GiB) in 12m 25s, read: 109.3 MiB/s, write: 9.6 MiB/s
INFO:  27% (270.1 GiB of 1000.0 GiB) in 13m 22s, read: 180.3 MiB/s, write: 0 B/s
INFO:  28% (280.2 GiB of 1000.0 GiB) in 13m 42s, read: 514.4 MiB/s, write: 3.2 MiB/s
INFO:  29% (291.3 GiB of 1000.0 GiB) in 13m 46s, read: 2.8 GiB/s, write: 16.0 MiB/s
INFO:  30% (304.6 GiB of 1000.0 GiB) in 13m 49s, read: 4.4 GiB/s, write: 14.7 MiB/s
INFO:  31% (319.8 GiB of 1000.0 GiB) in 13m 52s, read: 5.1 GiB/s, write: 0 B/s
INFO:  33% (334.8 GiB of 1000.0 GiB) in 13m 55s, read: 5.0 GiB/s, write: 0 B/s
INFO:  35% (351.7 GiB of 1000.0 GiB) in 13m 58s, read: 5.6 GiB/s, write: 0 B/s
INFO:  36% (368.6 GiB of 1000.0 GiB) in 14m  1s, read: 5.6 GiB/s, write: 0 B/s
INFO:  38% (385.5 GiB of 1000.0 GiB) in 14m  4s, read: 5.6 GiB/s, write: 0 B/s
INFO:  40% (402.2 GiB of 1000.0 GiB) in 14m  7s, read: 5.6 GiB/s, write: 0 B/s
INFO:  41% (419.1 GiB of 1000.0 GiB) in 14m 10s, read: 5.6 GiB/s, write: 0 B/s
INFO:  43% (436.1 GiB of 1000.0 GiB) in 14m 13s, read: 5.7 GiB/s, write: 0 B/s
INFO:  45% (453.0 GiB of 1000.0 GiB) in 14m 16s, read: 5.6 GiB/s, write: 0 B/s
INFO:  46% (469.8 GiB of 1000.0 GiB) in 14m 19s, read: 5.6 GiB/s, write: 0 B/s
INFO:  48% (486.8 GiB of 1000.0 GiB) in 14m 22s, read: 5.7 GiB/s, write: 0 B/s
INFO:  49% (499.7 GiB of 1000.0 GiB) in 14m 25s, read: 4.3 GiB/s, write: 5.3 MiB/s
INFO:  50% (500.0 GiB of 1000.0 GiB) in 14m 35s, read: 37.2 MiB/s, write: 819.2 KiB/s
INFO:  51% (514.2 GiB of 1000.0 GiB) in 15m 16s, read: 355.4 MiB/s, write: 32.8 MiB/s
INFO:  53% (530.6 GiB of 1000.0 GiB) in 15m 19s, read: 5.5 GiB/s, write: 0 B/s
INFO:  54% (542.3 GiB of 1000.0 GiB) in 15m 23s, read: 2.9 GiB/s, write: 22.0 MiB/s
INFO:  55% (556.2 GiB of 1000.0 GiB) in 15m 26s, read: 4.6 GiB/s, write: 18.7 MiB/s
INFO:  56% (568.9 GiB of 1000.0 GiB) in 15m 29s, read: 4.3 GiB/s, write: 13.3 MiB/s
INFO:  58% (583.0 GiB of 1000.0 GiB) in 15m 32s, read: 4.7 GiB/s, write: 18.7 MiB/s
INFO:  59% (597.1 GiB of 1000.0 GiB) in 15m 35s, read: 4.7 GiB/s, write: 18.7 MiB/s
INFO:  61% (613.2 GiB of 1000.0 GiB) in 15m 38s, read: 5.4 GiB/s, write: 6.7 MiB/s
INFO:  62% (628.3 GiB of 1000.0 GiB) in 15m 41s, read: 5.0 GiB/s, write: 0 B/s
INFO:  63% (637.5 GiB of 1000.0 GiB) in 15m 44s, read: 3.1 GiB/s, write: 0 B/s
INFO:  64% (648.7 GiB of 1000.0 GiB) in 15m 47s, read: 3.8 GiB/s, write: 0 B/s
INFO:  66% (661.3 GiB of 1000.0 GiB) in 15m 50s, read: 4.2 GiB/s, write: 0 B/s
INFO:  67% (674.0 GiB of 1000.0 GiB) in 15m 53s, read: 4.2 GiB/s, write: 0 B/s
INFO:  68% (687.3 GiB of 1000.0 GiB) in 15m 56s, read: 4.4 GiB/s, write: 0 B/s
INFO:  70% (701.4 GiB of 1000.0 GiB) in 15m 59s, read: 4.7 GiB/s, write: 0 B/s
INFO:  71% (716.7 GiB of 1000.0 GiB) in 16m  2s, read: 5.1 GiB/s, write: 0 B/s
INFO:  73% (732.4 GiB of 1000.0 GiB) in 16m  5s, read: 5.3 GiB/s, write: 0 B/s
INFO:  74% (747.5 GiB of 1000.0 GiB) in 16m  8s, read: 5.0 GiB/s, write: 0 B/s
INFO:  75% (750.0 GiB of 1000.0 GiB) in 16m 35s, read: 96.3 MiB/s, write: 28.0 MiB/s
INFO:  76% (760.1 GiB of 1000.0 GiB) in 18m 12s, read: 105.8 MiB/s, write: 633.4 KiB/s
INFO:  77% (772.9 GiB of 1000.0 GiB) in 19m  3s, read: 256.8 MiB/s, write: 2.3 MiB/s
INFO:  78% (781.5 GiB of 1000.0 GiB) in 19m  6s, read: 2.9 GiB/s, write: 20.0 MiB/s
INFO:  79% (794.5 GiB of 1000.0 GiB) in 19m  9s, read: 4.3 GiB/s, write: 17.3 MiB/s
INFO:  80% (805.6 GiB of 1000.0 GiB) in 19m 12s, read: 3.7 GiB/s, write: 14.7 MiB/s
INFO:  81% (819.8 GiB of 1000.0 GiB) in 19m 15s, read: 4.7 GiB/s, write: 9.3 MiB/s
INFO:  83% (835.6 GiB of 1000.0 GiB) in 19m 18s, read: 5.3 GiB/s, write: 6.7 MiB/s
INFO:  85% (852.1 GiB of 1000.0 GiB) in 19m 21s, read: 5.5 GiB/s, write: 0 B/s
INFO:  86% (868.9 GiB of 1000.0 GiB) in 19m 24s, read: 5.6 GiB/s, write: 0 B/s
INFO:  88% (885.2 GiB of 1000.0 GiB) in 19m 27s, read: 5.4 GiB/s, write: 0 B/s
INFO:  90% (901.9 GiB of 1000.0 GiB) in 19m 30s, read: 5.5 GiB/s, write: 0 B/s
INFO:  91% (918.7 GiB of 1000.0 GiB) in 19m 33s, read: 5.6 GiB/s, write: 0 B/s
INFO:  93% (935.1 GiB of 1000.0 GiB) in 19m 36s, read: 5.5 GiB/s, write: 0 B/s
INFO:  95% (951.9 GiB of 1000.0 GiB) in 19m 39s, read: 5.6 GiB/s, write: 0 B/s
INFO:  96% (967.3 GiB of 1000.0 GiB) in 19m 42s, read: 5.1 GiB/s, write: 0 B/s
INFO:  98% (983.9 GiB of 1000.0 GiB) in 19m 45s, read: 5.5 GiB/s, write: 0 B/s
INFO:  99% (998.0 GiB of 1000.0 GiB) in 19m 48s, read: 4.7 GiB/s, write: 6.7 MiB/s
INFO: 100% (1000.0 GiB of 1000.0 GiB) in 20m 12s, read: 84.8 MiB/s, write: 4.0 MiB/s
INFO: backup is sparse: 912.32 GiB (91%) total zero data
INFO: backup was done incrementally, reused 975.93 GiB (97%)
INFO: transferred 1000.00 GiB in 1212 seconds (844.9 MiB/s)
INFO: Finished Backup of VM 105 (00:20:15)
INFO: Backup finished at 2021-02-01 19:04:31
INFO: Backup job finished successfully
TASK OK
 
Bitte mal die MByte/s mit darstellen.
Restore via PBS:
Code:
WARNING: You have not turned on protection against thin pools running out of space.
  WARNING: Set activation/thin_pool_autoextend_threshold below 100 to trigger automatic extension of thin pools before they get full.
  Logical volume "vm-105-disk-0" created.
  WARNING: Sum of all thin volume sizes (<1.85 TiB) exceeds the size of thin pool pve/data and the size of whole volume group (836.12 GiB).
new volume ID is 'local-lvm:vm-105-disk-0'
restore proxmox backup image: /usr/bin/pbs-restore --repository backup@pbs@<Proxmox-Backup-Server-IP>:pbs01 vm/105/2021-02-01T17:44:16Z drive-scsi0.img.fidx /dev/pve/vm-105-disk-0 --verbose --format raw --skip-zero
connecting to repository 'backup@pbs@<Proxmox-Backup-Server-IP>:pbs01'
open block backend for target '/dev/pve/vm-105-disk-0'
starting to restore snapshot 'vm/105/2021-02-01T17:44:16Z'
download and verify backup index
progress 1% (read 10737418240 bytes, zeroes = 23% (2499805184 bytes), duration 295 sec)
progress 2% (read 21474836480 bytes, zeroes = 14% (3204448256 bytes), duration 696 sec)
progress 3% (read 32212254720 bytes, zeroes = 9% (3204448256 bytes), duration 1183 sec)
progress 4% (read 42949672960 bytes, zeroes = 10% (4500488192 bytes), duration 1436 sec)
progress 5% (read 53687091200 bytes, zeroes = 18% (9714008064 bytes), duration 1581 sec)
progress 6% (read 64424509440 bytes, zeroes = 31% (20409483264 bytes), duration 1581 sec)
progress 7% (read 75161927680 bytes, zeroes = 41% (31104958464 bytes), duration 1582 sec)
progress 8% (read 85899345920 bytes, zeroes = 48% (41800433664 bytes), duration 1582 sec)
progress 9% (read 96636764160 bytes, zeroes = 54% (52495908864 bytes), duration 1583 sec)
progress 10% (read 107374182400 bytes, zeroes = 58% (63191384064 bytes), duration 1583 sec)
progress 11% (read 118111600640 bytes, zeroes = 62% (73899442176 bytes), duration 1583 sec)
progress 12% (read 128849018880 bytes, zeroes = 65% (84636860416 bytes), duration 1583 sec)
progress 13% (read 139586437120 bytes, zeroes = 68% (95374278656 bytes), duration 1583 sec)
progress 14% (read 150323855360 bytes, zeroes = 70% (106111696896 bytes), duration 1583 sec)
progress 15% (read 161061273600 bytes, zeroes = 72% (116849115136 bytes), duration 1583 sec)
progress 16% (read 171798691840 bytes, zeroes = 74% (127586533376 bytes), duration 1583 sec)
progress 17% (read 182536110080 bytes, zeroes = 75% (138323951616 bytes), duration 1583 sec)
progress 18% (read 193273528320 bytes, zeroes = 77% (149061369856 bytes), duration 1583 sec)
progress 19% (read 204010946560 bytes, zeroes = 78% (159798788096 bytes), duration 1583 sec)
progress 20% (read 214748364800 bytes, zeroes = 79% (170536206336 bytes), duration 1583 sec)
progress 21% (read 225485783040 bytes, zeroes = 80% (181273624576 bytes), duration 1583 sec)
progress 22% (read 236223201280 bytes, zeroes = 81% (192011042816 bytes), duration 1583 sec)
progress 23% (read 246960619520 bytes, zeroes = 82% (202748461056 bytes), duration 1583 sec)
progress 24% (read 257698037760 bytes, zeroes = 82% (213485879296 bytes), duration 1583 sec)
progress 25% (read 268435456000 bytes, zeroes = 83% (224223297536 bytes), duration 1583 sec)
progress 26% (read 279172874240 bytes, zeroes = 80% (224516898816 bytes), duration 2002 sec)
progress 27% (read 289910292480 bytes, zeroes = 77% (224516898816 bytes), duration 2467 sec)
progress 28% (read 300647710720 bytes, zeroes = 77% (232733540352 bytes), duration 2570 sec)
progress 29% (read 311385128960 bytes, zeroes = 78% (243210911744 bytes), duration 2576 sec)
progress 30% (read 322122547200 bytes, zeroes = 78% (253906386944 bytes), duration 2576 sec)
progress 31% (read 332859965440 bytes, zeroes = 79% (264614445056 bytes), duration 2577 sec)
progress 32% (read 343597383680 bytes, zeroes = 80% (275301531648 bytes), duration 2578 sec)
progress 33% (read 354334801920 bytes, zeroes = 80% (285997006848 bytes), duration 2579 sec)
progress 34% (read 365072220160 bytes, zeroes = 81% (296717647872 bytes), duration 2579 sec)
progress 35% (read 375809638400 bytes, zeroes = 81% (307455066112 bytes), duration 2579 sec)
progress 36% (read 386547056640 bytes, zeroes = 82% (318192484352 bytes), duration 2579 sec)
progress 37% (read 397284474880 bytes, zeroes = 82% (328929902592 bytes), duration 2579 sec)
progress 38% (read 408021893120 bytes, zeroes = 83% (339667320832 bytes), duration 2579 sec)
progress 39% (read 418759311360 bytes, zeroes = 83% (350404739072 bytes), duration 2579 sec)
progress 40% (read 429496729600 bytes, zeroes = 84% (361142157312 bytes), duration 2579 sec)
progress 41% (read 440234147840 bytes, zeroes = 84% (371879575552 bytes), duration 2579 sec)
progress 42% (read 450971566080 bytes, zeroes = 84% (382616993792 bytes), duration 2579 sec)
progress 43% (read 461708984320 bytes, zeroes = 85% (393354412032 bytes), duration 2579 sec)
progress 44% (read 472446402560 bytes, zeroes = 85% (404091830272 bytes), duration 2579 sec)
progress 45% (read 483183820800 bytes, zeroes = 85% (414829248512 bytes), duration 2579 sec)
progress 46% (read 493921239040 bytes, zeroes = 86% (425566666752 bytes), duration 2579 sec)
progress 47% (read 504658657280 bytes, zeroes = 86% (436304084992 bytes), duration 2579 sec)
progress 48% (read 515396075520 bytes, zeroes = 86% (447041503232 bytes), duration 2579 sec)
progress 49% (read 526133493760 bytes, zeroes = 87% (457778921472 bytes), duration 2579 sec)
progress 50% (read 536870912000 bytes, zeroes = 87% (467975274496 bytes), duration 2592 sec)
progress 51% (read 547608330240 bytes, zeroes = 87% (476846227456 bytes), duration 2639 sec)
progress 52% (read 558345748480 bytes, zeroes = 87% (487583645696 bytes), duration 2639 sec)
progress 53% (read 569083166720 bytes, zeroes = 87% (498321063936 bytes), duration 2639 sec)
progress 54% (read 579820584960 bytes, zeroes = 87% (508836184064 bytes), duration 2643 sec)
progress 55% (read 590558003200 bytes, zeroes = 87% (519531659264 bytes), duration 2643 sec)
progress 56% (read 601295421440 bytes, zeroes = 88% (530227134464 bytes), duration 2643 sec)
progress 57% (read 612032839680 bytes, zeroes = 88% (540926803968 bytes), duration 2644 sec)
progress 58% (read 622770257920 bytes, zeroes = 88% (551622279168 bytes), duration 2644 sec)
progress 59% (read 633507676160 bytes, zeroes = 88% (562317754368 bytes), duration 2644 sec)
progress 60% (read 644245094400 bytes, zeroes = 88% (573013229568 bytes), duration 2644 sec)
progress 61% (read 654982512640 bytes, zeroes = 89% (583742259200 bytes), duration 2644 sec)
progress 62% (read 665719930880 bytes, zeroes = 89% (594479677440 bytes), duration 2644 sec)
progress 63% (read 676457349120 bytes, zeroes = 89% (605217095680 bytes), duration 2644 sec)
progress 64% (read 687194767360 bytes, zeroes = 89% (615954513920 bytes), duration 2644 sec)
progress 65% (read 697932185600 bytes, zeroes = 89% (626691932160 bytes), duration 2644 sec)
progress 66% (read 708669603840 bytes, zeroes = 89% (637429350400 bytes), duration 2644 sec)
progress 67% (read 719407022080 bytes, zeroes = 90% (648166768640 bytes), duration 2644 sec)
progress 68% (read 730144440320 bytes, zeroes = 90% (658904186880 bytes), duration 2644 sec)
progress 69% (read 740881858560 bytes, zeroes = 90% (669641605120 bytes), duration 2644 sec)
progress 70% (read 751619276800 bytes, zeroes = 90% (680379023360 bytes), duration 2644 sec)
progress 71% (read 762356695040 bytes, zeroes = 90% (691116441600 bytes), duration 2644 sec)
progress 72% (read 773094113280 bytes, zeroes = 90% (701853859840 bytes), duration 2644 sec)
progress 73% (read 783831531520 bytes, zeroes = 90% (712591278080 bytes), duration 2644 sec)
progress 74% (read 794568949760 bytes, zeroes = 91% (723328696320 bytes), duration 2644 sec)
progress 75% (read 805306368000 bytes, zeroes = 90% (732782657536 bytes), duration 2677 sec)
progress 76% (read 816043786240 bytes, zeroes = 89% (732866543616 bytes), duration 3137 sec)
progress 77% (read 826781204480 bytes, zeroes = 88% (734863032320 bytes), duration 3376 sec)
progress 78% (read 837518622720 bytes, zeroes = 89% (745545924608 bytes), duration 3376 sec)
progress 79% (read 848256040960 bytes, zeroes = 89% (756082016256 bytes), duration 3378 sec)
progress 80% (read 858993459200 bytes, zeroes = 89% (766777491456 bytes), duration 3379 sec)
progress 81% (read 869730877440 bytes, zeroes = 89% (777472966656 bytes), duration 3379 sec)
progress 82% (read 880468295680 bytes, zeroes = 89% (788172636160 bytes), duration 3379 sec)
progress 83% (read 891205713920 bytes, zeroes = 89% (798889082880 bytes), duration 3379 sec)
progress 84% (read 901943132160 bytes, zeroes = 89% (809626501120 bytes), duration 3379 sec)
progress 85% (read 912680550400 bytes, zeroes = 89% (820363919360 bytes), duration 3379 sec)
progress 86% (read 923417968640 bytes, zeroes = 90% (831101337600 bytes), duration 3379 sec)
progress 87% (read 934155386880 bytes, zeroes = 90% (841838755840 bytes), duration 3379 sec)
progress 88% (read 944892805120 bytes, zeroes = 90% (852576174080 bytes), duration 3379 sec)
progress 89% (read 955630223360 bytes, zeroes = 90% (863313592320 bytes), duration 3379 sec)
progress 90% (read 966367641600 bytes, zeroes = 90% (874051010560 bytes), duration 3379 sec)
progress 91% (read 977105059840 bytes, zeroes = 90% (884788428800 bytes), duration 3379 sec)
progress 92% (read 987842478080 bytes, zeroes = 90% (895525847040 bytes), duration 3379 sec)
progress 93% (read 998579896320 bytes, zeroes = 90% (906263265280 bytes), duration 3379 sec)
progress 94% (read 1009317314560 bytes, zeroes = 90% (917000683520 bytes), duration 3379 sec)
progress 95% (read 1020054732800 bytes, zeroes = 90% (927738101760 bytes), duration 3379 sec)
progress 96% (read 1030792151040 bytes, zeroes = 91% (938475520000 bytes), duration 3379 sec)
progress 97% (read 1041529569280 bytes, zeroes = 91% (949212938240 bytes), duration 3379 sec)
progress 98% (read 1052266987520 bytes, zeroes = 91% (959950356480 bytes), duration 3379 sec)
progress 99% (read 1063004405760 bytes, zeroes = 91% (970687774720 bytes), duration 3379 sec)
progress 100% (read 1073741824000 bytes, zeroes = 91% (979596476416 bytes), duration 3409 sec)
restore image complete (bytes=1073741824000, duration=3409.67s, speed=300.32MB/s)
rescan volumes...
TASK OK
 
Bitte mal die MByte/s mit darstellen.
Backup via NFS:
Code:
INFO: starting new backup job: vzdump 105 --remove 0 --storage pvestor01 --compress zstd --mode snapshot --node pve01
INFO: Starting Backup of VM 105 (qemu)
INFO: Backup started at 2021-02-01 17:33:28
INFO: status = running
INFO: VM Name: xxx
INFO: include disk 'scsi0' 'local-lvm:vm-105-disk-0' 1000G
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: snapshots found (not included into backup)
INFO: creating vzdump archive '/mnt/pve/pvestor01/dump/vzdump-qemu-105-2021_02_01-17_33_28.vma.zst'
INFO: started backup task '11391754-88fc-499e-bed7-c53316ee1ab6'
INFO: resuming VM again
INFO:   0% (90.9 MiB of 1000.0 GiB) in  3s, read: 30.3 MiB/s, write: 28.0 MiB/s
INFO:   1% (10.1 GiB of 1000.0 GiB) in  1m 52s, read: 94.5 MiB/s, write: 69.8 MiB/s
INFO:   2% (20.1 GiB of 1000.0 GiB) in  3m 27s, read: 106.9 MiB/s, write: 101.2 MiB/s
INFO:   3% (30.0 GiB of 1000.0 GiB) in  5m 17s, read: 92.9 MiB/s, write: 92.9 MiB/s
INFO:   4% (40.1 GiB of 1000.0 GiB) in  6m 51s, read: 109.0 MiB/s, write: 93.5 MiB/s
INFO:   5% (50.8 GiB of 1000.0 GiB) in  7m 50s, read: 187.3 MiB/s, write: 88.3 MiB/s
INFO:   6% (61.0 GiB of 1000.0 GiB) in  7m 57s, read: 1.5 GiB/s, write: 91.4 KiB/s
INFO:   7% (71.4 GiB of 1000.0 GiB) in  8m  3s, read: 1.7 GiB/s, write: 105.3 KiB/s
INFO:   8% (81.6 GiB of 1000.0 GiB) in  8m  9s, read: 1.7 GiB/s, write: 106.7 KiB/s
INFO:   9% (90.1 GiB of 1000.0 GiB) in  8m 14s, read: 1.7 GiB/s, write: 102.4 KiB/s
INFO:  10% (100.6 GiB of 1000.0 GiB) in  8m 20s, read: 1.7 GiB/s, write: 117.3 KiB/s
INFO:  11% (111.8 GiB of 1000.0 GiB) in  8m 26s, read: 1.9 GiB/s, write: 64.0 KiB/s
INFO:  12% (121.2 GiB of 1000.0 GiB) in  8m 31s, read: 1.9 GiB/s, write: 0 B/s
INFO:  13% (130.9 GiB of 1000.0 GiB) in  8m 36s, read: 1.9 GiB/s, write: 0 B/s
INFO:  14% (140.6 GiB of 1000.0 GiB) in  8m 41s, read: 1.9 GiB/s, write: 0 B/s
INFO:  15% (151.9 GiB of 1000.0 GiB) in  8m 47s, read: 1.9 GiB/s, write: 0 B/s
INFO:  16% (161.7 GiB of 1000.0 GiB) in  8m 52s, read: 2.0 GiB/s, write: 0 B/s
INFO:  17% (171.4 GiB of 1000.0 GiB) in  8m 57s, read: 1.9 GiB/s, write: 0 B/s
INFO:  18% (181.2 GiB of 1000.0 GiB) in  9m  2s, read: 2.0 GiB/s, write: 0 B/s
INFO:  19% (191.0 GiB of 1000.0 GiB) in  9m  7s, read: 1.9 GiB/s, write: 0 B/s
INFO:  20% (200.7 GiB of 1000.0 GiB) in  9m 12s, read: 2.0 GiB/s, write: 0 B/s
INFO:  21% (210.1 GiB of 1000.0 GiB) in  9m 17s, read: 1.9 GiB/s, write: 0 B/s
INFO:  22% (221.7 GiB of 1000.0 GiB) in  9m 23s, read: 1.9 GiB/s, write: 0 B/s
INFO:  23% (231.4 GiB of 1000.0 GiB) in  9m 28s, read: 1.9 GiB/s, write: 0 B/s
INFO:  24% (241.1 GiB of 1000.0 GiB) in  9m 33s, read: 1.9 GiB/s, write: 0 B/s
INFO:  25% (250.3 GiB of 1000.0 GiB) in  9m 38s, read: 1.8 GiB/s, write: 896.0 KiB/s
INFO:  26% (260.1 GiB of 1000.0 GiB) in 12m  1s, read: 70.4 MiB/s, write: 68.8 MiB/s
INFO:  27% (270.0 GiB of 1000.0 GiB) in 14m 29s, read: 68.6 MiB/s, write: 68.6 MiB/s
INFO:  28% (280.7 GiB of 1000.0 GiB) in 15m 16s, read: 231.8 MiB/s, write: 50.1 MiB/s
INFO:  29% (291.9 GiB of 1000.0 GiB) in 15m 24s, read: 1.4 GiB/s, write: 1.1 MiB/s
INFO:  30% (300.7 GiB of 1000.0 GiB) in 15m 29s, read: 1.8 GiB/s, write: 115.2 KiB/s
INFO:  31% (311.3 GiB of 1000.0 GiB) in 15m 35s, read: 1.8 GiB/s, write: 64.0 KiB/s
INFO:  32% (320.8 GiB of 1000.0 GiB) in 15m 41s, read: 1.6 GiB/s, write: 100.0 KiB/s
INFO:  33% (330.9 GiB of 1000.0 GiB) in 15m 50s, read: 1.1 GiB/s, write: 71.1 KiB/s
INFO:  34% (341.5 GiB of 1000.0 GiB) in 15m 58s, read: 1.3 GiB/s, write: 24.0 KiB/s
INFO:  35% (350.4 GiB of 1000.0 GiB) in 16m  5s, read: 1.3 GiB/s, write: 0 B/s
INFO:  36% (361.5 GiB of 1000.0 GiB) in 16m 12s, read: 1.6 GiB/s, write: 0 B/s
INFO:  37% (370.5 GiB of 1000.0 GiB) in 16m 19s, read: 1.3 GiB/s, write: 0 B/s
INFO:  38% (380.8 GiB of 1000.0 GiB) in 16m 27s, read: 1.3 GiB/s, write: 0 B/s
INFO:  39% (390.7 GiB of 1000.0 GiB) in 16m 34s, read: 1.4 GiB/s, write: 0 B/s
INFO:  40% (400.9 GiB of 1000.0 GiB) in 16m 40s, read: 1.7 GiB/s, write: 0 B/s
INFO:  41% (411.1 GiB of 1000.0 GiB) in 16m 46s, read: 1.7 GiB/s, write: 0 B/s
INFO:  42% (421.4 GiB of 1000.0 GiB) in 16m 52s, read: 1.7 GiB/s, write: 0 B/s
INFO:  43% (431.7 GiB of 1000.0 GiB) in 16m 58s, read: 1.7 GiB/s, write: 0 B/s
INFO:  44% (440.4 GiB of 1000.0 GiB) in 17m  3s, read: 1.7 GiB/s, write: 0 B/s
INFO:  45% (451.7 GiB of 1000.0 GiB) in 17m  9s, read: 1.9 GiB/s, write: 0 B/s
INFO:  46% (460.6 GiB of 1000.0 GiB) in 17m 14s, read: 1.8 GiB/s, write: 0 B/s
INFO:  47% (470.1 GiB of 1000.0 GiB) in 17m 19s, read: 1.9 GiB/s, write: 0 B/s
INFO:  48% (481.4 GiB of 1000.0 GiB) in 17m 26s, read: 1.6 GiB/s, write: 9.1 KiB/s
INFO:  49% (490.7 GiB of 1000.0 GiB) in 17m 31s, read: 1.9 GiB/s, write: 0 B/s
INFO:  50% (500.0 GiB of 1000.0 GiB) in 18m  0s, read: 327.0 MiB/s, write: 17.8 MiB/s
INFO:  51% (511.8 GiB of 1000.0 GiB) in 18m 57s, read: 211.9 MiB/s, write: 27.5 MiB/s
INFO:  52% (521.0 GiB of 1000.0 GiB) in 19m  2s, read: 1.8 GiB/s, write: 0 B/s
INFO:  53% (530.1 GiB of 1000.0 GiB) in 19m  7s, read: 1.8 GiB/s, write: 0 B/s
INFO:  54% (540.4 GiB of 1000.0 GiB) in 19m 14s, read: 1.5 GiB/s, write: 1.4 MiB/s
INFO:  55% (551.5 GiB of 1000.0 GiB) in 19m 21s, read: 1.6 GiB/s, write: 100.6 KiB/s
INFO:  56% (561.4 GiB of 1000.0 GiB) in 19m 27s, read: 1.6 GiB/s, write: 106.7 KiB/s
INFO:  57% (570.1 GiB of 1000.0 GiB) in 19m 32s, read: 1.8 GiB/s, write: 88.0 KiB/s
INFO:  58% (580.5 GiB of 1000.0 GiB) in 19m 39s, read: 1.5 GiB/s, write: 91.4 KiB/s
INFO:  59% (590.9 GiB of 1000.0 GiB) in 19m 45s, read: 1.7 GiB/s, write: 106.7 KiB/s
INFO:  60% (601.5 GiB of 1000.0 GiB) in 19m 51s, read: 1.8 GiB/s, write: 117.3 KiB/s
INFO:  61% (610.4 GiB of 1000.0 GiB) in 19m 56s, read: 1.8 GiB/s, write: 0 B/s
INFO:  62% (621.2 GiB of 1000.0 GiB) in 20m  2s, read: 1.8 GiB/s, write: 0 B/s
INFO:  63% (631.2 GiB of 1000.0 GiB) in 20m  8s, read: 1.7 GiB/s, write: 0 B/s
INFO:  64% (640.1 GiB of 1000.0 GiB) in 20m 13s, read: 1.8 GiB/s, write: 0 B/s
INFO:  65% (651.5 GiB of 1000.0 GiB) in 20m 19s, read: 1.9 GiB/s, write: 0 B/s
INFO:  66% (660.8 GiB of 1000.0 GiB) in 20m 24s, read: 1.9 GiB/s, write: 0 B/s
INFO:  67% (671.4 GiB of 1000.0 GiB) in 20m 30s, read: 1.8 GiB/s, write: 0 B/s
INFO:  68% (680.8 GiB of 1000.0 GiB) in 20m 35s, read: 1.9 GiB/s, write: 0 B/s
INFO:  69% (691.8 GiB of 1000.0 GiB) in 20m 41s, read: 1.8 GiB/s, write: 0 B/s
INFO:  70% (701.0 GiB of 1000.0 GiB) in 20m 46s, read: 1.8 GiB/s, write: 12.8 KiB/s
INFO:  71% (710.6 GiB of 1000.0 GiB) in 20m 51s, read: 1.9 GiB/s, write: 0 B/s
INFO:  72% (721.6 GiB of 1000.0 GiB) in 20m 57s, read: 1.8 GiB/s, write: 0 B/s
INFO:  73% (730.9 GiB of 1000.0 GiB) in 21m  2s, read: 1.9 GiB/s, write: 0 B/s
INFO:  74% (740.1 GiB of 1000.0 GiB) in 21m  7s, read: 1.8 GiB/s, write: 0 B/s
INFO:  75% (750.1 GiB of 1000.0 GiB) in 22m  0s, read: 193.3 MiB/s, write: 21.2 MiB/s
INFO:  76% (760.1 GiB of 1000.0 GiB) in 24m 34s, read: 66.2 MiB/s, write: 65.9 MiB/s
INFO:  77% (770.5 GiB of 1000.0 GiB) in 26m  4s, read: 118.8 MiB/s, write: 91.7 MiB/s
INFO:  78% (781.0 GiB of 1000.0 GiB) in 26m 12s, read: 1.3 GiB/s, write: 1.3 MiB/s
INFO:  79% (790.6 GiB of 1000.0 GiB) in 26m 18s, read: 1.6 GiB/s, write: 296.0 KiB/s
INFO:  80% (800.7 GiB of 1000.0 GiB) in 26m 24s, read: 1.7 GiB/s, write: 117.3 KiB/s
INFO:  81% (810.2 GiB of 1000.0 GiB) in 26m 30s, read: 1.6 GiB/s, write: 96.0 KiB/s
INFO:  82% (821.5 GiB of 1000.0 GiB) in 26m 38s, read: 1.4 GiB/s, write: 69.0 KiB/s
INFO:  83% (831.6 GiB of 1000.0 GiB) in 26m 44s, read: 1.7 GiB/s, write: 32.0 KiB/s
INFO:  84% (840.5 GiB of 1000.0 GiB) in 26m 49s, read: 1.8 GiB/s, write: 0 B/s
INFO:  85% (851.6 GiB of 1000.0 GiB) in 26m 55s, read: 1.9 GiB/s, write: 0 B/s
INFO:  86% (860.9 GiB of 1000.0 GiB) in 27m  0s, read: 1.9 GiB/s, write: 0 B/s
INFO:  87% (870.2 GiB of 1000.0 GiB) in 27m  5s, read: 1.8 GiB/s, write: 0 B/s
INFO:  88% (880.7 GiB of 1000.0 GiB) in 27m 11s, read: 1.8 GiB/s, write: 0 B/s
INFO:  89% (891.7 GiB of 1000.0 GiB) in 27m 17s, read: 1.8 GiB/s, write: 0 B/s
INFO:  90% (900.9 GiB of 1000.0 GiB) in 27m 22s, read: 1.8 GiB/s, write: 0 B/s
INFO:  91% (910.3 GiB of 1000.0 GiB) in 27m 27s, read: 1.9 GiB/s, write: 0 B/s
INFO:  92% (920.5 GiB of 1000.0 GiB) in 27m 33s, read: 1.7 GiB/s, write: 0 B/s
INFO:  93% (931.6 GiB of 1000.0 GiB) in 27m 39s, read: 1.8 GiB/s, write: 0 B/s
INFO:  94% (940.9 GiB of 1000.0 GiB) in 27m 44s, read: 1.9 GiB/s, write: 0 B/s
INFO:  95% (950.9 GiB of 1000.0 GiB) in 27m 50s, read: 1.7 GiB/s, write: 0 B/s
INFO:  96% (961.6 GiB of 1000.0 GiB) in 27m 57s, read: 1.5 GiB/s, write: 0 B/s
INFO:  97% (970.2 GiB of 1000.0 GiB) in 28m  2s, read: 1.7 GiB/s, write: 0 B/s
INFO:  98% (980.7 GiB of 1000.0 GiB) in 28m  8s, read: 1.7 GiB/s, write: 0 B/s
INFO:  99% (991.4 GiB of 1000.0 GiB) in 28m 14s, read: 1.8 GiB/s, write: 0 B/s
INFO: 100% (1000.0 GiB of 1000.0 GiB) in 28m 48s, read: 258.6 MiB/s, write: 46.1 MiB/s
INFO: backup is sparse: 914.95 GiB (91%) total zero data
INFO: transferred 1000.00 GiB in 1728 seconds (592.6 MiB/s)
INFO: archive file size: 79.21GB
INFO: Finished Backup of VM 105 (00:28:52)
INFO: Backup finished at 2021-02-01 18:02:20
INFO: Backup job finished successfully
TASK OK
 
Bitte mal die MByte/s mit darstellen.
Restore via NFS:
Code:
restore vma archive: zstd -q -d -c /mnt/pve/pvestor01/dump/vzdump-qemu-105-2021_02_01-17_33_28.vma.zst | vma extract -v -r /var/tmp/vzdumptmp27460.fifo - /var/tmp/vzdumptmp27460
CFG: size: 389 name: qemu-server.conf
CFG: size: 65 name: qemu-server.fw
DEV: dev_id=1 size: 1073741824000 devname: drive-scsi0
CTIME: Mon Feb  1 17:33:32 2021
  WARNING: You have not turned on protection against thin pools running out of space.
  WARNING: Set activation/thin_pool_autoextend_threshold below 100 to trigger automatic extension of thin pools before they get full.
  Logical volume "vm-105-disk-0" created.
  WARNING: Sum of all thin volume sizes (<1.85 TiB) exceeds the size of thin pool pve/data and the size of whole volume group (836.12 GiB).
new volume ID is 'local-lvm:vm-105-disk-0'
map 'drive-scsi0' to '/dev/pve/vm-105-disk-0' (write zeros = 0)
progress 1% (read 10737418240 bytes, duration 73 sec)
progress 2% (read 21474836480 bytes, duration 175 sec)
progress 3% (read 32212254720 bytes, duration 283 sec)
progress 4% (read 42949672960 bytes, duration 376 sec)
progress 5% (read 53687091200 bytes, duration 431 sec)
progress 6% (read 64424509440 bytes, duration 432 sec)
progress 7% (read 75161927680 bytes, duration 433 sec)
progress 8% (read 85899345920 bytes, duration 433 sec)
progress 9% (read 96636764160 bytes, duration 434 sec)
progress 10% (read 107374182400 bytes, duration 435 sec)
progress 11% (read 118111600640 bytes, duration 435 sec)
progress 12% (read 128849018880 bytes, duration 436 sec)
progress 13% (read 139586437120 bytes, duration 437 sec)
progress 14% (read 150323855360 bytes, duration 438 sec)
progress 15% (read 161061273600 bytes, duration 438 sec)
progress 16% (read 171798691840 bytes, duration 439 sec)
progress 17% (read 182536110080 bytes, duration 440 sec)
progress 18% (read 193273528320 bytes, duration 440 sec)
progress 19% (read 204010946560 bytes, duration 441 sec)
progress 20% (read 214748364800 bytes, duration 442 sec)
progress 21% (read 225485783040 bytes, duration 442 sec)
progress 22% (read 236223201280 bytes, duration 443 sec)
progress 23% (read 246960619520 bytes, duration 444 sec)
progress 24% (read 257698037760 bytes, duration 444 sec)
progress 25% (read 268435456000 bytes, duration 445 sec)
progress 26% (read 279172874240 bytes, duration 536 sec)
progress 27% (read 289910292480 bytes, duration 644 sec)
progress 28% (read 300647710720 bytes, duration 667 sec)
progress 29% (read 311385128960 bytes, duration 667 sec)
progress 30% (read 322122547200 bytes, duration 668 sec)
progress 31% (read 332859965440 bytes, duration 669 sec)
progress 32% (read 343597383680 bytes, duration 669 sec)
progress 33% (read 354334801920 bytes, duration 670 sec)
progress 34% (read 365072220160 bytes, duration 671 sec)
progress 35% (read 375809638400 bytes, duration 671 sec)
progress 36% (read 386547056640 bytes, duration 672 sec)
progress 37% (read 397284474880 bytes, duration 673 sec)
progress 38% (read 408021893120 bytes, duration 674 sec)
progress 39% (read 418759311360 bytes, duration 674 sec)
progress 40% (read 429496729600 bytes, duration 675 sec)
progress 41% (read 440234147840 bytes, duration 676 sec)
progress 42% (read 450971566080 bytes, duration 676 sec)
progress 43% (read 461708984320 bytes, duration 677 sec)
progress 44% (read 472446402560 bytes, duration 678 sec)
progress 45% (read 483183820800 bytes, duration 679 sec)
progress 46% (read 493921239040 bytes, duration 679 sec)
progress 47% (read 504658657280 bytes, duration 680 sec)
progress 48% (read 515396075520 bytes, duration 681 sec)
progress 49% (read 526133493760 bytes, duration 681 sec)
progress 50% (read 536870912000 bytes, duration 684 sec)
progress 51% (read 547608330240 bytes, duration 695 sec)
progress 52% (read 558345748480 bytes, duration 695 sec)
progress 53% (read 569083166720 bytes, duration 696 sec)
progress 54% (read 579820584960 bytes, duration 697 sec)
progress 55% (read 590558003200 bytes, duration 697 sec)
progress 56% (read 601295421440 bytes, duration 698 sec)
progress 57% (read 612032839680 bytes, duration 699 sec)
progress 58% (read 622770257920 bytes, duration 700 sec)
progress 59% (read 633507676160 bytes, duration 700 sec)
progress 60% (read 644245094400 bytes, duration 701 sec)
progress 61% (read 654982512640 bytes, duration 702 sec)
progress 62% (read 665719930880 bytes, duration 702 sec)
progress 63% (read 676457349120 bytes, duration 703 sec)
progress 64% (read 687194767360 bytes, duration 704 sec)
progress 65% (read 697932185600 bytes, duration 704 sec)
progress 66% (read 708669603840 bytes, duration 705 sec)
progress 67% (read 719407022080 bytes, duration 706 sec)
progress 68% (read 730144440320 bytes, duration 707 sec)
progress 69% (read 740881858560 bytes, duration 707 sec)
progress 70% (read 751619276800 bytes, duration 708 sec)
progress 71% (read 762356695040 bytes, duration 709 sec)
progress 72% (read 773094113280 bytes, duration 709 sec)
progress 73% (read 783831531520 bytes, duration 710 sec)
progress 74% (read 794568949760 bytes, duration 711 sec)
progress 75% (read 805306368000 bytes, duration 718 sec)
progress 76% (read 816043786240 bytes, duration 824 sec)
progress 77% (read 826781204480 bytes, duration 910 sec)
progress 78% (read 837518622720 bytes, duration 911 sec)
progress 79% (read 848256040960 bytes, duration 911 sec)
progress 80% (read 858993459200 bytes, duration 912 sec)
progress 81% (read 869730877440 bytes, duration 913 sec)
progress 82% (read 880468295680 bytes, duration 913 sec)
progress 83% (read 891205713920 bytes, duration 914 sec)
progress 84% (read 901943132160 bytes, duration 915 sec)
progress 85% (read 912680550400 bytes, duration 915 sec)
progress 86% (read 923417968640 bytes, duration 916 sec)
progress 87% (read 934155386880 bytes, duration 917 sec)
progress 88% (read 944892805120 bytes, duration 918 sec)
progress 89% (read 955630223360 bytes, duration 918 sec)
progress 90% (read 966367641600 bytes, duration 919 sec)
progress 91% (read 977105059840 bytes, duration 920 sec)
progress 92% (read 987842478080 bytes, duration 920 sec)
progress 93% (read 998579896320 bytes, duration 921 sec)
progress 94% (read 1009317314560 bytes, duration 922 sec)
progress 95% (read 1020054732800 bytes, duration 922 sec)
progress 96% (read 1030792151040 bytes, duration 923 sec)
progress 97% (read 1041529569280 bytes, duration 924 sec)
progress 98% (read 1052266987520 bytes, duration 925 sec)
progress 99% (read 1063004405760 bytes, duration 925 sec)
progress 100% (read 1073741824000 bytes, duration 932 sec)
total bytes read 1073741824000, sparse bytes 982419914752 (91.5%)
space reduction due to 4K zero blocks 0.218%
rescan volumes...
TASK OK
 
Als beim mir das vzdump vom Proxmox zum NAS viel zu langsam war habe ich etwas im BIOS an den Energiesparfunktionen geändert und bei den VMs überall den CPU-Typ von "Broadwell-IBRS" (ist ein Broadwell Xeon) auf "host" gestellt und seitdem liefen die Backups mit einem Vielfachen der Geschwindigkeit. kA was da bei mir genau das Problem war, aber irgendwie hat es geholfen.
Vielleicht ist das bei dir ja ähnlich.
 
Als beim mir das vzdump vom Proxmox zum NAS viel zu langsam war habe ich etwas im BIOS an den Energiesparfunktionen geändert und bei den VMs überall den CPU-Typ von "Broadwell-IBRS" (ist ein Broadwell Xeon) auf "host" gestellt und seitdem liefen die Backups mit einem Vielfachen der Geschwindigkeit. kA was da bei mir genau das Problem war, aber irgendwie hat es geholfen.
Vielleicht ist das bei dir ja ähnlich.
Werd ich mal checken...
 
Restore via NFS:
Code:
restore vma archive: zstd -q -d -c /mnt/pve/pvestor01/dump/vzdump-qemu-105-2021_02_01-17_33_28.vma.zst | vma extract -v -r /var/tmp/vzdumptmp27460.fifo - /var/tmp/vzdumptmp27460
CFG: size: 389 name: qemu-server.conf
CFG: size: 65 name: qemu-server.fw
DEV: dev_id=1 size: 1073741824000 devname: drive-scsi0
CTIME: Mon Feb  1 17:33:32 2021
  WARNING: You have not turned on protection against thin pools running out of space.
  WARNING: Set activation/thin_pool_autoextend_threshold below 100 to trigger automatic extension of thin pools before they get full.
  Logical volume "vm-105-disk-0" created.
  WARNING: Sum of all thin volume sizes (<1.85 TiB) exceeds the size of thin pool pve/data and the size of whole volume group (836.12 GiB).
new volume ID is 'local-lvm:vm-105-disk-0'
map 'drive-scsi0' to '/dev/pve/vm-105-disk-0' (write zeros = 0)
progress 1% (read 10737418240 bytes, duration 73 sec)
progress 2% (read 21474836480 bytes, duration 175 sec)
progress 3% (read 32212254720 bytes, duration 283 sec)
progress 4% (read 42949672960 bytes, duration 376 sec)
progress 5% (read 53687091200 bytes, duration 431 sec)
progress 6% (read 64424509440 bytes, duration 432 sec)
progress 7% (read 75161927680 bytes, duration 433 sec)
progress 8% (read 85899345920 bytes, duration 433 sec)
progress 9% (read 96636764160 bytes, duration 434 sec)
progress 10% (read 107374182400 bytes, duration 435 sec)
progress 11% (read 118111600640 bytes, duration 435 sec)
progress 12% (read 128849018880 bytes, duration 436 sec)
progress 13% (read 139586437120 bytes, duration 437 sec)
progress 14% (read 150323855360 bytes, duration 438 sec)
progress 15% (read 161061273600 bytes, duration 438 sec)
progress 16% (read 171798691840 bytes, duration 439 sec)
progress 17% (read 182536110080 bytes, duration 440 sec)
progress 18% (read 193273528320 bytes, duration 440 sec)
progress 19% (read 204010946560 bytes, duration 441 sec)
progress 20% (read 214748364800 bytes, duration 442 sec)
progress 21% (read 225485783040 bytes, duration 442 sec)
progress 22% (read 236223201280 bytes, duration 443 sec)
progress 23% (read 246960619520 bytes, duration 444 sec)
progress 24% (read 257698037760 bytes, duration 444 sec)
progress 25% (read 268435456000 bytes, duration 445 sec)
progress 26% (read 279172874240 bytes, duration 536 sec)
progress 27% (read 289910292480 bytes, duration 644 sec)
progress 28% (read 300647710720 bytes, duration 667 sec)
progress 29% (read 311385128960 bytes, duration 667 sec)
progress 30% (read 322122547200 bytes, duration 668 sec)
progress 31% (read 332859965440 bytes, duration 669 sec)
progress 32% (read 343597383680 bytes, duration 669 sec)
progress 33% (read 354334801920 bytes, duration 670 sec)
progress 34% (read 365072220160 bytes, duration 671 sec)
progress 35% (read 375809638400 bytes, duration 671 sec)
progress 36% (read 386547056640 bytes, duration 672 sec)
progress 37% (read 397284474880 bytes, duration 673 sec)
progress 38% (read 408021893120 bytes, duration 674 sec)
progress 39% (read 418759311360 bytes, duration 674 sec)
progress 40% (read 429496729600 bytes, duration 675 sec)
progress 41% (read 440234147840 bytes, duration 676 sec)
progress 42% (read 450971566080 bytes, duration 676 sec)
progress 43% (read 461708984320 bytes, duration 677 sec)
progress 44% (read 472446402560 bytes, duration 678 sec)
progress 45% (read 483183820800 bytes, duration 679 sec)
progress 46% (read 493921239040 bytes, duration 679 sec)
progress 47% (read 504658657280 bytes, duration 680 sec)
progress 48% (read 515396075520 bytes, duration 681 sec)
progress 49% (read 526133493760 bytes, duration 681 sec)
progress 50% (read 536870912000 bytes, duration 684 sec)
progress 51% (read 547608330240 bytes, duration 695 sec)
progress 52% (read 558345748480 bytes, duration 695 sec)
progress 53% (read 569083166720 bytes, duration 696 sec)
progress 54% (read 579820584960 bytes, duration 697 sec)
progress 55% (read 590558003200 bytes, duration 697 sec)
progress 56% (read 601295421440 bytes, duration 698 sec)
progress 57% (read 612032839680 bytes, duration 699 sec)
progress 58% (read 622770257920 bytes, duration 700 sec)
progress 59% (read 633507676160 bytes, duration 700 sec)
progress 60% (read 644245094400 bytes, duration 701 sec)
progress 61% (read 654982512640 bytes, duration 702 sec)
progress 62% (read 665719930880 bytes, duration 702 sec)
progress 63% (read 676457349120 bytes, duration 703 sec)
progress 64% (read 687194767360 bytes, duration 704 sec)
progress 65% (read 697932185600 bytes, duration 704 sec)
progress 66% (read 708669603840 bytes, duration 705 sec)
progress 67% (read 719407022080 bytes, duration 706 sec)
progress 68% (read 730144440320 bytes, duration 707 sec)
progress 69% (read 740881858560 bytes, duration 707 sec)
progress 70% (read 751619276800 bytes, duration 708 sec)
progress 71% (read 762356695040 bytes, duration 709 sec)
progress 72% (read 773094113280 bytes, duration 709 sec)
progress 73% (read 783831531520 bytes, duration 710 sec)
progress 74% (read 794568949760 bytes, duration 711 sec)
progress 75% (read 805306368000 bytes, duration 718 sec)
progress 76% (read 816043786240 bytes, duration 824 sec)
progress 77% (read 826781204480 bytes, duration 910 sec)
progress 78% (read 837518622720 bytes, duration 911 sec)
progress 79% (read 848256040960 bytes, duration 911 sec)
progress 80% (read 858993459200 bytes, duration 912 sec)
progress 81% (read 869730877440 bytes, duration 913 sec)
progress 82% (read 880468295680 bytes, duration 913 sec)
progress 83% (read 891205713920 bytes, duration 914 sec)
progress 84% (read 901943132160 bytes, duration 915 sec)
progress 85% (read 912680550400 bytes, duration 915 sec)
progress 86% (read 923417968640 bytes, duration 916 sec)
progress 87% (read 934155386880 bytes, duration 917 sec)
progress 88% (read 944892805120 bytes, duration 918 sec)
progress 89% (read 955630223360 bytes, duration 918 sec)
progress 90% (read 966367641600 bytes, duration 919 sec)
progress 91% (read 977105059840 bytes, duration 920 sec)
progress 92% (read 987842478080 bytes, duration 920 sec)
progress 93% (read 998579896320 bytes, duration 921 sec)
progress 94% (read 1009317314560 bytes, duration 922 sec)
progress 95% (read 1020054732800 bytes, duration 922 sec)
progress 96% (read 1030792151040 bytes, duration 923 sec)
progress 97% (read 1041529569280 bytes, duration 924 sec)
progress 98% (read 1052266987520 bytes, duration 925 sec)
progress 99% (read 1063004405760 bytes, duration 925 sec)
progress 100% (read 1073741824000 bytes, duration 932 sec)
total bytes read 1073741824000, sparse bytes 982419914752 (91.5%)
space reduction due to 4K zero blocks 0.218%
rescan volumes...
TASK OK
Das waren mehr als 1GByte/s ??? = 60GByte/min ? Wie geht das?
 
Wie viel Speicher ist auf dem pbs denn eigentlich belegt ?

Performance ist abhängig von IOPS, da alle chunks referenziert werden müssen.

Da du 300TB in verwendung hast sicherst du wahrscheinlich auch viel.


Die Anzahl der chunks kannst du mit "find .chunks -type f | wc -l" beim backup storage herausfinden.

Wie zuvor erwähnt atop busy und avio werte wären hilfreich um auszuschleißen, dass die festplatten das problem sind.
Ich kann die Festplatten (12x SATA Raidz2) sehr wahrscheinlich ausschließen. Ich stand heute beim neuen Testserver (siehe Post - Hardware Raid) dabei. Alle 10s ein kurzer Schreibzugriff bei 60MByte/s im log? Eben habe ich eine SATA SSD (Single) in eine Backplane eingeschoben (nicht am LSI, sondern Onboard 6G). Was soll ich sagen, 10% bessere Werte.

Sonst hier die Chunks, eigentlich normal:

root@nasomv6:/RAID-Z2/pbs# find .chunks -type f | wc -l
6109680


Speicherplatz:
root@nasomv6:/RAID-Z2/pbs# df -h
Dateisystem Größe Benutzt Verf. Verw% Eingehängt auf
udev 16G 0 16G 0% /dev
tmpfs 3,2G 304M 2,9G 10% /run
/dev/sde1 27G 15G 11G 59% /
tmpfs 16G 0 16G 0% /dev/shm
tmpfs 5,0M 0 5,0M 0% /run/lock
tmpfs 16G 0 16G 0% /sys/fs/cgroup
tmpfs 16G 168K 16G 1% /tmp
RAID-Z2 32T 256K 32T 1% /RAID-Z2
RAID-Z2/pbs 47T 16T 32T 34% /RAID-Z2/pbs
RAID-Z2/DATA 65T 34T 32T 53% /RAID-Z2/DATA
RAID-Z2/System_Backup 32T 15G 32T 1% /RAID-Z2/System_Backup
folder2ram 16G 4,1G 12G 26% /var/log
folder2ram 16G 0 16G 0% /var/tmp
folder2ram 16G 2,8M 16G 1% /var/lib/openmediavault/rrd
folder2ram 16G 1,2M 16G 1% /var/spool
folder2ram 16G 28M 16G 1% /var/lib/rrdcached
folder2ram 16G 4,0K 16G 1% /var/lib/monit
folder2ram 16G 1,6G 15G 10% /var/cache/samba
tmpfs 3,2G 4,0K 3,2G 1% /run/user/0
root@nasomv6:/RAID-Z2/pbs#
 
Last edited:
Werd ich mal checken...
Habe auf host umgestellt und es funktioniert etwas schneller. Könnte aber auch vielleicht die Netzwerkauslastung daran Schuld sein?

Code:
()
INFO: starting new backup job: vzdump 105 --node pve01 --remove 0 --storage pvestor01 --compress zstd --mode snapshot
INFO: Starting Backup of VM 105 (qemu)
INFO: Backup started at 2021-02-02 21:08:16
INFO: status = running
INFO: VM Name: xxx
INFO: include disk 'scsi0' 'local-lvm:vm-105-disk-0' 1000G
  /dev/sdc: open failed: No medium found
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: snapshots found (not included into backup)
INFO: creating vzdump archive '/mnt/pve/pvestor01/dump/vzdump-qemu-105-2021_02_02-21_08_16.vma.zst'
INFO: started backup task '79bba088-f42c-4f87-80b3-724bdfb55c45'
INFO: resuming VM again
INFO:   0% (165.4 MiB of 1000.0 GiB) in  3s, read: 55.1 MiB/s, write: 44.1 MiB/s
INFO:   1% (10.4 GiB of 1000.0 GiB) in  1m 44s, read: 103.4 MiB/s, write: 76.0 MiB/s
INFO:   2% (20.1 GiB of 1000.0 GiB) in  3m 31s, read: 93.3 MiB/s, write: 89.8 MiB/s
INFO:   3% (30.0 GiB of 1000.0 GiB) in  5m 25s, read: 89.0 MiB/s, write: 89.0 MiB/s
INFO:   4% (40.0 GiB of 1000.0 GiB) in  7m 10s, read: 97.3 MiB/s, write: 83.4 MiB/s
INFO:   5% (50.6 GiB of 1000.0 GiB) in  8m 31s, read: 133.8 MiB/s, write: 65.5 MiB/s
INFO:   6% (61.3 GiB of 1000.0 GiB) in  8m 38s, read: 1.5 GiB/s, write: 82.3 KiB/s
INFO:   7% (71.2 GiB of 1000.0 GiB) in  8m 45s, read: 1.4 GiB/s, write: 65.7 KiB/s
INFO:   8% (81.4 GiB of 1000.0 GiB) in  8m 52s, read: 1.5 GiB/s, write: 91.4 KiB/s
INFO:   9% (91.2 GiB of 1000.0 GiB) in  8m 58s, read: 1.6 GiB/s, write: 106.7 KiB/s
INFO:  10% (101.0 GiB of 1000.0 GiB) in  9m  4s, read: 1.6 GiB/s, write: 106.7 KiB/s
INFO:  11% (111.0 GiB of 1000.0 GiB) in  9m 10s, read: 1.7 GiB/s, write: 64.0 KiB/s
INFO:  12% (120.2 GiB of 1000.0 GiB) in  9m 15s, read: 1.8 GiB/s, write: 0 B/s
INFO:  13% (131.1 GiB of 1000.0 GiB) in  9m 21s, read: 1.8 GiB/s, write: 0 B/s
INFO:  14% (141.8 GiB of 1000.0 GiB) in  9m 27s, read: 1.8 GiB/s, write: 0 B/s
INFO:  15% (150.8 GiB of 1000.0 GiB) in  9m 32s, read: 1.8 GiB/s, write: 0 B/s
INFO:  16% (161.3 GiB of 1000.0 GiB) in  9m 38s, read: 1.8 GiB/s, write: 0 B/s
INFO:  17% (171.7 GiB of 1000.0 GiB) in  9m 44s, read: 1.7 GiB/s, write: 34.7 KiB/s
INFO:  18% (180.8 GiB of 1000.0 GiB) in  9m 49s, read: 1.8 GiB/s, write: 0 B/s
INFO:  19% (190.3 GiB of 1000.0 GiB) in  9m 54s, read: 1.9 GiB/s, write: 0 B/s
INFO:  20% (201.7 GiB of 1000.0 GiB) in 10m  1s, read: 1.6 GiB/s, write: 0 B/s
INFO:  21% (210.8 GiB of 1000.0 GiB) in 10m  6s, read: 1.8 GiB/s, write: 0 B/s
INFO:  22% (220.1 GiB of 1000.0 GiB) in 10m 11s, read: 1.8 GiB/s, write: 0 B/s
INFO:  23% (230.9 GiB of 1000.0 GiB) in 10m 17s, read: 1.8 GiB/s, write: 0 B/s
INFO:  24% (240.2 GiB of 1000.0 GiB) in 10m 22s, read: 1.9 GiB/s, write: 0 B/s
INFO:  25% (250.3 GiB of 1000.0 GiB) in 10m 28s, read: 1.7 GiB/s, write: 1.6 MiB/s
INFO:  26% (260.1 GiB of 1000.0 GiB) in 12m 50s, read: 70.3 MiB/s, write: 68.7 MiB/s
INFO:  27% (270.0 GiB of 1000.0 GiB) in 14m 42s, read: 91.1 MiB/s, write: 91.1 MiB/s
INFO:  28% (280.9 GiB of 1000.0 GiB) in 15m 16s, read: 327.2 MiB/s, write: 70.0 MiB/s
INFO:  29% (291.2 GiB of 1000.0 GiB) in 15m 23s, read: 1.5 GiB/s, write: 1.2 MiB/s
INFO:  30% (301.3 GiB of 1000.0 GiB) in 15m 29s, read: 1.7 GiB/s, write: 106.7 KiB/s
INFO:  31% (310.3 GiB of 1000.0 GiB) in 15m 34s, read: 1.8 GiB/s, write: 76.8 KiB/s
INFO:  32% (321.0 GiB of 1000.0 GiB) in 15m 40s, read: 1.8 GiB/s, write: 100.0 KiB/s
INFO:  33% (331.4 GiB of 1000.0 GiB) in 15m 46s, read: 1.7 GiB/s, write: 117.3 KiB/s
INFO:  34% (340.6 GiB of 1000.0 GiB) in 15m 51s, read: 1.8 GiB/s, write: 25.6 KiB/s
INFO:  35% (350.2 GiB of 1000.0 GiB) in 15m 56s, read: 1.9 GiB/s, write: 0 B/s
INFO:  36% (361.8 GiB of 1000.0 GiB) in 16m  2s, read: 1.9 GiB/s, write: 0 B/s
INFO:  37% (371.3 GiB of 1000.0 GiB) in 16m  7s, read: 1.9 GiB/s, write: 0 B/s
INFO:  38% (380.8 GiB of 1000.0 GiB) in 16m 13s, read: 1.6 GiB/s, write: 0 B/s
INFO:  39% (390.5 GiB of 1000.0 GiB) in 16m 18s, read: 1.9 GiB/s, write: 0 B/s
INFO:  40% (400.0 GiB of 1000.0 GiB) in 16m 23s, read: 1.9 GiB/s, write: 0 B/s
INFO:  41% (411.5 GiB of 1000.0 GiB) in 16m 29s, read: 1.9 GiB/s, write: 0 B/s
INFO:  42% (420.9 GiB of 1000.0 GiB) in 16m 34s, read: 1.9 GiB/s, write: 0 B/s
INFO:  43% (430.5 GiB of 1000.0 GiB) in 16m 39s, read: 1.9 GiB/s, write: 0 B/s
INFO:  44% (441.2 GiB of 1000.0 GiB) in 16m 45s, read: 1.8 GiB/s, write: 10.7 KiB/s
INFO:  45% (450.5 GiB of 1000.0 GiB) in 16m 50s, read: 1.9 GiB/s, write: 0 B/s
INFO:  46% (461.8 GiB of 1000.0 GiB) in 16m 56s, read: 1.9 GiB/s, write: 0 B/s
INFO:  47% (471.7 GiB of 1000.0 GiB) in 17m  1s, read: 2.0 GiB/s, write: 0 B/s
INFO:  48% (481.3 GiB of 1000.0 GiB) in 17m  6s, read: 1.9 GiB/s, write: 0 B/s
INFO:  49% (490.8 GiB of 1000.0 GiB) in 17m 11s, read: 1.9 GiB/s, write: 0 B/s
INFO:  50% (500.0 GiB of 1000.0 GiB) in 17m 35s, read: 394.9 MiB/s, write: 21.3 MiB/s
INFO:  51% (511.3 GiB of 1000.0 GiB) in 18m 15s, read: 289.8 MiB/s, write: 39.5 MiB/s
INFO:  52% (521.1 GiB of 1000.0 GiB) in 18m 20s, read: 2.0 GiB/s, write: 0 B/s
INFO:  53% (530.6 GiB of 1000.0 GiB) in 18m 25s, read: 1.9 GiB/s, write: 0 B/s
INFO:  54% (541.1 GiB of 1000.0 GiB) in 18m 32s, read: 1.5 GiB/s, write: 1.4 MiB/s
INFO:  55% (551.0 GiB of 1000.0 GiB) in 18m 38s, read: 1.6 GiB/s, write: 106.7 KiB/s
INFO:  56% (561.1 GiB of 1000.0 GiB) in 18m 44s, read: 1.7 GiB/s, write: 106.7 KiB/s
INFO:  57% (571.5 GiB of 1000.0 GiB) in 18m 50s, read: 1.7 GiB/s, write: 84.0 KiB/s
INFO:  58% (581.7 GiB of 1000.0 GiB) in 18m 56s, read: 1.7 GiB/s, write: 106.7 KiB/s
INFO:  59% (590.3 GiB of 1000.0 GiB) in 19m  1s, read: 1.7 GiB/s, write: 115.2 KiB/s
INFO:  60% (601.0 GiB of 1000.0 GiB) in 19m  7s, read: 1.8 GiB/s, write: 106.7 KiB/s
INFO:  61% (610.4 GiB of 1000.0 GiB) in 19m 12s, read: 1.9 GiB/s, write: 12.8 KiB/s
INFO:  62% (621.8 GiB of 1000.0 GiB) in 19m 18s, read: 1.9 GiB/s, write: 0 B/s
INFO:  63% (631.4 GiB of 1000.0 GiB) in 19m 23s, read: 1.9 GiB/s, write: 0 B/s
INFO:  64% (640.9 GiB of 1000.0 GiB) in 19m 28s, read: 1.9 GiB/s, write: 0 B/s
INFO:  65% (650.5 GiB of 1000.0 GiB) in 19m 33s, read: 1.9 GiB/s, write: 0 B/s
INFO:  66% (661.6 GiB of 1000.0 GiB) in 19m 39s, read: 1.9 GiB/s, write: 0 B/s
INFO:  67% (670.7 GiB of 1000.0 GiB) in 19m 44s, read: 1.8 GiB/s, write: 0 B/s
INFO:  68% (680.2 GiB of 1000.0 GiB) in 19m 49s, read: 1.9 GiB/s, write: 0 B/s
INFO:  69% (691.6 GiB of 1000.0 GiB) in 19m 55s, read: 1.9 GiB/s, write: 0 B/s
INFO:  70% (700.8 GiB of 1000.0 GiB) in 20m  0s, read: 1.8 GiB/s, write: 0 B/s
INFO:  71% (710.3 GiB of 1000.0 GiB) in 20m  5s, read: 1.9 GiB/s, write: 0 B/s
INFO:  72% (721.8 GiB of 1000.0 GiB) in 20m 11s, read: 1.9 GiB/s, write: 0 B/s
INFO:  73% (731.3 GiB of 1000.0 GiB) in 20m 16s, read: 1.9 GiB/s, write: 0 B/s
INFO:  74% (740.9 GiB of 1000.0 GiB) in 20m 21s, read: 1.9 GiB/s, write: 0 B/s
INFO:  75% (750.1 GiB of 1000.0 GiB) in 20m 56s, read: 268.7 MiB/s, write: 31.9 MiB/s
INFO:  76% (760.1 GiB of 1000.0 GiB) in 22m 52s, read: 88.3 MiB/s, write: 87.9 MiB/s
INFO:  77% (770.3 GiB of 1000.0 GiB) in 24m 28s, read: 108.9 MiB/s, write: 86.4 MiB/s
INFO:  78% (780.2 GiB of 1000.0 GiB) in 24m 34s, read: 1.6 GiB/s, write: 1.1 MiB/s
INFO:  79% (791.0 GiB of 1000.0 GiB) in 24m 41s, read: 1.5 GiB/s, write: 797.7 KiB/s
INFO:  80% (801.1 GiB of 1000.0 GiB) in 24m 47s, read: 1.7 GiB/s, write: 106.7 KiB/s
INFO:  81% (811.5 GiB of 1000.0 GiB) in 24m 53s, read: 1.7 GiB/s, write: 96.0 KiB/s
INFO:  82% (820.3 GiB of 1000.0 GiB) in 24m 58s, read: 1.8 GiB/s, write: 97.6 KiB/s
INFO:  83% (830.8 GiB of 1000.0 GiB) in 25m  4s, read: 1.7 GiB/s, write: 42.7 KiB/s
INFO:  84% (840.4 GiB of 1000.0 GiB) in 25m  9s, read: 1.9 GiB/s, write: 0 B/s
INFO:  85% (851.6 GiB of 1000.0 GiB) in 25m 15s, read: 1.9 GiB/s, write: 0 B/s
INFO:  86% (861.2 GiB of 1000.0 GiB) in 25m 20s, read: 1.9 GiB/s, write: 0 B/s
INFO:  87% (871.3 GiB of 1000.0 GiB) in 25m 26s, read: 1.7 GiB/s, write: 0 B/s
INFO:  88% (880.8 GiB of 1000.0 GiB) in 25m 31s, read: 1.9 GiB/s, write: 0 B/s
INFO:  89% (890.1 GiB of 1000.0 GiB) in 25m 36s, read: 1.9 GiB/s, write: 0 B/s
INFO:  90% (901.5 GiB of 1000.0 GiB) in 25m 42s, read: 1.9 GiB/s, write: 0 B/s
INFO:  91% (911.0 GiB of 1000.0 GiB) in 25m 47s, read: 1.9 GiB/s, write: 0 B/s
INFO:  92% (920.6 GiB of 1000.0 GiB) in 25m 52s, read: 1.9 GiB/s, write: 0 B/s
INFO:  93% (930.4 GiB of 1000.0 GiB) in 25m 57s, read: 2.0 GiB/s, write: 0 B/s
INFO:  94% (940.1 GiB of 1000.0 GiB) in 26m  2s, read: 1.9 GiB/s, write: 0 B/s
INFO:  95% (951.8 GiB of 1000.0 GiB) in 26m  8s, read: 2.0 GiB/s, write: 0 B/s
INFO:  96% (960.2 GiB of 1000.0 GiB) in 26m 14s, read: 1.4 GiB/s, write: 0 B/s
INFO:  97% (971.3 GiB of 1000.0 GiB) in 26m 20s, read: 1.8 GiB/s, write: 0 B/s
INFO:  98% (980.9 GiB of 1000.0 GiB) in 26m 25s, read: 1.9 GiB/s, write: 0 B/s
INFO:  99% (990.7 GiB of 1000.0 GiB) in 26m 30s, read: 2.0 GiB/s, write: 0 B/s
INFO: 100% (1000.0 GiB of 1000.0 GiB) in 27m  5s, read: 272.2 MiB/s, write: 44.7 MiB/s
INFO: backup is sparse: 914.76 GiB (91%) total zero data
INFO: transferred 1000.00 GiB in 1625 seconds (630.2 MiB/s)
INFO: archive file size: 79.25GB
INFO: Finished Backup of VM 105 (00:27:09)
INFO: Backup finished at 2021-02-02 21:35:25
INFO: Backup job finished successfully
TASK OK
 
Hier das komplette Log vom Backup auf den Hardware Raid PBS mit 1Gbit/s LINK:
Wirklich nicht gut und in dem Segment mich nicht einsetzbar.


vzdump 128 --mode snapshot --remove 0 --node pve09 --storage pbs03


128: 2021-02-02 19:36:25 INFO: Starting Backup of VM 128 (qemu)
128: 2021-02-02 19:36:25 INFO: status = running
128: 2021-02-02 19:36:25 INFO: VM Name:
128: 2021-02-02 19:36:25 INFO: include disk 'scsi0' 'nasomv7-ZFS-SSD1:vm-128-disk-0' 470G
128: 2021-02-02 19:36:25 INFO: include disk 'scsi1' 'nasomv7-ZFS-SSD1:vm-128-disk-1' 120G
128: 2021-02-02 19:36:26 INFO: backup mode: snapshot
128: 2021-02-02 19:36:26 INFO: ionice priority: 7
128: 2021-02-02 19:36:26 INFO: snapshots found (not included into backup)
128: 2021-02-02 19:36:26 INFO: creating Proxmox Backup Server archive 'vm/128/2021-02-02T18:36:25Z'
128: 2021-02-02 19:36:26 INFO: issuing guest-agent 'fs-freeze' command
128: 2021-02-02 19:36:28 INFO: issuing guest-agent 'fs-thaw' command
128: 2021-02-02 19:36:29 INFO: started backup task '0f5f02dc-4d56-4938-9d88-8e91dd9dc8c0'
128: 2021-02-02 19:36:29 INFO: resuming VM again
128: 2021-02-02 19:36:29 INFO: scsi0: dirty-bitmap status: existing bitmap was invalid and has been cleared
128: 2021-02-02 19:36:29 INFO: scsi1: dirty-bitmap status: existing bitmap was invalid and has been cleared
128: 2021-02-02 19:36:32 INFO: 0% (252.0 MiB of 590.0 GiB) in 3s, read: 84.0 MiB/s, write: 84.0 MiB/s
128: 2021-02-02 19:38:09 INFO: 1% (5.9 GiB of 590.0 GiB) in 1m 40s, read: 60.2 MiB/s, write: 58.1 MiB/s
128: 2021-02-02 19:39:52 INFO: 2% (11.8 GiB of 590.0 GiB) in 3m 23s, read: 58.3 MiB/s, write: 58.3 MiB/s
128: 2021-02-02 19:41:33 INFO: 3% (17.8 GiB of 590.0 GiB) in 5m 4s, read: 60.2 MiB/s, write: 60.2 MiB/s
128: 2021-02-02 19:43:14 INFO: 4% (23.7 GiB of 590.0 GiB) in 6m 45s, read: 59.8 MiB/s, write: 59.8 MiB/s
128: 2021-02-02 19:44:52 INFO: 5% (29.5 GiB of 590.0 GiB) in 8m 23s, read: 61.4 MiB/s, write: 61.4 MiB/s
128: 2021-02-02 19:46:31 INFO: 6% (35.4 GiB of 590.0 GiB) in 10m 2s, read: 61.3 MiB/s, write: 61.3 MiB/s
128: 2021-02-02 19:48:06 INFO: 7% (41.3 GiB of 590.0 GiB) in 11m 37s, read: 63.4 MiB/s, write: 63.3 MiB/s
128: 2021-02-02 19:49:43 INFO: 8% (47.2 GiB of 590.0 GiB) in 13m 14s, read: 62.4 MiB/s, write: 62.4 MiB/s
128: 2021-02-02 19:51:03 INFO: 9% (53.2 GiB of 590.0 GiB) in 14m 34s, read: 75.8 MiB/s, write: 24.4 MiB/s
128: 2021-02-02 19:52:27 INFO: 10% (59.0 GiB of 590.0 GiB) in 15m 58s, read: 71.8 MiB/s, write: 30.9 MiB/s
128: 2021-02-02 19:53:44 INFO: 11% (64.9 GiB of 590.0 GiB) in 17m 15s, read: 77.9 MiB/s, write: 17.9 MiB/s
128: 2021-02-02 19:54:53 INFO: 12% (70.8 GiB of 590.0 GiB) in 18m 24s, read: 87.9 MiB/s, write: 118.7 KiB/s
128: 2021-02-02 19:56:05 INFO: 13% (76.8 GiB of 590.0 GiB) in 19m 36s, read: 84.7 MiB/s, write: 0 B/s
128: 2021-02-02 19:57:16 INFO: 14% (82.7 GiB of 590.0 GiB) in 20m 47s, read: 84.7 MiB/s, write: 0 B/s
128: 2021-02-02 19:58:27 INFO: 15% (88.5 GiB of 590.0 GiB) in 21m 58s, read: 84.8 MiB/s, write: 0 B/s
128: 2021-02-02 19:59:38 INFO: 16% (94.4 GiB of 590.0 GiB) in 23m 9s, read: 85.1 MiB/s, write: 0 B/s
128: 2021-02-02 20:00:49 INFO: 17% (100.3 GiB of 590.0 GiB) in 24m 20s, read: 84.6 MiB/s, write: 0 B/s
128: 2021-02-02 20:02:02 INFO: 18% (106.2 GiB of 590.0 GiB) in 25m 33s, read: 83.2 MiB/s, write: 0 B/s
128: 2021-02-02 20:03:13 INFO: 19% (112.1 GiB of 590.0 GiB) in 26m 44s, read: 84.6 MiB/s, write: 0 B/s
128: 2021-02-02 20:04:25 INFO: 20% (118.1 GiB of 590.0 GiB) in 27m 56s, read: 84.7 MiB/s, write: 0 B/s
128: 2021-02-02 20:05:53 INFO: 21% (123.9 GiB of 590.0 GiB) in 29m 24s, read: 68.1 MiB/s, write: 37.4 MiB/s
128: 2021-02-02 20:07:34 INFO: 22% (129.8 GiB of 590.0 GiB) in 31m 5s, read: 60.0 MiB/s, write: 58.8 MiB/s
128: 2021-02-02 20:09:13 INFO: 23% (135.7 GiB of 590.0 GiB) in 32m 44s, read: 60.9 MiB/s, write: 58.7 MiB/s
128: 2021-02-02 20:10:54 INFO: 24% (141.6 GiB of 590.0 GiB) in 34m 25s, read: 59.8 MiB/s, write: 58.9 MiB/s
128: 2021-02-02 20:12:34 INFO: 25% (147.5 GiB of 590.0 GiB) in 36m 5s, read: 60.4 MiB/s, write: 58.6 MiB/s
128: 2021-02-02 20:14:11 INFO: 26% (153.4 GiB of 590.0 GiB) in 37m 42s, read: 62.6 MiB/s, write: 60.0 MiB/s
128: 2021-02-02 20:15:49 INFO: 27% (159.4 GiB of 590.0 GiB) in 39m 20s, read: 61.9 MiB/s, write: 60.7 MiB/s
128: 2021-02-02 20:17:26 INFO: 28% (165.2 GiB of 590.0 GiB) in 40m 57s, read: 62.0 MiB/s, write: 60.4 MiB/s
128: 2021-02-02 20:19:02 INFO: 29% (171.2 GiB of 590.0 GiB) in 42m 33s, read: 63.2 MiB/s, write: 60.0 MiB/s
128: 2021-02-02 20:20:39 INFO: 30% (177.0 GiB of 590.0 GiB) in 44m 10s, read: 62.0 MiB/s, write: 57.8 MiB/s
128: 2021-02-02 20:22:18 INFO: 31% (182.9 GiB of 590.0 GiB) in 45m 49s, read: 61.0 MiB/s, write: 55.8 MiB/s
128: 2021-02-02 20:23:52 INFO: 32% (188.8 GiB of 590.0 GiB) in 47m 23s, read: 64.3 MiB/s, write: 56.1 MiB/s
128: 2021-02-02 20:25:25 INFO: 33% (194.8 GiB of 590.0 GiB) in 48m 56s, read: 65.3 MiB/s, write: 54.2 MiB/s
128: 2021-02-02 20:26:57 INFO: 34% (200.6 GiB of 590.0 GiB) in 50m 28s, read: 65.2 MiB/s, write: 57.1 MiB/s
128: 2021-02-02 20:28:30 INFO: 35% (206.5 GiB of 590.0 GiB) in 52m 1s, read: 64.9 MiB/s, write: 56.2 MiB/s
128: 2021-02-02 20:30:02 INFO: 36% (212.4 GiB of 590.0 GiB) in 53m 33s, read: 65.8 MiB/s, write: 53.8 MiB/s
128: 2021-02-02 20:31:37 INFO: 37% (218.4 GiB of 590.0 GiB) in 55m 8s, read: 64.0 MiB/s, write: 54.5 MiB/s
128: 2021-02-02 20:33:08 INFO: 38% (224.2 GiB of 590.0 GiB) in 56m 39s, read: 66.0 MiB/s, write: 53.8 MiB/s
128: 2021-02-02 20:34:37 INFO: 39% (230.1 GiB of 590.0 GiB) in 58m 8s, read: 67.7 MiB/s, write: 50.8 MiB/s
128: 2021-02-02 20:36:09 INFO: 40% (236.1 GiB of 590.0 GiB) in 59m 40s, read: 66.2 MiB/s, write: 53.0 MiB/s
128: 2021-02-02 20:37:38 INFO: 41% (241.9 GiB of 590.0 GiB) in 1h 1m 9s, read: 67.5 MiB/s, write: 50.9 MiB/s
128: 2021-02-02 20:39:10 INFO: 42% (247.8 GiB of 590.0 GiB) in 1h 2m 41s, read: 66.0 MiB/s, write: 51.8 MiB/s
128: 2021-02-02 20:40:40 INFO: 43% (253.7 GiB of 590.0 GiB) in 1h 4m 11s, read: 66.9 MiB/s, write: 51.2 MiB/s
128: 2021-02-02 20:42:11 INFO: 44% (259.7 GiB of 590.0 GiB) in 1h 5m 42s, read: 66.8 MiB/s, write: 47.4 MiB/s
128: 2021-02-02 20:43:38 INFO: 45% (265.5 GiB of 590.0 GiB) in 1h 7m 9s, read: 68.8 MiB/s, write: 47.1 MiB/s
128: 2021-02-02 20:45:06 INFO: 46% (271.4 GiB of 590.0 GiB) in 1h 8m 37s, read: 68.6 MiB/s, write: 47.6 MiB/s
128: 2021-02-02 20:46:37 INFO: 47% (277.4 GiB of 590.0 GiB) in 1h 10m 8s, read: 66.9 MiB/s, write: 50.0 MiB/s
128: 2021-02-02 20:48:05 INFO: 48% (283.2 GiB of 590.0 GiB) in 1h 11m 36s, read: 68.4 MiB/s, write: 47.6 MiB/s
128: 2021-02-02 20:49:31 INFO: 49% (289.2 GiB of 590.0 GiB) in 1h 13m 2s, read: 70.5 MiB/s, write: 40.4 MiB/s
128: 2021-02-02 20:51:00 INFO: 50% (295.0 GiB of 590.0 GiB) in 1h 14m 31s, read: 67.8 MiB/s, write: 47.8 MiB/s
128: 2021-02-02 20:52:31 INFO: 51% (300.9 GiB of 590.0 GiB) in 1h 16m 2s, read: 66.0 MiB/s, write: 51.4 MiB/s
128: 2021-02-02 20:54:02 INFO: 52% (306.9 GiB of 590.0 GiB) in 1h 17m 33s, read: 66.9 MiB/s, write: 49.8 MiB/s
128: 2021-02-02 20:55:30 INFO: 53% (312.8 GiB of 590.0 GiB) in 1h 19m 1s, read: 68.6 MiB/s, write: 45.3 MiB/s
128: 2021-02-02 20:56:53 INFO: 54% (318.6 GiB of 590.0 GiB) in 1h 20m 24s, read: 72.7 MiB/s, write: 35.0 MiB/s
128: 2021-02-02 20:58:21 INFO: 55% (324.5 GiB of 590.0 GiB) in 1h 21m 52s, read: 68.4 MiB/s, write: 46.0 MiB/s
128: 2021-02-02 20:59:38 INFO: 56% (330.4 GiB of 590.0 GiB) in 1h 23m 9s, read: 78.8 MiB/s, write: 34.3 MiB/s
128: 2021-02-02 21:01:07 INFO: 57% (336.3 GiB of 590.0 GiB) in 1h 24m 38s, read: 67.7 MiB/s, write: 48.8 MiB/s
128: 2021-02-02 21:02:41 INFO: 58% (342.2 GiB of 590.0 GiB) in 1h 26m 12s, read: 64.3 MiB/s, write: 54.2 MiB/s
128: 2021-02-02 21:04:12 INFO: 59% (348.1 GiB of 590.0 GiB) in 1h 27m 43s, read: 66.2 MiB/s, write: 49.9 MiB/s
128: 2021-02-02 21:05:40 INFO: 60% (354.1 GiB of 590.0 GiB) in 1h 29m 11s, read: 69.1 MiB/s, write: 45.2 MiB/s
128: 2021-02-02 21:07:05 INFO: 61% (360.0 GiB of 590.0 GiB) in 1h 30m 36s, read: 71.2 MiB/s, write: 38.7 MiB/s
128: 2021-02-02 21:08:31 INFO: 62% (365.8 GiB of 590.0 GiB) in 1h 32m 2s, read: 69.9 MiB/s, write: 42.7 MiB/s
128: 2021-02-02 21:09:56 INFO: 63% (371.7 GiB of 590.0 GiB) in 1h 33m 27s, read: 70.9 MiB/s, write: 42.1 MiB/s
128: 2021-02-02 21:11:26 INFO: 64% (377.7 GiB of 590.0 GiB) in 1h 34m 57s, read: 67.6 MiB/s, write: 50.8 MiB/s
128: 2021-02-02 21:12:56 INFO: 65% (383.6 GiB of 590.0 GiB) in 1h 36m 27s, read: 67.0 MiB/s, write: 48.4 MiB/s
128: 2021-02-02 21:14:25 INFO: 66% (389.4 GiB of 590.0 GiB) in 1h 37m 56s, read: 67.6 MiB/s, write: 47.1 MiB/s
128: 2021-02-02 21:15:56 INFO: 67% (395.3 GiB of 590.0 GiB) in 1h 39m 27s, read: 66.2 MiB/s, write: 48.4 MiB/s
128: 2021-02-02 21:17:26 INFO: 68% (401.2 GiB of 590.0 GiB) in 1h 40m 57s, read: 67.2 MiB/s, write: 44.3 MiB/s
128: 2021-02-02 21:18:57 INFO: 69% (407.1 GiB of 590.0 GiB) in 1h 42m 28s, read: 66.5 MiB/s, write: 40.6 MiB/s
128: 2021-02-02 21:20:26 INFO: 70% (413.0 GiB of 590.0 GiB) in 1h 43m 57s, read: 67.5 MiB/s, write: 42.6 MiB/s
128: 2021-02-02 21:21:51 INFO: 71% (419.0 GiB of 590.0 GiB) in 1h 45m 22s, read: 71.9 MiB/s, write: 44.0 MiB/s
128: 2021-02-02 21:23:27 INFO: 72% (424.8 GiB of 590.0 GiB) in 1h 46m 58s, read: 62.2 MiB/s, write: 58.6 MiB/s
128: 2021-02-02 21:24:55 INFO: 73% (430.8 GiB of 590.0 GiB) in 1h 48m 26s, read: 69.2 MiB/s, write: 43.5 MiB/s
128: 2021-02-02 21:26:13 INFO: 74% (436.6 GiB of 590.0 GiB) in 1h 49m 44s, read: 77.0 MiB/s, write: 19.6 MiB/s
128: 2021-02-02 21:27:42 INFO: 75% (442.5 GiB of 590.0 GiB) in 1h 51m 13s, read: 68.0 MiB/s, write: 42.2 MiB/s
128: 2021-02-02 21:28:56 INFO: 76% (448.6 GiB of 590.0 GiB) in 1h 52m 27s, read: 84.3 MiB/s, write: 20.3 MiB/s
128: 2021-02-02 21:29:54 INFO: 77% (454.3 GiB of 590.0 GiB) in 1h 53m 25s, read: 100.8 MiB/s, write: 12.3 MiB/s
128: 2021-02-02 21:31:07 INFO: 78% (460.2 GiB of 590.0 GiB) in 1h 54m 38s, read: 82.9 MiB/s, write: 8.0 MiB/s
128: 2021-02-02 21:32:23 INFO: 79% (466.2 GiB of 590.0 GiB) in 1h 55m 54s, read: 79.8 MiB/s, write: 37.7 MiB/s
128: 2021-02-02 21:33:35 INFO: 80% (472.0 GiB of 590.0 GiB) in 1h 57m 6s, read: 83.0 MiB/s, write: 3.4 MiB/s
128: 2021-02-02 21:34:47 INFO: 81% (477.9 GiB of 590.0 GiB) in 1h 58m 18s, read: 84.1 MiB/s, write: 0 B/s
128: 2021-02-02 21:35:59 INFO: 82% (483.9 GiB of 590.0 GiB) in 1h 59m 30s, read: 84.6 MiB/s, write: 0 B/s
128: 2021-02-02 21:37:06 INFO: 83% (489.7 GiB of 590.0 GiB) in 2h 0m 37s, read: 89.5 MiB/s, write: 0 B/s
128: 2021-02-02 21:38:18 INFO: 84% (495.7 GiB of 590.0 GiB) in 2h 1m 49s, read: 84.3 MiB/s, write: 0 B/s
128: 2021-02-02 21:39:37 INFO: 85% (501.5 GiB of 590.0 GiB) in 2h 3m 8s, read: 76.4 MiB/s, write: 22.2 MiB/s
128: 2021-02-02 21:40:59 INFO: 86% (507.4 GiB of 590.0 GiB) in 2h 4m 30s, read: 73.7 MiB/s, write: 28.5 MiB/s
128: 2021-02-02 21:42:12 INFO: 87% (513.4 GiB of 590.0 GiB) in 2h 5m 43s, read: 83.1 MiB/s, write: 0 B/s
128: 2021-02-02 21:43:20 INFO: 88% (519.2 GiB of 590.0 GiB) in 2h 6m 51s, read: 88.2 MiB/s, write: 0 B/s
128: 2021-02-02 21:44:32 INFO: 89% (525.2 GiB of 590.0 GiB) in 2h 8m 3s, read: 84.4 MiB/s, write: 0 B/s
128: 2021-02-02 21:45:42 INFO: 90% (531.1 GiB of 590.0 GiB) in 2h 9m 13s, read: 86.4 MiB/s, write: 0 B/s
128: 2021-02-02 21:46:53 INFO: 91% (536.9 GiB of 590.0 GiB) in 2h 10m 24s, read: 84.5 MiB/s, write: 0 B/s
128: 2021-02-02 21:48:01 INFO: 92% (542.9 GiB of 590.0 GiB) in 2h 11m 32s, read: 89.4 MiB/s, write: 0 B/s
128: 2021-02-02 21:48:56 INFO: 93% (548.7 GiB of 590.0 GiB) in 2h 12m 27s, read: 109.4 MiB/s, write: 0 B/s
128: 2021-02-02 21:50:08 INFO: 94% (554.7 GiB of 590.0 GiB) in 2h 13m 39s, read: 84.4 MiB/s, write: 0 B/s
128: 2021-02-02 21:51:17 INFO: 95% (560.6 GiB of 590.0 GiB) in 2h 14m 48s, read: 87.5 MiB/s, write: 0 B/s
128: 2021-02-02 21:51:56 INFO: 96% (566.4 GiB of 590.0 GiB) in 2h 15m 27s, read: 153.9 MiB/s, write: 0 B/s
128: 2021-02-02 21:52:56 INFO: 97% (572.4 GiB of 590.0 GiB) in 2h 16m 27s, read: 101.5 MiB/s, write: 0 B/s
128: 2021-02-02 21:54:07 INFO: 98% (578.2 GiB of 590.0 GiB) in 2h 17m 38s, read: 84.3 MiB/s, write: 0 B/s
128: 2021-02-02 21:55:19 INFO: 99% (584.1 GiB of 590.0 GiB) in 2h 18m 50s, read: 84.1 MiB/s, write: 0 B/s
128: 2021-02-02 21:56:33 INFO: 100% (590.0 GiB of 590.0 GiB) in 2h 20m 4s, read: 81.1 MiB/s, write: 6.1 MiB/s
128: 2021-02-02 21:56:34 INFO: backup is sparse: 284.16 GiB (48%) total zero data
128: 2021-02-02 21:56:34 INFO: backup was done incrementally, reused 284.45 GiB (48%)
128: 2021-02-02 21:56:34 INFO: transferred 590.00 GiB in 8405 seconds (71.9 MiB/s)
128: 2021-02-02 21:56:34 INFO: Finished Backup of VM 128 (02:20:09)
 
Last edited:

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!