Scheduled Backup auf USB sehr langsam

[swoop]

Hallo,

ich habe einen Server, aufdem einige VMs und LXCs laufen. Als Backup verwende ich die in Proxmox eingebaute Backupmöglichkeit. Die sollte jede Nacht den Server Backupen, aber das dauert inzwischen so ungefäht 100 Stunden.
Der gesamtspeicherplatz beträgt ca. 1,6TB.
Als Backuplaufwerk werden mehrere 4TB USB Festplatte verwendet.
Die USB-Platte wird per pve6-usb-automount (apt moudl) eingebunden.
Funktioniert auch soweit gut, wenn die Festplatte manuel eingebunden wird.
Wenn die Festplatte per automount eingbunden wird ist die Geschwindigkeit extrem langsam bei etwa 1,6MB/s.

INFO: starting new backup job: vzdump 100 101 200 202 203 204 --compress lzo --mode snapshot --storage usb-sdb1 --mailnotification always --quiet 1 --mailto aazt@backup-loesung.com
INFO: Starting Backup of VM 100 (qemu)
INFO: Backup started at 2021-05-07 20:00:01
INFO: status = running
INFO: VM Name: TERRASERVER
INFO: include disk 'scsi0' 'local-lvm:vm-100-disk-0' 32G
INFO: backup mode: snapshot
INFO: ionice priority: 7
INFO: creating vzdump archive '/media/sdb1/dump/vzdump-qemu-100-2021_05_07-20_00_01.vma.lzo'
INFO: started backup task '65043548-1005-4d57-a082-dfc142cd612b'
INFO: resuming VM again
INFO:   0% (52.3 MiB of 32.0 GiB) in 3s, read: 17.4 MiB/s, write: 6.7 MiB/s
INFO:   1% (329.9 MiB of 32.0 GiB) in 3m 4s, read: 1.5 MiB/s, write: 1.5 MiB/s
INFO:   2% (659.7 MiB of 32.0 GiB) in 6m 33s, read: 1.6 MiB/s, write: 1.5 MiB/s
INFO:   3% (986.0 MiB of 32.0 GiB) in 10m 4s, read: 1.5 MiB/s, write: 1.5 MiB/s
INFO:   4% (1.3 GiB of 32.0 GiB) in 13m 54s, read: 1.4 MiB/s, write: 1.4 MiB/s
INFO:   5% (1.6 GiB of 32.0 GiB) in 17m 16s, read: 1.6 MiB/s, write: 1.6 MiB/s
INFO:   6% (1.9 GiB of 32.0 GiB) in 19m 44s, read: 2.2 MiB/s, write: 2.2 MiB/s
INFO:   7% (2.2 GiB of 32.0 GiB) in 22m 38s, read: 1.9 MiB/s, write: 1.7 MiB/s
INFO:   8% (2.6 GiB of 32.0 GiB) in 25m 29s, read: 1.9 MiB/s, write: 1.6 MiB/s
INFO:   9% (2.9 GiB of 32.0 GiB) in 31m 35s, read: 912.8 KiB/s, write: 911.6 KiB/s
INFO:  10% (3.2 GiB of 32.0 GiB) in 35m 54s, read: 1.3 MiB/s, write: 1.2 MiB/s
INFO:  11% (3.5 GiB of 32.0 GiB) in 39m 39s, read: 1.5 MiB/s, write: 1.4 MiB/s
INFO:  12% (3.8 GiB of 32.0 GiB) in 45m 45s, read: 912.8 KiB/s, write: 911.1 KiB/s
INFO:  13% (4.2 GiB of 32.0 GiB) in 49m 21s, read: 1.5 MiB/s, write: 1.4 MiB/s

Das ist beiweitem keine USB3 Geschwindigkeit. Wie bekomme ich Proxmox dazu, dass er die HDD per USB3 automountet damit das Backup wieder "normal" funktioniert?
Der Mount schreibt folgendes ins log:

May 18 07:02:30 server pve6-usb-automount: UDEV event for action::remove and device::sdb1 device_path::/devices/pci0000:00/0000:00:14.0/usb2/2-5/2-5:1.0/host7/target7:0:0/7:0:0:0/block/sdb/sdb1
May 18 07:02:30 server pve6-usb-automount: Remove event for sdb1
May 18 07:02:30 server ntfs-3g[17101]: Unmounting /dev/sdb1 (My Passport)
May 18 07:02:30 server ntfs-3g[17101]: Failed to sync device /dev/sdb1: Input/output error
May 18 07:02:30 server ntfs-3g[17101]: Failed to fsync device /dev/sdb1: Input/output error
May 18 07:02:30 server ntfs-3g[17101]: Failed to close volume /dev/sdb1: Device or resource busy
May 18 07:02:30 server systemd[1]: media-sdb1.mount: Succeeded.
May 18 07:02:30 server pve6-usb-automount: Device sdb1 was unmounted
May 18 07:02:30 server pve6-usb-automount: UDEV event for action::remove and device::sdb device_path::/devices/pci0000:00/0000:00:14.0/usb2/2-5/2-5:1.0/host7/target7:0:0/7:0:0:0/block/sdb
May 18 07:02:30 server pve6-usb-automount: Remove event for sdb
May 18 07:02:30 server pve6_usb_automount.py[562]: rmdir: failed to remove '/media/sdb1': Directory not empty
May 18 07:02:30 server pve6-usb-automount: Mount dir for device sdb was not found
May 18 07:02:30 server pve6-usb-automount: UDEV event for action::remove and device::dm-15 device_path::/devices/virtual/block/dm-15
May 18 07:02:30 server pve6-usb-automount: Remove event for dm-15
May 18 07:02:30 server pve6-usb-automount: Mount dir for device dm-15 was not found
May 18 07:02:30 server pve6-usb-automount: UDEV event for action::remove and device::dm-15 device_path::/devices/virtual/block/dm-15
May 18 07:02:30 server pve6-usb-automount: Remove event for dm-15
May 18 07:02:30 server pve6-usb-automount: Mount dir for device dm-15 was not found
May 18 07:02:30 server pve6-usb-automount: UDEV event for action::change and device::sda3 device_path::/devices/pci0000:00/0000:00:01.0/0000:01:00.0/host0/target0:2:0/0:2:0:0/block/sda/sda3
May 18 07:02:30 server pvestatd[1192]: unable to activate storage 'usb-sdb1' - directory is expected to be a mount point but is not mounted: '/media/sdb1'
May 18 07:02:30 server pve6-usb-automount: UDEV event for action::remove and device::dm-16 device_path::/devices/virtual/block/dm-16
May 18 07:02:30 server pve6-usb-automount: Remove event for dm-16
May 18 07:02:30 server pve6-usb-automount: Mount dir for device dm-16 was not found
May 18 07:02:30 server pvestatd[1192]: status update time (6.217 seconds)
May 18 07:02:30 server pve6-usb-automount: UDEV event for action::remove and device::dm-16 device_path::/devices/virtual/block/dm-16
May 18 07:02:30 server pve6-usb-automount: Remove event for dm-16
May 18 07:02:30 server pve6-usb-automount: Mount dir for device dm-16 was not found
May 18 07:02:31 server pve6-usb-automount: UDEV event for action::change and device::sda3 device_path::/devices/pci0000:00/0000:00:01.0/0000:01:00.0/host0/target0:2:0/0:2:0:0/block/sda/sda3
May 18 07:02:36 server kernel: [2124615.220399] usb 2-5: new SuperSpeed Gen 1 USB device number 5 using xhci_hcd
May 18 07:02:36 server kernel: [2124615.241229] usb 2-5: New USB device found, idVendor=1058, idProduct=2627, bcdDevice=40.08
May 18 07:02:36 server kernel: [2124615.241231] usb 2-5: New USB device strings: Mfr=2, Product=3, SerialNumber=1
May 18 07:02:36 server kernel: [2124615.241231] usb 2-5: Product: My Passport 2627
May 18 07:02:36 server kernel: [2124615.241232] usb 2-5: Manufacturer: Western Digital
May 18 07:02:36 server kernel: [2124615.241233] usb 2-5: SerialNumber: 5758433145373948314A5556
May 18 07:02:36 server kernel: [2124615.242246] usb-storage 2-5:1.0: USB Mass Storage device detected
May 18 07:02:36 server kernel: [2124615.242460] scsi host7: usb-storage 2-5:1.0
May 18 07:02:37 server kernel: [2124616.272688] scsi 7:0:0:0: Direct-Access     WD       My Passport 2627 4008 PQ: 0 ANSI: 6
May 18 07:02:37 server kernel: [2124616.272885] scsi 7:0:0:1: Enclosure         WD       SES Device       4008 PQ: 0 ANSI: 6
May 18 07:02:37 server kernel: [2124616.273680] sd 7:0:0:0: Attached scsi generic sg2 type 0
May 18 07:02:37 server kernel: [2124616.273785] ses 7:0:0:1: Attached Enclosure device
May 18 07:02:37 server kernel: [2124616.273829] ses 7:0:0:1: Attached scsi generic sg3 type 13
May 18 07:02:37 server kernel: [2124616.274809] sd 7:0:0:0: [sdb] Spinning up disk...
May 18 07:02:37 server kernel: [2124616.275034] ses 7:0:0:1: Wrong diagnostic page; asked for 1 got 8
May 18 07:02:37 server kernel: [2124616.275678] ses 7:0:0:1: Failed to get diagnostic page 0x1
May 18 07:02:37 server kernel: [2124616.276536] ses 7:0:0:1: Failed to bind enclosure -19
May 18 07:02:46 server kernel: [2124617.296341] ........ready
May 18 07:02:46 server kernel: [2124624.464903] sd 7:0:0:0: [sdb] Very big device. Trying to use READ CAPACITY(16).
May 18 07:02:46 server kernel: [2124624.465037] sd 7:0:0:0: [sdb] 7813969920 512-byte logical blocks: (4.00 TB/3.64 TiB)
May 18 07:02:46 server kernel: [2124624.465038] sd 7:0:0:0: [sdb] 4096-byte physical blocks
May 18 07:02:46 server kernel: [2124624.465311] sd 7:0:0:0: [sdb] Write Protect is off
May 18 07:02:46 server kernel: [2124624.465312] sd 7:0:0:0: [sdb] Mode Sense: 47 00 10 08
May 18 07:02:46 server kernel: [2124624.465630] sd 7:0:0:0: [sdb] No Caching mode page found
May 18 07:02:46 server kernel: [2124624.466247] sd 7:0:0:0: [sdb] Assuming drive cache: write through
May 18 07:02:47 server kernel: [2124625.637541]  sdb: sdb1
May 18 07:02:47 server kernel: [2124625.638546] sd 7:0:0:0: [sdb] Attached SCSI disk
May 18 07:02:47 server pve6-usb-automount: UDEV event for action::add and device::sdb device_path::/devices/pci0000:00/0000:00:14.0/usb2/2-5/2-5:1.0/host7/target7:0:0/7:0:0:0/block/sdb
May 18 07:02:47 server pve6-usb-automount: Add event for sdb
May 18 07:02:47 server pve6-usb-automount: Found USB device sdb, try to mount
May 18 07:02:47 server pve6-usb-automount: Blockdevice has no fs-type
May 18 07:02:48 server pve6-usb-automount: UDEV event for action::add and device::sdb1 device_path::/devices/pci0000:00/0000:00:14.0/usb2/2-5/2-5:1.0/host7/target7:0:0/7:0:0:0/block/sdb/sdb1
May 18 07:02:48 server pve6-usb-automount: Add event for sdb1
May 18 07:02:48 server pve6-usb-automount: Found USB device sdb1, try to mount
May 18 07:02:48 server pve6-usb-automount: Create mount dir </media/sdb1>
May 18 07:02:53 server ntfs-3g[5400]: Version 2017.3.23AR.3 integrated FUSE 28
May 18 07:02:53 server ntfs-3g[5400]: Mounted /dev/sdb1 (Read-Write, label "My Passport", NTFS 3.1)
May 18 07:02:53 server ntfs-3g[5400]: Cmdline options: rw,sync
May 18 07:02:53 server ntfs-3g[5400]: Mount options: sync,allow_other,nonempty,relatime,rw,fsname=/dev/sdb1,blkdev,blksize=4096
May 18 07:02:53 server ntfs-3g[5400]: Ownership and permissions disabled, configuration type 7

danke für eure Hilfe.
Wenn ihr noch Infos brauch, bitte Bescheid geben.

 

[AlexanderT]

Das erste, was ich probieren würde, ist die Festplatte z.B. in ext4 neu zu formatieren. NTFS läuft (noch) über Fuse mount im Userspace, was für reine Backups sicher nicht ideal ist.

 

[Dunuin]

Cmdline options: rw,sync

Festplatten sind halt einfach unglaublich langsam wenn du mit Sync Writes arbeitest. Ist da nicht unüblich wenn die HDDs einfach nicht mehr als 1-2MB/s schaffen. Versuch es mal mit async statt sync Writes, dann sollten die HDDs auch deutlich schneller arbeiten.