Virtual machine IO error after hot-swapping USB drive

Nov 15, 2024
3
0
1
I have two Windows Server 2016 virtual machines running on Proxmox 8.2.7, one of which has a USB disk drive attached to it to make quick file backups. I swap the drive every few weeks and has been without issues. However, on the last swap, I had an issue that caused both VMs to suddenly have IO problems with the virtual disk drives causing programs running on one VM that depends on the other one to error out, requiring to restart the programs and sessions to fix the issue.

I checked the event log on both machines, but there is nothing on them.

Here is the output of dmesg on Proxmox showing how it behaved on the second to last swap and the last swap:

Second to last swap:

[1578115.118505] systemd-journald[530]: Data hash table of /var/log/journal/4fcdcbe297054724a575e0b020ee6289/system.journal has a fill level at 75.0 (174763 of 233016 items, 75497472 file size, 431 bytes per hash table item), suggesting rotation.
[1578115.118511] systemd-journald[530]: /var/log/journal/4fcdcbe297054724a575e0b020ee6289/system.journal: Journal header limits reached or header out-of-date, rotating.
[1684272.913182] systemd-journald[530]: Data hash table of /var/log/journal/4fcdcbe297054724a575e0b020ee6289/system.journal has a fill level at 75.0 (174764 of 233016 items, 75497472 file size, 431 bytes per hash table item), suggesting rotation.
[1684272.913188] systemd-journald[530]: /var/log/journal/4fcdcbe297054724a575e0b020ee6289/system.journal: Journal header limits reached or header out-of-date, rotating.
[1790500.375711] systemd-journald[530]: Data hash table of /var/log/journal/4fcdcbe297054724a575e0b020ee6289/system.journal has a fill level at 75.0 (174765 of 233016 items, 75497472 file size, 431 bytes per hash table item), suggesting rotation.
[1790500.375719] systemd-journald[530]: /var/log/journal/4fcdcbe297054724a575e0b020ee6289/system.journal: Journal header limits reached or header out-of-date, rotating.
[1896495.043162] systemd-journald[530]: Data hash table of /var/log/journal/4fcdcbe297054724a575e0b020ee6289/system.journal has a fill level at 75.0 (174766 of 233016 items, 75497472 file size, 431 bytes per hash table item), suggesting rotation.
[1896495.043170] systemd-journald[530]: /var/log/journal/4fcdcbe297054724a575e0b020ee6289/system.journal: Journal header limits reached or header out-of-date, rotating.
[1971508.028816] usb 3-8: reset SuperSpeed USB device number 4 using xhci_hcd
[1971529.515608] usb 3-8: reset SuperSpeed USB device number 4 using xhci_hcd
[2002407.672254] systemd-journald[530]: Data hash table of /var/log/journal/4fcdcbe297054724a575e0b020ee6289/system.journal has a fill level at 75.0 (174763 of 233016 items, 75497472 file size, 431 bytes per hash table item), suggesting rotation.
[2002407.672262] systemd-journald[530]: /var/log/journal/4fcdcbe297054724a575e0b020ee6289/system.journal: Journal header limits reached or header out-of-date, rotating.
[2108450.537757] systemd-journald[530]: Data hash table of /var/log/journal/4fcdcbe297054724a575e0b020ee6289/system.journal has a fill level at 75.0 (174764 of 233016 items, 75497472 file size, 431 bytes per hash table item), suggesting rotation.
[2108450.537763] systemd-journald[530]: /var/log/journal/4fcdcbe297054724a575e0b020ee6289/system.journal: Journal header limits reached or header out-of-date, rotating.
[2133095.422251] usb 3-8: USB disconnect, device number 4
[2133126.288356] usb 3-8: new SuperSpeed USB device number 5 using xhci_hcd
[2133126.301388] usb 3-8: New USB device found, idVendor=1058, idProduct=25ed, bcdDevice=10.31
[2133126.301392] usb 3-8: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[2133126.301394] usb 3-8: Product: My Book 25ED
[2133126.301395] usb 3-8: Manufacturer: Western Digital
[2133126.301396] usb 3-8: SerialNumber: 575838324435304445343031
[2133126.302487] usb-storage 3-8:1.0: USB Mass Storage device detected
[2133126.302971] scsi host1: usb-storage 3-8:1.0
[2133126.708505] usb 3-8: reset SuperSpeed USB device number 5 using xhci_hcd
[2825415.035206] usb 3-8: USB disconnect, device number 5
[2825442.869205] usb 3-8: new SuperSpeed USB device number 6 using xhci_hcd
[2825442.882894] usb 3-8: New USB device found, idVendor=1058, idProduct=25ed, bcdDevice=10.31
[2825442.882899] usb 3-8: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[2825442.882900] usb 3-8: Product: My Book 25ED
[2825442.882901] usb 3-8: Manufacturer: Western Digital
[2825442.882902] usb 3-8: SerialNumber: 5758443244363331504A3136
[2825442.884842] usb-storage 3-8:1.0: USB Mass Storage device detected
[2825442.885111] scsi host1: usb-storage 3-8:1.0
[2825443.235553] usb 3-8: reset SuperSpeed USB device number 6 using xhci_hcd
[2828115.837199] hrtimer: interrupt took 5651 ns

Last swap:

[3343593.563132] usb 3-8: USB disconnect, device number 6
[3343614.598186] usb 3-8: new SuperSpeed USB device number 7 using xhci_hcd
[3343614.610881] usb 3-8: New USB device found, idVendor=1058, idProduct=25ed, bcdDevice=10.31
[3343614.610884] usb 3-8: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[3343614.610886] usb 3-8: Product: My Book 25ED
[3343614.610887] usb 3-8: Manufacturer: Western Digital
[3343614.610888] usb 3-8: SerialNumber: 575838324435304445343031
[3343614.611972] usb-storage 3-8:1.0: USB Mass Storage device detected
[3343614.612392] scsi host1: usb-storage 3-8:1.0
[3343614.907516] usb 3-8: reset SuperSpeed USB device number 7 using xhci_hcd
[3946462.550380] usb 3-8: USB disconnect, device number 7
[3946493.696462] usb 3-8: new SuperSpeed USB device number 8 using xhci_hcd
[3946493.709427] usb 3-8: New USB device found, idVendor=1058, idProduct=25ed, bcdDevice=10.31
[3946493.709431] usb 3-8: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[3946493.709433] usb 3-8: Product: My Book 25ED
[3946493.709434] usb 3-8: Manufacturer: Western Digital
[3946493.709435] usb 3-8: SerialNumber: 5758443244363331504A3136
[3946493.710588] usb-storage 3-8:1.0: USB Mass Storage device detected
[3946493.710851] scsi host1: usb-storage 3-8:1.0
[3946494.755423] scsi 1:0:0:0: Direct-Access WD My Book 25ED 1031 PQ: 0 ANSI: 6
[3946494.755986] scsi 1:0:0:1: Enclosure WD SES Device 1031 PQ: 0 ANSI: 6
[3946494.760513] sd 1:0:0:0: Attached scsi generic sg2 type 0
[3946494.760612] ses 1:0:0:1: Attached Enclosure device
[3946494.760653] ses 1:0:0:1: Attached scsi generic sg3 type 13
[3946494.762283] sd 1:0:0:0: [sdb] Spinning up disk...
[3946500.682211] ses 1:0:0:1: Wrong diagnostic page; asked for 1 got 8
[3946500.682216] ses 1:0:0:1: Failed to get diagnostic page 0x1
[3946500.682219] ses 1:0:0:1: Failed to bind enclosure -19
[3946501.727280] .ready
[3946501.727297] sd 1:0:0:0: [sdb] Read Capacity(10) failed: Result: hostbyte=DID_ERROR driverbyte=DRIVER_OK
[3946501.727300] sd 1:0:0:0: [sdb] Sense not available.
[3946501.727307] sd 1:0:0:0: [sdb] 0 512-byte logical blocks: (0 B/0 B)
[3946501.727308] sd 1:0:0:0: [sdb] 0-byte physical blocks
[3946501.727311] sd 1:0:0:0: [sdb] Write Protect is off
[3946501.727312] sd 1:0:0:0: [sdb] Mode Sense: 00 00 00 00
[3946501.727314] sd 1:0:0:0: [sdb] Asking for cache data failed
[3946501.727315] sd 1:0:0:0: [sdb] Assuming drive cache: write through
[3946501.727604] sd 1:0:0:0: [sdb] Attached SCSI disk
[3946501.881606] usb 3-8: reset SuperSpeed USB device number 8 using xhci_hcd
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!