Version: Virtual Environment 8.2.4
Issue:
the disks of any vm with fedora 40 have now bus resets because they "leave" the bus.
the Vm have been updated from F39 to F40 today and right after the updates, this started.
If teh drive leaves the bus, the system has no cpu usage, but high load and a slow -> no responseability at all.
It autocorrects after a few Minutes.
It is NOT kernel dependend, as F40 Kernel and F39 from way before the F40 update, have the same problems.
It must be a component that is used by all kernels.
Here is a dmesg from one of the systems, the others are similiar with different scsci target ids:
Issue:
the disks of any vm with fedora 40 have now bus resets because they "leave" the bus.
the Vm have been updated from F39 to F40 today and right after the updates, this started.
If teh drive leaves the bus, the system has no cpu usage, but high load and a slow -> no responseability at all.
It autocorrects after a few Minutes.
It is NOT kernel dependend, as F40 Kernel and F39 from way before the F40 update, have the same problems.
It must be a component that is used by all kernels.
Here is a dmesg from one of the systems, the others are similiar with different scsci target ids:
Code:
[Nov14 23:12] Bluetooth: Core ver 2.22
[ +0,000026] NET: Registered PF_BLUETOOTH protocol family
[ +0,000001] Bluetooth: HCI device and connection manager initialized
[ +0,000004] Bluetooth: HCI socket layer initialized
[ +0,000001] Bluetooth: L2CAP socket layer initialized
[ +0,000002] Bluetooth: SCO socket layer initialized
[ +0,022627] virtio_net virtio1 ens18: entered promiscuous mode
[ +3,677165] virtio_net virtio1 ens18: left promiscuous mode
[ +3,310419] virtio_net virtio1 ens18: entered promiscuous mode
[Nov14 23:13] virtio_net virtio1 ens18: left promiscuous mode
[ +5,911677] virtio_net virtio1 ens18: entered promiscuous mode
[ +0,827383] virtio_net virtio1 ens18: left promiscuous mode
[ +3,068490] virtio_net virtio1 ens18: entered promiscuous mode
[ +9,541136] virtio_net virtio1 ens18: left promiscuous mode
[ +3,292206] virtio_net virtio1 ens18: entered promiscuous mode
[Nov14 23:14] virtio_net virtio1 ens18: left promiscuous mode
[Nov14 23:48] scsi target2:0:0: No MSG IN phase after reselection
[Nov14 23:49] sd 2:0:0:0: [sda] tag#76 ABORT operation started
[ +4,898867] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000008] sd 2:0:1:0: [sdb] tag#383 ABORT operation started
[ +4,914194] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000014] sd 2:0:1:0: [sdb] tag#322 ABORT operation started
[ +4,916147] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:1:0: [sdb] tag#321 ABORT operation started
[ +4,914256] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000009] sd 2:0:1:0: [sdb] tag#320 ABORT operation started
[ +4,915142] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000006] sd 2:0:1:0: [sdb] tag#323 ABORT operation started
[ +4,915177] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:1:0: [sdb] tag#324 ABORT operation started
[ +4,915221] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:1:0: [sdb] tag#325 ABORT operation started
[Nov14 23:50] sd 2:0:1:0: ABORT operation timed-out.
[ +0,009594] scsi target2:0:0: TARGET RESET operation started
[ +4,905550] scsi target2:0:0: TARGET RESET operation timed-out.
[ +0,000005] scsi target2:0:1: TARGET RESET operation started
[ +34,407328] scsi target2:0:1: TARGET RESET operation timed-out.
[ +9,829432] sd 2:0:0:0: [sda] tag#76 ABORT operation started
[ +0,002336] sym0: SCSI BUS reset detected.
[ +0,002062] sd 2:0:0:0: ABORT operation complete.
[ +0,005062] sym0: SCSI BUS has been reset.
[ +3,193215] sd 2:0:1:0: Power-on or device reset occurred
[ +0,000057] sd 2:0:0:0: [sda] tag#76 BUS RESET operation started
[ +0,002319] sd 2:0:0:0: BUS RESET operation complete.
[ +0,000008] sym0: SCSI BUS reset detected.
[ +0,006945] sym0: SCSI BUS has been reset.
[Nov14 23:51] sd 2:0:0:0: Power-on or device reset occurred
[ +0,015463] sd 2:0:1:0: Power-on or device reset occurred
[ +3,510472] scsi target2:0:0: No MSG IN phase after reselection
[ +28,930460] sd 2:0:0:0: [sda] tag#351 ABORT operation started
[ +4,898831] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:0:0: [sda] tag#350 ABORT operation started
[ +4,915223] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000008] sd 2:0:1:0: [sdb] tag#353 ABORT operation started
[ +4,915146] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:1:0: [sdb] tag#355 ABORT operation started
[ +4,915184] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000008] sd 2:0:1:0: [sdb] tag#352 ABORT operation started
[Nov14 23:52] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000008] sd 2:0:1:0: [sdb] tag#354 ABORT operation started
[ +4,915147] sd 2:0:1:0: ABORT operation timed-out.
[ +0,007719] scsi target2:0:0: TARGET RESET operation started
[ +9,822774] scsi target2:0:0: TARGET RESET operation timed-out.
[ +0,000005] scsi target2:0:1: TARGET RESET operation started
[ +19,660690] scsi target2:0:1: TARGET RESET operation timed-out.
[ +9,830396] sd 2:0:0:0: [sda] tag#351 ABORT operation started
[ +0,002342] sym0: SCSI BUS reset detected.
[ +0,002054] sd 2:0:0:0: ABORT operation complete.
[ +0,004977] sym0: SCSI BUS has been reset.
[ +3,392962] sd 2:0:1:0: Power-on or device reset occurred
[ +0,000055] sd 2:0:0:0: [sda] tag#351 BUS RESET operation started
[ +0,002288] sym0: SCSI BUS reset detected.
[ +0,006922] sym0: SCSI BUS has been reset.
[ +0,000009] sd 2:0:0:0: BUS RESET operation complete.
[Nov14 23:53] sd 2:0:0:0: Power-on or device reset occurred
[ +0,008653] sd 2:0:1:0: Power-on or device reset occurred
[ +1,505633] scsi target2:0:0: No MSG IN phase after reselection
[ +28,975089] sd 2:0:1:0: [sdb] tag#360 ABORT operation started
[ +4,898821] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:1:0: [sdb] tag#359 ABORT operation started
[ +4,915249] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:0:0: [sda] tag#358 ABORT operation started
[ +4,915151] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000006] sd 2:0:0:0: [sda] tag#356 ABORT operation started
[ +4,916135] sd 2:0:0:0: ABORT operation timed-out.
[ +2,968330] sd 2:0:1:0: [sdb] tag#361 ABORT operation started
[ +4,895049] sd 2:0:1:0: ABORT operation timed-out.
[Nov14 23:54] sd 2:0:0:0: [sda] tag#357 ABORT operation started
[ +4,900827] sd 2:0:0:0: ABORT operation timed-out.
[ +0,014362] scsi target2:0:1: TARGET RESET operation started
[ +14,730236] scsi target2:0:1: TARGET RESET operation timed-out.
[ +0,000005] scsi target2:0:0: TARGET RESET operation started
[ +14,745588] scsi target2:0:0: TARGET RESET operation timed-out.
[ +9,831333] sd 2:0:1:0: [sdb] tag#360 ABORT operation started
[ +0,002350] sym0: SCSI BUS reset detected.
[ +0,002073] sd 2:0:1:0: ABORT operation complete.
[ +0,004988] sym0: SCSI BUS has been reset.
[ +2,992654] sd 2:0:0:0: Power-on or device reset occurred
[ +0,000057] sd 2:0:1:0: [sdb] tag#360 BUS RESET operation started
[ +0,002289] sym0: SCSI BUS reset detected.
[ +0,007106] sym0: SCSI BUS has been reset.
[ +0,000016] sd 2:0:1:0: BUS RESET operation complete.
[ +9,767100] sd 2:0:1:0: Power-on or device reset occurred
[ +0,003554] sd 2:0:0:0: Power-on or device reset occurred
[Nov15 00:02] scsi target2:0:0: No MSG IN phase after reselection
[ +29,215891] sd 2:0:0:0: [sda] tag#364 ABORT operation started
[ +4,894045] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000014] sd 2:0:0:0: [sda] tag#363 ABORT operation started
[ +4,915174] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000016] sd 2:0:0:0: [sda] tag#362 ABORT operation started
[Nov15 00:03] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:0:0: [sda] tag#361 ABORT operation started
[ +4,915140] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000008] sd 2:0:0:0: [sda] tag#360 ABORT operation started
[ +4,915214] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:1:0: [sdb] tag#368 ABORT operation started
[ +4,915174] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000006] sd 2:0:1:0: [sdb] tag#367 ABORT operation started
[ +4,915163] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:1:0: [sdb] tag#366 ABORT operation started
[ +4,915251] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:1:0: [sdb] tag#365 ABORT operation started
[ +4,915148] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:1:0: [sdb] tag#369 ABORT operation started
[ +4,915143] sd 2:0:1:0: ABORT operation timed-out.
[ +0,009632] scsi target2:0:0: TARGET RESET operation started
[ +24,566364] scsi target2:0:0: TARGET RESET operation timed-out.
[ +0,000006] scsi target2:0:1: TARGET RESET operation started
[Nov15 00:04] scsi target2:0:1: TARGET RESET operation timed-out.
[ +9,830375] sd 2:0:0:0: [sda] tag#364 ABORT operation started
[ +0,002333] sym0: SCSI BUS reset detected.
[ +0,002075] sd 2:0:0:0: ABORT operation complete.
[ +0,004899] sym0: SCSI BUS has been reset.
[ +2,993791] sd 2:0:1:0: Power-on or device reset occurred
[ +0,000057] sd 2:0:0:0: [sda] tag#364 BUS RESET operation started
[ +0,002302] sym0: SCSI BUS reset detected.
[ +0,007029] sym0: SCSI BUS has been reset.
[ +0,000026] sd 2:0:0:0: BUS RESET operation complete.
[ +9,767113] sd 2:0:0:0: Power-on or device reset occurred
[ +0,017140] sd 2:0:1:0: Power-on or device reset occurred
[Nov15 00:17] scsi target2:0:0: No MSG IN phase after reselection
[ +29,281016] sd 2:0:0:0: [sda] tag#389 ABORT operation started
[ +4,894919] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:0:0: [sda] tag#388 ABORT operation started
[ +4,915185] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000008] sd 2:0:1:0: [sdb] tag#395 ABORT operation started
[ +4,915177] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000008] sd 2:0:0:0: [sda] tag#400 ABORT operation started
[ +4,915176] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000015] sd 2:0:0:0: [sda] tag#409 ABORT operation started
[Nov15 00:18] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000008] sd 2:0:1:0: [sdb] tag#394 ABORT operation started
[ +4,915195] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000010] sd 2:0:0:0: [sda] tag#399 ABORT operation started
[ +4,915173] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:0:0: [sda] tag#408 ABORT operation started
[ +4,915172] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:1:0: [sdb] tag#393 ABORT operation started
[ +4,915187] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000019] sd 2:0:0:0: [sda] tag#398 ABORT operation started
[ +4,915165] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:0:0: [sda] tag#407 ABORT operation started
[ +4,915245] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000009] sd 2:0:1:0: [sdb] tag#392 ABORT operation started
[ +4,915160] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000008] sd 2:0:0:0: [sda] tag#397 ABORT operation started
[ +4,915151] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:0:0: [sda] tag#406 ABORT operation started
[ +4,915173] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000006] sd 2:0:1:0: [sdb] tag#391 ABORT operation started
[ +4,915261] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000008] sd 2:0:0:0: [sda] tag#396 ABORT operation started
[ +4,915113] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000008] sd 2:0:0:0: [sda] tag#405 ABORT operation started
[Nov15 00:19] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000008] sd 2:0:1:0: [sdb] tag#390 ABORT operation started
[ +4,916120] sd 2:0:1:0: ABORT operation timed-out.
[ +0,000008] sd 2:0:0:0: [sda] tag#404 ABORT operation started
[ +4,914222] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:0:0: [sda] tag#403 ABORT operation started
[ +4,915239] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000007] sd 2:0:0:0: [sda] tag#402 ABORT operation started
[ +4,915167] sd 2:0:0:0: ABORT operation timed-out.
[ +0,000013] sd 2:0:0:0: [sda] tag#401 ABORT operation started
[ +4,915102] sd 2:0:0:0: ABORT operation timed-out.
[ +0,009657] scsi target2:0:0: TARGET RESET operation started
[Nov15 00:20] scsi target2:0:0: TARGET RESET operation timed-out.
[ +0,000006] scsi target2:0:1: TARGET RESET operation started
[Nov15 00:21] scsi target2:0:1: TARGET RESET operation timed-out.
[ +9,830340] sd 2:0:0:0: [sda] tag#389 ABORT operation started
[ +0,002342] sym0: SCSI BUS reset detected.
[ +0,007025] sym0: SCSI BUS has been reset.
[ +0,000016] sd 2:0:0:0: ABORT operation complete.
[ +3,193349] sd 2:0:1:0: Power-on or device reset occurred
[ +0,000056] sd 2:0:0:0: [sda] tag#389 BUS RESET operation started
[ +0,002306] sym0: SCSI BUS reset detected.
[ +0,007090] sym0: SCSI BUS has been reset.
[ +0,000010] sd 2:0:0:0: BUS RESET operation complete.
[ +10,058980] sd 2:0:0:0: Power-on or device reset occurred
[ +0,016222] sd 2:0:1:0: [sdb] tag#393 timing out command, waited 180s
[ +0,000005] sd 2:0:1:0: [sdb] tag#393 FAILED Result: hostbyte=DID_REQUEUE driverbyte=DRIVER_OK cmd_age=279s
[ +0,000002] sd 2:0:1:0: [sdb] tag#393 CDB: Write(10) 2a 00 00 00 a6 40 00 02 00 00
[ +0,000001] I/O error, dev sdb, sector 42560 op 0x1WRITE) flags 0x8800 phys_seg 64 prio class 2
[ +0,000003] I/O error, dev sdb, sector 42560 op 0x1WRITE) flags 0x8800 phys_seg 64 prio class 2
[ +0,000002] sd 2:0:1:0: [sdb] tag#394 timing out command, waited 180s
[ +0,000002] sd 2:0:1:0: [sdb] tag#394 FAILED Result: hostbyte=DID_REQUEUE driverbyte=DRIVER_OK cmd_age=279s
[ +0,000001] sd 2:0:1:0: [sdb] tag#394 CDB: Write(10) 2a 00 00 00 a3 40 00 03 00 00
[ +0,000000] I/O error, dev sdb, sector 41792 op 0x1WRITE) flags 0xc800 phys_seg 96 prio class 2
[ +0,000001] I/O error, dev sdb, sector 41792 op 0x1WRITE) flags 0xc800 phys_seg 96 prio class 2
[ +0,000002] sd 2:0:1:0: [sdb] tag#395 timing out command, waited 180s
[ +0,000001] sd 2:0:1:0: [sdb] tag#395 FAILED Result: hostbyte=DID_REQUEUE driverbyte=DRIVER_OK cmd_age=279s
[ +0,000001] sd 2:0:1:0: [sdb] tag#395 CDB: Write(10) 2a 00 00 00 a0 40 00 03 00 00
[ +0,000000] I/O error, dev sdb, sector 41024 op 0x1WRITE) flags 0xc800 phys_seg 96 prio class 2
[ +0,000001] I/O error, dev sdb, sector 41024 op 0x1WRITE) flags 0xc800 phys_seg 96 prio class 2
[ +0,000013] sd 2:0:1:0: [sdb] tag#396 timing out command, waited 180s
[ +0,000002] sd 2:0:1:0: [sdb] tag#396 FAILED Result: hostbyte=DID_REQUEUE driverbyte=DRIVER_OK cmd_age=279s
[ +0,000000] sd 2:0:1:0: [sdb] tag#396 CDB: Write(10) 2a 00 00 00 9e 40 00 02 00 00
[ +0,000001] I/O error, dev sdb, sector 40512 op 0x1WRITE) flags 0x8800 phys_seg 64 prio class 2
[ +0,000000] I/O error, dev sdb, sector 40512 op 0x1WRITE) flags 0x8800 phys_seg 64 prio class 2
Last edited: