MD3200i SAN issues

hotwired007 · Nov 6, 2012

I now have my MD3200i configured with all the NICs connected:

192.168.15.80	MD3200i	Management Port 0
192.168.15.81	MD3200i	Management Port 1
192.168.15.82	MD3200i iSCSI	Controller 0 Port 0
192.168.15.83	MD3200i iSCSI	Controller 1 Port 0
192.168.15.84	MD3200i iSCSI	Controller 0 Port 1
192.168.15.85	MD3200i iSCSI	Controller 1 Port 1
192.168.15.86	MD3200i iSCSI	Controller 0 Port 2
192.168.15.87	MD3200i iSCSI	Controller 1 Port 2
192.168.15.88	MD3200i iSCSI	Controller 0 Port 3
192.168.15.89	MD3200i iSCSI	Controller 1 Port 3

and i have added the iSCSI connection in Proxmox but when i got to create an LVM on top of the iSCSI - like i have done with the readyNAS 2100 - nothing is displayed in the Base Volume drop down when the iSCSI connection is selected.

I have created a Host group on the MD3200i and assigned Hosts and assigned the Disk to the group

has anyone got any suggestions?

hotwired007 · Nov 6, 2012

I had created a virtual disk 4.6TB in size - i deleted it and recreated it at 1TB and it now shows up... whats the maximum size i can use?

i'm getting loads of errors on my proxmox nodes:

Code:

Nov  6 14:59:12 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:12 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 03 00 00 00 08 00
Nov  6 14:59:12 node1 kernel: Buffer I/O error on device sdd, logical block 96
Nov  6 14:59:12 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:12 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:12 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:12 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 03 00 00 00 08 00
Nov  6 14:59:12 node1 kernel: Buffer I/O error on device sdd, logical block 96
Nov  6 14:59:13 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:13 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:13 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:13 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 03 08 00 00 08 00
Nov  6 14:59:13 node1 kernel: Buffer I/O error on device sdd, logical block 97
Nov  6 14:59:13 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:13 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:13 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:13 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 03 08 00 00 08 00
Nov  6 14:59:13 node1 kernel: Buffer I/O error on device sdd, logical block 97
Nov  6 14:59:14 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:14 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:14 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:14 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 03 10 00 00 08 00
Nov  6 14:59:14 node1 kernel: Buffer I/O error on device sdd, logical block 98
Nov  6 14:59:14 node1 kernel: end_request: I/O error, dev sdd, sector 784
Nov  6 14:59:14 node1 kernel: Buffer I/O error on device sdd, logical block 98
Nov  6 14:59:15 node1 kernel: __ratelimit: 1 callbacks suppressed
Nov  6 14:59:15 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:15 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:15 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:15 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:15 node1 kernel: __ratelimit: 1 callbacks suppressed
Nov  6 14:59:15 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:15 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:15 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:15 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:15 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:16 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:16 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:16 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:16 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:16 node1 kernel: __ratelimit: 1 callbacks suppressed
Nov  6 14:59:16 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:16 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:16 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:16 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:16 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:16 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:16 node1 iscsid: connect to 192.168.15.89:3260 failed (No route to host)
Nov  6 14:59:16 node1 iscsid: connect to 192.168.15.87:3260 failed (No route to host)
Nov  6 14:59:16 node1 iscsid: connect to 192.168.15.85:3260 failed (No route to host)
Nov  6 14:59:17 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:17 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:17 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:17 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:17 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:17 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:17 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:17 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:17 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 10 00 00 08 00
Nov  6 14:59:17 node1 kernel: Buffer I/O error on device sdd, logical block 2
Nov  6 14:59:18 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:18 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:18 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:18 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:18 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:19 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:19 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:19 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:19 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:19 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:19 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:19 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:19 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:19 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:19 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:20 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:20 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:20 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:20 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:20 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:20 node1 kernel: end_request: I/O error, dev sdd, sector 0
Nov  6 14:59:20 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:21 node1 kernel: __ratelimit: 1 callbacks suppressed
Nov  6 14:59:21 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:21 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:21 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:21 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:21 node1 kernel: __ratelimit: 1 callbacks suppressed
Nov  6 14:59:21 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:21 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:21 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:21 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:21 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:22 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:22 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:22 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:22 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:22 node1 kernel: __ratelimit: 1 callbacks suppressed
Nov  6 14:59:22 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:22 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:22 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:22 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:22 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:22 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:22 node1 iscsid: connect to 192.168.15.89:3260 failed (No route to host)
Nov  6 14:59:22 node1 iscsid: connect to 192.168.15.87:3260 failed (No route to host)
Nov  6 14:59:22 node1 iscsid: connect to 192.168.15.85:3260 failed (No route to host)
Nov  6 14:59:23 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:23 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:23 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:23 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:23 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:23 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:23 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:23 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:23 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:23 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:24 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:24 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:24 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:24 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:24 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:24 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:24 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:24 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:24 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 80 00 00 08 00
Nov  6 14:59:24 node1 kernel: Buffer I/O error on device sdd, logical block 16
Nov  6 14:59:25 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:25 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:25 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:25 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 80 00 00 08 00
Nov  6 14:59:25 node1 kernel: Buffer I/O error on device sdd, logical block 16
Nov  6 14:59:25 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:25 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:25 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:25 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 10 00 00 08 00
Nov  6 14:59:25 node1 kernel: Buffer I/O error on device sdd, logical block 2
Nov  6 14:59:26 node1 kernel: end_request: I/O error, dev sdd, sector 0
Nov  6 14:59:26 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:26 node1 kernel: __ratelimit: 1 callbacks suppressed
Nov  6 14:59:26 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:26 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:26 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:26 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:26 node1 kernel: __ratelimit: 1 callbacks suppressed
Nov  6 14:59:26 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:27 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:27 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:27 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:27 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
Nov  6 14:59:27 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:27 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:27 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:27 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 10 00 00 08 00
Nov  6 14:59:27 node1 kernel: __ratelimit: 1 callbacks suppressed
Nov  6 14:59:27 node1 kernel: Buffer I/O error on device sdd, logical block 2
Nov  6 14:59:28 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:28 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:28 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:28 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:28 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:28 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:28 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:28 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:28 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:28 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:28 node1 iscsid: connect to 192.168.15.89:3260 failed (No route to host)
Nov  6 14:59:28 node1 iscsid: connect to 192.168.15.87:3260 failed (No route to host)
Nov  6 14:59:28 node1 iscsid: connect to 192.168.15.85:3260 failed (No route to host)
Nov  6 14:59:29 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:29 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:29 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:29 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:29 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:29 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:29 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:29 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:29 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:29 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:30 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:30 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:30 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:30 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:30 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:30 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:30 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:30 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:30 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:30 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:31 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:31 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:31 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:31 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
Nov  6 14:59:31 node1 kernel: Buffer I/O error on device sdd, logical block 1
Nov  6 14:59:31 node1 kernel: end_request: I/O error, dev sdd, sector 128
Nov  6 14:59:31 node1 kernel: Buffer I/O error on device sdd, logical block 16
Nov  6 14:59:32 node1 kernel: __ratelimit: 1 callbacks suppressed
Nov  6 14:59:32 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:32 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:32 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:32 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:32 node1 kernel: __ratelimit: 1 callbacks suppressed
Nov  6 14:59:32 node1 kernel: Buffer I/O error on device sdd, logical block 0
Nov  6 14:59:32 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:32 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:32 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:32 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:33 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:33 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:33 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:33 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 10 00 00 00 08 00
Nov  6 14:59:33 node1 kernel: __ratelimit: 1 callbacks suppressed
Nov  6 14:59:33 node1 kernel: Buffer I/O error on device sdd, logical block 512
Nov  6 14:59:33 node1 multipathd: sdd: add path (uevent)
Nov  6 14:59:33 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:33 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:33 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:33 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:33 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:33 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:33 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:33 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:34 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:34 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:34 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:34 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:34 node1 multipathd: 3690b11c00008da2c000008a35098b0dc: failed to access path 8:48
Nov   6 14:59:34 node1 multipathd: 3690b11c00008da2c000008a35098b0dc: load  table [0 2147483648 multipath 0 0 5 1 round-robin 0 1 1 8:96 1000  round-robin 0 1 1 8:6
Nov  6 14:59:34 node1 kernel: device-mapper: multipath: Failing path 8:48.
Nov  6 14:59:34 node1 multipathd: sdd path added to devmap 3690b11c00008da2c000008a35098b0dc
Nov  6 14:59:34 node1 multipathd: dm-5: add map (uevent)
Nov  6 14:59:34 node1 multipathd: dm-5: devmap already registered
Nov  6 14:59:34 node1 multipathd: dm-5: add map (uevent)
Nov  6 14:59:34 node1 multipathd: dm-5: devmap already registered
Nov  6 14:59:34 node1 iscsid: connect to 192.168.15.89:3260 failed (No route to host)
Nov  6 14:59:34 node1 iscsid: connect to 192.168.15.87:3260 failed (No route to host)
Nov  6 14:59:34 node1 iscsid: connect to 192.168.15.85:3260 failed (No route to host)
Nov  6 14:59:35 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:35 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:35 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:35 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:35 node1 multipathd: sdd: directio checker reports path is down
Nov  6 14:59:40 node1 iscsid: connect to 192.168.15.89:3260 failed (No route to host)
Nov  6 14:59:40 node1 iscsid: connect to 192.168.15.87:3260 failed (No route to host)
Nov  6 14:59:40 node1 iscsid: connect to 192.168.15.85:3260 failed (No route to host)
Nov  6 14:59:41 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:41 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:41 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:41 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:41 node1 multipathd: sdd: directio checker reports path is down
Nov  6 14:59:46 node1 iscsid: connect to 192.168.15.89:3260 failed (No route to host)
Nov  6 14:59:46 node1 iscsid: connect to 192.168.15.87:3260 failed (No route to host)
Nov  6 14:59:46 node1 iscsid: connect to 192.168.15.85:3260 failed (No route to host)
Nov  6 14:59:47 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:47 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:47 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:47 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:47 node1 multipathd: sdd: directio checker reports path is down
Nov  6 14:59:52 node1 iscsid: connect to 192.168.15.89:3260 failed (No route to host)
Nov  6 14:59:52 node1 iscsid: connect to 192.168.15.87:3260 failed (No route to host)
Nov  6 14:59:52 node1 iscsid: connect to 192.168.15.85:3260 failed (No route to host)
Nov  6 14:59:53 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:53 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:53 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:53 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:53 node1 multipathd: sdd: directio checker reports path is down
Nov  6 14:59:59 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 14:59:59 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 14:59:59 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 14:59:59 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 14:59:59 node1 multipathd: sdd: directio checker reports path is down
Nov  6 14:59:59 node1 iscsid: connect to 192.168.15.89:3260 failed (No route to host)
Nov  6 14:59:59 node1 iscsid: connect to 192.168.15.87:3260 failed (No route to host)
Nov  6 14:59:59 node1 iscsid: connect to 192.168.15.85:3260 failed (No route to host)
Nov  6 15:00:05 node1 kernel: sd 7:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:00:05 node1 kernel: sd 7:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 15:00:05 node1 kernel: sd 7:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:00:05 node1 kernel: sd 7:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00

dietmar · Nov 6, 2012

Maybe a network problem (No route to host)?

Code:

Nov  6 14:59:59 node1 iscsid: connect to 192.168.15.89:3260 failed (No route to host)

hotwired007 · Nov 6, 2012

Solved one issue - 2 broken network leads and one that needed reinserting. I've replaced both and all IPs are responding to pings (Going to order 8 brand new Cat6 cables now!)

Still getting these errors:

Code:

Nov  6 15:41:38 node2 kernel: sd 12:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:38 node2 kernel: sd 12:0:0:0: [sdd] CDB: Read(10): 28 00 7f ff ff 80 00 00 08 00
Nov  6 15:41:38 node2 kernel: sd 12:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:38 node2 kernel: sd 12:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 15:41:38 node2 kernel: sd 12:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:38 node2 kernel: sd 12:0:0:0: [sdd] CDB: Read(10): 28 00 7f ff ff f0 00 00 08 00
Nov  6 15:41:39 node2 kernel: sd 12:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:39 node2 kernel: sd 12:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 15:41:39 node2 kernel: sd 12:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:39 node2 kernel: sd 12:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:41:39 node2 kernel: sd 12:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:39 node2 kernel: sd 12:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 15:41:39 node2 kernel: sd 12:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:39 node2 kernel: sd 12:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
Nov  6 15:41:40 node2 kernel: sd 7:0:0:0: [sde] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:40 node2 kernel: sd 7:0:0:0: [sde] Sense Key : Illegal Request [current] 
Nov  6 15:41:40 node2 kernel: sd 7:0:0:0: [sde] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:40 node2 kernel: sd 7:0:0:0: [sde] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:41:40 node2 kernel: sd 7:0:0:0: [sde] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:40 node2 kernel: sd 7:0:0:0: [sde] Sense Key : Illegal Request [current] 
Nov  6 15:41:40 node2 kernel: sd 7:0:0:0: [sde] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:40 node2 kernel: sd 7:0:0:0: [sde] CDB: Read(10): 28 00 7f ff ff 80 00 00 08 00
Nov  6 15:41:41 node2 kernel: sd 12:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:41 node2 kernel: sd 12:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 15:41:41 node2 kernel: sd 12:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:41 node2 kernel: sd 12:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:41:41 node2 kernel: end_request: I/O error, dev sde, sector 0
Nov  6 15:41:41 node2 kernel: end_request: I/O error, dev sdk, sector 0
Nov  6 15:41:41 node2 kernel: end_request: I/O error, dev sdh, sector 0
Nov  6 15:41:41 node2 kernel: end_request: I/O error, dev sde, sector 2147483632
Nov  6 15:41:41 node2 multipathd: sdd: directio checker reports path is down
Nov  6 15:41:41 node2 multipathd: sde: directio checker reports path is down
Nov  6 15:41:41 node2 multipathd: sdk: directio checker reports path is down
Nov  6 15:41:41 node2 multipathd: sdh: directio checker reports path is down
Nov  6 15:41:41 node2 kernel: end_request: I/O error, dev sde, sector 0
Nov  6 15:41:42 node2 kernel: __ratelimit: 5 callbacks suppressed
Nov  6 15:41:42 node2 kernel: sd 7:0:0:0: [sde] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:42 node2 kernel: sd 7:0:0:0: [sde] Sense Key : Illegal Request [current] 
Nov  6 15:41:42 node2 kernel: sd 7:0:0:0: [sde] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:42 node2 kernel: sd 7:0:0:0: [sde] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
Nov  6 15:41:42 node2 kernel: __ratelimit: 5 callbacks suppressed
Nov  6 15:41:42 node2 kernel: sd 8:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:42 node2 kernel: sd 8:0:0:0: [sdh] Sense Key : Illegal Request [current] 
Nov  6 15:41:42 node2 kernel: sd 8:0:0:0: [sdh] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:42 node2 kernel: sd 8:0:0:0: [sdh] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:41:43 node2 kernel: sd 8:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:43 node2 kernel: sd 8:0:0:0: [sdh] Sense Key : Illegal Request [current] 
Nov  6 15:41:43 node2 kernel: sd 8:0:0:0: [sdh] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:43 node2 kernel: sd 8:0:0:0: [sdh] CDB: Read(10): 28 00 7f ff ff 80 00 00 08 00
Nov  6 15:41:44 node2 kernel: sd 8:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:44 node2 kernel: sd 8:0:0:0: [sdh] Sense Key : Illegal Request [current] 
Nov  6 15:41:44 node2 kernel: sd 8:0:0:0: [sdh] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:44 node2 kernel: sd 8:0:0:0: [sdh] CDB: Read(10): 28 00 7f ff ff f0 00 00 08 00
Nov  6 15:41:44 node2 kernel: sd 8:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:44 node2 kernel: sd 8:0:0:0: [sdh] Sense Key : Illegal Request [current] 
Nov  6 15:41:44 node2 kernel: sd 8:0:0:0: [sdh] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:44 node2 kernel: sd 8:0:0:0: [sdh] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:41:45 node2 kernel: sd 8:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:45 node2 kernel: sd 8:0:0:0: [sdh] Sense Key : Illegal Request [current] 
Nov  6 15:41:45 node2 kernel: sd 8:0:0:0: [sdh] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:45 node2 kernel: sd 8:0:0:0: [sdh] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
Nov  6 15:41:45 node2 kernel: sd 13:0:0:0: [sdk] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:45 node2 kernel: sd 13:0:0:0: [sdk] Sense Key : Illegal Request [current] 
Nov  6 15:41:45 node2 kernel: sd 13:0:0:0: [sdk] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:45 node2 kernel: sd 13:0:0:0: [sdk] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:41:46 node2 kernel: sd 13:0:0:0: [sdk] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:46 node2 kernel: sd 13:0:0:0: [sdk] Sense Key : Illegal Request [current] 
Nov  6 15:41:46 node2 kernel: sd 13:0:0:0: [sdk] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:46 node2 kernel: sd 13:0:0:0: [sdk] CDB: Read(10): 28 00 7f ff ff 80 00 00 08 00
Nov  6 15:41:46 node2 kernel: sd 13:0:0:0: [sdk] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:46 node2 kernel: sd 13:0:0:0: [sdk] Sense Key : Illegal Request [current] 
Nov  6 15:41:46 node2 kernel: sd 13:0:0:0: [sdk] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:46 node2 kernel: sd 13:0:0:0: [sdk] CDB: Read(10): 28 00 7f ff ff f0 00 00 08 00
Nov  6 15:41:47 node2 kernel: sd 13:0:0:0: [sdk] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:47 node2 kernel: sd 13:0:0:0: [sdk] Sense Key : Illegal Request [current] 
Nov  6 15:41:47 node2 kernel: sd 13:0:0:0: [sdk] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:47 node2 kernel: sd 13:0:0:0: [sdk] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:41:47 node2 kernel: end_request: I/O error, dev sdd, sector 0
Nov  6 15:41:47 node2 kernel: end_request: I/O error, dev sde, sector 0
Nov  6 15:41:47 node2 kernel: end_request: I/O error, dev sdk, sector 0
Nov  6 15:41:47 node2 kernel: end_request: I/O error, dev sdh, sector 0
Nov  6 15:41:47 node2 kernel: end_request: I/O error, dev sdk, sector 8
Nov  6 15:41:47 node2 pvestatd[2576]: status update time (10.406 seconds)
Nov  6 15:41:47 node2 multipathd: sdd: directio checker reports path is down
Nov  6 15:41:47 node2 multipathd: sde: directio checker reports path is down
Nov  6 15:41:47 node2 multipathd: sdk: directio checker reports path is down
Nov  6 15:41:47 node2 multipathd: sdh: directio checker reports path is down
Nov  6 15:41:48 node2 kernel: __ratelimit: 5 callbacks suppressed
Nov  6 15:41:48 node2 kernel: sd 12:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:48 node2 kernel: sd 12:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 15:41:48 node2 kernel: sd 12:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:48 node2 kernel: sd 12:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:41:48 node2 kernel: __ratelimit: 5 callbacks suppressed
Nov  6 15:41:48 node2 kernel: sd 12:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:48 node2 kernel: sd 12:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 15:41:48 node2 kernel: sd 12:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:48 node2 kernel: sd 12:0:0:0: [sdd] CDB: Read(10): 28 00 7f ff ff 80 00 00 08 00
Nov  6 15:41:49 node2 kernel: sd 12:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:49 node2 kernel: sd 12:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 15:41:49 node2 kernel: sd 12:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:49 node2 kernel: sd 12:0:0:0: [sdd] CDB: Read(10): 28 00 7f ff ff f0 00 00 08 00
Nov  6 15:41:49 node2 kernel: sd 12:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:49 node2 kernel: sd 12:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 15:41:49 node2 kernel: sd 12:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:49 node2 kernel: sd 12:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:41:50 node2 kernel: sd 12:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:50 node2 kernel: sd 12:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 15:41:50 node2 kernel: sd 12:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:50 node2 kernel: sd 12:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
Nov  6 15:41:50 node2 kernel: sd 7:0:0:0: [sde] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:50 node2 kernel: sd 7:0:0:0: [sde] Sense Key : Illegal Request [current] 
Nov  6 15:41:50 node2 kernel: sd 7:0:0:0: [sde] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:50 node2 kernel: sd 7:0:0:0: [sde] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:41:51 node2 kernel: sd 7:0:0:0: [sde] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:51 node2 kernel: sd 7:0:0:0: [sde] Sense Key : Illegal Request [current] 
Nov  6 15:41:51 node2 kernel: sd 7:0:0:0: [sde] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:51 node2 kernel: sd 7:0:0:0: [sde] CDB: Read(10): 28 00 7f ff ff 80 00 00 08 00
Nov  6 15:41:51 node2 kernel: sd 7:0:0:0: [sde] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:51 node2 kernel: sd 7:0:0:0: [sde] Sense Key : Illegal Request [current] 
Nov  6 15:41:51 node2 kernel: sd 7:0:0:0: [sde] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:51 node2 kernel: sd 7:0:0:0: [sde] CDB: Read(10): 28 00 7f ff ff f0 00 00 08 00
Nov  6 15:41:52 node2 kernel: sd 7:0:0:0: [sde] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:52 node2 kernel: sd 7:0:0:0: [sde] Sense Key : Illegal Request [current] 
Nov  6 15:41:52 node2 kernel: sd 7:0:0:0: [sde] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:52 node2 kernel: sd 7:0:0:0: [sde] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:41:52 node2 kernel: sd 7:0:0:0: [sde] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:52 node2 kernel: sd 7:0:0:0: [sde] Sense Key : Illegal Request [current] 
Nov  6 15:41:52 node2 kernel: sd 7:0:0:0: [sde] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:52 node2 kernel: sd 7:0:0:0: [sde] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
Nov  6 15:41:53 node2 kernel: end_request: I/O error, dev sdd, sector 0
Nov  6 15:41:53 node2 kernel: end_request: I/O error, dev sde, sector 0
Nov  6 15:41:53 node2 kernel: end_request: I/O error, dev sdk, sector 0
Nov  6 15:41:53 node2 kernel: end_request: I/O error, dev sdh, sector 0
Nov  6 15:41:53 node2 kernel: end_request: I/O error, dev sdh, sector 0
Nov  6 15:41:53 node2 multipathd: sdd: directio checker reports path is down
Nov  6 15:41:53 node2 multipathd: sde: directio checker reports path is down
Nov  6 15:41:53 node2 multipathd: sdk: directio checker reports path is down
Nov  6 15:41:53 node2 multipathd: sdh: directio checker reports path is down
Nov  6 15:41:53 node2 kernel: __ratelimit: 5 callbacks suppressed
Nov  6 15:41:53 node2 kernel: sd 8:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:53 node2 kernel: sd 8:0:0:0: [sdh] Sense Key : Illegal Request [current] 
Nov  6 15:41:53 node2 kernel: sd 8:0:0:0: [sdh] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:53 node2 kernel: sd 8:0:0:0: [sdh] CDB: Read(10): 28 00 7f ff ff 80 00 00 08 00
Nov  6 15:41:53 node2 kernel: __ratelimit: 5 callbacks suppressed
Nov  6 15:41:54 node2 kernel: sd 8:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:54 node2 kernel: sd 8:0:0:0: [sdh] Sense Key : Illegal Request [current] 
Nov  6 15:41:54 node2 kernel: sd 8:0:0:0: [sdh] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:54 node2 kernel: sd 8:0:0:0: [sdh] CDB: Read(10): 28 00 7f ff ff f0 00 00 08 00
Nov  6 15:41:55 node2 kernel: sd 8:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:55 node2 kernel: sd 8:0:0:0: [sdh] Sense Key : Illegal Request [current] 
Nov  6 15:41:55 node2 kernel: sd 8:0:0:0: [sdh] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:55 node2 kernel: sd 8:0:0:0: [sdh] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:41:55 node2 kernel: sd 8:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:55 node2 kernel: sd 8:0:0:0: [sdh] Sense Key : Illegal Request [current] 
Nov  6 15:41:55 node2 kernel: sd 8:0:0:0: [sdh] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:55 node2 kernel: sd 8:0:0:0: [sdh] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
Nov  6 15:41:56 node2 kernel: sd 13:0:0:0: [sdk] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:56 node2 kernel: sd 13:0:0:0: [sdk] Sense Key : Illegal Request [current] 
Nov  6 15:41:56 node2 kernel: sd 13:0:0:0: [sdk] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:56 node2 kernel: sd 13:0:0:0: [sdk] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:41:56 node2 kernel: sd 13:0:0:0: [sdk] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:56 node2 kernel: sd 13:0:0:0: [sdk] Sense Key : Illegal Request [current] 
Nov  6 15:41:56 node2 kernel: sd 13:0:0:0: [sdk] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:56 node2 kernel: sd 13:0:0:0: [sdk] CDB: Read(10): 28 00 7f ff ff 80 00 00 08 00
Nov  6 15:41:57 node2 kernel: sd 13:0:0:0: [sdk] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:57 node2 kernel: sd 13:0:0:0: [sdk] Sense Key : Illegal Request [current] 
Nov  6 15:41:57 node2 kernel: sd 13:0:0:0: [sdk] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:57 node2 kernel: sd 13:0:0:0: [sdk] CDB: Read(10): 28 00 7f ff ff f0 00 00 08 00
Nov  6 15:41:57 node2 kernel: sd 13:0:0:0: [sdk] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:57 node2 kernel: sd 13:0:0:0: [sdk] Sense Key : Illegal Request [current] 
Nov  6 15:41:57 node2 kernel: sd 13:0:0:0: [sdk] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:57 node2 kernel: sd 13:0:0:0: [sdk] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:41:58 node2 kernel: sd 13:0:0:0: [sdk] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:58 node2 kernel: sd 13:0:0:0: [sdk] Sense Key : Illegal Request [current] 
Nov  6 15:41:58 node2 kernel: sd 13:0:0:0: [sdk] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:58 node2 kernel: sd 13:0:0:0: [sdk] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
Nov  6 15:41:58 node2 pvestatd[2576]: status update time (10.492 seconds)
Nov  6 15:41:58 node2 kernel: sd 12:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:58 node2 kernel: sd 12:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 15:41:58 node2 kernel: sd 12:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:58 node2 kernel: sd 12:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:41:59 node2 kernel: end_request: I/O error, dev sdd, sector 2147483520
Nov  6 15:41:59 node2 kernel: end_request: I/O error, dev sdd, sector 0
Nov  6 15:41:59 node2 kernel: end_request: I/O error, dev sde, sector 0
Nov  6 15:41:59 node2 kernel: end_request: I/O error, dev sdk, sector 0
Nov  6 15:41:59 node2 kernel: end_request: I/O error, dev sdh, sector 0
Nov  6 15:41:59 node2 kernel: __ratelimit: 5 callbacks suppressed
Nov  6 15:41:59 node2 kernel: sd 12:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:41:59 node2 kernel: sd 12:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 15:41:59 node2 kernel: sd 12:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:41:59 node2 kernel: sd 12:0:0:0: [sdd] CDB: Read(10): 28 00 7f ff ff f0 00 00 08 00
Nov  6 15:41:59 node2 kernel: __ratelimit: 5 callbacks suppressed
Nov  6 15:41:59 node2 multipathd: sdd: directio checker reports path is down
Nov  6 15:41:59 node2 multipathd: sde: directio checker reports path is down
Nov  6 15:41:59 node2 multipathd: sdk: directio checker reports path is down
Nov  6 15:41:59 node2 multipathd: sdh: directio checker reports path is down
Nov  6 15:42:00 node2 kernel: sd 12:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:00 node2 kernel: sd 12:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 15:42:00 node2 kernel: sd 12:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:00 node2 kernel: sd 12:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:42:00 node2 kernel: sd 12:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:00 node2 kernel: sd 12:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 15:42:00 node2 kernel: sd 12:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:00 node2 kernel: sd 12:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
Nov  6 15:42:01 node2 kernel: sd 7:0:0:0: [sde] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:01 node2 kernel: sd 7:0:0:0: [sde] Sense Key : Illegal Request [current] 
Nov  6 15:42:01 node2 kernel: sd 7:0:0:0: [sde] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:01 node2 kernel: sd 7:0:0:0: [sde] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:42:01 node2 ntpd[1301]: Listen normally on 7 venet0 fe80::1 UDP 123
Nov  6 15:42:01 node2 kernel: sd 7:0:0:0: [sde] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:01 node2 kernel: sd 7:0:0:0: [sde] Sense Key : Illegal Request [current] 
Nov  6 15:42:01 node2 kernel: sd 7:0:0:0: [sde] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:01 node2 kernel: sd 7:0:0:0: [sde] CDB: Read(10): 28 00 7f ff ff 80 00 00 08 00
Nov  6 15:42:02 node2 kernel: sd 7:0:0:0: [sde] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:02 node2 kernel: sd 7:0:0:0: [sde] Sense Key : Illegal Request [current] 
Nov  6 15:42:02 node2 kernel: sd 7:0:0:0: [sde] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:02 node2 kernel: sd 7:0:0:0: [sde] CDB: Read(10): 28 00 7f ff ff f0 00 00 08 00
Nov  6 15:42:02 node2 kernel: sd 7:0:0:0: [sde] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:02 node2 kernel: sd 7:0:0:0: [sde] Sense Key : Illegal Request [current] 
Nov  6 15:42:02 node2 kernel: sd 7:0:0:0: [sde] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:02 node2 kernel: sd 7:0:0:0: [sde] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:42:03 node2 kernel: sd 7:0:0:0: [sde] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:03 node2 kernel: sd 7:0:0:0: [sde] Sense Key : Illegal Request [current] 
Nov  6 15:42:03 node2 kernel: sd 7:0:0:0: [sde] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:03 node2 kernel: sd 7:0:0:0: [sde] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
Nov  6 15:42:03 node2 kernel: sd 8:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:03 node2 kernel: sd 8:0:0:0: [sdh] Sense Key : Illegal Request [current] 
Nov  6 15:42:03 node2 kernel: sd 8:0:0:0: [sdh] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:03 node2 kernel: sd 8:0:0:0: [sdh] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:42:04 node2 kernel: sd 8:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:04 node2 kernel: sd 8:0:0:0: [sdh] Sense Key : Illegal Request [current] 
Nov  6 15:42:04 node2 kernel: sd 8:0:0:0: [sdh] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:04 node2 kernel: sd 8:0:0:0: [sdh] CDB: Read(10): 28 00 7f ff ff 80 00 00 08 00
Nov  6 15:42:04 node2 kernel: end_request: I/O error, dev sdh, sector 2147483632
Nov  6 15:42:05 node2 kernel: __ratelimit: 1 callbacks suppressed
Nov  6 15:42:05 node2 kernel: sd 12:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:05 node2 kernel: sd 12:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  6 15:42:05 node2 kernel: sd 12:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:05 node2 kernel: sd 12:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:42:05 node2 kernel: __ratelimit: 1 callbacks suppressed
Nov  6 15:42:05 node2 kernel: sd 7:0:0:0: [sde] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:05 node2 kernel: sd 7:0:0:0: [sde] Sense Key : Illegal Request [current] 
Nov  6 15:42:05 node2 kernel: sd 7:0:0:0: [sde] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:05 node2 kernel: sd 7:0:0:0: [sde] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:42:05 node2 kernel: sd 13:0:0:0: [sdk] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:05 node2 kernel: sd 13:0:0:0: [sdk] Sense Key : Illegal Request [current] 
Nov  6 15:42:05 node2 kernel: sd 13:0:0:0: [sdk] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:05 node2 kernel: sd 13:0:0:0: [sdk] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:42:05 node2 kernel: sd 8:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:05 node2 kernel: sd 8:0:0:0: [sdh] Sense Key : Illegal Request [current] 
Nov  6 15:42:05 node2 kernel: sd 8:0:0:0: [sdh] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:05 node2 kernel: sd 8:0:0:0: [sdh] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:42:05 node2 kernel: sd 8:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:05 node2 kernel: sd 8:0:0:0: [sdh] Sense Key : Illegal Request [current] 
Nov  6 15:42:05 node2 kernel: sd 8:0:0:0: [sdh] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:05 node2 kernel: sd 8:0:0:0: [sdh] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:42:05 node2 multipathd: sdd: directio checker reports path is down
Nov  6 15:42:05 node2 multipathd: sde: directio checker reports path is down
Nov  6 15:42:05 node2 multipathd: sdk: directio checker reports path is down
Nov  6 15:42:05 node2 multipathd: sdh: directio checker reports path is down
Nov  6 15:42:05 node2 kernel: sd 8:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:05 node2 kernel: sd 8:0:0:0: [sdh] Sense Key : Illegal Request [current] 
Nov  6 15:42:05 node2 kernel: sd 8:0:0:0: [sdh] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:05 node2 kernel: sd 8:0:0:0: [sdh] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
Nov  6 15:42:06 node2 kernel: sd 13:0:0:0: [sdk] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:06 node2 kernel: sd 13:0:0:0: [sdk] Sense Key : Illegal Request [current] 
Nov  6 15:42:06 node2 kernel: sd 13:0:0:0: [sdk] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:06 node2 kernel: sd 13:0:0:0: [sdk] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:42:07 node2 kernel: sd 13:0:0:0: [sdk] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:07 node2 kernel: sd 13:0:0:0: [sdk] Sense Key : Illegal Request [current] 
Nov  6 15:42:07 node2 kernel: sd 13:0:0:0: [sdk] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:07 node2 kernel: sd 13:0:0:0: [sdk] CDB: Read(10): 28 00 7f ff ff 80 00 00 08 00
Nov  6 15:42:07 node2 kernel: sd 13:0:0:0: [sdk] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:07 node2 kernel: sd 13:0:0:0: [sdk] Sense Key : Illegal Request [current] 
Nov  6 15:42:07 node2 kernel: sd 13:0:0:0: [sdk] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:07 node2 kernel: sd 13:0:0:0: [sdk] CDB: Read(10): 28 00 7f ff ff f0 00 00 08 00
Nov  6 15:42:08 node2 kernel: sd 13:0:0:0: [sdk] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  6 15:42:08 node2 kernel: sd 13:0:0:0: [sdk] Sense Key : Illegal Request [current] 
Nov  6 15:42:08 node2 kernel: sd 13:0:0:0: [sdk] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  6 15:42:08 node2 kernel: sd 13:0:0:0: [sdk] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  6 15:42:08 node2 kernel: end_request: I/O error, dev sdk, sector 8
Nov  6 15:42:08 node2 pvestatd[2576]: status update time (10.436 seconds)

hotwired007 · Nov 6, 2012

I've rebooted all the nodes now and reinstalled multipath-tools and now i think i have an idea as to whats going on:

multipath -ll

Code:

3690b11c00008da2c000008a35098b0dc dm-5 DELL,MD32xxi
size=1.0T features='0' hwhandler='0' wp=rw
|-+- policy='round-robin 0' prio=1 status=active
| `- 9:0:0:0  sdh 8:112 active ready  running
|-+- policy='round-robin 0' prio=1 status=enabled
| `- 12:0:0:0 sdi 8:128 active ready  running
|-+- policy='round-robin 0' prio=1 status=enabled
| `- 5:0:0:0  sdj 8:144 active ready  running
|-+- policy='round-robin 0' prio=1 status=enabled
| `- 11:0:0:0 sdk 8:160 active ready  running
|-+- policy='round-robin 0' prio=0 status=enabled
| `- 6:0:0:0  sdg 8:96  failed faulty running
|-+- policy='round-robin 0' prio=0 status=enabled
| `- 10:0:0:0 sde 8:64  failed faulty running
|-+- policy='round-robin 0' prio=0 status=enabled
| `- 8:0:0:0  sdd 8:48  failed faulty running
`-+- policy='round-robin 0' prio=0 status=enabled
  `- 7:0:0:0  sdf 8:80  failed faulty running

syslog:

Code:

Nov  6 16:06:28 node1 multipathd: sdd: directio checker reports path is down
Nov  6 16:06:28 node1 multipathd: sde: directio checker reports path is down
Nov  6 16:06:28 node1 multipathd: sdf: directio checker reports path is down
Nov  6 16:06:28 node1 multipathd: sdg: directio checker reports path is down

on the MD3200i there is two controllers 1 is active and the second is the backup - i'm guessing that i need to configure something on the SAN so that the additional controller is used or do i need to configure something in iSCSI to suppress the errors?

hotwired007 · Nov 7, 2012

if i swap the active controller on the MD3200i the errors are still there but the source changes, it looks like ive found the source of the issue.. now i need to find how to fix it!

any suggestions?

hotwired007 · Nov 7, 2012

been having another look at the multipath stuff - i suspect the issue is in the config somehow.

As the MD3200i only has 4 ports per controller and each virtual disk can only be assigned to one controller at a time, i assume that the multipath needs to be configured for the 4 connections with failover to the other 4 connections instead.

has anyone else got a MD3200i with dual controllers configured?

hotwired007 · Nov 8, 2012

spent a bit of time googling... found how to configure the multipath.conf file:

Code:

defaults
{
 polling_interval          2
 selector                    "round-robin 0"
 path_grouping_policy        multibus
 getuid_callout              "/lib/udev/scsi_id -g -u -d /dev/%n"
 rr_min_io                   100
 failback                    immediate
 no_path_retry               queue
 max_fds         8192
 user_friendly_names     yes 
 …
}
blacklist {
…
  device {
  vendor "*"
  product "Universal Xport"
}
…
}
devices {
  device {
  vendor            "DELL"
  product                "MD32xxi"
  path_grouping_policy        group_by_prio
  prio               rdac 
  polling_interval         5
  path_checker              rdac 
  path_selector              "round-robin 0"
  hardware_handler        "1 rdac"
  failback                immediate
  features                "2 pg_init_retries 50"
  no_path_retry          30
  rr_min_io              100
  prio_callout "/sbin/mpath_prio_rdac /dev/%n"
 }
device {
  vendor            "DELL"
  product            "MD32xx"
  path_grouping_policy    group_by_prio
  prio            rdac 
  polling_interval        5
  path_checker              rdac
  path_selector              "round-robin 0"
  hardware_handler        "1 rdac"
  failback                immediate
  features         "2 pg_init_retries 50"
  no_path_retry          30
  rr_min_io              100
  prio_callout "/sbin/mpath_prio_rdac /dev/%n"
 }
}

my syslog is now not being killed by error messages although when i try to doa nything to my servers i get these error messages - although the system is running fine.

Code:

/dev/sdd: read failed after 0 of 4096 at 0: Input/output error
  /dev/sdd: read failed after 0 of 4096 at 1099511562240: Input/output error
  /dev/sdd: read failed after 0 of 4096 at 1099511619584: Input/output error
  /dev/sdd: read failed after 0 of 4096 at 4096: Input/output error
  /dev/sde: read failed after 0 of 4096 at 0: Input/output error
  /dev/sde: read failed after 0 of 4096 at 1099511562240: Input/output error
  /dev/sde: read failed after 0 of 4096 at 1099511619584: Input/output error
  /dev/sde: read failed after 0 of 4096 at 4096: Input/output error
  /dev/sdi: read failed after 0 of 4096 at 0: Input/output error
  /dev/sdi: read failed after 0 of 4096 at 1099511562240: Input/output error
  /dev/sdi: read failed after 0 of 4096 at 1099511619584: Input/output error
  /dev/sdi: read failed after 0 of 4096 at 4096: Input/output error
  /dev/sdk: read failed after 0 of 4096 at 0: Input/output error
  /dev/sdk: read failed after 0 of 4096 at 1099511562240: Input/output error
  /dev/sdk: read failed after 0 of 4096 at 1099511619584: Input/output error
  /dev/sdk: read failed after 0 of 4096 at 4096: Input/output error
  /dev/sdd: read failed after 0 of 4096 at 0: Input/output error
  /dev/sdd: read failed after 0 of 4096 at 1099511562240: Input/output error
  /dev/sdd: read failed after 0 of 4096 at 1099511619584: Input/output error
  /dev/sdd: read failed after 0 of 4096 at 4096: Input/output error
  /dev/sde: read failed after 0 of 4096 at 0: Input/output error
  /dev/sde: read failed after 0 of 4096 at 1099511562240: Input/output error
  /dev/sde: read failed after 0 of 4096 at 1099511619584: Input/output error
  /dev/sde: read failed after 0 of 4096 at 4096: Input/output error
  /dev/sdi: read failed after 0 of 4096 at 0: Input/output error
  /dev/sdi: read failed after 0 of 4096 at 1099511562240: Input/output error
  /dev/sdi: read failed after 0 of 4096 at 1099511619584: Input/output error
  /dev/sdi: read failed after 0 of 4096 at 4096: Input/output error
  /dev/sdk: read failed after 0 of 4096 at 0: Input/output error
  /dev/sdk: read failed after 0 of 4096 at 1099511562240: Input/output error
  /dev/sdk: read failed after 0 of 4096 at 1099511619584: Input/output error
  /dev/sdk: read failed after 0 of 4096 at 4096: Input/output error

any suggestions?

I'm going to try removing the new iscsi connection and reboot the nodes and then readding the iscsi connection ow that the multipath is configured and working ok.

hotwired007 · Nov 8, 2012

Still getting these errors - the errors all corespond to the 'ghost' controller...

Code:

Nov  8 11:25:11 node2 kernel: sd 13:0:0:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  8 11:25:11 node2 kernel: sd 13:0:0:0: [sdd] Sense Key : Illegal Request [current] 
Nov  8 11:25:11 node2 kernel: sd 13:0:0:0: [sdd] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  8 11:25:11 node2 kernel: sd 13:0:0:0: [sdd] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  8 11:25:11 node2 kernel: Buffer I/O error on device sdd, logical block 0
Nov  8 11:25:11 node2 kernel: sd 7:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  8 11:25:11 node2 kernel: sd 7:0:0:0: [sdh] Sense Key : Illegal Request [current] 
Nov  8 11:25:11 node2 kernel: sd 7:0:0:0: [sdh] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  8 11:25:11 node2 kernel: sd 7:0:0:0: [sdh] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  8 11:25:11 node2 kernel: Buffer I/O error on device sdh, logical block 0
Nov  8 11:25:11 node2 kernel: sd 8:0:0:0: [sdf] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  8 11:25:11 node2 kernel: sd 8:0:0:0: [sdf] Sense Key : Illegal Request [current] 
Nov  8 11:25:11 node2 kernel: sd 8:0:0:0: [sdf] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  8 11:25:11 node2 kernel: sd 8:0:0:0: [sdf] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  8 11:25:11 node2 kernel: Buffer I/O error on device sdf, logical block 0
Nov  8 11:25:11 node2 kernel: sd 12:0:0:0: [sdk] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE
Nov  8 11:25:11 node2 kernel: sd 12:0:0:0: [sdk] Sense Key : Illegal Request [current] 
Nov  8 11:25:11 node2 kernel: sd 12:0:0:0: [sdk] <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
Nov  8 11:25:11 node2 kernel: sd 12:0:0:0: [sdk] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
Nov  8 11:25:11 node2 kernel: Buffer I/O error on device sdk, logical block 0
Nov  8 11:25:11 node2 kernel: Dev sdd: unable to read RDB block 0
Nov  8 11:25:11 node2 kernel: Dev sdf: unable to read RDB block 0
Nov  8 11:25:11 node2 kernel: Dev sdk: unable to read RDB block 0
Nov  8 11:25:11 node2 kernel: unable to read partition table
Nov  8 11:25:11 node2 kernel: unable to read partition table
Nov  8 11:25:11 node2 kernel: unable to read partition table
Nov  8 11:25:11 node2 kernel: Dev sdh: unable to read RDB block 0
Nov  8 11:25:11 node2 kernel: unable to read partition table
Nov  8 11:25:11 node2 kernel: sd 13:0:0:0: [sdd] Attached SCSI disk
Nov  8 11:25:11 node2 kernel: sd 8:0:0:0: [sdf] Attached SCSI disk
Nov  8 11:25:11 node2 kernel: sd 12:0:0:0: [sdk] Attached SCSI disk
Nov  8 11:25:11 node2 kernel: sd 7:0:0:0: [sdh] Attached SCSI disk

hotwired007 · Nov 19, 2012

any suggestions? getting quite frustrated!

tom · Nov 19, 2012

the way to go further with complex problems in a commercial environment is direct support, see http://www.proxmox.com/products/proxmox-ve/subscription-service-plans

hotwired007 · Nov 22, 2012

Hi Tom, thanks for the info, is it possible to buy a corporate/site support licence? We have several clusters in a few different locations - it worls out far too expensive using your per CPU socket licencing model for a small company like ourselves when most of the clusters are for test & backup enviroments - i am currently in discussion about buying a standard support package for our main cluster (5 dual CPU servers) but seeing as our SAN is being setup on our test cluster, i assume the support contract wouldnt be any use. We need to add the SAN to our existing cluster with mimimal downtime - if any - hence the extensive testing.

tom · Nov 22, 2012

please discuss commercial request with our sales team, just write to office@proxmox.com

segaphone · Nov 23, 2012

you need install multipath-tools-boot. then you need include script in /etc/initramfs-tools/scripts/init-top/
script:

#!/bin/sh
PREREQ=""
prereqs()
{
echo "$PREREQ"
}
case $1 in
# get pre-requisites
prereqs)
prereqs
exit 0
;;
esac
modprobe scsi_dh_rdac
modprobe dm_multipath
modprobe dm_round_robin

and exectute this:

update-initramfs -u

and reboot the host(ibm ds3524 and bladecenter-e with 3 blades hs22 is working good)

segaphone · Nov 23, 2012

test reply

dietmar · Nov 24, 2012

segaphone said:
test reply

This is a moderated forum. To avoid spam, messages from new users needs moderation, so they will be delayed.

segaphone · Nov 24, 2012

dietmar said:
This is a moderated forum. To avoid spam, messages from new users needs moderation, so they will be delayed.

ok.
i'm sorry.

hotwired007 · Nov 27, 2012

segaphone said:
you need install multipath-tools-boot. then you need include script in /etc/initramfs-tools/scripts/init-top/
script:

and exectute this:

and reboot the host(ibm ds3524 and bladecenter-e with 3 blades hs22 is working good)

Hi Segaphone,

I've installed multipath-boot but your instructions aren't complete
- what does the script need to be called?

segaphone · Nov 27, 2012

See post #14 in "linear mode" of threads, it was edited.
and try to comment prio_callout parameters

MD3200i SAN issues

Member

Member

Proxmox Staff Member

Member

Member

Member

Member

Member

Member

Member

Proxmox Staff Member

Member

Proxmox Staff Member

segaphone

Guest

segaphone

Guest

Proxmox Staff Member

segaphone

Guest

Member

segaphone

Guest