Hi all,
We are in the process of moving from vSphere/ESXi to Proxmox (as many are).
Our setup uses two dedicated 10Gbps nics per host to connect iSCSI to a Dell EqualLogic storage array. This is the same setup as we are using on vSphere.
We use multipath on top of the iSCSI connections and we are using LVM on top of the iSCSI LUNs.
We used this document https://linux.dell.com/files/whitepapers/iSCSI_Multipathing_in_Ubuntu_Server.pdf for the initial setup.
Although it appears to be working, we see many iSCSI level errors, with dropping connections, and even some I/O errors now and then.
The errors we are seeing include:
We are having some trouble identifying the root cause of these issues, since (as far as we can tell). We have tried to fiddle with some of the iscsid timeout settings and tried various multipath options, but without making much of a difference.
We hope that there are some experts here that recognize some of these errors, and are willing to help us out.
We are in the process of moving from vSphere/ESXi to Proxmox (as many are).
Our setup uses two dedicated 10Gbps nics per host to connect iSCSI to a Dell EqualLogic storage array. This is the same setup as we are using on vSphere.
We use multipath on top of the iSCSI connections and we are using LVM on top of the iSCSI LUNs.
We used this document https://linux.dell.com/files/whitepapers/iSCSI_Multipathing_in_Ubuntu_Server.pdf for the initial setup.
Although it appears to be working, we see many iSCSI level errors, with dropping connections, and even some I/O errors now and then.
The errors we are seeing include:
iscsi_tcp: datalen 10957675 > 262144received itt 8568d1c expected session age (8)[sdaz] tag#28 FAILED Result: hostbyte=DID_TRANSPORT_DISRUPTED driverbyte=DRIVER_OK cmd_age=50s
[sdaz] tag#28 CDB: Write(16) 8a 00 00 00 00 00 9c a3 a9 00 00 00 06 80 00 00ping timeout of 5 secs expired, recv timeout 5, last rx 4793794517, last ping 4793799680, now 4793804800I/O error, dev sdo, sector 4047049216 op 0x1:(WRITE) flags 0x4a00 phys_seg 83 prio class 2
We are having some trouble identifying the root cause of these issues, since (as far as we can tell). We have tried to fiddle with some of the iscsid timeout settings and tried various multipath options, but without making much of a difference.
We hope that there are some experts here that recognize some of these errors, and are willing to help us out.
Last edited: