Hello,
I am trying to use proxmox in the following way:
- Four nodes of proxmox Version 5.2-1 (Kernel Version Linux 4.15.17-1-pve)
- Storage Dell Compellent SCV3020
Enable multipath according to the proxmox documentation
File /etc/multipath.conf
device {
vendor "COMPELNT"
product "Compellent *"
path_checker tur
prio alua
path_selector "service-time 0"
path_grouping_policy group_by_prio
no_path_retry fail
hardware_handler "1 alua"
failback immediate
rr_weight priorities
Conf Compellent multipath:
Error log
Aug 17 19:56:37 prx04 kernel: [11484.707256] connection18: 0: detected with error (1020)
Aug 17 19:56:37 prx04 kernel: [11484.707273] connection11: 0: detected with error (1020)
Aug 17 19:57:17 prx04 kernel: [11524.983966] connection12: 0: detected with error (1020)
Aug 17 19:57:17 prx04 kernel: [11524.984061] sd 12: 0: 0: 1: [sdb] tag # 0 FAILED Result: hostbyte = DID_TRANSPORT_DISRUPTED driverbyte = DRIVER_OK
Aug 17 19:57:17 prx04 kernel: [11524.984065] sd 12: 0: 0: 1: [sdb] tag # 0 CDB: Test Unit Ready 00 00 00 00 00 00
Aug 17 19:57:18 prx04 kernel: [11525.178367] connection16: 0: detected with error (1020)
Aug 17 19:57:18 prx04 kernel: [11525.178389] connection20: 0: detected with error (1020)
Aug 17 19:57:18 prx04 kernel: [11525.178448] sd 16: 0: 0: 1: [sdc] tag # 0 FAILED Result: hostbyte = DID_TRANSPORT_DISRUPTED driverbyte = DRIVER_OK
Aug 17 19:57:18 prx04 kernel: [11525.178453] sd 16: 0: 0: 1: [sdc] tag # 0 CDB: Test Unit Ready 00 00 00 00 00 00
Aug 17 19:57:18 prx04 kernel: [11525.178509] sd 20: 0: 0: 1: [sdd] tag # 0 FAILED Result: hostbyte = DID_TRANSPORT_DISRUPTED driverbyte = DRIVER_OK
Aug 17 19:57:18 prx04 kernel: [11525.178513] sd 20: 0: 0: 1: [sdd] tag # 0 CDB: Test Unit Ready 00 00 00 00 00 00
Aug 17 19:57:19 prx04 kernel: [11526.202202] connection17: 0: detected with error (1022)
Aug 17 19:57:19 prx04 kernel: [11526.206978] connection19: 0: detected with error (1022)
Aug 17 19:57:20 prx04 kernel: [11527.472460] sd 12: 0: 0: 1: Warning! Received an indication that the LUN assignments on this target have changed. The Linux SCSI layer does not automatical
Aug 17 19:57:20 prx04 kernel: [11527.475033] sd 16: 0: 0: 1: Warning! Received an indication that the LUN assignments on this target have changed. The Linux SCSI layer does not automatical
Aug 17 19:57:20 prx04 kernel: [11527.768770] sd 20: 0: 0: 1: Warning! Received an indication that the LUN assignments on this target have changed. The Linux SCSI layer does not automatical
Because multipath did not work, I tried to use the LUN without multipath, but I got the following error:
Conf Compellent wihtout multipath
Aug 22 12:58:43 prx03 kernel: [8073.966559] connection23: 0: detected with error (1020)
Aug 22 12:58:45 prx03 kernel: [8076.420870] sd 11: 0: 0: 1: Warning! Received an indication that the LUN assignments on this target have changed. The Linux SCSI layer does not automatical
Aug 22 12:59:47 prx03 kernel: [8138.734485] connection23: 0: detected with error (1020)
Aug 22 12:59:47 prx03 kernel: [8138.735175] scsi_io_completion: 20 suppressed callbacks
Aug 22 12:59:47 prx03 kernel: [8138.735181] sd 11: 0: 0: 1: [sdb] tag # 9 FAILED Result: hostbyte = DID_TRANSPORT_DISRUPTED driverbyte = DRIVER_OK
Aug 22 12:59:47 prx03 kernel: [8138.735187] sd 11: 0: 0: 1: [sdb] tag # 9 CDB: Write (16) 8a 00 00 00 00 00 00 20 30 00 00 00 10 00 00 00
Aug 22 12:59:47 prx03 kernel: [8138.735189] print_req_error: 20 suppressed callbacks
Aug 22 12:59:47 prx03 kernel: [8138.735488] buffer_io_error: 2324 suppressed callbacks
Aug 22 12:59:47 prx03 kernel: [8138.738962] sd 11: 0: 0: 1: [sdb] tag # 2 FAILED Result: hostbyte = DID_TRANSPORT_DISRUPTED driverbyte = DRIVER_OK
The network interfaces of proxmox are in 9000, the switch and compellent as well.
Someone of you has integrated proxmox with compellent, have some example of configuration, apply good practices of Dell documents, but still did not get satisfactory results.
I wish you could help me, I remain attentive to your comments
I am trying to use proxmox in the following way:
- Four nodes of proxmox Version 5.2-1 (Kernel Version Linux 4.15.17-1-pve)
- Storage Dell Compellent SCV3020
Enable multipath according to the proxmox documentation
File /etc/multipath.conf
device {
vendor "COMPELNT"
product "Compellent *"
path_checker tur
prio alua
path_selector "service-time 0"
path_grouping_policy group_by_prio
no_path_retry fail
hardware_handler "1 alua"
failback immediate
rr_weight priorities
Conf Compellent multipath:
Error log
Aug 17 19:56:37 prx04 kernel: [11484.707256] connection18: 0: detected with error (1020)
Aug 17 19:56:37 prx04 kernel: [11484.707273] connection11: 0: detected with error (1020)
Aug 17 19:57:17 prx04 kernel: [11524.983966] connection12: 0: detected with error (1020)
Aug 17 19:57:17 prx04 kernel: [11524.984061] sd 12: 0: 0: 1: [sdb] tag # 0 FAILED Result: hostbyte = DID_TRANSPORT_DISRUPTED driverbyte = DRIVER_OK
Aug 17 19:57:17 prx04 kernel: [11524.984065] sd 12: 0: 0: 1: [sdb] tag # 0 CDB: Test Unit Ready 00 00 00 00 00 00
Aug 17 19:57:18 prx04 kernel: [11525.178367] connection16: 0: detected with error (1020)
Aug 17 19:57:18 prx04 kernel: [11525.178389] connection20: 0: detected with error (1020)
Aug 17 19:57:18 prx04 kernel: [11525.178448] sd 16: 0: 0: 1: [sdc] tag # 0 FAILED Result: hostbyte = DID_TRANSPORT_DISRUPTED driverbyte = DRIVER_OK
Aug 17 19:57:18 prx04 kernel: [11525.178453] sd 16: 0: 0: 1: [sdc] tag # 0 CDB: Test Unit Ready 00 00 00 00 00 00
Aug 17 19:57:18 prx04 kernel: [11525.178509] sd 20: 0: 0: 1: [sdd] tag # 0 FAILED Result: hostbyte = DID_TRANSPORT_DISRUPTED driverbyte = DRIVER_OK
Aug 17 19:57:18 prx04 kernel: [11525.178513] sd 20: 0: 0: 1: [sdd] tag # 0 CDB: Test Unit Ready 00 00 00 00 00 00
Aug 17 19:57:19 prx04 kernel: [11526.202202] connection17: 0: detected with error (1022)
Aug 17 19:57:19 prx04 kernel: [11526.206978] connection19: 0: detected with error (1022)
Aug 17 19:57:20 prx04 kernel: [11527.472460] sd 12: 0: 0: 1: Warning! Received an indication that the LUN assignments on this target have changed. The Linux SCSI layer does not automatical
Aug 17 19:57:20 prx04 kernel: [11527.475033] sd 16: 0: 0: 1: Warning! Received an indication that the LUN assignments on this target have changed. The Linux SCSI layer does not automatical
Aug 17 19:57:20 prx04 kernel: [11527.768770] sd 20: 0: 0: 1: Warning! Received an indication that the LUN assignments on this target have changed. The Linux SCSI layer does not automatical
Because multipath did not work, I tried to use the LUN without multipath, but I got the following error:
Conf Compellent wihtout multipath
Aug 22 12:58:43 prx03 kernel: [8073.966559] connection23: 0: detected with error (1020)
Aug 22 12:58:45 prx03 kernel: [8076.420870] sd 11: 0: 0: 1: Warning! Received an indication that the LUN assignments on this target have changed. The Linux SCSI layer does not automatical
Aug 22 12:59:47 prx03 kernel: [8138.734485] connection23: 0: detected with error (1020)
Aug 22 12:59:47 prx03 kernel: [8138.735175] scsi_io_completion: 20 suppressed callbacks
Aug 22 12:59:47 prx03 kernel: [8138.735181] sd 11: 0: 0: 1: [sdb] tag # 9 FAILED Result: hostbyte = DID_TRANSPORT_DISRUPTED driverbyte = DRIVER_OK
Aug 22 12:59:47 prx03 kernel: [8138.735187] sd 11: 0: 0: 1: [sdb] tag # 9 CDB: Write (16) 8a 00 00 00 00 00 00 20 30 00 00 00 10 00 00 00
Aug 22 12:59:47 prx03 kernel: [8138.735189] print_req_error: 20 suppressed callbacks
Aug 22 12:59:47 prx03 kernel: [8138.735488] buffer_io_error: 2324 suppressed callbacks
Aug 22 12:59:47 prx03 kernel: [8138.738962] sd 11: 0: 0: 1: [sdb] tag # 2 FAILED Result: hostbyte = DID_TRANSPORT_DISRUPTED driverbyte = DRIVER_OK
The network interfaces of proxmox are in 9000, the switch and compellent as well.
Someone of you has integrated proxmox with compellent, have some example of configuration, apply good practices of Dell documents, but still did not get satisfactory results.
I wish you could help me, I remain attentive to your comments