[SOLVED] iSCSI-Trouble with pve5 and Dell MD36XXi

U

udo

Distinguished Member
Proxmox Subscriber
Apr 22, 2009
5,977
199
163
Ahrensburg; Germany
Hi,
I try to upgrade an pve3-cluster to pve5 with an new installation.
I stuck with the iscsi-storage on the pve5 node.

I see sessions:
Code: 
iscsiadm --mode session
tcp: [1] 172.24.1.37:3260,2 iqn.1984-05.com.dell:powervault.md3600i.6f01faf000e05bcc0000000012d6c906 (non-flash)
tcp: [2] 172.24.1.36:3260,2 iqn.1984-05.com.dell:powervault.md3600i.6f01faf000e05bcc0000000012d6c906 (non-flash)
tcp: [3] 172.24.1.39:3260,1 iqn.1984-05.com.dell:powervault.md3600i.6f01faf000e05bcc0000000012d6c906 (non-flash)
tcp: [4] 172.24.1.38:3260,1 iqn.1984-05.com.dell:powervault.md3600i.6f01faf000e05bcc0000000012d6c906 (non-flash)
But no disk-device, sg-devices only:
Code: 
[   17.742746] scsi host7: iSCSI Initiator over TCP/IP
[   17.747771] scsi host8: iSCSI Initiator over TCP/IP
[   17.750821] scsi host9: iSCSI Initiator over TCP/IP
[   17.754179] scsi host10: iSCSI Initiator over TCP/IP
[   17.761043] scsi 7:0:0:0: Direct-Access     DELL     MD36xxi          0784 PQ: 1 ANSI: 5
[   17.761070] scsi 8:0:0:0: Direct-Access     DELL     MD36xxi          0784 PQ: 1 ANSI: 5
[   17.763847] scsi 9:0:0:0: Direct-Access     DELL     MD36xxi          0784 PQ: 1 ANSI: 5
[   17.764287] scsi 10:0:0:0: Direct-Access     DELL     MD36xxi          0784 PQ: 1 ANSI: 5
[   17.810206] scsi 8:0:0:0: rdac: LUN 0 (IOSHIP) (unowned)
[   17.810395] scsi 8:0:0:0: Attached scsi generic sg3 type 0
[   17.814245] scsi 8:0:0:31: Direct-Access     DELL     Universal Xport  0784 PQ: 0 ANSI: 5
[   17.814300] scsi 7:0:0:0: rdac: LUN 0 (IOSHIP) (unowned)
[   17.814450] scsi 7:0:0:0: Attached scsi generic sg4 type 0
[   17.817811] scsi 7:0:0:31: Direct-Access     DELL     Universal Xport  0784 PQ: 0 ANSI: 5
[   17.826655] scsi 10:0:0:0: rdac: LUN 0 (IOSHIP) (unowned)
[   17.826776] scsi 10:0:0:0: Attached scsi generic sg5 type 0
[   17.826847] scsi 9:0:0:0: rdac: LUN 0 (IOSHIP) (unowned)
[   17.826946] scsi 9:0:0:0: Attached scsi generic sg6 type 0
[   17.832773] scsi 10:0:0:31: Direct-Access     DELL     Universal Xport  0784 PQ: 0 ANSI: 5
[   17.833157] scsi 9:0:0:31: Direct-Access     DELL     Universal Xport  0784 PQ: 0 ANSI: 5
[   17.873094] scsi 7:0:0:31: Attached scsi generic sg7 type 0
[   17.889223] scsi 10:0:0:31: Attached scsi generic sg8 type 0
[   17.889323] scsi 8:0:0:31: Attached scsi generic sg9 type 0
[   17.893087] scsi 9:0:0:31: Attached scsi generic sg10 type 0
on the old node I see afterwards the disks (and an owned instead of unowned):
Code: 
scsi 8:0:0:0: Direct-Access     DELL     MD36xxi          0784 PQ: 0 ANSI: 5
scsi 11:0:0:0: Direct-Access     DELL     MD36xxi          0784 PQ: 0 ANSI: 5
scsi 9:0:0:0: Direct-Access     DELL     MD36xxi          0784 PQ: 0 ANSI: 5
scsi 10:0:0:0: Direct-Access     DELL     MD36xxi          0784 PQ: 0 ANSI: 5
scsi 11:0:0:0: rdac: LUN 0 (IOSHIP) (owned)
sd 11:0:0:0: Attached scsi generic sg4 type 0
scsi 9:0:0:0: rdac: LUN 0 (IOSHIP) (unowned)
scsi 10:0:0:0: rdac: LUN 0 (IOSHIP) (unowned)
sd 9:0:0:0: Attached scsi generic sg5 type 0
scsi 11:0:0:1: Direct-Access     DELL     MD36xxi          0784 PQ: 0 ANSI: 5
scsi 11:0:0:1: rdac: LUN 1 (IOSHIP) (unowned)
sd 10:0:0:0: Attached scsi generic sg6 type 0
scsi 9:0:0:1: Direct-Access     DELL     MD36xxi          0784 PQ: 0 ANSI: 5
sd 11:0:0:1: Attached scsi generic sg7 type 0
scsi 9:0:0:1: rdac: LUN 1 (IOSHIP) (owned)
scsi 10:0:0:1: Direct-Access     DELL     MD36xxi          0784 PQ: 0 ANSI: 5
scsi 10:0:0:1: rdac: LUN 1 (IOSHIP) (owned)
sd 9:0:0:1: Attached scsi generic sg8 type 0
scsi 11:0:0:31: Direct-Access     DELL     Universal Xport  0784 PQ: 0 ANSI: 5
sd 10:0:0:1: Attached scsi generic sg9 type 0
scsi 9:0:0:31: Direct-Access     DELL     Universal Xport  0784 PQ: 0 ANSI: 5
scsi 11:0:0:31: Attached scsi generic sg10 type 0
scsi 11:0:0:31: Embedded Enclosure Device
scsi 11:0:0:31: Failed to get diagnostic page 0x8000002
scsi 11:0:0:31: Failed to bind enclosure -19
scsi 9:0:0:31: Attached scsi generic sg11 type 0
scsi 9:0:0:31: Embedded Enclosure Device
scsi 10:0:0:31: Direct-Access     DELL     Universal Xport  0784 PQ: 0 ANSI: 5
scsi 9:0:0:31: Failed to get diagnostic page 0x8000002
scsi 9:0:0:31: Failed to bind enclosure -19
scsi 10:0:0:31: Attached scsi generic sg12 type 0
scsi 10:0:0:31: Embedded Enclosure Device
scsi 10:0:0:31: Failed to get diagnostic page 0x8000002
scsi 10:0:0:31: Failed to bind enclosure -19
scsi 8:0:0:0: rdac: LUN 0 (IOSHIP) (owned)
sd 8:0:0:0: Attached scsi generic sg13 type 0
scsi 8:0:0:1: Direct-Access     DELL     MD36xxi          0784 PQ: 0 ANSI: 5
sd 11:0:0:0: [sdc] Attached SCSI disk
scsi 8:0:0:1: rdac: LUN 1 (IOSHIP) (unowned)
sd 8:0:0:1: Attached scsi generic sg14 type 0
scsi 8:0:0:31: Direct-Access     DELL     Universal Xport  0784 PQ: 0 ANSI: 5
scsi 8:0:0:31: Attached scsi generic sg15 type 0
scsi 8:0:0:31: Embedded Enclosure Device
scsi 8:0:0:31: Failed to get diagnostic page 0x8000002
scsi 8:0:0:31: Failed to bind enclosure -19
sd 9:0:0:0: [sdd] Attached SCSI disk
sd 10:0:0:0: [sde] Attached SCSI disk
sd 11:0:0:1: [sdf] Attached SCSI disk
sd 9:0:0:1: [sdg] Attached SCSI disk
sd 10:0:0:1: [sdh] Attached SCSI disk
sd 8:0:0:0: [sdi] Attached SCSI disk
sd 8:0:0:1: [sdj] Attached SCSI disk
My experiences with iSCSI is not so high, perhaps I forgot an importand step, but scsi_dh_rdac is loaded (in /etc/modules) and my iscsi.conf looks similiar to the conf on the pve3 system:
Code: 
iscsid.startup = /sbin/iscsid
node.startup = automatic
node.leading_login = No
node.session.timeo.replacement_timeout = 15
node.conn[0].timeo.login_timeout = 15
node.conn[0].timeo.logout_timeout = 15
node.conn[0].timeo.noop_out_interval = 5
node.conn[0].timeo.noop_out_timeout = 5
node.session.err_timeo.abort_timeout = 15
node.session.err_timeo.lu_reset_timeout = 30
node.session.err_timeo.tgt_reset_timeout = 30
node.session.initial_login_retry_max = 8
node.session.cmds_max = 128
node.session.queue_depth = 32
node.session.xmit_thread_priority = -20
node.session.iscsi.InitialR2T = No
node.session.iscsi.ImmediateData = Yes
node.session.iscsi.FirstBurstLength = 262144
node.session.iscsi.MaxBurstLength = 16776192
node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
discovery.sendtargets.iscsi.MaxRecvDataSegmentLength = 32768
node.session.nr_sessions = 1
node.session.iscsi.FastAbort = Yes
multipath should not be the problem, without disks no multipath...

Any hint's?
Without storage the migration is quite not easy ;)

Udo
 
You must log in or register to reply here.
Top Bottom