WARNING: storage is not online (ISCSI)

3

3a4eM

New Member
Mar 19, 2012
5
0
1
Hi,
Sorry, my english is not very wellMy english...

When you add storage type ISCSI (HP P2000 G3 ISCSI, ip 192.168.2.83) in syslog on all nodes appears:
Code: 
Feb 26 15:30:09 node102 pvestatd[4098]: WARNING: storage 'nas5ISCSI' is not online
Feb 26 15:30:28 node102 pvestatd[4098]: WARNING: storage 'nas5ISCSI' is not online
Feb 26 15:30:30 node102 pvestatd[4098]: WARNING: storage 'nas5ISCSI' is not online
Storage keeps going out, but if you create a LVM over ISCSI (only need to get to a time when the online store :)) virtual machines are working properly (if the storage is time to start online :))
What could be the problem?

pveversion -V
Code: 
proxmox-ve-2.6.32: 3.1-121 (running kernel: 2.6.32-27-pve)
pve-manager: 3.1-43 (running version: 3.1-43/1d4b0dfb)
pve-kernel-2.6.32-20-pve: 2.6.32-100
pve-kernel-2.6.32-27-pve: 2.6.32-121
pve-kernel-2.6.32-19-pve: 2.6.32-96
pve-kernel-2.6.32-25-pve: 2.6.32-113
pve-kernel-2.6.32-26-pve: 2.6.32-114
pve-kernel-2.6.32-11-pve: 2.6.32-66
pve-kernel-2.6.32-23-pve: 2.6.32-109
lvm2: 2.02.98-pve4
clvm: 2.02.98-pve4
corosync-pve: 1.4.5-1
openais-pve: 1.1.4-3
libqb0: 0.11.1-2
redhat-cluster-pve: 3.2.0-2
resource-agents-pve: 3.9.2-4
fence-agents-pve: 4.0.5-1
pve-cluster: 3.0-12
qemu-server: 3.1-15
pve-firmware: 1.1-2
libpve-common-perl: 3.0-13
libpve-access-control: 3.0-11
libpve-storage-perl: 3.0-19
pve-libspice-server1: 0.12.4-3
vncterm: 1.1-6
vzctl: 4.0-1pve4
vzprocps: 2.0.11-2
vzquota: 3.1-2
pve-qemu-kvm: 1.7-4
ksm-control-daemon: 1.1-1
glusterfs-client: 3.4.2-1

cat /etc/mulitpath.conf
Code: 
defaults {
        polling_interval        2
        path_selector           "round-robin 0"
        path_grouping_policy    multibus
        getuid_callout          "/lib/udev/scsi_id -g -u -d /dev/%n"
        rr_min_io               100
        failback                immediate
        no_path_retry           queue
}
blacklist {
        wwid *
}

blacklist_exceptions {
        wwid "3600c0ff0001b18d90a960c5301000000"
        wwid "3600c0ff0001b177afb950c5301000000"
}

multipaths {
  multipath {
        wwid "3600c0ff0001b18d90a960c5301000000"
        alias win
  }
}

multipaths {
  multipath {
        wwid "3600c0ff0001b177afb950c5301000000"
        alias nix
  }
}

multipath -ll
Code: 
3600c0ff0001b18d90a960c5301000000 dm-4 HP,P2000 G3 iSCSI
size=7.3T features='1 queue_if_no_path' hwhandler='0' wp=rw
|-+- policy='round-robin 0' prio=32 status=active
| |- 8:0:0:1  sdn 8:208 active ready running
| |- 12:0:0:1 sdo 8:224 active ready running
| |- 10:0:0:1 sdp 8:240 active ready running
| `- 11:0:0:1 sdq 65:0  active ready running
`-+- policy='round-robin 0' prio=2 status=enabled
  |- 7:0:0:1  sdj 8:144 active ready running
  |- 5:0:0:1  sdk 8:160 active ready running
  |- 9:0:0:1  sdm 8:192 active ready running
  `- 6:0:0:1  sdl 8:176 active ready running
3600c0ff0001b177afb950c5301000000 dm-3 HP,P2000 G3 iSCSI
size=7.3T features='1 queue_if_no_path' hwhandler='0' wp=rw
|-+- policy='round-robin 0' prio=32 status=active
| |- 7:0:0:0  sdc 8:32  active ready running
| |- 6:0:0:0  sdd 8:48  active ready running
| |- 9:0:0:0  sde 8:64  active ready running
| `- 5:0:0:0  sdb 8:16  active ready running
`-+- policy='round-robin 0' prio=2 status=enabled
  |- 8:0:0:0  sdf 8:80  active ready running
  |- 11:0:0:0 sdh 8:112 active ready running
  |- 10:0:0:0 sdg 8:96  active ready running
  `- 12:0:0:0 sdi 8:128 active ready running

iscsiadm -m node
192.168.2.84:3260,5 iqn.1986-03.com.hp:storage.p2000g3.13361aa3ad
192.168.2.85:3260,7 iqn.1986-03.com.hp:storage.p2000g3.13361aa3ad
192.168.2.82:3260,1 iqn.1986-03.com.hp:storage.p2000g3.13361aa3ad
192.168.2.89:3260,8 iqn.1986-03.com.hp:storage.p2000g3.13361aa3ad
192.168.2.83:3260,3 iqn.1986-03.com.hp:storage.p2000g3.13361aa3ad
192.168.2.87:3260,4 iqn.1986-03.com.hp:storage.p2000g3.13361aa3ad
192.168.2.86:3260,2 iqn.1986-03.com.hp:storage.p2000g3.13361aa3ad
192.168.2.88:3260,6 iqn.1986-03.com.hp:storage.p2000g3.13361aa3ad
 
The problem persists:
Code: 
Mar 5 09:12:50 node102 pvedaemon[671900]: WARNING: storage 'nas5ISCSI' is not online
Mar 5 09:12:53 node102 pvestatd[672004]: WARNING: storage 'nas5ISCSI' is not online
Mar 5 09:13:03 node102 pvestatd[672004]: WARNING: storage 'nas5ISCSI' is not online
Mar 5 09:13:23 node102 pvestatd[672004]: WARNING: storage 'nas5ISCSI' is not online
cat /etc/multipath.conf
Code: 
defaults {
        path_grouping_policy group_by_prio
        path_selector "round-robin 0"
        failback immediate
        rr_weight uniform
        no_path_retry 10
        rr_min_io 100
}

blacklist {
        wwid *
}

blacklist_exceptions {
        wwid "3600c0ff0001b18d90a960c5301000000"
        wwid "3600c0ff0001b177afb950c5301000000"
}

multipaths {
  multipath {
        wwid "3600c0ff0001b18d90a960c5301000000"
        alias win
        path_grouping_policy group_by_prio
        path_selector "round-robin 0"
        failback immediate
        rr_weight uniform
        no_path_retry 10
        rr_min_io 100
  }
 
  multipath {
        wwid "3600c0ff0001b177afb950c5301000000"
        alias nix
        path_grouping_policy group_by_prio
        path_selector "round-robin 0"
        failback immediate
        rr_weight uniform
        no_path_retry 10
        rr_min_io 100
  }
}

multipath -ll
Code: 
win (3600c0ff0001b18d90a960c5301000000) dm-4 HP,P2000 G3 iSCSI
size=7.3T features='1 queue_if_no_path' hwhandler='0' wp=rw
|-+- policy='round-robin 0' prio=32 status=active
| |- 6:0:0:1  sdn 8:208 active ready running
| |- 8:0:0:1  sdo 8:224 active ready running
| |- 9:0:0:1  sdp 8:240 active ready running
| `- 7:0:0:1  sdq 65:0  active ready running
`-+- policy='round-robin 0' prio=2 status=enabled
  |- 3:0:0:1  sdj 8:144 active ready running
  |- 4:0:0:1  sdk 8:160 active ready running
  |- 10:0:0:1 sdm 8:192 active ready running
  `- 5:0:0:1  sdl 8:176 active ready running
nix (3600c0ff0001b177afb950c5301000000) dm-3 HP,P2000 G3 iSCSI
size=7.3T features='1 queue_if_no_path' hwhandler='0' wp=rw
|-+- policy='round-robin 0' prio=32 status=active
| |- 3:0:0:0  sdb 8:16  active ready running
| |- 4:0:0:0  sdc 8:32  active ready running
| |- 5:0:0:0  sde 8:64  active ready running
| `- 10:0:0:0 sdi 8:128 active ready running
`-+- policy='round-robin 0' prio=2 status=enabled
  |- 6:0:0:0  sdd 8:48  active ready running
  |- 8:0:0:0  sdf 8:80  active ready running
  |- 7:0:0:0  sdh 8:112 active ready running
  `- 9:0:0:0  sdg 8:96  active ready running

cat /etc/iscsi/iscsid.conf | grep -v "#"
Code: 
iscsid.startup = /usr/sbin/iscsid
node.startup = automatic
node.leading_login = No
node.session.timeo.replacement_timeout = 15
node.conn[0].timeo.login_timeout = 15
node.conn[0].timeo.logout_timeout = 15
node.conn[0].timeo.noop_out_interval = 5
node.conn[0].timeo.noop_out_timeout = 5
node.session.err_timeo.abort_timeout = 15
node.session.err_timeo.lu_reset_timeout = 30
node.session.err_timeo.tgt_reset_timeout = 30
node.session.initial_login_retry_max = 8
node.session.cmds_max = 128
node.session.queue_depth = 32
node.session.xmit_thread_priority = -20
node.session.iscsi.InitialR2T = No
node.session.iscsi.ImmediateData = Yes
node.session.iscsi.FirstBurstLength = 262144
node.session.iscsi.MaxBurstLength = 16776192
node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
discovery.sendtargets.iscsi.MaxRecvDataSegmentLength = 32768
node.session.nr_sessions = 1
node.session.iscsi.FastAbort = Yes

Please tell me what am I doing wrong?
 
Maybe someone has an example of the working multipaths config for HP P2000 G3 ISCSI? :confused:
 
3a4eM said:
Maybe someone has an example of the working multipaths config for HP P2000 G3 ISCSI? :confused:
Click to expand...

You can REMOVE (rename) your multipath.conf and test again.

You can verify many things withd multipatd, beginning with :
multipathd show config

Don't forget to RTFM.

Are you sure about your network switch config? Network cables?

Your NICs?

Is your NIC EEE (Efficient Energy Ethernet) compatible? If yes, disable that feature.

Christophe.
 
You must log in or register to reply here.

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Quick Navigation

Home Get Subscription Wiki Downloads Proxmox Customer Portal About

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!
Community platform by XenForo® © 2010-2024 XenForo Ltd.
Top Bottom
Back