cluster 2 nodes and iscsi storage

Smile

Member
Jul 6, 2015
9
0
21
Hi,
I have 2 nodes (IBM x3550 M4) with PVE 3.4 and IBM v3700 storage.
Both nodes are connected to each iscsi controller (a total of 2 ports for each node).

I followed this guide: http://pve.proxmox.com/wiki/Storage_Model#LVM_Groups_with_Network_Backing
to achieve iscsi lun for kvm, so I'll be able to migrate from one node to each other.
The problem is that I can't use migrate, it always fail with an error "storage 'iscsi-node1' is not available on node 'node2'".
Both nodes have an access to same iscsi lun.

node1 iscsi sessions:
root@node1:~# iscsiadm -m session
tcp: [1] 10.0.1.10:3260,3 iqn.1986-03.com.ibm:2145.nativstorage.node1
tcp: [2] 10.0.2.10:3260,4 iqn.1986-03.com.ibm:2145.nativstorage.node1

node2 iscsi sessions:
root@node2:~# iscsiadm -m session
tcp: [1] 10.0.2.20:3260,4 iqn.1986-03.com.ibm:2145.nativstorage.node2
tcp: [2] 10.0.1.20:3260,3 iqn.1986-03.com.ibm:2145.nativstorage.node2

node1 vgdisplay:
root@node1:~# vgdisplay
--- Volume group ---
VG Name kvm1
System ID
Format lvm2
Metadata Areas 1
Metadata Sequence No 1
VG Access read/write
VG Status resizable
MAX LV 0
Cur LV 0
Open LV 0
Max PV 0
Cur PV 1
Act PV 1
VG Size 1023.94 GiB
PE Size 4.00 MiB
Total PE 262128
Alloc PE / Size 0 / 0
Free PE / Size 262128 / 1023.94 GiB
VG UUID kHrese-yr0z-uMQ9-TqWw-ihKs-01ir-aicGbR

node2 vgdisplay:
root@node2:~# vgdisplay
--- Volume group ---
VG Name kvm1
System ID
Format lvm2
Metadata Areas 1
Metadata Sequence No 1
VG Access read/write
VG Status resizable
MAX LV 0
Cur LV 0
Open LV 0
Max PV 0
Cur PV 1
Act PV 1
VG Size 1023.94 GiB
PE Size 4.00 MiB
Total PE 262128
Alloc PE / Size 0 / 0
Free PE / Size 262128 / 1023.94 GiB
VG UUID kHrese-yr0z-uMQ9-TqWw-ihKs-01ir-aicGbR

node1 storage.cfg:
root@node1:~# cat /etc/pve/storage.cfg
iscsi: iscsi-node1
target iqn.1986-03.com.ibm:2145.nativstorage.node1
portal 10.0.1.10
content none

dir: local
path /var/lib/vz
shared
content iso,vztmpl,rootdir
maxfiles 0

iscsi: iscsi-node2
target iqn.1986-03.com.ibm:2145.nativstorage.node2
portal 10.0.1.20
content none

dir: container-node2
path /var/lib/vz-lun
shared
content vztmpl,rootdir,backup
maxfiles 1
nodes node2

dir: container-node1
path /var/lib/vz-lun
shared
content vztmpl,rootdir,backup
maxfiles 1
nodes node1

lvm: kvm-node1
vgname kvm1
base iscsi-node1:0.0.2.scsi-kvm
content images
shared

node2 storage.cfg:
root@node2:~# cat /etc/pve/storage.cfg
iscsi: iscsi-node1
target iqn.1986-03.com.ibm:2145.nativstorage.node1
portal 10.0.1.10
content none

dir: local
path /var/lib/vz
shared
content iso,vztmpl,rootdir
maxfiles 0

iscsi: iscsi-node2
target iqn.1986-03.com.ibm:2145.nativstorage.node2
portal 10.0.1.20
content none

dir: container-node2
path /var/lib/vz-lun
shared
content vztmpl,rootdir,backup
maxfiles 1
nodes node2

dir: container-node1
path /var/lib/vz-lun
shared
content vztmpl,rootdir,backup
maxfiles 1
nodes node1

lvm: kvm-node1
vgname kvm1
base iscsi-node1:0.0.2.scsi-kvm
content images
shared

I think the problem is that kvm-node1 base is iscsi-node1 on both of my nodes, but I can't change it to iscsi-node2 because it will replicate it to node1.
How can I solve this problem?
 
I just deleted base iscsi-node1:0.0.2.scsi-kvm from storage.cfg, now it's working fine.
Is it safe to do so?
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!