LVM not replicating to cluster peer

[HawHoo]

Hi,
I have an LVM running over Iscsi (connected to a nimble storage system)
the LVM shows up fine in the first cluster node PVE-01,
however the LVM does not show up in the 2nd node (PVE-02).

I tested this out in a lab with a Synology ISCSI setup and the LVM is showing up on all cluster nodes.
The LUN is shared on the nimble and iscsi and LVM are configured similarly as on the Synology/LAB setup.

When I try to migrate the VM connected to the LVM i get:" TASK ERROR: storage 'BCi-DS-WRK1--02' is not online"
I guess that would be expected with the missing LVM in the migrated to Cluster Node.

What would be the next step in tracking down the issue ?

 

[HawHoo]

Here is the output for Volume groups and Logical Volumes:
(in the lab the output is identical for all nodes...)
------------------------------------------
root@bci-uc-pve-01:~# vgs
VG #PV #LV #SN Attr VSize VFree
BCI-DC-W10-02 1 1 0 wz--n- <300.00g <150.00g
root@bci-uc-pve-01:~# lvs
LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert
vm-399-disk-0 BCI-DC-W10-02 -wi-ao---- 150.00g
------------------------------------------
root@bci-uc-pve-02:~#
root@bci-uc-pve-02:~# vgs
root@bci-uc-pve-02:~# lvs
root@bci-uc-pve-02:~#
------------------------------------------
root@bci-uc-pve-02:~# pvscan
No matching physical volumes found
root@bci-uc-pve-02:~#
root@bci-uc-pve-02:~# vgscan
root@bci-uc-pve-02:~#
------------------------------------------

 

[HawHoo]

The storage configuration looks correct to me on the 2nd misbehaving node:
iscsi: BCi-DS-WRK1--02
lvm: BCI-DS-WRK10-02 is the LVM that is not showing......

------------------------------------------------
root@bci-uc-pve-02:~# cat /etc/pve/storage.cfg
dir: local
path /var/lib/vz
content backup,vztmpl,iso

zfspool: local-zfs
pool rpool/data
content images,rootdir
sparse 1

esxi: VM-2
server 10.80.1.22
username root
content import
skip-cert-verification 1

iscsi: BCi-DS-WRK1--02
portal 10.90.1.98
target iqn.2007-11.com.nimblestorageve-bci-ds-w10-02-v587b240bb62bb559.00000089.ee509152
content none
nodes bci-uc-pve-01,bci-uc-pve-02

lvm: BCI-DS-WRK10-02
vgname BCI-DC-W10-02
base BCi-DS-WRK1--02:0.0.0.scsi-SNimble_Server_adf957d30dfa30396c9ce900529150ee
content images
nodes bci-uc-pve-01,bci-uc-pve-02
saferemove 0
shared 1

root@bci-uc-pve-02:~#
-------------------------------------------------------------

no error messages here:
root@bci-uc-pve-02:~# dmesg | grep -i lvm
[ 7.912119] systemd[1]: Listening on lvm2-lvmpolld.socket - LVM2 poll daemon socket.
[ 8.541848] systemd[1]: Starting lvm2-monitor.service - Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling...
root@bci-uc-pve-02:~#

 

[HawHoo]

SOLUTION:
I hope this helps somebody some time ....
the iscsi.service was not running
(and in our case multipathd was not setup properly)