[SOLVED] LVM over iSCSI: VG is missing on new node.

[engineer5]

I want to build a small cluster with a QNAP NAS as iSCSI storage.
Node1 was installed, NAS connectivity with multipath works, a LUN created, a LVM over iSCSI created. Node 2 came online and found the LUN and the LVM, and VMs could move from Node1 to Node2 and back.
I now installed Node3 (already with Proxmox 8.2.4 instead of 8.2.2) and Node3 does discover the iSCSI, but the LVM is not shown.

Node2:

root@server2:/etc# cat pve/storage.cfg
dir: local
    path /var/lib/vz
    content backup,iso,vztmpl

lvmthin: local-lvm
    thinpool data
    vgname pre
    content images,rootdir

iscsi: Q932ssd4T
    portal 192.168.1.6
    target iqn.2004-04.com.qnap:ts-932px:iscsi.q932ssd4t.7f5f57
    content none

lvm: Q4T932
    vgname LUN0Q932
    base Q932ssd4T:0.0.0.scsi-36f842b2e2165efbdbbd0d437fda4c4d0
    content images,rootdir
    saferemove 0
    shared 1

root@server2:/etc# lvscan
  ACTIVE            '/dev/LUN0Q932/vm-100-disk-0' [32.00 GiB] inherit
  ACTIVE            '/dev/LUN0Q932/vm-101-disk-0' [120.00 GiB] inherit
  ACTIVE            '/dev/LUN0Q932/vm-102-disk-0' [256.00 GiB] inherit
  ACTIVE            '/dev/LUN0Q932/vm-102-disk-1' [512.00 GiB] inherit
  ACTIVE            '/dev/LUN0Q932/vm-103-disk-0' [<128.02 GiB] inherit
  ACTIVE            '/dev/LUN0Q932/vm-103-disk-1' [<499.88 GiB] inherit
  ACTIVE            '/dev/pve/data' [112.94 GiB] inherit
  ACTIVE            '/dev/pve/swap' [8.00 GiB] inherit
  ACTIVE            '/dev/pve/root' [<59.75 GiB] inherit

root@server2:/etc# vgscan
  Found volume group "LUN0Q932" using metadata type lvm2
  Found volume group "pve" using metadata type lvm2

Node3:

root@server3:/etc# lvscan
  ACTIVE            '/dev/pve/data' [112.94 GiB] inherit
  ACTIVE            '/dev/pve/swap' [8.00 GiB] inherit
  ACTIVE            '/dev/pve/root' [<59.75 GiB] inherit

root@node3:/etc# vgscan
  Found volume group "pve" using metadata type lvm2

fdisk sees the iSCSI, the /dev/LUN0Q932/vm-*-disk-* are there on node 3 also.
But the volume group LUN0Q932 is not there.

What am I missing here? I'm thankful for any tips and ideas!

#engineer5

 

[gfngfn256]

I now installed Node3

Have you tried rebooting the Node3 ?

 

[bbgeek17]

Additionally, did you install multipath on all 3 nodes?
Do lsblk and multipath -ll show the same information across all nodes?
Are there any errors in journalctl ?

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[engineer5]

Thank you for your help!

"multipath -ll" did not show the devices.
I did overlook at that node that I need to add the WWID to the multipath configuration via "multipath -a <WWID>".

Now everything works like a charm.

 

[gfngfn256]

Happy you got it working. Maybe tag prefix the thread-title with [SOLVED], (upper right hand corner under title).