Issues with proxmox cluster and multipath.

milank2

Member
May 11, 2021
2
0
6
24
Hello everyone,
I have proxmox cluster(7.4.3) with 3 nodes connected with iscsi to Dell storage.
Node 1 is working fine and it is connected to the storage with multipath enabled.
The node 2 and 3 multipath is configured : Screenshot 2023-04-14 at 1.33.59 PM.png

ode2:/# multipath -ll
mpathLUN2 (3600c0ff00066d22c5c91266401000000) dm-5 DellEMC,ME5
size=11T features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=30 status=active
|- 11:0:0:1 sdc 8:32 active ready running
|- 12:0:0:1 sdb 8:16 active ready running
|- 13:0:0:1 sdd 8:48 active ready running
`- 14:0:0:1 sde 8:64 active ready running
and:
node2:/# /lib/udev/scsi_id -v -g /dev/sdd
3600c0ff00066d22c5c91266401000000
root@vig-rajska-zahrada-node2:/# /lib/udev/scsi_id -v -g /dev/sde
3600c0ff00066d22c5c91266401000000
and so on for sdc and sdd

But when I add the lvm in Datacenter, storage, lvm I get error:
Screenshot 2023-04-14 at 2.00.20 PM.png


Can you please help me out.
Thanks a lot.
 
If you have multipath properly configured on all nodes, you should be using DM device, not direct sdX devices.
Your problem description is a bit confusing - you have storage configured in a cluster, it appears from screenshot to be presented to all nodes, you say its working on node1 - meaning you actually use it for VMs already? Yet you are trying to add another LVM layer on top of working storage?


Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
Hi thanks for answering, yes node 1 has woking storage LVM1 which connected to vm.
vm has it mounted under /mnt Screenshot 2023-04-14 at 4.49.39 PM.pngScreenshot 2023-04-14 at 4.50.14 PM.png
Yes mounting LVM layer on top of Dell storage
 
You have to figure out:
a) What device is LVM1 pointing to? (lvs/vgs/pvs)
b) Is LVM1 a thin or thick LVM?
c) If thick - is it marked "shared" in PVE config?
d) If its pointing to DM device, has LVM thick and is marked shared - why are you trying to create new VGs on underlying raw devices on other nodes?


Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox