Issues with proxmox cluster and multipath.

milank2

Member
May 11, 2021
2
0
6
23
Hello everyone,
I have proxmox cluster(7.4.3) with 3 nodes connected with iscsi to Dell storage.
Node 1 is working fine and it is connected to the storage with multipath enabled.
The node 2 and 3 multipath is configured : Screenshot 2023-04-14 at 1.33.59 PM.png

ode2:/# multipath -ll
mpathLUN2 (3600c0ff00066d22c5c91266401000000) dm-5 DellEMC,ME5
size=11T features='1 queue_if_no_path' hwhandler='1 alua' wp=rw
`-+- policy='round-robin 0' prio=30 status=active
|- 11:0:0:1 sdc 8:32 active ready running
|- 12:0:0:1 sdb 8:16 active ready running
|- 13:0:0:1 sdd 8:48 active ready running
`- 14:0:0:1 sde 8:64 active ready running
and:
node2:/# /lib/udev/scsi_id -v -g /dev/sdd
3600c0ff00066d22c5c91266401000000
root@vig-rajska-zahrada-node2:/# /lib/udev/scsi_id -v -g /dev/sde
3600c0ff00066d22c5c91266401000000
and so on for sdc and sdd

But when I add the lvm in Datacenter, storage, lvm I get error:
Screenshot 2023-04-14 at 2.00.20 PM.png


Can you please help me out.
Thanks a lot.
 
If you have multipath properly configured on all nodes, you should be using DM device, not direct sdX devices.
Your problem description is a bit confusing - you have storage configured in a cluster, it appears from screenshot to be presented to all nodes, you say its working on node1 - meaning you actually use it for VMs already? Yet you are trying to add another LVM layer on top of working storage?


Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
Hi thanks for answering, yes node 1 has woking storage LVM1 which connected to vm.
vm has it mounted under /mnt Screenshot 2023-04-14 at 4.49.39 PM.pngScreenshot 2023-04-14 at 4.50.14 PM.png
Yes mounting LVM layer on top of Dell storage
 
You have to figure out:
a) What device is LVM1 pointing to? (lvs/vgs/pvs)
b) Is LVM1 a thin or thick LVM?
c) If thick - is it marked "shared" in PVE config?
d) If its pointing to DM device, has LVM thick and is marked shared - why are you trying to create new VGs on underlying raw devices on other nodes?


Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!