Ask how to setup shared storage in cluster with 2 node proxmox

adotamaa

New Member
Sep 13, 2024
2
0
1
Hello,

I would like to ask about an issue I'm facing. I have 2 Proxmox nodes that are already in a cluster. I want to connect one storage to this cluster so that all the VMs on these two nodes can store their data on the connected storage. For the storage, I'm using a Dell EMC, which I connected to the server using a SAN switch by registering the WWNs of both Proxmox servers and the WWN of the Dell EMC storage.

I have tried adding storage using the "Directory" method, but the result is still the same—it cannot share the storage. My goal is that if node 1 goes down, the VMs will automatically migrate to node 2 since the storage is already shared. Do you have any suggestions for this? I have tried several settings such as multipath and iSCSI.

lscsi
node 1:
lsscsi node 1.png
node:2
lsscsi node 2.png

fdisk -l
node 1:
fidsk -l node 1.png
node 2:
fdisk -l node 2.png

disk on node 1:
disk node 1.png

disk on node 2:
disk node 2.png
 
Hi @adotamaa, welcome to the forum.

1) A two-node cluster is not a supported configuration for production. You need an odd number of hosts to ensure Quorum in case of single-node failure. https://pve.proxmox.com/wiki/Cluster_Manager#_quorum
2) You said you "registered WWN", this implies that your connection to storage is FC. In this case, there is no iSCSI involved.
3) After you have successfully established FC _or_ iSCSI connections and your host sees the raw LUNs (as it appears to be in your case), you need to install and configure Multipath. Of course if you, indeed, have multiple paths. Again, it appears that you do.
https://pve.proxmox.com/wiki/ISCSI_Multipath
4) Once you have configured Multipath you will see /dev/dm* device. That is the device you should be using, not the underlying /dev/sdX devices.
5) You placed the XFS filesystem on your _shared_ storage. The XFS is not a Cluster SAFE file system. You need to wipe your disks clean
6) Your primary option for volume manager on top of shared storage is LVM
https://pve.proxmox.com/wiki/Storage:_LVM


https://pve.proxmox.com/wiki/Storage

My advice is to go to Youtube and search for "proxmox multipath", "proxmox shared storage", and "proxmox shared LVM".
There is a multitude of step-by-step walkthroughs that can assist you. Ignore the iSCSI portions, everything else is the same.

Good luck


Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
1. So, I need to add one more node to the cluster, making the total number of nodes 3?
2. Alright, that means I’ll be using an FC connection.
3. In the image above, the disk I connected has already been detected by both servers.
4. So, if I have formatted the storage to LVM and configured multipath, does that mean the storage will no longer be under /dev/sdX but could be under /dev/dm* or /mnt/pve/*?


Alright, I will try it first. Thank you.
 

About

The Proxmox community has been around for many years and offers help and support for Proxmox VE, Proxmox Backup Server, and Proxmox Mail Gateway.
We think our community is one of the best thanks to people like you!

Get your subscription!

The Proxmox team works very hard to make sure you are running the best software and getting stable updates and security enhancements, as well as quick enterprise support. Tens of thousands of happy customers have a Proxmox subscription. Get yours easily in our online shop.

Buy now!