LVM-thin Storage with multipath-tools

[Owl.paul]

I am experiencing issues with the configuration of multipath and LVM-thin on my setup, which includes two HP ProLiant DL380p Gen8 servers connected to an HP StorageWorks P2000 over Fibre Channel (FC). After rebooting a cluster node, my settings are reset, and the LVM group is created directly on the disk instead of on top of the multipath device (mpath).

root@node1:~# lsblk
NAME                              MAJ:MIN RM   SIZE RO TYPE  MOUNTPOINTS
sda                                 8:0    0 465.7G  0 disk
├─sda1                              8:1    0  1007K  0 part
├─sda2                              8:2    0     1G  0 part
└─sda3                              8:3    0 464.7G  0 part
  ├─pve-swap                      252:0    0     8G  0 lvm   [SWAP]
  ├─pve-root                      252:1    0    96G  0 lvm   /
  ├─pve-data_tmeta                252:2    0   3.4G  0 lvm
  │ └─pve-data                    252:4    0 337.8G  0 lvm
  └─pve-data_tdata                252:3    0 337.8G  0 lvm
    └─pve-data                    252:4    0 337.8G  0 lvm
sdb                                 8:16   0   9.1T  0 disk
└─mpatha                          252:8    0   9.1T  0 mpath
  ├─vg_storage-thin_storage_tmeta 252:5    0    76M  0 lvm
  │ └─vg_storage-thin_storage     252:7    0     9T  0 lvm
  └─vg_storage-thin_storage_tdata 252:6    0     9T  0 lvm
    └─vg_storage-thin_storage     252:7    0     9T  0 lvm
sdc                                 8:32   0   9.1T  0 disk
└─mpatha                          252:8    0   9.1T  0 mpath
  ├─vg_storage-thin_storage_tmeta 252:5    0    76M  0 lvm
  │ └─vg_storage-thin_storage     252:7    0     9T  0 lvm
  └─vg_storage-thin_storage_tdata 252:6    0     9T  0 lvm
    └─vg_storage-thin_storage     252:7    0     9T  0 lvm
sr0                                11:0    1  1024M  0 rom

After reboot:

root@node1:~# lsblk
NAME                         MAJ:MIN RM   SIZE RO TYPE  MOUNTPOINTS
sda                            8:0    0 465.7G  0 disk 
├─sda1                         8:1    0  1007K  0 part 
├─sda2                         8:2    0     1G  0 part 
└─sda3                         8:3    0 464.7G  0 part 
  ├─pve-swap                 252:0    0     8G  0 lvm   [SWAP]
  ├─pve-root                 252:1    0    96G  0 lvm   /
  ├─pve-data_tmeta           252:2    0   3.4G  0 lvm   
  │ └─pve-data               252:4    0 337.8G  0 lvm   
  └─pve-data_tdata           252:3    0 337.8G  0 lvm   
    └─pve-data               252:4    0 337.8G  0 lvm   
sdb                            8:16   0   9.1T  0 disk 
└─mpatha                     252:8    0   9.1T  0 mpath
sdc                            8:32   0   9.1T  0 disk 
├─vg_storage-thin_pool_tmeta 252:5    0    76M  0 lvm   
│ └─vg_storage-thin_pool     252:7    0   9.1T  0 lvm   
├─vg_storage-thin_pool_tdata 252:6    0   9.1T  0 lvm   
│ └─vg_storage-thin_pool     252:7    0   9.1T  0 lvm   
└─mpatha                     252:8    0   9.1T  0 mpath
sr0                           11:0    1  1024M  0 rom

 

[bbgeek17]

Hi @Owl.paul , welcome to the forum.

LVM thin is not suitable for shared storage use-case. You need to use regular LVM aka LVM Thick.

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[Owl.paul]

Hi @Owl.paul , welcome to the forum.

LVM thin is not suitable for shared storage use-case. You need to use regular LVM aka LVM Thick.

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

Okay, I get it. How then can I set up replication for my virtual machines? As far as I know, regular LVM does not support replication.

 

[bbgeek17]

How then can I set up replication for my virtual machines?

The only, currently, supported method of replication in PVE - https://pve.proxmox.com/wiki/Storage_Replication

Perhaps, you can replicate via some 3rd party tool. I.e. Veeam, rsync, etc. It all depends on your RTO and RPO requirements.

Good luck

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[Owl.paul]

The only, currently, supported method of replication in PVE - https://pve.proxmox.com/wiki/Storage_Replication

Perhaps, you can replicate via some 3rd party tool. I.e. Veeam, rsync, etc. It all depends on your RTO and RPO requirements.

Good luck

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

Ok, thanks for the tips,