Unable to add LVM storage from iscsi LUN

[farfy]

Hello,

I've configured my iscsi target and multipathing, and everything is working up until the point I attempt to actually create LVM storage. When creating, I get this error:

create storage failed: command '/sbin/pvs --separator : --noheadings --units k --unbuffered --nosuffix --options pv_name,pv_size,vg_name,pv_uuid /dev/disk/by-id/scsi-SDELL_MD32xxi_523003V' failed: exit code 5 (500)

but I can't seem to find any info on what is causing it/why its happening, can anyone help? I am adding the storage via the GUI

 

[bbgeek17]

/dev/disk/by-id/scsi-SDELL_MD32xxi_523003V

You said you configured multipath, this path ^ does not look like a correct one for a multipath owned disk.
What do the following commands show:
lsscsi (may need to be installed)
lsblk
multipath -ll

If you use multipath, all volume manager manipulations must be against the DM multipath device.

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[farfy]

You said you configured multipath, this path ^ does not look like a correct one for a multipath owned disk.
What do the following commands show:
lsscsi (may need to be installed)
lsblk
multipath -ll

If you use multipath, all volume manager manipulations must be against the DM multipath device.

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

lsscsi output:

[0:2:0:0]    disk    DELL     PERC H730 Mini   4.30  /dev/sda
[0:2:1:0]    disk    DELL     PERC H730 Mini   4.30  /dev/sdb
[10:0:0:0]   cd/dvd  HL-DT-ST DVD-ROM DTA0N    D3B0  /dev/sr0
[11:0:0:0]   disk    DELL     MD32xxi          0820  /dev/sdc
[11:0:0:31]  disk    DELL     Universal Xport  0820  -       
[12:0:0:0]   disk    DELL     MD32xxi          0820  /dev/sdd
[12:0:0:31]  disk    DELL     Universal Xport  0820  -       
[13:0:0:0]   disk    DELL     MD32xxi          0820  /dev/sde
[13:0:0:31]  disk    DELL     Universal Xport  0820  -       
[14:0:0:0]   disk    DELL     MD32xxi          0820  /dev/sdf
[14:0:0:31]  disk    DELL     Universal Xport  0820  -

lsblk output:

NAME                           MAJ:MIN RM  SIZE RO TYPE MOUNTPOINTS
sda                              8:0    0  5.5T  0 disk
├─sda1                           8:1    0 1007K  0 part
├─sda2                           8:2    0    1G  0 part /boot/efi
└─sda3                           8:3    0  5.5T  0 part
  ├─pve-swap                   252:0    0    8G  0 lvm  [SWAP]
  ├─pve-root                   252:1    0   96G  0 lvm  /
  ├─pve-data_tmeta             252:2    0 15.9G  0 lvm 
  │ └─pve-data-tpool           252:6    0  5.3T  0 lvm 
  │   ├─pve-data               252:7    0  5.3T  1 lvm 
  │   ├─pve-vm--100--disk--0   252:8    0   32G  0 lvm 
  │   ├─pve-crumpets           252:9    0  1.5T  0 lvm  /sausage
  │   ├─pve-vm--101--disk--0   252:10   0    4M  0 lvm 
  │   ├─pve-vm--101--disk--1   252:11   0  200G  0 lvm 
  │   ├─pve-vm--102--disk--0   252:12   0    4M  0 lvm 
  │   ├─pve-vm--102--disk--1   252:13   0  282G  0 lvm 
  │   ├─pve-vm--102--disk--2   252:14   0  500G  0 lvm 
  │   └─pve-vm--100--disk--1   252:15   0  500G  0 lvm 
  └─pve-data_tdata             252:4    0  5.3T  0 lvm 
    └─pve-data-tpool           252:6    0  5.3T  0 lvm 
      ├─pve-data               252:7    0  5.3T  1 lvm 
      ├─pve-vm--100--disk--0   252:8    0   32G  0 lvm 
      ├─pve-crumpets           252:9    0  1.5T  0 lvm  /sausage
      ├─pve-vm--101--disk--0   252:10   0    4M  0 lvm 
      ├─pve-vm--101--disk--1   252:11   0  200G  0 lvm 
      ├─pve-vm--102--disk--0   252:12   0    4M  0 lvm 
      ├─pve-vm--102--disk--1   252:13   0  282G  0 lvm 
      ├─pve-vm--102--disk--2   252:14   0  500G  0 lvm 
      └─pve-vm--100--disk--1   252:15   0  500G  0 lvm 
sdb                              8:16   0 16.4T  0 disk
├─storage-storage_tmeta        252:3    0 15.9G  0 lvm 
│ └─storage-storage-tpool      252:16   0 16.3T  0 lvm 
│   ├─storage-storage          252:17   0 16.3T  1 lvm 
│   └─storage-vm--100--disk--0 252:18   0   17T  0 lvm 
└─storage-storage_tdata        252:5    0 16.3T  0 lvm 
  └─storage-storage-tpool      252:16   0 16.3T  0 lvm 
    ├─storage-storage          252:17   0 16.3T  1 lvm 
    └─storage-vm--100--disk--0 252:18   0   17T  0 lvm 
sdc                              8:32   0   32T  0 disk
sdd                              8:48   0   32T  0 disk
sde                              8:64   0   32T  0 disk
sdf                              8:80   0   32T  0 disk
sr0                             11:0    1 1024M  0 rom

multipath -ll isn't returning anything

root@pve:~# multipath -ll
root@pve:~#

 

[bbgeek17]

Then your multipath is not configured properly. Is that 2x32 devices, or 1 with 4 paths? Either way, you need to review your configuration.

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[farfy]

1 storage array with 4 paths

I'm struggling to understand the multipathing, I followed the setup guide for iscsi multipath, and added the dell vendor specific info, but im not sure what exactly is wrong

 

[farfy]

Is this where I went wrong? I followed each step under the multipath setup, and then the steps for dell specifically. so is it trying to use 2 different configs?

 

[bbgeek17]

I'm struggling to understand the multipathing, I followed the setup guide for iscsi multipath, and added the dell vendor specific info, but im not sure what exactly is wrong

If you list the exact steps you took, add your configuration file (using CODE tags or similar), add output commands of your steps, someone might be able to help. You can also always reach out to your Storage vendor (Dell) and ask for assistance in configuring this particular model for multipath on Debian system.

Is this where I went wrong? I followed each step under the multipath setup, and then the steps for dell specifically. so is it trying to use 2 different configs?

very likely: https://forum.proxmox.com/threads/cannot-create-lvm-on-iscsi-storage.82145/
But there is not enough data to be definitive. For now, a simple act of "pvs", which simply lists physical volumes, fails. And, yes, presence of unfiltered duplicate devices is very likely to cause this.

Good luck

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[farfy]

I found the issue....in my /etc/multipath.conf file, the wwid was missing the first number....so the wwid was incorrect. I just fixed it and changed it and everything worked without issue.

Thank you for your help!