Proxmox Configuring HP Nimble Multipath and ISCSI

[dave10x]

when trying to create the LVM i get this


create storage failed: command '/sbin/pvs --separator : --noheadings --units k --unbuffered --nosuffix --options pv_name,pv_size,vg_name,pv_uuid /dev/disk/by-id/scsi-SNimble_Server_2614f0c861be04846c9ce900ee763fd6' failed: exit code 5 (500)


Also:

root@pmx6:~# fdisk -l
Disk /dev/sdb: 558.88 GiB, 600093712384 bytes, 1172058032 sectors
Disk model: LOGICAL VOLUME
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 262144 bytes / 262144 bytes
Disklabel type: gpt
Disk identifier: 019777FC-3B5A-419C-8E19-E7824D0CC1B1

Device Start End Sectors Size Type
/dev/sdb1 34 2047 2014 1007K BIOS boot
/dev/sdb2 2048 2099199 2097152 1G EFI System
/dev/sdb3 2099200 1172057998 1169958799 557.9G Linux LVM

Partition 1 does not start on physical sector boundary.


Disk /dev/mapper/pve-swap: 8 GiB, 8589934592 bytes, 16777216 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 262144 bytes / 262144 bytes


Disk /dev/mapper/pve-root: 96 GiB, 103079215104 bytes, 201326592 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 262144 bytes / 262144 bytes


Disk /dev/sdc: 1 TiB, 1099511627776 bytes, 2147483648 sectors <-- two drives ?
Disk model: Server
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes


Disk /dev/sdd: 1 TiB, 1099511627776 bytes, 2147483648 sectors <-- two drives ?
Disk model: Server
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes

 

[dave10x]

Ok Looks like when i changed the LUN to just a single side of the NIMBLE the WWID changed. I've re added this to the WWID file and updated the multipath.conf REmoved everything and started again.

ISCSI Storage has added

LVM created at DC level

VM has started and is booting nicely.

Thank you all you wonderful people.

 

[bbgeek17]

@dave10x,
Just to confirm for you and anyone else reading later:

Just a few posts earlier you created a Multipath device. This is the only device you should be accessing from this point on (mpath0). You should NOT be accessing direct LUN or /dev/sdx disk in any way.

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[dave10x]

Thank makes total sense. I can see the device now as.

Disk /dev/mapper/mpath0: 1 TiB, 1099511627776 bytes, 2147483648 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes

 

[bbgeek17]

Thank makes total sense. I can see the device now as.

Disk /dev/mapper/mpath0: 1 TiB, 1099511627776 bytes, 2147483648 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes

If you created LVM on /dev/disk/by-anything, remove the VM, remove LVM. Redo the LVM config to point to dm or mpath device.

Good luck

---

Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox

 

[dave10x]

No the new VM is on this device.

 

[pthomson]

well done, glad to hear its sorted,

 

[waltar]

remove the VM, remove LVM. Redo the LVM config to point to dm or mpath device.

No the new VM is on this device.

well done, glad to hear its sorted,

As bbgeek17 wrote (!!) you should have NOT defined any /dev/sd* devices in your lvm !!
When you define more volume and vm/lxc disks and boot your device names will change, you get lvm and vm/lxc problems.
Migrate your new vm to any other storage, remove lvm on /dev/sdc, redefine LVM on multipath device and migrate your vm back
otherwise you will highly probably run - into yet unexpected - funny problems after next pve reboot.