PVE iSCSI with different /dev/sdX for iSCSI LUN

unsichtbarre

Member
Oct 1, 2024
46
8
8
Howdy!

I created a PVE 8.4.1 host, connected iSCSI SAN/LUN then built a VM. I then created two other PVE hosts and created a cluster. Trying to migrate a VM from the first host to another failed. I created CEPH on the cluster, migrated the VM to CEPH and then migration worked. I started looking at storage and, while all hosts were connected to the iSCSI, hosts 2 & 3 used different /dev/sdX identifiers for iSCSI as compared to host 1 (output below). I see now that hosts 2 & 3 have a flash drive enabled (/dev/sdd 29/7G) whereas host 1 has the flash drive disabled in BIOS/UEFI.

Is there a way of correcting this or should I just remove host 1 from the cluster and re-install with the flash drive enabled (easier than re-installing hosts 2 & 3!).

THX in ADV
-JB

host 1:
Code:
root@va1-pve101:~# lsblk
NAME                                                                            MAJ:MIN RM   SIZE RO TYPE MOUNTPOINTS
sda                                                                               8:0    0   3.6T  0 disk
└─ceph--421ed1b6--412a--4750--ae8b--ec69db4a35a7-osd--block--686e5635--9f7b--4309--bb6c--e25e69ea0eba
                                                                                252:9    0   3.6T  0 lvm
sdb                                                                               8:16   0   3.6T  0 disk
└─ceph--9c4a4c0c--6438--4a58--9daa--aca9026685be-osd--block--eb2f597f--c89a--411c--becd--c188e2f44627
                                                                                252:10   0   3.6T  0 lvm
sdc                                                                               8:32   0   3.6T  0 disk
└─ceph--815722ea--dd4b--4b85--94f6--5b8851eda3d6-osd--block--08502226--125a--49ba--98e3--e886707595f5
                                                                                252:11   0   3.6T  0 lvm
sdd                                                                               8:48   0   500G  0 disk
└─sdd1                                                                            8:49   0   500G  0 part
sde                                                                               8:64   0    10T  0 disk
└─sde1                                                                            8:65   0    10T  0 part
sdf                                                                               8:80   0    15T  0 disk
└─sdf1                                                                            8:81   0    15T  0 part
sdg                                                                               8:96   0    15T  0 disk
└─sdg1                                                                            8:97   0    15T  0 part
sdh                                                                               8:112  0     5T  0 disk
├─S1-vm--100--disk--0                                                           252:5    0    32G  0 lvm
└─S1-vm--101--disk--0                                                           252:6    0   120G  0 lvm
nvme0n1                                                                         259:0    0 232.9G  0 disk
├─nvme0n1p1                                                                     259:1    0  1007K  0 part
├─nvme0n1p2                                                                     259:2    0     1G  0 part /boot/efi
└─nvme0n1p3                                                                     259:3    0 231.9G  0 part
  ├─pve-swap                                                                    252:0    0     8G  0 lvm  [SWAP]
  ├─pve-root                                                                    252:1    0    68G  0 lvm  /
  ├─pve-data_tmeta                                                              252:2    0   1.4G  0 lvm
  │ └─pve-data                                                                  252:4    0 137.1G  0 lvm
  └─pve-data_tdata                                                              252:3    0 137.1G  0 lvm
    └─pve-data                                                                  252:4    0 137.1G  0 lvm
hosts 2 & 3
Code:
root@va1-pve102:~# lsblk
NAME                                                                            MAJ:MIN RM   SIZE RO TYPE MOUNTPOINTS
sda                                                                               8:0    0   3.6T  0 disk
└─ceph--05845e81--e3ee--470c--9d4b--f00a4d869a52-osd--block--14a20678--4f20--429f--8e33--f4496e7d1d52
                                                                                252:7    0   3.6T  0 lvm
sdb                                                                               8:16   0   3.6T  0 disk
└─ceph--0a5dc595--e7c6--48ef--ac19--0e437f0570dc-osd--block--3139840a--64e4--4c84--990c--14a8a4d2d683
                                                                                252:8    0   3.6T  0 lvm
sdc                                                                               8:32   0   3.6T  0 disk
└─ceph--a85fe242--0269--4125--a2aa--9221ef262313-osd--block--45e17a26--8756--4dfc--b078--a75210f24b40
                                                                                252:9    0   3.6T  0 lvm
sdd                                                                               8:48   0  29.7G  0 disk
├─sdd1                                                                            8:49   0   100M  0 part
├─sdd5                                                                            8:53   0     4G  0 part
├─sdd6                                                                            8:54   0     4G  0 part
└─sdd7                                                                            8:55   0  21.6G  0 part
sde                                                                               8:64   0   500G  0 disk
└─sde1                                                                            8:65   0   500G  0 part
sdf                                                                               8:80   0    10T  0 disk
└─sdf1                                                                            8:81   0    10T  0 part
sdg                                                                               8:96   0    15T  0 disk
└─sdg1                                                                            8:97   0    15T  0 part
sdh                                                                               8:112  0    15T  0 disk
└─sdh1                                                                            8:113  0    15T  0 part
sdi                                                                               8:128  0     5T  0 disk
├─S1-vm--100--disk--0                                                           252:5    0    32G  0 lvm
└─S1-vm--101--disk--0                                                           252:6    0   120G  0 lvm
nvme0n1                                                                         259:0    0 232.9G  0 disk
├─nvme0n1p1                                                                     259:1    0  1007K  0 part
├─nvme0n1p2                                                                     259:2    0     1G  0 part /boot/efi
└─nvme0n1p3                                                                     259:3    0 231.9G  0 part
  ├─pve-swap                                                                    252:0    0     8G  0 lvm  [SWAP]
  ├─pve-root                                                                    252:1    0    68G  0 lvm  /
  ├─pve-data_tmeta                                                              252:2    0   1.4G  0 lvm
  │ └─pve-data                                                                  252:4    0 137.1G  0 lvm
  └─pve-data_tdata                                                              252:3    0 137.1G  0 lvm
    └─pve-data                                                                  252:4    0 137.1G  0 lvm
 
Double post: