ISCSI disk status unknown

mrbeanzg

Member
Sep 22, 2020
21
0
21
41
Hi all,

I need help. Over night some of my iscsi lvm disk report status unknow. I remove them from cluster storage setup and now i cannot reattach them back to cluster.

Can someone help with this?

I have 4 nodes in cluster connected to hp 3par over iscsi 10gb network.

Best regards
 
I need help. Over night some of my iscsi lvm disk report status unknow. I remove them from cluster storage setup and now i cannot reattach them back to cluster.

Can someone help with this?
Were there any errors in the log? Did the luns drop off from all nodes? Are you getting errors when you are trying to attach them? What exactly do you mean by "attach"?
What is the context of "/etc/pve/storage.cfg" ? What is the output of:
iscsiadm -m nodes
iscsiadm -m sessions
lsscsi
pvesm scan iscsi [portal]


Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
sorry for late reply. the 10gb switches are dead. i have replace them and now i need to restore this two virtual disks. disks are on storage but i cannot see them on proxmox cluster.

what can i do now?

this is from storage.cfg . The effected disk are not in the file

dir: local
path /var/lib/vz
content iso,images,vztmpl,backup
shared 0

zfspool: local-zfs
disable
pool rpool/data
content rootdir,images
sparse 1

iscsi: hp3parlink1
portal 172.30.50.20
target iqn.2000-05.com.3pardata:20210002ac00635f
content images

iscsi: hp3parlink2
portal 172.30.50.21
target iqn.2000-05.com.3pardata:20220002ac00635f
content images

iscsi: hp3parlink3
portal 172.30.50.22
target iqn.2000-05.com.3pardata:21210002ac00635f
content images

iscsi: hp3parlink4
portal 172.30.50.23
target iqn.2000-05.com.3pardata:21220002ac00635f
content images

lvm: hpe3par5gb
vgname test
content images,rootdir
shared 1

lvm: hpe3par6tbFC
vgname hpe3par6tbFC
content rootdir,images
shared 1

nfs: syn_datacentar_b5
export /volume3/Backupovi_proxmox
path /mnt/pve/syn_datacentar_b5
server 192.168.57.203
content iso,images,rootdir,snippets,vztmpl,backup
prune-backups keep-last=4

nfs: synology_disks
export /volume2/Proxmox_disks
path /mnt/pve/synology_disks
server 192.168.57.203
content images
prune-backups keep-all=1

lvm: nesto
vgname 4tbhdd
content images,rootdir
shared 1

iscsi: gb1
portal 172.30.50.20
target iqn.2000-05.com.3pardata:20210002ac00635f
content none
 
sorry for late reply. the 10gb switches are dead. i have replace them and now i need to restore this two virtual disks. disks are on storage but i cannot see them on proxmox cluster.

what can i do now?

this is from storage.cfg . The effected disk are not in the file
I apologize, I am unable to follow your description of the issue. If you feel like you cant add sufficient CLI output to demonstrate your issue, perhaps you can use screenshots.
Keep in mind that many technologies use the same terminology for different things, ie "virtual disks".



Blockbridge : Ultra low latency all-NVME shared storage for Proxmox - https://www.blockbridge.com/proxmox
 
sorry here are output :

root@proxsvr11:~# iscsiadm -m node
172.30.50.20:3260,21 iqn.2000-05.com.3pardata:20210002ac00635f
172.30.50.21:3260,22 iqn.2000-05.com.3pardata:20220002ac00635f
172.30.50.22:3260,121 iqn.2000-05.com.3pardata:21210002ac00635f
172.30.50.23:3260,122 iqn.2000-05.com.3pardata:21220002ac00635f


root@proxsvr11:~# iscsiadm -m session
tcp: [1] 172.30.50.23:3260,122 iqn.2000-05.com.3pardata:21220002ac00635f (non-flash)
tcp: [2] 172.30.50.22:3260,121 iqn.2000-05.com.3pardata:21210002ac00635f (non-flash)
tcp: [3] 172.30.50.20:3260,21 iqn.2000-05.com.3pardata:20210002ac00635f (non-flash)
tcp: [4] 172.30.50.21:3260,22 iqn.2000-05.com.3pardata:20220002ac00635f (non-flash)


root@proxsvr11:~# lsscsi
[3:0:0:0] cd/dvd HPE DVDROM DUD0N UMD1 /dev/sr0
[6:0:0:0] enclosu HPE Smart Adapter 5.32 -
[6:1:0:0] disk HPE LOGICAL VOLUME 5.32 /dev/sda
[6:2:0:0] storage HPE P408i-a SR Gen10 5.32 -
[7:0:0:0] disk Generic- SD/MMC CRW 1.00 /dev/sdb
[8:0:0:0] disk 3PARdata VV 3312 /dev/sdc
[8:0:0:1] disk 3PARdata VV 3312 /dev/sdd
[8:0:0:2] disk 3PARdata VV 3312 /dev/sde
[8:0:0:3] disk 3PARdata VV 3312 /dev/sdf
[8:0:0:4] disk 3PARdata VV 3312 /dev/sdg
[8:0:0:5] disk 3PARdata VV 3312 /dev/sdh
[8:0:0:6] disk 3PARdata VV 3312 /dev/sdi
[8:0:0:7] disk 3PARdata VV 3312 /dev/sdj
[8:0:0:8] disk 3PARdata VV 3312 /dev/sdk
[8:0:0:9] disk 3PARdata VV 3312 /dev/sdl
[8:0:0:256] disk 3PARdata VV 3312 /dev/sdm
[9:0:0:0] disk 3PARdata VV 3312 /dev/sdn
[9:0:0:1] disk 3PARdata VV 3312 /dev/sdo
[9:0:0:2] disk 3PARdata VV 3312 /dev/sdp
[9:0:0:3] disk 3PARdata VV 3312 /dev/sdq
[9:0:0:4] disk 3PARdata VV 3312 /dev/sdr
[9:0:0:5] disk 3PARdata VV 3312 /dev/sds
[9:0:0:6] disk 3PARdata VV 3312 /dev/sdu
[9:0:0:7] disk 3PARdata VV 3312 /dev/sdw
[9:0:0:8] disk 3PARdata VV 3312 /dev/sdy
[9:0:0:9] disk 3PARdata VV 3312 /dev/sdab
[9:0:0:256] disk 3PARdata VV 3312 /dev/sdac
[10:0:0:0] disk 3PARdata VV 3312 /dev/sdv
[10:0:0:1] disk 3PARdata VV 3312 /dev/sdaa
[10:0:0:2] disk 3PARdata VV 3312 /dev/sdae
[10:0:0:3] disk 3PARdata VV 3312 /dev/sdag
[10:0:0:4] disk 3PARdata VV 3312 /dev/sdan
[10:0:0:5] disk 3PARdata VV 3312 /dev/sdao
[10:0:0:6] disk 3PARdata VV 3312 /dev/sdap
[10:0:0:7] disk 3PARdata VV 3312 /dev/sdaq
[10:0:0:8] disk 3PARdata VV 3312 /dev/sdar
[10:0:0:9] disk 3PARdata VV 3312 /dev/sdas
[10:0:0:256] disk 3PARdata VV 3312 /dev/sdat
[11:0:0:0] disk 3PARdata VV 3312 /dev/sdt
[11:0:0:1] disk 3PARdata VV 3312 /dev/sdx
[11:0:0:2] disk 3PARdata VV 3312 /dev/sdz
[11:0:0:3] disk 3PARdata VV 3312 /dev/sdad
[11:0:0:4] disk 3PARdata VV 3312 /dev/sdaf
[11:0:0:5] disk 3PARdata VV 3312 /dev/sdah
[11:0:0:6] disk 3PARdata VV 3312 /dev/sdai
[11:0:0:7] disk 3PARdata VV 3312 /dev/sdaj
[11:0:0:8] disk 3PARdata VV 3312 /dev/sdak
[11:0:0:9] disk 3PARdata VV 3312 /dev/sdal
[11:0:0:256] disk 3PARdata VV 3312 /dev/sdam


thanks